11+ Data-driven testing Jobs in Pune | Data-driven testing Job openings in Pune

MeltPlan is building the “planning engine” for the $14 Tn construction industry, an AI system designed specifically to optimize decisions before construction begins. While design software optimizes use and aesthetics and construction software optimizes execution and control, MeltPlan is building the missing layer - software that optimizes decisions and tradeoffs upstream, before scope is locked, procurement begins, and change orders become inevitable. MeltPlan’s long-term goal is to help teams make construction “boring” by making planning more intense: surfacing constraints and tradeoffs early, aligning stakeholders before plans are frozen, and reducing the need for late-stage redlines, rework, and change orders.

MeltPlan is founded by operators who have built at scale. Kanav previously co-founded Innovaccer, a $3Bn healthtech company focused on making US healthcare more affordable and accessible. He’s now applying that systems-level thinking to construction.He’s joined by Tanmaya Kala, former Project Executive at DPR Construction, who led large commercial, healthcare, and life sciences projects. We combine deep tech scale with real construction execution.

What This Role Really is :

We are seeking a detail-oriented and technically strong AI QA Engineer to ensure the quality, reliability, and performance of Large Language Model (LLM)-based systems. In this role, you will be responsible for designing and executing test strategies, validating model outputs, and building evaluation frameworks to enhance the accuracy, safety, and overall performance of AI-driven applications.We would particularly value candidates who have hands-on experience in developing evaluation frameworks (evals) for AI systems, along with strong expertise in comprehensive system testing and quality assurance practices.You are responsible for making MeltPlan work in the real world.

What You'll Do:

• Design, develop, and execute evaluation frameworks (Evals) for Large Language Models (LLMs) and AI systems.
• Perform end-to-end system testing, regression testing, and performance testing for AI-driven applications.
• Validate model outputs for accuracy, consistency, safety, hallucination detection, and edge cases.
• Build automated test pipelines and quality benchmarks for AI systems.
• Collaborate closely with AI/ML engineers, product teams, and platform engineers to improve system reliability.
• Analyze failures, identify root causes, and provide actionable feedback to improve model behavior.
• Develop datasets, prompts, and testing scenarios to measure model performance across multiple use cases.
• Monitor production performance and continuously improve evaluation metrics and testing standards.
• Ensure compliance with responsible AI and quality assurance best practices.

What We're looking for: 

• Bachelor’s degree in Computer Science, Engineering, or related field
• 5–7 years of experience in QA/testing, preferably in AI/ML or data-driven systems
• Strong experience in AI/LLM evaluation frameworks and system testing.
• Hands-on experience with automated testing methodologies and QA processes.
• Familiarity with prompt engineering, AI benchmarking, and model validation techniques.
• Experience working with Python and testing frameworks.
• Understanding of LLM behaviors, hallucinations, prompt injection risks, and AI safety concepts.
• Exposure to tools/frameworks such as OpenAI Evals, LangSmith, DeepEval, Promptfoo, or similar platforms is preferred.
• Strong analytical and debugging skills with attention to detail.
• Excellent collaboration and communication skills.
• Familiarity with Large Language Models and Generative AI concepts
• Experience with API testing tools (e.g., Postman) and automation frameworks
• Understanding of NLP concepts such as tokenization, embeddings, and text generation
• Strong analytical and problem-solving skills
• Experience testing AI/ML models or data pipelines
• Experience with prompt engineering and prompt testing
• Familiarity with cloud platforms (AWS, GCP, or Azure)
• Exposure to AI safety, bias detection, and model governance

Bonus if you have:

• Have worked in construction or on project sites
• Have startup experience
• Experience working with Generative AI or conversational AI products.
• Knowledge of CI/CD pipelines and automation workflows.
• Prior experience in performance testing and monitoring distributed systems.
• Understanding of AI product lifecycle and production deployment environments.

We’re not looking for someone who waits for clean requirements.We’re looking for someone who thrives in the mess and turns it into systems.

Why meltplan

• Massive industry, real-world impact
• High ownership from day one
• Small team, zero bureaucracy
• Competitive comp + meaningful equity

• 8+ years of Data Engineering experience
• Strong SQL and Redshift experience
• CI/CD and orchestration experience using Bitbucket, Jenkins and Control-M
• Reporting experience preferably Tableau

• Location – Pune, Hyderabad, Bengaluru

• Minimum 1 years of relevant experience, in PySpark (mandatory)
• Hands on experience in development, test, deploy, maintain and improving data integration pipeline in AWS cloud environment is added plus 
• Ability to play lead role and independently manage 3-5 member of Pyspark development team 
• EMR ,Python and PYspark mandate.
• Knowledge and awareness working with AWS Cloud technologies like Apache Spark, , Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS

We are looking for a Node.js Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, definition, and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application. Therefore, a basic understanding of front-end technologies is necessary as well.

• 2+ years of experience with Node.js/Express.js or similar framework
• 1+ years of experience with MongoDB
• 1+ years of experience creating REST APIs and backend systems
• Experience with Docker is a plus
• Integration of user-facing elements developed by front-end developers with server-side logic
• Writing reusable, testable, and efficient code
• Design and implementation of low-latency, high-availability, and performant applications
• Implementation of security and data protection
• Server Setup/AWS/GCP experience is a plus
• Creating APIs and backend systems
• Scraping sites and creating backend dashboards for data management
• Backend infrastructure management and deployment

Responsibilities:

• Developing and maintaining all server-side network components.
• Ensuring optimal performance of the central database and responsiveness to front-end requests.
• Collaborating with front-end developers on the integration of elements.
• Designing customer-facing UI and back-end services for various business processes.
• Developing high-performance applications by writing testable, reusable, and efficient code.
• Implementing effective security protocols, data protection measures, and storage solutions.
• Running diagnostic tests, repairing defects, and providing technical support.
• Documenting Node.js processes, including database schemas, as well as preparing reports.
• Recommending and implementing improvements to processes and technologies.
• Keeping informed of advancements in the field of Node.js development.

Requirements:

• Bachelor's degree in computer science, information science, or similar.
• At least two years of experience as a Node.js developer.
• Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.
• Superb interpersonal, communication, and collaboration skills.
• Exceptional analytical and problem-solving aptitude.
• Great organizational and time management skills.
• Availability to resolve urgent web application issues outside of business hours.

Responsibilities

• Candidate must have demonstrated experience of migrating solutions to the Azure cloud platform
• Assess, analyze  current infrastructure footprint (compute, storage, network) and complete requirement gathering (HW, SW) to move individual applications to Cloud
• Complete high level and low level design for cloud infrastructure, databases and other required components.
• Build and deploy infrastructure in cloud
• Migrate OS, Database and application from on-premise to Cloud
• Apply technical knowledge and customer insights to create application modernization roadmap and architect solutions to meet business and IT needs, ensuring technical viability of new projects and successful deployments, orchestrating key resources and infusing key application development and DevOps technologies (e.g. App Service, containers, serverless, cloud native, Java/node.js, DevOps and OSS tools)
• Connect with Client  team to remove key blockers

Qualifications

• Must have at least 1 Azure certification (Administrator, Developer or Architect)
• Must have 5+ experience in Cloud and Data center migration project as solution architect
• Must have in-depth understanding of compute, storage, network components including backup, monitoring and DR environment requirements
• Experience and understanding of large-scale applications portfolio in enterprise-wide environment (including migration of on-premise workloads to the cloud) required;
• Deep domain expertise of cloud application development solutions (e.g. IaaS, Serverless, API Management), container orchestration (e.g. Kubernetes, Cloud Foundry), continuous integration technologies (e.g. Jenkins, Spinnaker, Azure for DevOps, Chef, Puppet), web application server technologies, cloud application design, software architecture and practices (design/development/deployment, Agile, SCRUM, ALM), breadth of technical experience, and technical aptitude to learn and adjust to new technologies and cloud trends required;
• Experience and understanding of large-scale application development projects (including key coding skills and practices) required;

Responsibilities:

• Candidate will implement automation solutions on Azure using open source tools and technologies (e.g. Ansible, Jenkins, Chef) in any of the following technology tiers/products:
• Unix/Linux
• Microsoft Windows Server
• Oracle Database
• Middleware (IBM WebSphere, JBoss)
• VMware
• Candidate must have demonstrated experience of migrating solutions to the Azure cloud platform
• Candidate will provide expert level of automation solution support.
• Perform as primary Systems Administrator in a large enterprise environment.
• Perform Patch management tasks to include: maintaining current knowledge of available patches, deciding what patches are appropriate for particular systems, ensuring that patches are installed properly, testing systems after installation, and documenting all associated procedures
• Test new releases of products to ensure compatibility and minimize user impact.
• Recommend and implement system enhancements that will improve the performance and reliability of the system including installing, upgrading/patching, monitoring, problem resolution, and configuration management.
• Develop, document, and automate technical processes and procedures as needed.
• Adhere to strict Information Systems security guidelines in all cases. 

Qualifications:

• Must have at least 1 Azure certification (Administrator, Developer or Architect)
• Must have experience with one or more open source tools (Ansible, Chef, Puppet, Yamal, Parker, etc.).
• Hands on experience with change automation and orchestration.
• Proficient in scripting languages (e.g. Perl, Python, Bash, Ruby, etc.)
• Hand on experience with troubleshooting and diagnoses of hardware and software problems.
• Experience installing, configuring, and maintaining computer hardware and software in a large-scale enterprise environment.