Test Data Support

Date: 29 Sept 2026

Company: QualityAI

Country/Region: IN

Role SummaryWe are seeking a Lakehouse Data Product Test Engineer with strong experience in data/ETL testing, big data validation, SQL, cloud platforms, API testing, and test automation. The role will focus on validating data products, ensuring data accuracy and completeness, and performing end-to-end testing across Lakehouse data pipelines and downstream applications.Key ResponsibilitiesDesign and execute data, ETL, integration, regression, and end-to-end testing for Lakehouse data products.Validate data ingestion, transformation, processing, and consumption across large-scale data environments.Perform source-to-target validation, data reconciliation, completeness, accuracy, and data quality testing.Write complex SQL queries to validate transformations, business rules, aggregations, and data integrity.Test data pipelines and workflows running on big data frameworks and cloud platforms.Develop automated data validation and testing solutions using Python/PySpark.Perform API testing to validate data services and integrations.Validate data products across multiple layers of the Lakehouse and downstream systems.Execute regression testing for new data, code, schema, and pipeline changes.Troubleshoot data discrepancies and pipeline failures and perform root-cause analysis.Build and maintain reusable test automation frameworks and regression suites.Collaborate with Data Engineering, Product, Platform, and Business teams to ensure data products meet functional and data quality requirements.Support production releases and perform post-deployment data validation.Required SkillsStrong Data/ETL Testing experienceStrong SQL skillsData validation and source-to-target reconciliationExperience with Big Data frameworksPython and/or PySparkCloud data platforms, preferably AWSExperience with AWS EMR or similar big data servicesAPI testing and integration testingTest automation and framework developmentFunctional, regression, integration, and end-to-end testingStrong troubleshooting and root-cause analysis skillsPreferred SkillsHealthcare data/domain knowledgeExperience with healthcare data standards such as HL7, FHIR, or claims/clinical dataExperience with Databricks, Spark, Delta Lake, or similar Lakehouse technologiesAWS services such as S3, EMR, Glue, Lambda, Athena, or RedshiftExperience with large-scale healthcare datasetsKnowledge of data quality and governance practicesExperience integrating automated tests into CI/CD pipelinesExperience5+ years of experience in data/ETL testing or data quality engineering, with strong hands-on experience in SQL, big data validation, Python/PySpark, cloud platforms, and test automation. Healthcare data experience is highly preferred.Top 3 Must-Have SkillsData/ETL Testing & ValidationSQL & Python/PySparkBig Data / Lakehouse & Cloud (AWS/EMR) Testing