Role Overview
EPAM Systems is looking for a Data Quality Engineer specializing in ETL/ELT testing, Data Warehouse (DWH), and Data Lake quality across modern cloud platforms. In this engineering role, you will design and implement Python- and SQL-driven automated testing frameworks, integrate data validation suites into continuous integration and delivery (CI/CD) pipelines, and collaborate with data engineers, analysts, and cross-functional teams to verify the precision, completeness, and reliability of enterprise data workflows.
Core Responsibilities
- Pipeline & ETL Automation: Author, maintain, and execute automated test scripts to validate end-to-end batch and streaming ETL/ELT pipelines.
- Data Validation & Reconciliation: Perform comprehensive data reconciliation and schema checks across large-scale data warehouses and data lakes using advanced SQL queries.
- Framework Development: Build reusable, scalable test automation frameworks leveraging Python to streamline repetitive quality verification tasks.
- CI/CD Integration: Connect automated test suites into CI/CD pipelines using Jenkins, Git, and Azure DevOps to enable automated testing on every deployment.
- Multi-Cloud Verification: Validate complex data transformation logic and data completeness across cloud services including Azure (ADF, Databricks), AWS (Glue, Lambda, Redshift), and GCP (BigQuery).
- Agile Collaboration: Participate actively in sprint ceremonies, sprint planning, user story refinement, and defect triage alongside global delivery teams.
Qualifications & Requirements
- Professional Experience: 4 to 6 years of hands-on experience in ETL/ELT automation, database testing, and quality assurance within Data Warehouse or Data Lake architectures.
- SQL Expertise: Strong SQL proficiency for complex querying, data reconciliation, logic validation, and data profiling across distributed datasets.
- Scripting & Automation: Practical experience developing automation scripts and custom testing frameworks using Python.
- Cloud Data Ecosystems: Working exposure to cloud data services across Azure (ADF, Databricks), AWS (Glue, Lambda, Redshift), or GCP (BigQuery).
- DevOps & Delivery Tools: Hands-on experience integrating test suites with CI/CD tools such as Jenkins, Git, and Azure DevOps within Agile/Scrum teams.
- Preferred Qualifications: Prior experience with data observability tools (Great Expectations, Deequ), understanding of data governance principles, or cloud platform certifications.
About EPAM Systems
Founded in 1993, EPAM Systems is a leading global provider of digital platform engineering, data software solutions, and consulting services. Operating in more than 50 countries, EPAM empowers leading global enterprises to architect, build, and optimize scalable digital products and data-driven platforms.