Role Summary
Ubique is looking for a Data Engineer on a contract basis to design, build, and optimize enterprise-scale ETL/ELT pipelines across a modern hybrid work environment in India. In this role, you will implement medallion lakehouse architectures, build production-grade workflows in Databricks, and apply robust data quality frameworks using PySpark, advanced SQL, and Python. You will collaborate closely with data architects, consultants, and enterprise client stakeholders to deliver performant and cost-optimized data solutions.
Key Responsibilities
- Pipeline Engineering: Design, build, and maintain high-performance batch and streaming ETL/ELT pipelines on the Databricks Lakehouse platform.
- Lakehouse Implementation: Architect and maintain medallion lakehouse layers (Bronze, Silver, Gold) utilizing Delta Lake, Delta tables, and Unity Catalog for centralized governance.
- Workflow Automation: Develop and schedule data processing tasks using Databricks Jobs, Databricks Workflows, and Delta Live Tables (DLT).
- Performance & Cost Optimization: Profile and tune Spark workloads through cluster right-sizing, compute governance, query optimization, and resource scheduling.
- Data Quality & Observability: Implement validation frameworks, automated data quality checks, and active monitoring/alerting routines to ensure pipeline reliability.
Key Qualifications
- Education: Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related quantitative field.
- Experience: 2 to 4 years of hands-on data engineering experience building enterprise ETL/ELT pipelines.
- Core Technical Skills: Databricks, Apache Spark (PySpark/Spark SQL), Python, Advanced SQL, Delta Lake, Unity Catalog, and Data Warehousing concepts.
- Key Methodologies: Medallion Architecture (Bronze/Silver/Gold), Dimensional Modeling, Performance Tuning, and Agile CI/CD for data pipelines.
- Preferred Capabilities: Hands-on experience with Delta Live Tables (DLT), Databricks SQL, compute access policies, and distributed file formats (Parquet, Delta, JSON).
About Ubique
Ubique is a modern technology and consulting organization dedicated to helping enterprises solve complex business challenges through measurable, technology-driven outcomes. With a strong culture of continuous learning and collaboration, Ubique delivers high-impact digital and data engineering programs for leading global organizations.