Role Summary
NTT DATA Services is looking for a senior-level Data Engineer - Microsoft Fabric Pipelines & Orchestration to join the core offshore delivery team on a remote contract engagement for The Coca-Cola Company (Program Symphony). In this role, you will lead the migration of Spark job definitions from Azure Synapse to Microsoft Fabric, construct resilient data orchestration pipelines, and implement code-first ETL logic using Scala and SQL on Apache Spark. Immediate mobilization is required.
Key Responsibilities
- Synapse to Fabric Migration: Migrate Spark Job Definitions from Azure Synapse to Microsoft Fabric, establishing robust workflow scheduling and data orchestration.
- Code-First Pipeline Engineering: Design, develop, refactor, and maintain high-throughput data processing pipelines using Scala, Java, and Spark SQL within a metadata-driven architectural framework.
- Operational Support & Triage: Monitor post-go-live pipelines, perform root-cause analysis on job failures, and resolve complex data quality issues and throughput bottlenecks.
- Automation & Frameworks: Develop reusable data ingestion patterns, implement automated pipeline monitoring, and manage source code and release versions using GitHub.
- Data Discovery & Optimization: Participate in data discovery workshops with client architects to map requirements directly from source data layers and continuously tune query execution plans.
Key Qualifications
- Education: Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related discipline.
- Experience: 8 to 10 years of hands-on data engineering experience building large-scale data warehouses and distributed pipelines.
- Core Stack: Advanced proficiency in Apache Spark internals, Scala (or Java), Advanced SQL, Azure Synapse Analytics, Microsoft Fabric data pipelines, and GitHub.
- Nice to Have: Hands-on background working with metadata-driven architectures and analytics in the consumer goods (CPG/FMCG) or marketing domains.
- Requirements: Must be a hands-on technical builder available for immediate mobilization.
About NTT DATA
NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100 with comprehensive capabilities across cloud, data engineering, artificial intelligence, and enterprise transformation.