Role Overview
NatWest Digital X is seeking an experienced, visionary Data Engineer at the Vice President (VP) level in Bangalore, Karnataka, India. In this senior technical leadership position, you will lead the architecture, deployment, and optimization of enterprise-scale data infrastructure supporting modern lakehouse platforms. Leveraging extensive expertise in AWS, Snowflake, Terraform, and Apache Airflow, you will drive automated data pipelines, implement cloud financial management (FinOps) best practices, enforce rigorous data security standards, and lead cross-functional engineering teams delivering customer-centric digital banking experiences.
Core Responsibilities
- Cloud Infrastructure & IaC Leadership: Architect, provision, and maintain secure, scalable data lakehouse environments by owning Infrastructure as Code (Terraform) to automate resource deployment across AWS and Snowflake.
- Data Pipeline Engineering & Automation: Lead the end-to-end design, implementation, and optimization of batch and streaming data pipelines using AWS services (EMR, S3, Glue, Lambda), eliminating manual intervention.
- FinOps & Cost Governance: Champion FinOps methodologies to monitor, profile, and continuously optimize data platform costs and compute consumption against commercial targets.
- Workflow Orchestration & CI/CD: Oversee Apache Airflow DAG architecture and performance, and partner with DevOps teams to integrate robust CI/CD pipelines for automated data platform releases.
- Security, Compliance & Governance: Establish and enforce stringent cloud security controls, encryption, and governance standards across all banking data pipelines and lakehouse stores.
- Incident Management & Mentorship: Lead high-priority incident troubleshooting and root cause resolutions while mentoring engineering squads in adopting emerging modern data engineering practices.
Qualifications & Requirements
- Professional Experience: Extensive proven experience in senior or lead data engineering capacities architecting large-scale distributed data systems.
- Cloud & Data Warehouse Platforms: Deep, production-tested expertise across the AWS data ecosystem (EMR, S3, Glue, Lambda) and Snowflake data warehouse platforms.
- Infrastructure as Code: Strong hands-on proficiency using Terraform to manage complex cloud data topologies and multi-environment infrastructure.
- Cost Optimization: Practical knowledge of FinOps practices and cloud cost optimization strategies for large-scale data lakehouses.
- Orchestration & Scripting: Demonstrated proficiency managing workflow scheduling via Apache Airflow, supported by advanced scripting capabilities in Python or Bash.
- Streaming & Delivery: Familiarity with streaming ingestion architectures and modern CI/CD deployment pipelines.
About NatWest Group
NatWest Group is a relationship bank serving millions of individuals, families, and businesses across the UK and globally. Within NatWest Digital X, engineering and product teams work collaboratively under the principles of engineer, protect, and operate to create effortless, secure, and pioneering digital experiences.