Role Overview
EPAM Systems is seeking a talented, forward-thinking Senior Data Software Engineer to join our global Data Software Engineering practice across our delivery hubs in Hyderabad, Bangalore, or Pune, India (Hybrid). In this senior role, you will be instrumental in architecting, building, and deploying large-scale data engineering solutions that solve complex, multi-geography business challenges. Leveraging advanced proficiency in Apache Spark, Python, Hadoop ecosystems, and dual-cloud environments (AWS and Azure), you will optimize data pipelines for performance, security, and enterprise scalability within high-performing engineering teams.
Core Responsibilities
- Architect End-to-End Data Solutions: Design, build, and deploy robust, scalable data ingestion and processing frameworks tailored to intricate enterprise business requirements.
- Scalable Cloud Implementations: Leverage deep expertise in Apache Spark and Python to build high-throughput, low-latency data pipelines deployed across AWS and Azure cloud platforms.
- Big Data Ecosystem Management: Develop, query, and optimize large-scale distributed datasets utilizing core Big Data technologies including Hadoop and Hive.
- Performance & Security Engineering: Continuously monitor and tune system performance, memory management, and compute utilization while enforcing stringent data governance and security controls.
- Collaborative Problem Solving: Partner with cross-functional solution architects, business analysts, and multi-national engineering pods to analyze project requirements and drive delivery excellence.
- Innovation & Technology Adoption: Keep abreast of industry breakthroughs and emerging data engineering paradigms to integrate best practices into EPAM’s development lifecycles.
Qualifications & Requirements
- Professional Experience: 5 to 8 years of dedicated, hands-on software development experience within the data engineering and big data domains.
- Apache Spark Expertise: Advanced, proven proficiency in Apache Spark for distributed data processing, dataset transformations, and streaming architectures.
- Programming Proficiency: Strong programming capabilities in Python for data manipulation, scripting, and pipeline automation.
- Big Data Foundations: Practical background and solid operational understanding of Hadoop architecture and Apache Hive querying.
- Cloud Platforms: Proven, hands-on experience designing and operating data services on both Amazon Web Services (AWS) and Microsoft Azure.
- Communication & Leadership: Excellent analytical problem-solving abilities and effective communication skills to collaborate with global stakeholders.
About EPAM Systems
EPAM Systems Inc. is a leading global provider of digital platform engineering and software development services. Since 1993, EPAM has leveraged its advanced software engineering heritage to become the foremost global digital transformation services provider, leading the industry in digital and physical product development and digital platform engineering services across top global enterprises.