We are seeking a Lead Data Software Engineer to partner closely with our client and shape resilient, scalable data solutions end to end. You will lead the design and upkeep of ETL/ELT pipelines plus batch and streaming platforms, while guiding delivery practices and technical quality across the lifecycle—apply now.

Responsibilities

• Architect and maintain the codebase for ETL and ELT pipelines, large batch/micro batch processing, and streaming systems
• Build the infrastructure needed for efficient data extraction, transformation, and loading from many sources using ADF, Spark, Kafka, or similar technologies
• Identify, design, and implement internal process improvements, including automation of manual work, optimization of data delivery, and infrastructure redesign for scalability
• Design and implement innovative data services solutions using Spring Boot, ReactJS, NoSQL, or other UI and API related technologies
• Ensure governance of processes across delivery management and production in line with the selected delivery model
• Own delivery-related topics for top management and stakeholders, including escalations, upsells, and ramp-downs
• Provide technical leadership for delivery by planning sound, future-proof architecture and ensuring implementation meets technical quality standards
• Write stories and the associated acceptance criteria within an agile/scrum workflow
• Coordinate across multiple disciplines and stakeholders
• Ensure projects follow client processes and methodologies with a strong focus on agile approaches
• Establish a continuous delivery risk management strategy to enable proactive decisions and actions throughout the delivery life cycle
• Measure and improve delivery productivity, consult Data Engineers, and perform production support and deployment activities

Requirements

• 5+ years of experience in SQL, Spark, and Scala
• Deep expertise with Databricks
• Solid background in designing and delivering ETL/ELT pipelines and large batch/micro batch processing systems
• Hands-on familiarity with data services solutions using Spring Boot, ReactJS, and NoSQL or other UI and API related technologies
• Good understanding of agile/scrum workflow and different delivery models
• Proven ability to provide technical leadership and act as a consultant to Data Engineers
• English proficiency at B2 (Upper-Intermediate) level or higher for direct communication with the client

Nice to have

• Experience with Spark Streaming and Kafka
• Familiarity with Azure

We offer

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn