EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team.
The ideal candidate will be deeply involved in handling big data migrations, orchestrating DevOps pipelines, and driving technical solutions while closely collaborating with stakeholders across various teams. As a lead, you will also be responsible for overseeing a team of data engineers, promoting best practices in data management and ensuring our data architecture supports our business goals.
Responsibilities
- Analyze datasets to identify discrepancies and areas for improvement
- Execute data migration from CF1 to CF2 using Azure
- Establish and maintain a GitHub repository for efficient code management
- Implement Azure resources integrated with ADP
- Develop and manage CI/CD pipelines leveraging Github actions and Terraform
- Deploy code to new environments ensuring compliance and performance
- Monitor and run the code to deliver optimal results
- Conduct technical validation of the output
- Communicate regularly with stakeholders, providing updates on project status and outcomes
Requirements
- Minimum of 5 years' experience in data engineering or similar roles
- Proficiency in Python and PySpark
- Expertise in MLOps methodologies
- Showcase of projects managed on Github
- Skills in Databricks and Azure cloud services
- Background in setting up CI/CD pipelines using GitHub Actions and Terraform
- Capacity to lead and mentor a team of engineers
We offer
- We believe that the greatest strength of the company is its people. EPAM is fully committed to help its employees to reach their full potential and achieve their professional goals through continues learning. With this in mind, we would like to introduce to you few of the many opportunities and services which we believe will help you expand your current knowledge:
- Full access to cutting-edge tools and technologies
- Competitive compensation depending on experience and skills
- All-around Social package: professional & soft skills training, medical & family care programs, sports
- Relocation opportunities
- Free English classes
- Unlimited access to LinkedIn learning solutions
- Continuous experience exchange with experts and professionals worldwide
- Friendly team and comfortable working environment
- Engineering, corporate, and social events within and outside the Company
- Flexible working schedule
- Opportunities for self-realization
