EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
We are seeking an experienced Senior Azure Databricks Engineer to join our team to facilitate the onboarding of data to our Data Lake and TOR. This role will involve collaborating closely with both data providers and our team to ensure the efficient and accurate integration of diverse data sources into Databricks and TOR environments. The ideal candidate will bring a strong background in Databricks, PySpark, SQL, and a proven ability to drive innovation in line with our target Way of Working (WOW).
Responsibilities
- Assist teams within the Company Technology Platform (CTP) in onboarding their data to our centralized Data Lake and TOR
- Work effectively with Data Stewards who create data and ensure smooth data transfer and validation
- Optimize current workflows to enhance team performance and facilitate strategic innovations, ensuring alignment with our new WOW
- Play a pivotal role in enhancing data quality and resolving recurring issues to reduce routine fixes, enabling the team to focus on transformative improvements
- Support other teams by enabling and streamlining their functional capabilities through innovation and optimization
- Decrease onboarding efforts through strategic interactions with AI assistance and innovation-focused initiatives
Requirements
- Extensive experience with Azure Databricks, PySpark, and SQL (3+ years)
- Demonstrated ability to innovate processes and workflows for improved efficiency
- Strong understanding of data onboarding processes and challenges, with a keen eye for improving data quality
- Capability to work autonomously as well as collaboratively in a fast-paced environment
- Excellent communication and problem-solving skills
We offer
- We believe that the greatest strength of the company is its people. EPAM is fully committed to help its employees to reach their full potential and achieve their professional goals through continues learning. With this in mind, we would like to introduce to you few of the many opportunities and services which we believe will help you expand your current knowledge:
- Full access to cutting-edge tools and technologies
- Competitive compensation depending on experience and skills
- All-around Social package: professional & soft skills training, medical & family care programs, sports
- Relocation opportunities
- Free English classes
- Unlimited access to LinkedIn learning solutions
- Continuous experience exchange with experts and professionals worldwide
- Friendly team and comfortable working environment
- Engineering, corporate, and social events within and outside the Company
- Flexible working schedule
- Opportunities for self-realization
