Job Summary: Join our team as a Data Engineer and help bridge the gap between data analytics and software engineering, bringing cutting-edge solutions to life in the complex world of data. This role focuses heavily on developing, maintaining, and optimizing our data infrastructure, particularly in Databricks and cloud environments, while supporting existing applications.
Key Responsibilities:
- Design, implement, manage, and monitor end-to-end IT solutions for Advanced Analytics and Data Replication (CDC) platforms.
- Ensure the seamless operation of services within SLA performance parameters, with a focus on Databricks and cloud-based solutions.
- Innovate and optimize IT services and systems, emphasizing cloud solutions such as Databricks and AWS.
- Implement Data Products in a Data Mesh architecture.
- Support and maintain existing applications, ensuring they are running efficiently and effectively.
- Work closely with the Data team to transition data pipelines into optimized production-ready states for various workflows.
- Administer and manage Data environments, tech stack, and traditional databases.
- Implement automation and CI/CD practices using tools such as Git, Jenkins/GitHub Actions, and Ansible/Terraform.
- Participate in diagnosing and solving complex problems, documenting configurations to maintain best practices across IT infrastructure.
Required Qualifications:
- Bachelor’s or Master’s degree in computer science, Engineering, or a related technical field.
- Experience with Cloud architecture and Big Data solutions, particularly with Databricks and AWS.
- Minimum 3 years of experience in Data Engineering , Data DevOps, or a relevant field, preferably in the banking or telecommunications industry.
- Advanced knowledge in specific Data Engineering technologies: Spark, Hadoop, Hive, Python, R, Databricks, Kafka, Debezium, Golden Gate (2 or more preferred).
- Strong understanding of networking and microservices architectures like Kubernetes/EKS/OpenShift.
- Automation & CI/CD tools (Git, Jenkins/Github Actions, Ansible/Terraform, Shell/Python).
- Excellent problem-solving skills with the ability to collaborate effectively with various teams.
- Professional certifications would be a plus, especially if you have practical experience with the technologies.
Preferred Qualifications:
- Experience in the banking or telecommunications industry.
- Proficient in Linux, with advanced system management and shell scripting skills.
- Knowledge of Service Management and software development methodologies.
- Professional certifications in relevant technologies or practices.
Join us and be part of a dynamic team that drives innovation and excellence in the field of Data DevOps Engineering, with a special focus on Databricks and cloud solutions while supporting existing applications.
