Data DevOps Engineer Senior Platforma de Date

Job Summary:

Raiffeisen Bank is seeking a Data Engineer with a DevOps orientation to play a key role in developing, maintaining, and innovating our data infrastructure to support on prem, AWS and Databricks Cloud and critical AI-driven solutions. The successful candidate will collaborate with multiple teams, including ML Engineers, MLOps, DevOps, to build efficient data pipelines, build Data Products in a Data Mesh Architecture, manage Big Data ecosystems and ensure the seamless operation of Data applications. This role bridges the realms of data analytics and software engineering within the complex landscape of Datawarehouse, Big Data and data replication platforms.

Key Responsibilities:

1. Innovate and optimize IT services and systems, focusing on cloud solutions such as Databricks.
2. Implement Data Products in a Data Mesh architecture.
3. Act as a coach for the team, provide specific guidance in the processing of cases with increased complexity when requested by juniors colleagues or specialists.
4. Provide training with colleagues. May delegate certain tasks to specialists.
5. Manage end-to-end IT solutions for Advanced Analytics and Data Replication (CDC) platforms, ensuring services operate within SLA performance parameters.
6. Design, build, and maintain efficient, scalable data pipelines using Apache Spark and Apache Airflow in a Hadoop Big Data environment.
7. Work closely with the AI team to transition data pipelines into optimized production-ready states for AI and ML workflows.
8. Administer and manage Big Data environments, tech stack and traditional databases like PostgreSQL.
9. Implement automation and continuous integration/continuous deployment (CI/CD) practices using tools such as Git, Jenkins/GitHub Actions and Ansible/Terraform.
10. Participate in diagnosing and solving complex problems, and document configurations to maintain best practices across IT infrastructure.

Required Qualifications:

1. Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
2. Minimum 3 years experience in DevOps, Data Engineering, or a relevant field, with a preference for banking or telecommunications industry experience.
3. Experience with Cloud architecture and Big Data solutions, particularly with Databricks and AWS.
4. Proficient in Linux, with advanced system management and shell scripting skills.
5. Strong understanding of networking and microservices architectures like Kubernetes/EKS/OpenShift.
6. Excellent problem-solving skills with the ability to collaborate effectively with various teams.