Senior Data Engineer - ODS

Description

The company is Open Digital Services, the software development arm of the company Group, based in Spain. It builds banking products for the company Group affiliates, and its flagship partner is Openbank, where the most advanced concepts are developed first.

The team designs and supports an omnichannel digital platform that aims to give customers the best experience using current technology.

As a Senior Data Engineer in the Data Management department, you will design, build and tune scalable data solutions that feed analytics, machine learning, reporting and critical business decisions.

You will work with large, complex data estates, building robust pipelines and distributed processing jobs on Spark. The role suits someone with solid data engineering foundations, hands-on Spark experience, and the ability to run reliable production data systems in the cloud.

Responsibilities

• Design, build and optimise large-scale data pipelines with Apache Spark and Scala.
• Build and maintain batch and near-real-time processing for high-volume data.
• Produce reliable, reusable, well-structured datasets for analytics, data science, machine learning and business teams.
• Process, transform, store and serve data efficiently on AWS.
• Put data quality checks, validation, monitoring and documentation in place across pipelines.
• Work with data engineering, data science, machine learning, architecture and business colleagues to understand needs and deliver workable data solutions.
• Help raise engineering standards for code quality, testing, version control, CI/CD and automation.

Requirements

• 5+ years in data engineering, big data engineering or a similar technical role. Required
• Track record of building production-grade pipelines in large or complex data environments. Required
• 5+ years of hands-on Spark work with Scala on real projects. Required
• Experience with cloud data platforms. Required
• Experience in banking, fintech or regulated environments. Preferred
• Fluent Spanish. Preferred
• Professional English. Required
• Strong Spark-based distributed processing skills. Required
• Strong Scala coding for data engineering. Required
• Solid SQL and experience with relational and analytical databases. Required
• Experience designing and tuning ETL and ELT processes. Required
• Experience with AWS or comparable cloud ecosystems, ideally S3, Glue, Athena, EMR, Redshift, IAM or Lake Formation. Required
• Experience with Git and collaborative development. Required
• Understanding of data quality, validation, monitoring and performance tuning. Required
• Experience with CI/CD or DevOps tools such as Jenkins, Sonar, Nexus, Jira, Splunk or similar. Preferred
• Experience with Apache Flink, Spark Streaming or near-real-time applications. Preferred
• Experience with Apache Iceberg, Delta Lake or modern lakehouse formats. Preferred
• Experience with Airflow or other workflow orchestration tools. Preferred
• Strong problem-solving skills and the ability to work independently. Required
• Sense of ownership and a focus on building reliable, maintainable solutions. Required
• Clear communication with both technical and non-technical stakeholders. Required
• Ability to collaborate across data engineering, data science, ML and business teams. Required
• Curiosity and willingness to pick up new tools, frameworks and cloud services. Required

Conditions

Location: Spain.

Equal opportunity employer: candidates are assessed on experience and skills regardless of gender identity, sexual orientation, ethnicity, religion, age, political views, union membership or disability.