You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Inetum

DATA ENGINEER (Scala/Spark)

  • Hybrid
  • English (C1)

Salary

Not stated

Similar roles pay €60K - 105K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The role is a data engineering position at an international digital consultancy with about 27,000 people across 27 countries.

The main work is moving an existing Hadoop environment to the cloud and building the data pipelines that run on it.

Responsibilities

  • Move the current Hadoop setup to a cloud environment on Kubernetes Engine, using COS storage, Spark as a service and Airflow as a service.
  • Build data transformation and quality checks that keep data consistent and accurate, writing Scala and SQL and using Spark for transformation and enrichment.
  • Create CI/CD pipelines that automate deployments, unit tests and development workflow.
  • Write unit and validation tests that confirm the code you produce is accurate and reliable.
  • Automate data pipelines and speed up ingestion by setting up orchestrators and scheduling, mainly Airflow as a service.
  • Document specifications and operational procedures so the team keeps its knowledge.
  • Work with cross-functional teams to pin down data needs and deliver solutions.
  • Help build a habit of continuous learning and improvement across the team.

Requirements

  • Solid working knowledge of Spark with Scala.
  • Solid working knowledge of CI/CD tools such as GitLab or Jenkins.
  • Solid working knowledge of HDFS and SQL databases.
  • Solid working knowledge of Apache Airflow.
  • Solid working knowledge of S3 or COS storage and the parquet and ORC formats.
  • Strong command of SQL and NoSQL databases.
  • Strong command of Hadoop.
  • Full understanding of Oozie and shell scripting.
  • Full understanding of the software development lifecycle and Agile principles and ceremonies.
  • Ability to write effective prompts for Gen AI tools across IT work during development, such as coding, testing, data generation and documentation.
  • Some knowledge of Kubernetes containers.
  • Some knowledge of Dremio for data virtualization.
  • Optional, a plus: Elasticsearch and Kibana.
  • Optional, a plus: streaming tools such as Kafka or event streams.
  • Optional, a plus: HVault.
  • Familiarity with banking industry processes.
  • Strong problem solving and decision making.
  • Ability to work across business and IT, including IT operations.
  • Ability to understand, explain and support change.
  • Results driven.
  • Ability to collaborate with data squads and business teams.
  • English at C1 level.
  • French is optional.

Conditions

Hybrid work, based in Madrid.

Where you’d work

Part of the week in the office

About the company

Inetum

Office in Madrid, Spain

Also hiring in Porto, Portugal, Belgium, Bucharest, Romania and 8 more places

7 of their 108 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 19 checks run
  • 1 red flag

Still hiring?

13 checks

1 red flag

How crowded?

6 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details10 facts · Role, Location, Compensation, Employment, Requirements
Tech stack
  • SQL
  • Kubernetes
  • Kafka
  • Spark
  • Airflow
  • LLMs
Type
Full-time
Specialty
Data Engineering
Region
Europe
Pay period
Annual
Show 5 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Tech stack
  • SQL
  • Kubernetes
  • Kafka
  • Spark
  • Airflow
  • LLMs

Location

Work model
Hybrid
Region
Europe
Office
  • Madrid, Spain

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Full-time

Requirements

Languages
  • English (C1)

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason