Senior Data Engineer with Databricks

Description

The company is a global partner in AI-first digital transformation and engineering, with over 25 years in the field, around 5,000 staff and presence in 16 countries.

It focuses on artificial intelligence, data and cloud, intelligent automation and digital products.

The CEE region team has nearly 1,000 specialists building applications, data platforms and AI solutions for a wide range of clients, using AWS, Azure, GCP, Databricks and Snowflake.

Responsibilities

• Build scalable data pipelines on Databricks.
• Bring existing pipelines up to the gold standard approach.
• Move legacy data pipelines to the new platform and refactor them.
• Write data transformations with dbt and Python.
• Help onboard new datasets from the US and APAC regions.
• Work with data architects and analytics teams.
• Help lay the groundwork for future Data Science and MLOps work.
• Optimize performance and resource use under capacity constraints.

Requirements

• Have a strong background as a Data Engineer.
• Have hands-on experience running production-grade pipelines on Databricks.
• Have very good Python skills for data processing.
• Have experience with dbt and data transformation layers.
• Understand pipeline design, orchestration and scalability well.
• Have worked with legacy systems and pipeline migrations.
• Have experience with cloud data platforms on Azure, AWS or GCP.
• Know data modeling, including medallion architecture and dimensional models.
• Have experience with financial or market data.
• Be familiar with CI/CD practices for data pipelines.
• Work independently and take ownership of data solutions.
• Communicate well and collaborate readily within a team.
• Have experience with Data Science environments or MLOps.
• Know how ML lifecycle support works in Databricks.
• Have worked in global, distributed teams.
• Have been involved in large-scale, multi-region data onboarding projects.

Conditions

You must work from the European Union region and hold a work permit.

The hiring process runs through a CV review, an HR call, an interview, a client interview and a decision.