Medior Data Engineer – Databricks & Lakehouse Platform (Cloud)

Description

The company is a geo-data business moving its data estate onto a cloud lakehouse built on Databricks, so that governed, high-quality data can be used at scale.

This is a mid-level data engineering role for someone who starts from the business problem, works directly with stakeholders, and then designs and builds the data solutions behind it.

You will work alongside engineering, analytics, data science and domain teams to ship production-grade data products for the company's worldwide operations.

Responsibilities

• Talk with stakeholders to learn their challenges, goals and intended outcomes, then turn those needs into data solutions and products.
• Build and maintain cloud-native batch and streaming pipelines on Databricks using Lakeflow, Delta Lake and orchestration tools.
• Apply the medallion architecture (bronze, silver, gold) to produce trustworthy, performant datasets.
• Write transformations in PySpark and Spark SQL, and help turn repeated approaches into reusable engineering patterns.
• Own data quality, observability and operational reliability through validation, monitoring, alerting and runbooks.
• Use Unity Catalog to keep access governed, and keep documentation and lineage in view while you develop.
• Shape requirements from analytics and the business into scalable, pragmatic datasets for BI, analytics and AI.
• Raise engineering standards through code reviews, testing, CI/CD and cost-efficient cloud usage.
• Work with platform, analytics and domain teams to deliver production-ready data products from start to finish.

Requirements

• 3-6 years of data engineering experience, or equivalent, delivering production-grade cloud pipelines.
• Hands-on experience with Apache Spark on Databricks.
• Strong Python and SQL skills.
• Experience building reliable batch and/or streaming data pipelines.
• Experience with at least one major cloud (AWS, Azure or GCP), including cloud storage and security concepts.
• Familiarity with lakehouse principles, Delta Lake and incremental processing patterns.
• Understanding of governance concepts such as catalogs, permissions, lineage and data contracts.
• Unity Catalog experience is a plus.
• Experience with common ingestion patterns from files, APIs and databases, and a sense of how to balance reliability, performance and cost.
• Clear communication and effective collaboration with engineers, analysts and business stakeholders.

Conditions

29 holidays per year on a full-time basis, 4 of which are set by company management, with the option to buy 12 extra days.

Flexible working hours and the option to work from home, agreed with your manager and within company policy.

Benefits

• A competitive salary.
• Wide training and career opportunities, both in the country and abroad.
• Commuting allowance.
• Modern pension scheme.
• Collective health insurance.
• Access to a corporate fitness plan.
• Coaching through the employee assistance programme (EAP).