You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Senior Databricks Engineer

  • Hybrid
  • 6+ years

Salary

Not stated

Similar roles pay €60K - 105K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The team is hiring a senior data engineer to build scalable data pipelines and Lakehouse solutions on Azure Databricks, working with 5-10 years of data engineering experience in total, including solid hands-on work with Azure Databricks, PySpark, SQL and Delta Lake.

You will work closely with data architects, business analysts, analytics teams and business stakeholders to turn enterprise data into reliable, business-ready data products.

Responsibilities

  • Build and maintain scalable data pipelines using Azure Databricks, PySpark, Python, SQL and Delta Lake.
  • Set up Bronze, Silver and Gold Lakehouse layers and reusable data engineering frameworks.
  • Create complex ETL and ELT solutions that draw on SAP and other enterprise source systems.
  • Ingest SAP data and apply the right business and transformation logic to it.
  • Build data solutions that support manufacturing processes, reporting and analytics.
  • Handle batch and incremental loading, schema evolution, historical data and pipeline recovery.
  • Tune complex Spark, PySpark and SQL workloads for scale and speed.
  • Put in place data quality checks, validation, reconciliation, monitoring and exception handling.
  • Design analytical and dimensional models, including Fact/Dimension and Star Schema designs.
  • Apply sound engineering practice to Git, CI/CD, automated deployment, coding standards and documentation.
  • Turn technical and business requirements into scalable data solutions with data architects and business stakeholders.
  • Take part in design reviews, code reviews and ongoing improvement of Databricks engineering practice.

Requirements

  • 5-10 years of experience in data engineering, data warehousing or data platform development.
  • Strong hands-on experience with Azure Databricks.
  • Strong skills in PySpark, Apache Spark, Python and SQL.
  • Good understanding of Delta Lake and Lakehouse architecture.
  • Experience implementing Bronze, Silver and Gold (Medallion) architecture.
  • Strong track record building enterprise-scale ETL, ELT and data pipelines.
  • Experience with data modelling, including Fact/Dimension models and Star Schemas.
  • Understanding of data quality, governance, metadata, lineage and security concepts.
  • Experience with Git, CI/CD and DevOps practices for data engineering.
  • Strong troubleshooting, performance tuning and problem-solving skills.
  • Good communication skills and the ability to work with technical and business teams spread across the world.
  • Nice to have: experience with SAP as a source system and a good grasp of SAP data extraction and integration.
  • Nice to have: Oil & Gas, Energy, manufacturing or customer experience background, with an understanding of the data tied to business processes. This is required for the role.
  • Nice to have: Databricks Certified Data Engineer Associate.
  • Strong advantage: Databricks Certified Data Engineer Professional.
  • Added advantage: Microsoft Azure or data engineering certifications.
  • Nice to have: Databricks AI Certification.

Conditions

The company welcomes applicants of every background and gender, in line with its diversity and equity commitment.

Where you’d work

Part of the week in the office

About the company

Company hidden

Office in Poland

Your chances

Still hiring, not crowded yet, and you'd be among the first.

  • 15 checks run
  • 4 good signs
  • 1 red flag

Still hiring?

10 checks

Actively hiring

In its favour2

  • Still on the company's own careers site, checked 2 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence

Against it1

  • Posted 6 times at once for the same place: mass postings are often a pipeline, not one seatSlight evidence

How crowded?

5 checks

Low

In its favour2

  • In its Early Window: not on the big job boards yetStrong evidence
  • Asks for 10+ years: a narrow poolModerate evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • SQL
  • Azure
  • CI/CD
Seniority
Senior
Type
Full-time
Equity
Equity offered
Specialty
Data Engineering
Region
Europe
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Senior
Experience
10+ years
Tech stack
  • Python
  • SQL
  • Azure
  • CI/CD

Location

Work model
Hybrid
Region
Europe
Office
  • Poland

Compensation

Salary
Salary by agreement
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason