You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Netcompany

Senior Data Engineer

  • Hybrid
  • 6+ years

Salary

Not stated

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

You will lay the data groundwork for a large migration by designing and running pipelines that repeatedly bring varied source data into one platform, owning the work from intake to delivery.

The company is a major European technology partner with more than 9,500 staff, serving governments, critical industries and businesses across Europe, and handles projects from strategy through to running systems day to day.

AI is part of how the company builds its solutions, used in business-critical systems with human oversight, transparency, security and accountability built in.

Responsibilities

  • You will join a migration team and work with the data lead, analysts, the platform team and the source organisations for the whole delivery.
  • Create repeatable steps to receive, unpack, check and load data arriving from several sources.
  • Reshape source extracts into consistent structures ready for the move to a single platform.
  • Write maintainable ingestion and transformation code in SQL, Python, PySpark and dbt.
  • Set up automated checks that confirm the migrated data is complete and accurate.
  • Watch pipelines, find the cause of failed or partial runs, and get them working again.
  • Keep auditable records of sources, mappings, transformations and results, and apply the agreed controls for handling data securely.

Requirements

  • You have hands-on experience building and running data pipelines on Azure, AWS or Google Cloud.
  • You have worked with Spark, PySpark, Databricks or similar distributed processing tools.
  • You have built modular, tested and documented transformations with dbt or a comparable approach.
  • You write strong SQL and Python, including for troubleshooting transformations and validation and reconciliation queries.
  • You have scheduled, monitored and recovered pipelines using cloud-native or equivalent orchestration tools.
  • You have worked with Delta Lake, including transactional tables, schema changes and repeatable batch loads.
  • You have used Terraform or another infrastructure as code tool to provision and maintain consistent cloud environments.
  • You have experience delivering reliable data processing within a structured migration setting.
  • You will keep growing your skills through the responsibility you take on, the projects you lead and the colleagues you learn from, inside a structured career model that builds on what you already bring.
  • You will get a personal mentor from the leadership group to support your professional development, career direction and personal goals.
  • The company values a shared community in which collaboration, trust and support are part of daily work, with colleagues from different backgrounds treated with respect and given equal chances to develop.

Conditions

Hybrid working, with some flexibility in working hours.

The company runs a Disability Confident Interview Scheme, guaranteeing interviews to applicants with a disability who meet the minimum criteria, if they opt in.

The company welcomes applicants from all backgrounds and treats everyone with respect.

Benefits

  • 25 days holiday.
  • Private medical healthcare through Vitality.
  • Pension contribution and life assurance.
  • Support for professional certifications as part of learning and development.
  • Retail discounts covering restaurants, supermarkets, travel, leisure and health and well-being services.
  • Access to employee resource groups that represent diverse backgrounds and help colleagues connect, learn and support each other.

Where you’d work

Part of the week in the office

You can work from

  • United Kingdom

About the company

Netcompany

Office in Leeds, United Kingdom

Also hiring in Brussels, Belgium, London, United Kingdom, United Kingdom and 6 more places

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 19 checks run
  • 1 red flag

Still hiring?

13 checks

1 red flag

How crowded?

6 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • SQL
  • AWS
  • Google Cloud
  • dbt
  • Azure
  • Spark
  • Databricks
  • LLMs
Seniority
Senior
Type
Full-time
Specialty
Data Engineering
Region
United Kingdom
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Senior
Experience
6+ years
Tech stack
  • Python
  • SQL
  • AWS
  • Google Cloud
  • dbt
  • Azure
  • Spark
  • Databricks
  • LLMs

Location

Work model
Hybrid
Region
United Kingdom
Office
  • Leeds, United Kingdom
Remote from
  • United Kingdom

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason