You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Netcompany

Data Engineer

  • Hybrid

Salary

Not stated

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

You will lay the data groundwork for a large-scale migration by designing and running repeatable pipelines that bring varied source data into one platform, owning processing from intake to delivery.

The company is one of Europe's leading technology partners, with more than 9,500 colleagues delivering digital solutions for governments, critical industries and businesses, from strategy through to daily operations.

It describes itself as Europe's leader in sovereign AI and builds technology on Europe's own terms, with AI used in business-critical systems under human judgement, transparency, security and accountability.

Culture centres on low bureaucracy, high agility and flexibility.

Responsibilities

  • Join a migration team and work with the data lead, analysts, the platform team and source organisations for the full delivery.
  • Create repeatable processes to receive, unpack, check and load data from several sources.
  • Reshape source extracts into consistent structures ready for a single platform.
  • Write maintainable ingestion and transformation code in SQL, Python, PySpark and dbt.
  • Build automated checks that confirm completeness and accuracy at every stage of the migration.
  • Monitor pipelines, find the cause of failed or incomplete runs, and recover them.
  • Keep auditable records of sources, mappings, transformations and outcomes, and apply the agreed controls for handling data securely.

Requirements

  • You can deliver dependable data processing in a structured migration setting, backed by hands-on experience building and running data pipelines.
  • Hands-on experience building and running data pipelines on Azure, AWS or Google Cloud.
  • Experience with Spark, PySpark, Databricks or similar distributed processing technologies.
  • Experience building modular, tested and documented transformations with dbt or an equivalent approach.
  • Strong SQL and Python skills for writing, debugging and validating transformations and reconciliation queries.
  • Experience scheduling, monitoring and recovering pipelines with cloud-native or equivalent orchestration tools.
  • Experience with Delta Lake, including transactional tables, schema changes and repeatable batch loading.
  • Experience with Terraform or equivalent infrastructure as code to provision and maintain consistent cloud environments.

Conditions

Hybrid working model with some flexible working.

Applicants with a disability who meet the minimum criteria can opt in to a Disability Confident Interview Scheme that guarantees an interview.

Benefits

  • 25 days of holiday.
  • Private medical healthcare through Vitality.
  • Pension contribution and life assurance.
  • Support for professional certifications as part of learning and development.
  • Retail discounts on restaurants, supermarkets, travel, leisure, and health and well-being services.
  • Access to employee resource groups that represent diverse backgrounds and help colleagues connect, learn and support one another.
  • A personal mentor from the leadership group to guide your development, career direction and goals, within a structured career model that builds on your existing experience.
  • Growth comes through the responsibility you take, the projects you lead and the people you learn from.

Where you’d work

Part of the week in the office

You can work from

  • United Kingdom

About the company

Netcompany

Office in Leeds, United Kingdom

Also hiring in London, United Kingdom, France, Brussels, Belgium and 6 more places

Your chances

We've checked whether it's still hiring and how crowded it is.

  • 19 checks run
  • 0 red flags

Still hiring?

13 checks

No red flags

How crowded?

6 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details10 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • SQL
  • AWS
  • Google Cloud
  • dbt
  • Azure
  • Spark
  • Databricks
  • LLMs
Type
Full-time
Specialty
Data Engineering
Region
United Kingdom
Pay period
Annual
Show 5 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Tech stack
  • Python
  • SQL
  • AWS
  • Google Cloud
  • dbt
  • Azure
  • Spark
  • Databricks
  • LLMs

Location

Work model
Hybrid
Region
United Kingdom
Office
  • Leeds, United Kingdom
Remote from
  • United Kingdom

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason