You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Experian

Lead Data Platform Engineer - AWS, Spark

  • Hybrid
  • 6+ years

Salary

Not stated

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company's Credit Services and Verifications business is hiring a Lead Data Platform Engineer to provide hands-on technical leadership on a new fraud data capability. The work connects fraud-related data assets into the company's central Data Analytics Platform.

You will report to the Engineering Director and lead a technical team, holding the team to the highest technical standards.

You will work with the central Data Analytics Platform team, data owners, and security, compliance, platform and delivery colleagues. Together you will agree practical implementation approaches, follow established platform patterns, and deliver secure, scalable and supportable solutions.

The role suits someone with strong data engineering depth, cloud platform experience, engineering discipline and team leadership. You will apply solid DevSecOps practices and help shape the technical roadmap where requirements are shared or overlap with the wider platform. Broader architectural ownership sits with central platform teams, so you will collaborate with them.

This is a hybrid role based in Nottingham, with 40% of time in the office.

Responsibilities

  • Lead an agile technical team that delivers data platform solutions for fraud-related data assets.
  • Guide delivery of AWS-based data pipelines, data lake components and producer-side data platform capability.
  • Take over, own, maintain and extend pipelines and cloud components first built by the central DAP team.
  • Lead the team in building, testing and maintaining reliable data pipelines from sources such as Snowflake and internal product and data platforms.
  • Make sure metadata is accurate and published so assets appear in the DAP catalogue.
  • Drive DevSecOps, CI/CD, Infrastructure as Code and cloud-native tooling to improve reliability, security and delivery speed.
  • Mentor and coach senior and junior engineers, encouraging learning, innovation and teamwork.
  • Promote modern engineering practices, including automation and AI-assisted development where suitable, to speed up delivery and improve quality and repeatability.

Requirements

  • Strong experience building data pipelines, data lake solutions or data platform capabilities.
  • Strong experience with AWS services for data engineering and platform delivery, such as Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
  • Strong experience with DevOps and Infrastructure as Code tools, including Terraform, CI/CD pipelines, Git and Jenkins.
  • Strong experience developing on Apache Spark or Hadoop.
  • Significant programming experience in Scala or Python.
  • Experience with Configuration as Code and API integration.
  • Strong grasp of cloud security, data privacy, access control and governance in data platform environments.
  • Desirable: AWS Developer Certification or another relevant AWS certification.
  • Desirable: strong expertise in Terraform or CloudFormation.
  • Desirable: experience with OpenShift or Kubernetes.
  • Desirable: experience with automated testing tools such as pytest or Scalatest.
  • Desirable: familiarity with code quality and security scanning tools such as SonarQube and Veracode.
  • Desirable: knowledge of RESTful APIs and microservice architectures.
  • Desirable: experience with sensitive, governed or regulated data environments.
  • Desirable: familiarity with data catalogues, metadata management, data marketplaces or federated data mesh concepts.

Conditions

Hybrid working in Nottingham, with 40% of time in the office.

Equal opportunity and affirmative action employer. Candidates needing accommodation for a disability or special need should say so as early as possible.

Benefits

  • A competitive pay package plus a discretionary bonus scheme.
  • 25 days of annual leave, 8 bank holidays and 3 volunteering days, with the option to buy extra leave.
  • Core benefits include a pension, Bupa healthcare, and a Sharesave scheme, among others.
  • The company is a global data and technology business with about 25,200 people in 32 countries, operating across financial services, healthcare, automotive, agribusiness and insurance.
  • Internal grade: D/EB8.

Where you’d work

Part of the week in the office

You can work from

  • United Kingdom

About the company

Experian

  • Industry: FinTech

Office in United Kingdom

Also hiring in London, United Kingdom, Madrid, Spain, United States and 5 more places

1 of their 39 open roles is remote

Your chances

We've checked whether it's still hiring and how crowded it is.

  • 19 checks run
  • 0 red flags

Still hiring?

13 checks

No red flags

How crowded?

6 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details13 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • AWS
  • Kubernetes
  • Spark
  • Snowflake
Seniority
Lead
Type
Full-time
Industry
FinTech
Specialty
Data Engineering
Region
United Kingdom
Show 7 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Lead
Experience
6+ years
Tech stack
  • Python
  • AWS
  • Kubernetes
  • Spark
  • Snowflake

Location

Work model
Hybrid
Region
United Kingdom
Office
  • United Kingdom
Remote from
  • United Kingdom

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Full-time

Company

Industry
FinTech

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason