You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Experian

Senior Data Platform Engineer AWS, Spark

  • Hybrid
  • 6+ years

Salary

Not stated

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company's Credit Services and Verifications business is hiring a Senior Data Platform Engineer to lead hands-on technical work on a new fraud data capability. The capability will bring fraud-related data assets into the company's Data Analytics Platform.

You will work with the central Data Analytics Platform team, data owners, and security, compliance, platform and delivery stakeholders. Together you will settle practical implementation approaches, fit existing platform patterns, and make sure solutions are secure, scalable and supportable.

The role is hands-on engineering for someone with deep data engineering skills, cloud platform experience, engineering discipline and team leadership. You will apply DevSecOps practices and take part in technical roadmap discussions, using CI/CD, Infrastructure as Code and cloud-native tooling to drive automation and ongoing improvement across the engineering lifecycle.

This is a hybrid role based in Nottingham, with 40% of time in the office. You will report to the Director of Engineering.

Responsibilities

  • Design, build, test and maintain AWS-based data pipelines for fraud-related data assets.
  • Help ingest and transform data from source platforms such as Snowflake and internal product and data systems.
  • Build new data flows, integrations and automation as more data assets are onboarded.
  • Work with platform, security and data stakeholders so solutions follow agreed security, governance and compliance patterns.
  • Take part in technical design discussions, review proposals, compare options, provide estimates and recommend workable solutions.
  • Deliver repeatable solutions using Infrastructure as Code and Configuration as Code tools such as Terraform, Git and CI/CD pipelines.
  • Write clear documentation for pipelines, data flows, operational procedures and support processes.
  • Support junior engineers where useful and help build a collaborative, quality-focused engineering culture.
  • Use modern engineering practices, including automation and AI-assisted development where suitable, to improve delivery speed, quality and repeatability.

Requirements

  • Solid track record building data pipelines, data lake solutions or data platform capabilities.
  • Strong experience with AWS services used in data engineering and platform delivery, such as Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
  • Strong experience with DevOps and Infrastructure as Code tools, including Terraform, CI/CD pipelines, Git and Jenkins.
  • Strong experience developing on Apache Spark or Hadoop.
  • Significant programming experience in Scala or Python.
  • Strong grasp of cloud security, data privacy, access control and governance in data platform environments.
  • Desired skills:
  • AWS Developer Certification or another relevant AWS certification (desirable).
  • Strong expertise in Terraform or CloudFormation (desirable).
  • Experience with OpenShift or Kubernetes (desirable).
  • Experience with automated testing tools such as pytest or Scalatest (desirable).
  • Knowledge of RESTful APIs and microservice architectures (desirable).
  • Experience with sensitive, governed or regulated data environments (desirable).
  • Familiarity with data catalogue, metadata management, data marketplace or federated data mesh concepts (desirable).

Conditions

Hybrid working in Nottingham, with 40% of time in the office.

Reports to the Director of Engineering.

Internal grade D/EB8.

The company is an equal opportunity and affirmative action employer and will make reasonable accommodations on request.

Benefits

  • Competitive compensation package and a discretionary bonus plan.
  • Core benefits include a pension, Bupa healthcare, a Sharesave scheme and more.
  • 25 days annual leave, 8 bank holidays and 3 volunteering days, with the option to buy additional annual leave.

Where you’d work

Part of the week in the office

You can work from

  • United Kingdom

About the company

Experian

  • Industry: FinTech

Office in United Kingdom

Also hiring in London, United Kingdom, Madrid, Spain, United States and 6 more places

2 of their 41 open roles are remote

Your chances

We've checked whether it's still hiring and how crowded it is.

  • 19 checks run
  • 0 red flags

Still hiring?

13 checks

No red flags

How crowded?

6 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details13 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • AWS
  • Kubernetes
  • Spark
  • Snowflake
Seniority
Senior
Type
Full-time
Industry
FinTech
Specialty
Data Engineering
Region
United Kingdom
Show 7 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Senior
Experience
6+ years
Tech stack
  • Python
  • AWS
  • Kubernetes
  • Spark
  • Snowflake

Location

Work model
Hybrid
Region
United Kingdom
Office
  • United Kingdom
Remote from
  • United Kingdom

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Full-time

Company

Industry
FinTech

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason