Senior Data Engineer

Description

The company is one of the largest independent mobile games makers in the world.

It employs over 2,500 people across 12 studios.

Its games reach top chart positions globally and attract more than 25 million daily active users.

You would join the central AI team to build a game event data hub that brings together data from several studios.

This is a new senior role. Early on, the focus is ingestion, preparation and quality, so the team can see how healthy its data is and alert the right people when something breaks.

You will mostly work within the central team and liaise with studio data engineers through their named contacts, so your solutions fit how each studio already works. Later you will move into other parts of the team's work, including building, running and maintaining machine learning pipelines.

Responsibilities

• Build the game event data hub and bring in data from multiple studios.
• Create and run pipelines for ingestion, preparation, quality checks, backfills and orchestration.
• Consolidate dataset metadata and data quality results in a tool such as OpenMetadata so the team can see the health of its data assets.
• Strengthen monitoring and alerts so people learn quickly when a pipeline or dataset needs attention.
• Work with studio data engineers to keep shared components aligned with their needs and conventions.
• Help productionise machine learning pipelines, monitor them and fix issues as you rotate through the team's areas.

Requirements

• A track record of building and running data pipelines that cover ingestion, preparation, quality checks, backfills and orchestration.
• Working knowledge of Kubernetes, Airflow, SQL and Spark.
• A dependable, pragmatic way of working, keeping systems maintained and staying consistent with colleagues.
• Able to collaborate well with engineers on your own team and across the studios.
• Games industry experience is a plus, not a requirement. The company will help you learn the domain if your technical knowledge is strong.
• Experience with change data capture or streaming.
• Exposure to machine learning workflows.
• Knowledge of Kubeflow.

Conditions

25 days of paid holiday on top of bank holidays.

Hybrid working: in the office 3 days a week, on Tuesdays, Wednesdays and one day you choose.

Up to 20 days a year of remote work from anywhere in the world, which you can also use in place of mandatory office days.

Benefits

• £12 every day you are in the office to order food from JustEat.
• Quarterly on-site and off-site events that mark cultural occasions, company achievements and team spirit.
• Confidential support through the Employee Assistance Program, available whenever you need it.
• Support for family forming and fertility journeys, subject to policy.
• Life assurance and group income cover to protect you and your loved ones.
• Ongoing opportunities for professional development.
• Opt-in private medical cover (P11d benefit) with Bupa, plus a cash plan with Medicash.
• Opt-in dental cover (P11d benefit).
• Cycle to work scheme: salary sacrifice bike purchase.
• Pension: qualifying earnings, or opt-in 4% contributory match.