Senior Data Engineer-Product Data Quality

Description

The Product Data Quality team needs a data engineer who enjoys building at the crossover of data engineering, software development and data science. The team is made up of data and backend engineers, product managers and applied scientists. Together they use AI to learn about a catalogue of hundreds of thousands of live products and then present those findings to customers at scale in new ways.

You will work with engineering colleagues, including those in product and applied science, to design, build, deploy and monitor cloud-based data processing architectures. These systems pull machine learning insights from several independent data sources and merge them to improve product information in a way that scales and stays maintainable. Beyond data pipelines, the team builds and runs cloud-based microservices, such as a flexible rules engine and an image customisation service. The stack includes Databricks, Python, Airflow, Kotlin, Kubernetes, Elasticsearch, PostgreSQL and other AWS services. The Tech Blog covers these tools in more detail.

Responsibilities

• Lead the design, build and rollout of the team's pipelines, dashboards and other systems, drawing on deep experience.
• Work well with engineers, applied scientists and product owners across the organisation, communicating clearly with each group.
• Design and maintain robust architectures that can change as product needs change.
• Deliver high-quality, testable and dependable systems, and raise the bar through thorough reviews and mentoring.
• Test features with stakeholders in short iterations while keeping the overall project goals in view.
• Improve team processes, automation, communication and collaboration to raise the team's speed and output.

Requirements

• Deep experience designing and building data pipelines with tools such as Databricks, Spark and Airflow.
• Comfort working across teams with different goals, including ML engineers, applied scientists and other software engineering teams.
• Interest in both how something is built and what it should do, with a customer-first view when designing experiences.
• Strong engineering skills and a drive to solve real customer problems.
• Willingness to pick up new languages, tools and systems and choose the right one for each task. The current stack is Databricks, Python, Airflow, Kubernetes, Kotlin, PostgreSQL, Elasticsearch and AWS.
• Ability to move between building new features from scratch and improving existing systems.
• Clear spoken and written communication, including concise, well-structured documentation, which matters a lot because the team currently works remotely.
• Enjoyment of engineering: designing, building and solving problems.
• Alignment with the company's values.

Conditions

Remote working setup.

The company encourages applications even when you do not meet every requirement.

The company is committed to reducing bias in hiring by assessing skills and contributions. Please leave personal details such as a photo, age or marital status off your CV.

The company will make reasonable adjustments to the hiring process on request.

Benefits

• 40% off products sold and shipped by the company.
• 2 paid volunteering days a year.
• Up to 30 working days a year spent working from abroad.
• 27 days of holiday per year, rising from the start.
• A one-time allowance for an ergonomic workstation outside the office.
• Health and dental insurance (opt-in).
• Pension trust fund with up to a 10% employer match (opt-in).
• Life assurance and income protection.
• Cycle to Work scheme and tax-saver commuter tickets.
• Employee share programme.
• Family services, including counselling and support.
• Health and wellbeing options, including Wellhub.
• Mental health support and coaching.
• Professional development through a training platform and biannual peer-to-peer reviews.