The AI & Automation department turns complex data into scalable, intelligent solutions. The team builds infrastructure that supports regulatory compliance and process efficiency, using cloud technology and machine learning to keep data reliable and to find ways to improve performance across global platforms.
You will help build and run pipelines that move data from the data lake into a new cloud-based Enterprise Data Warehouse (EDW). The architecture and data models are already in place, so your focus is building and improving the pipelines that load fact and dimension tables, along with automation and data quality work.
In-Play betting is its main focus, with over 1.38 million In-Play sporting events a year, more than 750 concurrent fixtures at peak, and more than 750,000 live sports streams, the most in Europe. The platform handles over 6 million HTTP requests a day and processes more than 1.5 million bets per hour at peak.
Responsibilities
Build, maintain and improve reliable pipelines that ingest data from the data lake into the cloud EDW.
Build and support the loading of fact and dimension tables, following the existing architecture, data models and development standards.
Write efficient SQL and transformation logic with attention to data quality, testing, performance, monitoring, error handling and reliability.
Work in a shared, source-controlled repository with other developers, taking part in peer reviews, CI/CD and the controlled release of data solutions.
Find and fix pipeline and data quality problems, and help with automation, technical documentation and ongoing EDW improvements.
Work with engineers, analysts and stakeholders in an agile setting, using AI tools responsibly for development, troubleshooting, documentation and solution design.
Requirements
Strong SQL skills, including writing queries that are efficient and easy to maintain for analytics and data warehousing.
Hands-on experience with cloud data platforms, especially Google BigQuery, and with building, maintaining and troubleshooting pipelines in Apache Airflow or similar tools.
Proven ability to load, transform and model data for cloud warehouses, including fact and dimension tables, with exposure to dbt or Dataform.
Solid grounding in data engineering: data quality, testing, monitoring, performance and reliability.
Demonstrated use of Git for source control and teamwork in a shared repository with several developers.
Applied understanding of CI/CD, peer review and development standards for controlled testing and deployment.
Experience working in an agile environment, contributing to technical discussions, planning and delivery.
Ability to use AI tools responsibly for code generation, refinement, troubleshooting and documentation.