Senior Data Engineer (Microsoft Fabric)

Description

The team builds and runs data pipelines and data solutions on Azure, with Microsoft Fabric as one of the platforms in use.

The role centres on preparing data for modelling, from ingestion through to dependable, well-structured data layers.

Responsibilities

• Ingest data from source systems and engineer features that feed modelling data layers and the models and workflows that use them.
• Design, build and maintain pipelines for ingesting, processing and transforming data using cloud services and other tools.
• Build and maintain data solutions in Azure using Data Factory, Synapse or Fabric, whichever fits the work.
• Put data validation and cleansing steps in place so the data stays accurate, complete and reliable.
• Make pipelines more scalable, efficient and cost-effective over time.
• Watch pipelines, diagnose and fix faults, and keep the data consistent and available.

Requirements

• Solid Python skills.
• Working knowledge of data design principles such as Kimball and star schema, along with data warehousing and data modelling.
• Substantial experience with relational databases, and ideally NoSQL databases too.
• A strong grasp of ETL and ELT processes.
• Some exposure to data monitoring and observability tools.

Conditions

Equal opportunity: the company welcomes applicants from all backgrounds and hires on merit; tell the company if you need adjustments during recruitment.