Senior Data Engineer (Microsoft Fabric)

Description

The team builds and runs data pipelines and data solutions on Azure, with Microsoft Fabric in the stack.

The role supports data ingestion, feature engineering and the modelling data layers that feed models and workflows.

Responsibilities

• Prepare data sources and engineer features that feed the modelling data layers, and connect that data into models and workflows.
• Design, build and maintain pipelines that ingest, process and transform data, using cloud services and other tools.
• Build and maintain data solutions in Azure with Data Factory, Synapse or Fabric, whichever fits the need.
• Add validation and cleansing steps so the data stays accurate, consistent and reliable.
• Make pipelines more scalable, efficient and cost-effective.
• Watch data pipelines, diagnose problems when they occur and fix them so the data stays consistent and available.

Requirements

• Strong Python skills.
• Solid grasp of data design principles such as Kimball and star schema, along with data warehousing and data modelling.
• Substantial experience with relational databases, and ideally NoSQL databases too.
• Strong understanding of ETL and ELT processes.
• Some exposure to data monitoring and observability tools.

Conditions

Equal opportunity: the company hires on merit, skills, qualifications and potential, and will provide adjustments during recruitment on request.