Senior Microsoft Fabric Data Engineer - Manager - Data & AI - Technology Consulting - Advisory

Description

This is a Manager-level role in the Advisory line of service, within Technology Strategy, and it is not tied to a specific industry. The company is based in Ireland.

The role centres on hands-on work building enterprise data platforms on Microsoft Fabric for data engineering, analytics and AI.

You will work across the Fabric ecosystem, including OneLake, Lakehouse, Data Warehouse, Data Factory, Dataflows Gen2, Real-Time Intelligence, Power BI, Semantic Models and Microsoft Purview, and you will help shape reusable frameworks, practices and delivery accelerators.

Responsibilities

• Design, build, deploy and support large-scale Microsoft Fabric solutions for data engineering, analytics and AI.
• Design and maintain scalable Lakehouse and Warehouse setups that follow Medallion Architecture.
• Build and tune ingestion pipelines using Fabric Data Factory, Dataflows Gen2, Fabric Mirroring, shortcuts, APIs, databases, SaaS applications and cloud-native sources.
• Create reusable ingestion patterns and accelerators so projects can move quickly and consistently.
• Bring structured, semi-structured and streaming data into Microsoft Fabric OneLake.
• Develop and optimise transformation pipelines in Spark, PySpark and SQL.
• Build scalable ETL and ELT frameworks for enterprise reporting, analytics and AI workloads.
• Where suitable, design and deliver real-time analytics using Eventstreams, Real-Time Intelligence and streaming architectures.
• Prepare data foundations that support Copilot, Fabric Data Agents, machine learning and generative AI.
• Set up data quality controls, validation frameworks, monitoring and automated alerts.
• Apply data governance, metadata management, lineage and security controls with Microsoft Purview and Fabric governance features.
• Help build trusted, governed, secure and compliant data platforms.
• Set up CI/CD pipelines, source control standards, testing frameworks and automated deployments using Azure DevOps and Git.
• Create reusable templates, accelerators and engineering frameworks that raise delivery quality, consistency and productivity.
• Monitor platform performance, tune workloads and resolve complex data engineering issues.
• Work with Solution Architects, business stakeholders, Data Analysts and AI teams to achieve business goals.
• Support modern analytics, AI and self-service reporting built on the Microsoft Fabric ecosystem.
• Own end-to-end delivery of data engineering workstreams, meeting agreed standards for quality, governance, security and performance.

Requirements

• Have 6+ years of experience in data engineering and Azure analytics platforms.
• Have delivered modern Azure data and analytics solutions, with hands-on Microsoft Fabric work in production.
• Have strong hands-on experience with Fabric Lakehouse, Fabric Warehouse, OneLake, Data Factory, Dataflows Gen2, Notebooks and Semantic Models.
• Have extensive experience building scalable ETL and ELT solutions and modern data platforms.
• Have strong skills in SQL, Python, PySpark and data modelling.
• Have experience with Medallion Architecture, Delta Lake and modern analytics patterns.
• Have experience integrating data from APIs, SaaS platforms, databases and cloud systems.
• Have a strong grasp of data governance, security, metadata management and compliance.
• Have experience with CI/CD pipelines, source control and DevOps practices.
• Can troubleshoot, optimise and support enterprise-scale data platforms.
• Communicate well and manage stakeholders across both technical and business teams.
• Have worked with Solution Architects, Data Analysts and engineering teams on complex data platform projects.
• Optional skills are also listed, including feedback, active listening, AI fluency, data modelling and data quality, plus 33 more.

Conditions

Visa sponsorship is available.

No government clearance is required.

The company is committed to an inclusive workplace and welcomes candidates from all backgrounds.

Benefits

• Join a purpose-led organisation that works to build trust in society and tackle complex client challenges, with teams collaborating across sectors and regions.
• Grow through continuous learning, leadership development and access to advanced technology.
• Receive rewards designed around your lifestyle and needs, plus recognition from your peers.
• Access the company perks, a curated set of discounts, experiences and extras.