Senior Data Engineer with Python and Databricks

Description

The team works with data scientists and analysts to define data needs and build effective pipelines.

The company, a consultancy working with leading brands across industries, delivers digital platforms and data-driven solutions.

Responsibilities

• Design, build and maintain pipelines that ingest, process and transform data, using cloud services and other technologies.
• Build and run data solutions in Azure with any of Data Factory, Synapse, Databricks/Spark, Polars/Pandas or Fabric.
• Add data validation and cleansing steps so the data stays accurate, complete and reliable.
• Improve pipeline scalability, efficiency and cost-effectiveness.
• Monitor pipelines, fix problems as they arise, and keep data consistent and available.

Requirements

• Proficient in Python and SQL.
• Understanding of sound data design, including Kimball and Star Schema, data warehousing and data modelling.
• Strong experience with relational databases; NoSQL experience is ideal.
• Strong grasp of ETL and ELT processes.
• Exposure to data monitoring and observability tools.
• Relevant experience with event-driven architecture.
• Good understanding of Agile ways of working.
• Additional information: no further requirements are listed.

Conditions

Hybrid work with flexible working hours.

The company is committed to an open, inclusive workplace and welcomes applicants from all backgrounds. Hiring is based on merit, skills, qualifications and potential. Tell us if you need adjustments during recruitment.

Benefits

• Finance: competitive salary package, share plan, company performance bonuses, value-based recognition awards and a referral bonus.
• Career development: career coaching, global career opportunities, non-linear career paths, and internal programmes for management and technical leadership.
• Learning: complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platform subscriptions, pass-it-on sessions, workshops and conferences.
• Work-life balance: employee assistance programme.
• Health: global internal wellbeing programme and access to wellbeing apps.
• Community: global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, and events and celebrations.