You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Capco

Senior Azure Data Engineer (Databricks)

  • Hybrid
  • 6+ years

Salary

Not stated

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

Build advanced data solutions at scale as part of a consulting team.

Work on high-impact technology for Tier 1 financial institutions.

The company is a flat, entrepreneurial consultancy that invests in continuous learning, training and industry certifications.

You will join a team helping shape digital financial services and digital transformation across financial services and energy.

You must be able to work three days a week on a client site in Edinburgh or Glasgow.

Responsibilities

  • Design, build and deploy secure, scalable data engineering pipelines on Databricks in Azure, working hands-on.
  • Meet with clients to understand their data needs and design solutions that transform their business.
  • Help introduce best practices and keep improving within cross-functional engineering teams.
  • Build pipelines with DeltaLake, Spark Structured Streaming and Unity Catalog.
  • Create real-time, event-driven solutions using tools such as Kafka and Azure Event Hubs.
  • Apply DevOps principles to build CI/CD pipelines with Azure DevOps, Jenkins or GitHub Actions.
  • Work with clients and stakeholders to turn data needs into technical strategy.
  • Promote clean code, data lifecycle optimisation and sound software engineering practice.

Requirements

  • Proven hands-on experience with the Databricks platform and orchestration.
  • Strong Python, PySpark and SQL skills, with knowledge of distributed data systems.
  • Experience building full lifecycle pipelines across ingestion, transformation and serving layers.
  • Experience with data lakehouse architecture, schema design and GDPR-compliant solutions.
  • Working knowledge of DevOps tools and CI/CD processes.
  • Bonus: development experience in Scala or Java.
  • Bonus: familiarity with Cloudera, Hadoop, HIVE and the Spark ecosystem.
  • Bonus: understanding of data privacy regulations, including GDPR, and experience with sensitive data.
  • Bonus: ability to learn and adapt to new technologies quickly to meet business needs.
  • Bonus: a collaborative mindset and curiosity about innovation and continuous learning.

Conditions

Based in the Scotland office, with potential work in Edinburgh or Glasgow depending on client expectations.

Flexibility to work three days per week on a client site in Edinburgh or Glasgow is required.

Adjustments are available at any stage of recruitment on request.

Benefits

  • Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover.
  • Access to CareFirst, Unmind and Aviva consultations, plus in-house first aiders.
  • Maternity, adoption and shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause and bereavement.
  • 8 complimentary backup care sessions for emergency childcare or elder care.
  • 5 weeks of annual leave, with the option to buy or sell holiday days.
  • Minimum 40 hours of training each year, through workshops, certifications or e-learning.
  • A business coach assigned from day one.
  • Online GP services.
  • Gympass (Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work and dental insurance.

Where you’d work

Part of the week in the office

You can work from

  • United Kingdom

About the company

Capco

Office in Glasgow, United Kingdom

Also hiring in London, United Kingdom, Brussels, Belgium, Toronto, Canada and 11 more places

2 of their 51 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 19 checks run
  • 1 red flag

Still hiring?

13 checks

1 red flag

How crowded?

6 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details11 facts · Role, Location, Compensation
Tech stack
  • Python
  • SQL
  • Kafka
  • Azure
  • Spark
  • Databricks
Seniority
Senior
Specialty
Data Engineering
Region
United Kingdom
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Senior
Experience
6+ years
Tech stack
  • Python
  • SQL
  • Kafka
  • Azure
  • Spark
  • Databricks

Location

Work model
Hybrid
Region
United Kingdom
Office
  • Glasgow, United Kingdom
Remote from
  • United Kingdom

Compensation

Salary
Salary by agreement
Pay period
Annual

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason