You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Software Engineer II

  • Office
  • 0-3 years

Salary

Not stated

Similar roles pay £90K - 130K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company is a global ad-tech firm, the largest independent platform for digital advertising, with more than 3,000 staff across over 30 offices. Its technology lets advertisers reach audiences across the open web, including streaming TV, podcasts, mobile apps and news sites.

The DataProc team runs the platform that schedules, orchestrates and processes the company's data at scale. Workflow scheduling runs on Airflow and TaskService, and distributed compute runs on Spark across Amazon EMR, Kubernetes and Databricks. Most engineering teams build on what this team ships, so its reliability and speed affect the whole business.

Engineers here own work from design through delivery on data products. The platform serves global traffic around the clock, and the team builds distributed systems together, using a wide mix of technologies to solve problems in algorithms, performance and scale.

Responsibilities

  • Build, run and improve the services and libraries behind data orchestration and workflows (Airflow, TaskService), which teams across the company depend on.
  • Write, scale and tune distributed Spark jobs that run on Amazon EMR, Kubernetes and Databricks.
  • Work with other engineering teams to move big data workloads, such as shifting jobs to Databricks or from EMR to Spark on Kubernetes.
  • Raise platform reliability and visibility through metrics, alerts, tracing (OpenTelemetry) and on-call tooling.
  • Create internal tools and light UIs that let engineers monitor, debug and run their pipelines.
  • Take projects from design and code review through deployment, rollout and production support.
  • Find and fix complex faults in large, distributed production systems.
  • Help shape the technical roadmap and set data pipeline practices for the whole company.

Requirements

  • Solid software engineering basics and production experience in Python, Scala or Java.
  • Experience building or running distributed data systems (such as Spark, Databricks or Hadoop) or workflow tools (such as Airflow).
  • Working knowledge of cloud infrastructure (AWS, Kubernetes) and CI/CD pipelines.
  • Strong grasp of data structures, algorithms and distributed systems design.
  • Strong debugging skills and a record of fixing issues in large production systems.
  • Some experience with, or interest in, building internal tools, dashboards or light UIs.
  • Clear communication and a willingness to work with engineering teams to understand their needs and remove blockers.
  • A pragmatic approach that takes ownership of building and running software.
  • 2+ years of software development or engineering experience.
  • A bachelor's or master's degree in computer science or a related engineering field, or equivalent experience. Degree level does not limit consideration.
  • Not every item above is required. Candidates who meet most of them are more likely to succeed in the role.
  • Nice to have: SQL and data warehousing (such as Snowflake or Vertica).
  • Nice to have: Kubernetes operators and cluster administration.
  • Nice to have: observability tools (OpenTelemetry, Grafana, Prometheus).
  • Nice to have: carrying production on-call duties for critical systems.
  • Nice to have: exposure to machine learning pipelines or ad-tech and real-time bidding systems.
  • You do not need to know every technology the team uses on day one. What matters most is how quickly you learn and how well you find solutions with the right tools.

Conditions

Equal opportunity employer.

Where you’d work

From the office

About the company

Company hidden

Office in London, United Kingdom

Your chances

Still hiring, not crowded yet, and you'd be among the first.

  • 15 checks run
  • 5 good signs
  • 0 red flags

Still hiring?

10 checks

Actively hiring

In its favour2

  • Still on the company's own careers site, checked 1 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence

How crowded?

5 checks

Low

In its favour3

  • In its Early Window: not on the big job boards yetStrong evidence
  • In the office in London: only people nearby can take itSlight evidence
  • Asks for Scala, which only 1% of open roles doSlight evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details9 facts · Role, Location, Compensation
Tech stack
  • Python
  • Java
  • SQL
  • AWS
  • Kubernetes
  • Scala
  • CI/CD
Specialty
Backend
Region
United Kingdom
Pay period
Annual
Show 5 more factsShow less

Role

Category
Development
Specialty
Backend
Experience
2+ years
Tech stack
  • Python
  • Java
  • SQL
  • AWS
  • Kubernetes
  • Scala
  • CI/CD

Location

Work model
Office
Region
United Kingdom
Office
  • London, United Kingdom

Compensation

Salary
Salary by agreement
Pay period
Annual

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason