Observability Platform Engineer

Description

The company is building an internal observability platform used by hundreds of engineering teams across the business, so they can see and run their services from one place.

The platform brings together telemetry, dashboards, alerts, service health and operational insight. It uses OpenTelemetry, Cribl, ClickHouse, Grafana and Redis, with links to Datadog, BigPanda and other tools where needed.

Cribl sits at the centre of the telemetry pipeline for routing and normalising data, so much of your time will go into designing and evolving Cribl pipelines that move and shape data across the platform.

This is a product engineering role focused on delivering backlog features end to end. It is not an operations or support role.

Responsibilities

• Design, build and maintain Cribl pipelines that route, normalise, enrich and filter telemetry and send it to several destinations.
• Create and manage Cribl packs so pipeline logic is consistent across teams and signal types.
• Deliver backlog features and improvements, covering design, implementation, testing and documentation.
• Build and maintain OpenTelemetry collector configurations for metrics, logs, traces and events.
• Design and evolve ClickHouse schemas for telemetry storage and query speed.
• Build Grafana dashboards and alerts for the platform and for user teams.
• Build integrations with Datadog, BigPanda and other downstream systems using APIs and automation.
• Write Terraform infrastructure-as-code for platform components and integrations.
• Help build and improve CI/CD pipelines and GitOps workflows with the DevOps engineer.
• Review code, apply engineering standards and help keep the engineering culture healthy.
• Improve platform documentation, onboarding guides and self-service processes so teams need less direct support.
• Collaborate with colleagues across several locations and time zones.

Requirements

• Hands-on Cribl experience building and running pipelines, routes and packs in production.
• A track record of shipping production-quality features as part of a team in software or platform engineering.
• Solid software engineering basics: readable code, testing, version control and taking part in code reviews.
• Experience building integrations with REST APIs or event-driven patterns.
• Familiarity with Terraform infrastructure-as-code and CI/CD pipeline tooling.
• Understanding of telemetry concepts, including metrics, logs, traces, cardinality, retention and pipeline design.
• Ability to work from a product-style backlog and ask proactively about requirements and acceptance criteria.
• Optional: experience with CriblCloud or Cribl Edge deployment patterns.
• Optional: experience building or contributing to internal platforms used by several engineering teams.
• Optional: experience with ClickHouse SQL or similar columnar or analytical query languages.
• Optional: familiarity with cloud or hybrid on-premises and cloud deployment patterns.
• Optional: experience with GitOps workflows and practices.
• Optional: experience in a regulated, financial services or large enterprise technology environment.

Conditions

Senior Associate career stage.

Work spans multiple locations and time zones.

We welcome applicants from all backgrounds and career paths, and do not discriminate on any protected basis; reasonable accommodation is available for religious practices and for mental health or physical disability needs.

Benefits

• Healthcare, retirement planning, paid volunteering days and wellbeing initiatives.
• The chance to build a platform that changes how a large global enterprise runs its systems.
• Work at the London Stock Exchange Group, a global financial markets infrastructure and data provider with around 25,000 people in 65 countries.
• Access to the company Foundation, which gives grants to community groups, and opportunities to fundraise and volunteer.