You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Senior Backend Engineer

  • Office
  • 6+ years

Salary

$200,000 - 260,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company's open-source AI gateway is the most widely used of its kind. Large firms including Adobe, Netflix, NASA and NVIDIA send their LLM traffic through its code, so a defect reaches them directly.

The work centres on the proxy's routing, auth, caching, spend tracking, guardrails and observability, which must behave correctly and quickly at 1B+ requests a month.

You'll be on the critical path for some of the largest companies in the world and will have real ownership of core systems on a small, senior-leaning team.

Responsibilities

  • Take full ownership of core proxy components, from design through production, including their incidents.
  • Eliminate whole categories of defects such as race conditions, stale cache state across replicas, and errors swallowed before users see them.
  • Make sure each guardrail and policy check, including applyguardrail, is logged, traceable and raises errors visibly when it should.
  • Build guardrails that run inside the gateway and stop common attacks on LLM APIs, MCP servers and agents.
  • Keep Datadog, Splunk, Prometheus and OpenTelemetry integrations accurate at 1B+ requests a month, with little added latency and no leaks such as runaway Prometheus metric cardinality.
  • Help move performance-critical paths from Python to Rust without changing behavior.
  • Set the team's standards for code review, testing and debugging.

Requirements

  • 2+ years of backend work in production, including real ownership of a mission-critical system such as payments, gateways, core APIs, data stores, or any service where downtime hurts customers.
  • Strong Python and experience with async or high-throughput services, using asyncio, FastAPI or similar.
  • A proven record of improving production reliability through code, via refactors, re-architectures, migrations, or permanent root-cause fixes.
  • Excellent debugging across services, Postgres and Redis databases, and distributed systems.
  • High ownership: you answer for the customer impact of what you ship.
  • BS/MS in Computer Science or a related field, or equivalent proof of exceptional ability.
  • Rust, Go or C++ used in production.
  • Experience at a fast-growing startup with a large, real codebase.
  • Experience with LLM APIs, proxies or API gateways.
  • Open-source contributions.

Conditions

Based onsite in San Francisco.

Base pay of $220k-$260k.

Benefits

  • Equity.
  • Health, dental and vision coverage.

Where you’d work

From the office

The office

About the company

Company hidden

Office in San Francisco, United States

Your chances

Still hiring, not crowded yet, and you'd be among the first.

  • 17 checks run
  • 8 good signs
  • 1 red flag

Still hiring?

11 checks

Actively hiring

In its favour4

  • Still on the company's own careers site, checked 1 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence
  • Specific about the basics: pay, place, level, stack and contract all statedSlight evidence
1 moreFewer
  • States its salarySlight evidence

Against it1

  • Listed again after an earlier listing of the same role closedModerate evidence

How crowded?

6 checks

Low

In its favour4

  • In its Early Window: not on the big job boards yetStrong evidence
  • In the office in San Francisco: only people nearby can take itSlight evidence
  • Senior level: far fewer people qualifySlight evidence
1 moreFewer
  • Asks for Redis, which only 1% of open roles doSlight evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • Go
  • PostgreSQL
  • C++
  • Rust
  • Redis
  • LLMs
Seniority
Senior
Type
Full-time
Equity
Equity offered
Specialty
Backend
Region
United States
Show 6 more factsShow less

Role

Category
Development
Specialty
Backend
Seniority
Senior
Experience
2+ years
Tech stack
  • Python
  • Go
  • PostgreSQL
  • C++
  • Rust
  • Redis
  • LLMs

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States

Compensation

Salary
$200,000 - 260,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason