You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Be the first to open itNo views yet
Company hidden

Member of Technical Staff

  • Office
  • 6+ years

Salary

$150,000 - 200,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

Read This First

We work with unusual intensity. In-person in San Francisco, six days a week, long days, most weekends. This is not a phase we'll grow out of. It's how we've chosen to build, because we're in a market where speed decides who wins.

We're telling you this in the first paragraph, not the last, because we only want people who read that and feel pulled in, not talked into it. If you want a 9-to-5 (genuinely, no judgment), this isn't your role, and we'd rather you know now.

Here's what you get in exchange:

Top-of-market cash. We don't pay average salaries and ask for extraordinary hours. The comp reflects the commitment.

Meaningful equity you can believe in. Significant grants, employee-friendly terms, and our intent to create liquidity opportunities as we raise.

Zero commute tax. We support you living close to the office, with dinner at the office every night. Your hours go into building, not commuting.

Founders in the trenches. We work the same schedule we ask of you. This is a shared war, not extraction.

Compression of a decade into two years. You'll ship more, own more, and grow faster here than anywhere paying you to coast.

About the company

The company is building the voice AI engineer. Teams use the company to test agents before going live, monitor real production calls, and self-improve continuously. The company doesn't just flag issues and suggest fixes: it reproduces failures in simulation, fixes them, tests the fix thoroughly, and raises PRs. The platform spans pre-production simulation, LLM-powered evaluation, adversarial red-teaming, production monitoring with live drift detection, and cross-provider benchmarking (Vapi, Retell, Pipecat, LiveKit, ElevenLabs, and more).

About the Role

You'll build the core of the company: the simulation engines, evaluation systems, self-improvement loops, and observability pipelines our customers rely on to ship voice agents with confidence.

We deliberately don't split this into "software engineer" vs. "AI engineer." The interesting problems live at the boundary: real-time voice infrastructure meets LLM-as-judge evaluation, distributed systems meet RL-style self-improvement loops, telephony meets audio and speech analysis (ASR quality, barge-in, latency, prosody), and classic NLP meets frontier agentic behavior. You'll work across that whole surface.

Responsibilities

  • Build the testing and simulation engine. Design and ship systems that simulate thousands of realistic conversations against customer agents across voice, chat, and phone, with control over personas, interruptions, background noise, and edge cases.
  • Push the frontier of agent evaluation. Build LLM-powered evaluators, metrics, and the closed self-improvement loop at the heart of the product: detect failure, reproduce in simulation, generate the fix, test it thoroughly, and raise the PR, all autonomously. This includes adversarial red-teaming for jailbreaks, PII leaks, and off-script behavior, plus production monitoring with live drift detection.
  • Do applied audio and speech research. Go beyond the transcript. Separate background noise from actual speech, and map the paralinguistic layer of conversation (emotion, tone, silences, hesitations, speaking rate, overlaps) into structured signals, so agents are evaluated on how something was said, not just what.
  • Own real-time voice infrastructure. SIP, WebRTC, WebSockets, STT/TTS pipelines, and providers like Twilio, Vapi, Retell, LiveKit, and Pipecat. Latency, barge-in, and audio quality are first-class problems here.
  • Ship end-to-end. Take features from design to production. You own the full stack of what you build: backend, infra, evals, and the product surface customers touch.
  • Shape how we build. We're a small, senior team. Your architectural decisions, code standards, and technical taste will compound as the team grows.

Requirements

  • A strong generalist engineer excited to work across systems and AI, not someone looking to stay in one lane.
  • You've built and operated production systems and care about reliability, latency, and correctness.
  • Fluent in Python and comfortable picking up whatever the problem needs.
  • Strong instincts about LLMs: where they fail, how to evaluate them, how to build reliable systems on unreliable models.
  • You like ambiguity, move fast, and raise the bar for the people around you.
  • You've read the first section of this JD twice and you're still here.
  • Bonus: you're an ex-founder or aspire to be one.
  • Minimum Qualifications
  • Strong coding ability in Python, TypeScript, or Go.
  • Experience with at least one of: distributed systems, real-time infrastructure, or LLM-based products.
  • Strong written and verbal communication.
  • Hands-on experience with LLM evals, agent frameworks, or AI observability.
  • Voice AI experience: Twilio, SIP, WebRTC, Vapi, Retell, LiveKit, Pipecat, or STT/TTS pipelines.
  • Early-stage startup experience, or early engineer at a dev-tool, infra, or AI company.
  • Open-source contributions or public technical work.
  • This Is Not for You If
  • You want a narrowly scoped role or a fixed tech stack.
  • You prefer working only on models, or only on infrastructure, never both.
  • You need rigid processes or heavy structure.
  • You're optimizing for work-life balance right now. (Later in your career, maybe. Here, now, no.)
  • You don't want to work in-person in San Francisco.
  • Why the company
  • The hardest problems in AI agent reliability: simulation, voice evals, real-time voice at scale.
  • Work directly with founders and a highly technical team.
  • Meaningful equity, top-of-market compensation, fast growth.
  • US visa sponsorship available.
  • Medical, dental, vision, daily lunches and dinners, relocation support to live near the office.
  • Experience: Any (new grads ok)
  • Visa: Will sponsor

Where you’d work

From the office

The office

Relocation offered

Visa sponsored

About the company

Company hidden

  • Industry: AI

Office in San Francisco, United States

Your chances

Still hiring, moderately crowded, and a person reads your message.

  • 20 checks run
  • 8 good signs
  • 4 red flags

Still hiring?

12 checks

Actively hiring

In its favour4

  • Still on the company's own careers site, checked 4 h agoModerate evidence
  • Specific about the basics: pay, place, level, stack and contract all statedSlight evidence
  • States its salarySlight evidence
1 moreFewer
  • A hiring contact is attached to itSlight evidence

Against it1

  • Posted 6 weeks ago, older than 90% of the open roles we trackModerate evidence

How crowded?

8 checks

Moderate

In its favour4

  • You can message the hiring contact and skip the queueModerate evidence
  • In the office in San Francisco: only people nearby can take itSlight evidence
  • Senior level: far fewer people qualifySlight evidence
1 moreFewer
  • Pays below most similar roles, which thins the crowdSlight evidence

Against it3

  • Open for 6 weeks: applications have had time to pile upModerate evidence
  • Offers relocation: people from other countries apply tooSlight evidence
  • Sponsors visas: applicants from abroad compete for it tooSlight evidence
74 roles like this are in their Early WindowFound before the big job boards, while the crowd hasn’t arrived

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details15 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • TypeScript
  • Python
  • Go
  • LLMs
Seniority
Staff
Type
Full-time
Equity
Equity offered
Industry
AI
Specialty
Backend
Show 9 more factsShow less

Role

Category
Development
Specialty
Backend
Seniority
Staff
Experience
6+ years
Tech stack
  • TypeScript
  • Python
  • Go
  • LLMs

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States
Relocation
Offered
Visa sponsorship
Sponsored

Compensation

Salary
$150,000 - 200,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Staff Software Engineer

    Salary by agreement

    • Remote · Europe, Portugal
    • Senior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Senior Software Engineer

    Salary by agreement

    • Remote
    • Senior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Software Engineer

    Salary by agreement

    • Hybrid · Toronto
    • Junior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Senior Software Engineer

    €85,000 - 140,000 / year

    • Office · Ireland
    • Senior
    Direct apply

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason