You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Be the first to open itNo views yet
Company hidden

Member of Technical Staff

  • Office
  • 6+ years

Salary

$180,000 - 350,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company was a 1 person company from 0 → 10M of revenue.

Every employee should contribute >30M of revenue/yr to the company.

The best candidates would be top 1% at multiple parts of the inference stack, yet have breadth across the whole stack.

The company builds high margin inference infrastructure. Our stack spans kernels, model serving, routing, autoscaling, and capacity.

Responsibilities

  • Find the gap between theoretical hardware performance and production performance
  • Trace latency and throughput regressions from the API layer down to individual kernels
  • Optimize batching, scheduling, routing, quantization, and distributed execution
  • Work on new research directions around caching
  • Work with NVLink and RoCE
  • Validate that every optimization preserves model quality and correctness
  • You might be a fit if you
  • Have optimized complex production systems
  • Can juggle 8+ Codex/Claude/other coding agents concurrently
  • Understand GPU performance, memory bandwidth, collectives, and inference serving
  • Are strong in Python, CuTEdsl, and comfortable navigating unfamiliar codebases
  • Care about tokens per second, tokens per dollar, and correctness equally
  • You will work directly with the founders on problems that determine how efficiently frontier-scale models can be served. Small team, enormous compute, immediate production impact.
  • Experience: 6+ years
  • Visa: US citizen/visa only

Where you’d work

From the office

The office

No visa sponsorship

You must already be able to work in the United States

About the company

Company hidden

  • Industry: AI

Office in San Francisco, United States

Your chances

Still hiring, not crowded yet, and a person reads your message.

  • 19 checks run
  • 8 good signs
  • 2 red flags

Still hiring?

12 checks

Actively hiring

In its favour4

  • Still on the company's own careers site, checked 3 h agoModerate evidence
  • Specific about the basics: pay, place, level, stack and contract all statedSlight evidence
  • States its salarySlight evidence
1 moreFewer
  • A hiring contact is attached to itSlight evidence

How crowded?

7 checks

Low

In its favour4

  • You can message the hiring contact and skip the queueModerate evidence
  • In the office in San Francisco: only people nearby can take itSlight evidence
  • Only for people already authorized to work in United StatesSlight evidence
1 moreFewer
  • Senior level: far fewer people qualifySlight evidence

Against it2

  • Open for 2 weeks: applications have had time to pile upModerate evidence
  • Pays more than 88% of similar roles: that draws applicantsSlight evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details14 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
Seniority
Staff
Type
Full-time
Industry
AI
Specialty
Backend
Region
United States
Show 8 more factsShow less

Role

Category
Development
Specialty
Backend
Seniority
Staff
Experience
6+ years
Tech stack
  • Python

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States
Visa sponsorship
Not sponsored
Must already work in
  • United States

Compensation

Salary
$180,000 - 350,000 / year
Pay period
Annual

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Staff Software Engineer

    Salary by agreement

    • Remote · Europe, Portugal
    • Senior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Senior Software Engineer

    Salary by agreement

    • Remote
    • Senior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Software Engineer

    Salary by agreement

    • Hybrid · Toronto
    • Junior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Senior Software Engineer

    €85,000 - 140,000 / year

    • Office · Ireland
    • Senior
    Direct apply

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason