You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Member of Technical Staff

  • Office
  • 6+ years

Salary

$200,000 - 300,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company is a small AI infrastructure team that works on making inference for LLMs faster and more energy-efficient.

You will build and run systems that serve open-source models on many kinds of hardware, from low-level optimization through to production.

Responsibilities

  • Bring new open-source models into service and tune each one for response time and how much it can process at once.
  • Improve the serving stack through batching, KV cache handling, speculative decoding, and quantization.
  • Write and tune GPU kernels in CUDA, HIP, and Triton for mixed hardware.
  • Set up, deploy, and maintain clusters that combine hardware from several vendors.
  • Keep production inference running reliably, with better monitoring and a lower cost per token.
  • Talk with customers to learn what they need and fix their infrastructure problems.

Requirements

  • You have 1 to 6 years in backend, infrastructure, or systems work, including low-level engineering beyond application code.
  • You understand computer architecture, the memory hierarchy, and operating system internals well.
  • You have worked with CUDA, Triton, or GPU programming. Experience with HIP and heterogeneous accelerators is useful.
  • You know how to optimize ML inference, for example through quantization, batching, KV caching, or speculative decoding.
  • You have deployed or run infrastructure at scale, such as clusters or large GPU fleets.
  • You have strong computer science fundamentals and have shown ownership, fast learning, or achievement on hard technical problems.
  • You are comfortable using AI coding tools to improve how engineering gets done and talking with customers.
  • Early-career candidates and new graduates with relevant internships are welcome to apply.

Conditions

Base salary is $200,000 to $300,000 per year.

Visa sponsorship is available.

The role is on-site in San Francisco, California, 5 days a week.

Where you’d work

From the office, 4 or more days a week in the office

The office

Visa sponsored

About the company

Company hidden

Office in San Francisco, United States

Your chances

Still hiring, not crowded yet, and you'd be among the first.

  • 19 checks run
  • 9 good signs
  • 3 red flags

Still hiring?

11 checks

Actively hiring

In its favour4

  • Still on the company's own careers site, checked 1 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence
  • Specific about the basics: pay, place, level, stack and contract all statedSlight evidence
1 moreFewer
  • States its salarySlight evidence

Against it1

  • Listed for the 19th time after earlier listings of it closedModerate evidence

How crowded?

8 checks

Low

In its favour5

  • In its Early Window: not on the big job boards yetStrong evidence
  • In the office in San Francisco: only people nearby can take itSlight evidence
  • In the office 4 or more days a week: most applicants want lessSlight evidence
2 moreFewer
  • Senior level: far fewer people qualifySlight evidence
  • Asks for CUDA, which only 1% of open roles doSlight evidence

Against it2

  • Sponsors visas: applicants from abroad compete for it tooSlight evidence
  • Pays more than 83% of similar roles: that draws applicantsSlight evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details13 facts · Role, Location, Compensation, Employment
Tech stack
  • LLMs
  • CUDA
Seniority
Staff
Type
Full-time
Specialty
Backend
Region
United States
Pay period
Annual
Show 7 more factsShow less

Role

Category
Development
Specialty
Backend
Seniority
Staff
Experience
6+ years
Tech stack
  • LLMs
  • CUDA

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States
Days in the office
4 or more days
Visa sponsorship
Sponsored

Compensation

Salary
$200,000 - 300,000 / year
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason