You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Preference Model

Member of Technical Staff - Research Engineer, RL Environments

  • Office
  • 6+ years

Salary

$200,000 - 350,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds RL environments for training AI systems that are more capable and better aligned.

Model behavior depends largely on the reward signals used in training. Models often fail to do what people intend, either because they lack capability or because they are misaligned, and both trace back to training objectives.

The team tackles this by improving how RL environments are built, aiming at today's models and at future systems that far exceed human ability.

Over the past year the company has built RL environments for several frontier labs and raised $16M in seed funding led by a16z. Its founders previously built data infrastructure and datasets on the data team at Anthropic, including data behind a leading AI assistant.

You would join the Capabilities org, a small, high-ownership team working on the data layer behind frontier LLM capability.

Responsibilities

  • Design and implement RL environments and reward functions that give frontier models clear, learnable signals on ML research and engineering tasks.
  • Own the environments you build from start to finish, with full autonomy over them.
  • Run experiments and evaluations, and move your work into production training runs.
  • Stay current with the latest research, develop new approaches, and turn them into working code.
  • Build deep knowledge across frontier ML research, training, and inference infrastructure.
  • Work with colleagues to generate ideas and build tools that improve how environments are created.

Requirements

  • 5+ years of experience in machine learning or research, mainly on LLMs and transformer models.
  • Strong ML fundamentals and wide research interests. You read widely, understand topics in depth, and can turn them into RLVR problems.
  • Proficiency in Python and systems programming, plus at least one of PyTorch or JAX.
  • Take ownership and drive solutions from start to finish.
  • Keep up with fast-changing ML infrastructure.
  • Meet throughput expectations and respond quickly to feedback.
  • You may be a good fit if you also have expert knowledge of an active DL/ML research area, shown through publications or public code. Research experience (PhD, MS) is a big plus.
  • You may be a good fit if you also understand transformer internals, training and inference of modern LLMs, and have used inference libraries such as vLLM or SGLang.
  • You may be a good fit if you also have strong kernel development skills in CUDA, Triton, or Pallas.
  • You may be a good fit if you also have built complex interactive RL environments.

Conditions

This role is only for experienced ML engineers. A separate opening exists for new grads.

The company welcomes diverse backgrounds, and you are encouraged to apply even if you do not meet every listed requirement.

Benefits

  • Competitive cash and equity compensation, above the 90th percentile.
  • Ownership and autonomy in a fast-moving startup.
  • The chance to work with top machine learning engineers.
  • Health, vision, and dental benefits.
  • 401K match.
  • Lunch provided every day onsite.
  • Weekly snack orders.
  • Visa sponsorship and relocation support available.

Where you’d work

From the office

The office

Relocation offered

Visa sponsored

About the company

Preference Model

  • Industry: AI

Office in San Francisco, United States

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 23 checks run
  • 4 red flags

Still hiring?

14 checks

1 red flag

How crowded?

9 checks

3 red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details15 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • PyTorch
  • LLMs
  • CUDA
Seniority
Staff
Type
Full-time
Equity
Equity offered
Industry
AI
Specialty
ML
Show 9 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Seniority
Staff
Experience
5+ years
Tech stack
  • Python
  • PyTorch
  • LLMs
  • CUDA

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States
Relocation
Offered
Visa sponsorship
Sponsored

Compensation

Salary
$200,000 - 350,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason