You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Software Engineer

  • Office

Salary

$260,000 - 290,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The team builds datasets, evaluation rubrics, and infrastructure that help make advanced AI models better. You will work alongside research teams to run experiments, find the ways models fail, and convert training goals into working data and evaluation systems.

Responsibilities

  • Design data slices that expose meaningful model failures in finance, code, and enterprise workflows.
  • Build and improve evaluation rubrics and reward signals for RLHF and RLVR pipelines.
  • Study how annotators behave and run experiments aimed at stronger model capabilities.
  • Create quantitative measures of dataset quality, diversity, and effect on alignment and capabilities.
  • Set up and maintain real-world and synthetic data pipelines.
  • Work with AI research teams to turn training goals into concrete data and evaluation specs.

Requirements

  • You have 1 to 4 years of software engineering experience building reliable data pipelines, experiment infrastructure, or evaluation systems.
  • You write strong Python and have shipped software and infrastructure.
  • You have hands-on work with LLM evaluations, post-training, reward modeling, RLHF, RLVR, or related ML infrastructure.
  • You have created or assessed datasets, judging quality, diversity, coverage, and downstream model performance.
  • You reason well about experiments: you form hypotheses, define metrics, design controlled tests, and read noisy results.
  • You have designed data collection strategies and evaluation rubrics for machine learning models.

Conditions

Base salary is $260,000 to $290,000 per year.

Visa sponsorship is available.

The role is on-site in San Francisco, California.

Where you’d work

From the office

The office

Visa sponsored

About the company

Company hidden

Office in San Francisco, United States

Your chances

Still hiring, not crowded yet, and you'd be among the first.

  • 18 checks run
  • 5 good signs
  • 2 red flags

Still hiring?

11 checks

Actively hiring

In its favour3

  • Still on the company's own careers site, checked 1 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence
  • A tight salary range, set for one seat: $260K to $290KSlight evidence

Against it1

  • Listed for the 5th time after earlier listings of it closedModerate evidence

How crowded?

7 checks

Low

In its favour2

  • In its Early Window: not on the big job boards yetStrong evidence
  • In the office in San Francisco: only people nearby can take itSlight evidence

Against it1

  • Sponsors visas: applicants from abroad compete for it tooSlight evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details10 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • LLMs
Type
Full-time
Specialty
ML
Region
United States
Pay period
Annual
Show 5 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Tech stack
  • Python
  • LLMs

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States
Visa sponsorship
Sponsored

Compensation

Salary
$260,000 - 290,000 / year
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason