You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Mercor

Sr. Machine Learning Engineer, Anonymization

  • Office
  • 6+ years

Salary

$180,000 - 500,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds infrastructure that lets frontier AI labs and enterprises train, evaluate, and improve AI on real professional work, using expert knowledge. It has over 5 million experts in its network and pays out more than $5 million a day to them.

The company has built training and evaluation systems with leading AI labs and now offers the same capabilities to businesses in many industries, so they can shape AI around their own expertise and standards. Its benchmarks measure how AI performs on work that has economic value.

The company is profitable and recently raised a $750 million Series D at a $20 billion valuation.

This role is for the ML systems behind the company's frontier data products. These systems score, check, and improve complex work where answers are seldom simply right or wrong and labels are often noisy, late, or contested. A single job can remain active for days, moving between model inference, automated checks, expert review, dispute resolution, and feedback. Your work shapes how models handle ambiguous inputs, when they hand off to humans, how quality gets measured, and how feedback improves the system over time.

This is applied ML product engineering with real production limits: incomplete ground truth, changing requirements, latency and cost tradeoffs, and workflows where a model failure that goes unnoticed corrupts the final output. It is not an offline benchmarking role.

Responsibilities

  • Build ML systems that score, check, and improve complex work products where correctness is subtle and labels are imperfect.
  • Design evaluation frameworks for ambiguous tasks where ground truth is partial, late, or contested.
  • Build feedback loops that turn reviews, disagreements, corrections, and final rulings into measurable gains in model and system quality.
  • Own production ML behavior from start to finish, including precision and recall tradeoffs, regression detection, drift, latency, cost, and explainability.
  • Improve model quality with whichever tool fits: prompting, fine-tuning, retrieval, active learning, heuristics, or error analysis.
  • Work with backend engineers to put inference into durable, long-running workflows while keeping them debuggable and under human oversight.
  • The architecture is still open, so early engineers will decide how quality is measured, how models and people work together, where automation can be trusted, and how the system improves over time.
  • Changes to model behavior reach customers quickly and visibly, so the feedback loop is short.
  • You will work across models, data, backend systems, and product surfaces, switching context often.
  • You will debug production ML failures in live, long-running workflows where silent errors do real harm.
  • You will work closely with backend engineers on a stack of Python, Temporal, Postgres, AWS, and LiteLLM.
  • You will balance automation confidence against human review, knowing when to hand off matters as much as knowing when to ship.

Requirements

  • You have shipped ML systems that improved a real product, workflow, or business metric.
  • You have a strong sense of model quality, evaluation design, error analysis, and how production systems fail.
  • You are comfortable in ambiguous problem spaces where labels are imperfect and correct answers change over time.
  • You use good judgment about when to use prompting, fine-tuning, heuristics, retrieval, human review, or a simpler product constraint.
  • You have solid engineering fundamentals across the whole ML stack, not only modeling.
  • You have 4+ years of experience.
  • You prefer simple, inspectable ML systems that improve quickly and fail in ways that are easy to understand, over the most impressive architecture.
  • You are uneasy when a model ships without a clear evaluation plan.
  • You can work with ambiguity without freezing and make sensible calls with incomplete information.
  • You care about what the system produces for real users, not only benchmark scores.
  • A strong plus: experience with LLM applications, model-assisted workflows, evaluation frameworks, or human-in-the-loop ML.

Conditions

The role is full time in person, 5 days a week, in San Francisco, New York, or London.

The company is an equal opportunity employer and does not discriminate or allow harassment or retaliation based on any protected characteristic under federal, New York, or local law.

Benefits

  • Generous equity grant vesting over 4 years.
  • Health, dental, and vision insurance.
  • 401(k) with company match.
  • Unlimited paid vacation and sick days.
  • Parental leave for birthing and non-birthing parents.
  • Free mental health services.
  • $200 monthly wellness reimbursement.
  • $1.5K monthly meal stipend.
  • $200 monthly laundry reimbursement.
  • Free Equinox membership.
  • Relocation bonus of up to $15K.

Where you’d work

From the office, 4 or more days a week in the office

The office

Relocation offered

About the company

Mercor

  • Industry: AI

Office in New York City, United States

Also hiring in New York, United States, San Francisco, United States and United States

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 23 checks run
  • 4 red flags

Still hiring?

14 checks

2 red flags

How crowded?

9 checks

2 red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details15 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • PostgreSQL
  • AWS
  • LLMs
Seniority
Senior
Type
Full-time
Equity
Equity offered
Industry
AI
Specialty
ML
Show 9 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Seniority
Senior
Experience
4+ years
Tech stack
  • Python
  • PostgreSQL
  • AWS
  • LLMs

Location

Work model
Office
Region
United States
Office
  • New York City, United States
Days in the office
4 or more days
Relocation
Offered

Compensation

Salary
$180,000 - 500,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason