You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Databricks

Sr. Research Scientist - Agent Flywheel

  • Office
  • 6+ years

Salary

$164,000 - 235,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company is building the models and agents that help enterprises get value from their own data, spanning model training through multi-agent systems.

You will join a small, fast-moving team of researchers from varied backgrounds and turn your findings into products customers use.

The Agent Flywheel team works on the context layer for agent self-improvement, using raw production session traces from the company's data agents.

Posting reference: P-1213.

Responsibilities

  • Turn raw production session traces from Genie Code and Genie One into online signals that agents can optimize against.
  • Train and calibrate LLM judges so model feedback is reliable and repeatable, including calibrating against expert human ratings.
  • Convert multi-turn agent trajectories into datasets and reward signals for post-training, linking production signals, evaluation and agent improvement.
  • Design benchmarks and RL environments from real customer workloads that test long-horizon, tool-using agent behavior.
  • Advance evaluation research: online evals on live traffic, automated raters, verifiable rewards, and measurement that keeps up with agents that act.
  • Track the latest deep learning work and build new techniques that go beyond the current state of the art.

Requirements

  • Skill at debugging and diagnosing failures in complex, stochastic, multi-component systems.
  • Strong instinct for designing metrics and evals that measure what matters, and for doubting noisy, sparse or biased signals.
  • Experimental rigor and causal reasoning, from offline ablations to online experiments.
  • A drive to turn measurement into improvement, moving from signals to changes that shift the numbers.
  • Solid AI research and software engineering skills.
  • Strong communication skills and enthusiasm for working on a small, fast-moving team.
  • A drive to get your work into the hands of real users.
  • Experience with agent systems, such as coding agents, long-horizon tool-using agents, or building evaluation environments.
  • A record of novel research on learning from feedback, such as post-training, RLHF or reward modeling.

Conditions

Pay is set fairly. The expected salary range for this role is $164,000 to $235,000 USD, and the offer depends on factors such as skills, depth of experience, certifications, training and work location. The company expects to use the full range. Total compensation may include an annual performance bonus, equity and the benefits below.

The company is an equal opportunity employer and considers applicants regardless of protected characteristics.

If the role needs access to export-controlled technology or source code, the company decides at its discretion whether to seek a U.S. government license, and may decline an applicant on that basis alone.

Benefits

  • Comprehensive benefits and perks, with details available for each region.

Where you’d work

From the office

The office

About the company

Databricks

Office in New York City, United States

Also hiring in United States, New York, United States, Germany and 27 more places

23 of their 122 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 1 red flag

Still hiring?

14 checks

No red flags

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details11 facts · Role, Location, Compensation
Tech stack
  • LLMs
  • Databricks
Seniority
Senior
Equity
Equity offered
Specialty
Data Science
Region
United States
Pay period
Annual
Show 5 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Science
Seniority
Senior
Experience
6+ years
Tech stack
  • LLMs
  • Databricks

Location

Work model
Office
Region
United States
Office
  • New York City, United States

Compensation

Salary
$164,000 - 235,000 / year
Pay period
Annual
Equity
Equity offered

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason