You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Be the first to open itNo views yet
Company hidden

Member of Technical Staff

  • Office
  • 6+ years

Salary

$165,000 - 325,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

What we do

The company Labs helps enterprises own the intelligence behind their most important workflows.

Every company has years of historical evidence showing how work gets done: the context people had, the decisions they made, the actions they took, and the outcomes that followed. Today, most of that history is inert. It isn’t structured in a way that companies can use to evaluate models and improve agent behavior.

The company turns this history into replayable environments and eval sets grounded in real workflows and observed outcomes. We use those environments to improve model performance through reinforcement learning and other post-training techniques, alongside context engineering, harness design, and agent engineering.

The result is better, more cost-efficient AI for each enterprise’s specific work, powered by open-weight models that the company owns and controls. This allows each company to retain ownership of its core intelligence instead of outsourcing it to a model provider.

Now we're growing the founding team

 

Responsibilities

  • At the center of the company Labs is a replayable environment engine for the enterpirse.
  • The system reconstructs a company’s world as it existed at a particular moment in the past then exposes that state through the same tools an agent would use in production. This lets us place new policies and agent configurations inside real historical environments, observe how they reason and act, and grade their performance against real outcomes.
  • You'll work across research, infrastructure, and production systems including:
  • Building an environment factory that converts recorded enterprise data and task definitions into runnable environments
  • Designing graders that turn ambiguous business objectives into verifiable rewards
  • Developing methods for mining useful tasks, trajectories, and evaluation cases from historical workflows
  • Creating eval sets that are representative, reproducible, and resistant to overfitting
  • Finding the right combinations of models, tools, context, and policies to maximize performance while reducing inference cost
  • Training and evaluating agents that operate over long horizons, incomplete information, and large tool spaces
  • Building replay and observability systems that make agent behavior explainable and measurable
  • Scaling from individual environments to thousands of concurrent training and evaluation runs
  • These problems are wide open. You’ll have significant ownership over both the research direction and the production systems that make it real.
  • You’ll work directly with the CTO, deploy into real enterprise workflows, and see your research tested against consequential problems and observable outcomes.
  •  

Requirements

  • You have 1-7 years of experience building production software or machine-learning systems (we're hiring at multiple levels for this role).
  • Bonus points for working on reinforcement-learning environments, LLM post-training, evaluation infrastructure, agent harnesses, or closely related systems
  • You understand how environment design, reward design, context, tooling, and policy behavior interact
  • You’re comfortable turning fuzzy business objectives into tasks and signals that can be evaluated reliably
  • You can diagnose whether a model’s limitations come from the model itself, its context, its tools, its harness, or its training
  • You can move between research questions and production implementation without treating them as separate jobs
  • You write strong software and can build systems that process large, messy datasets at scale
  • You care about reproducibility, observability, and understanding why a model behaves the way it does
  • You’re looking to do the best work of your life and build something you’ll be proud of for decades
  • We care much more about what you’ve built and how you think than credentials or conventional career paths.

Benefits

  • Significant equity and ownership
  • Equinox membership
  • Free meals, coffee, and snacks
  • Health insurance
  • Unlimited PTO
  • Experience: 3+ years
  • Visa: US citizen/visa only

Where you’d work

From the office

No visa sponsorship

About the company

Company hidden

  • Industry: AI

Offices in New York, United States, San Francisco, United States

Your chances

Still hiring, moderately crowded, and a person reads your message.

  • 18 checks run
  • 6 good signs
  • 2 red flags

Still hiring?

12 checks

Actively hiring

In its favour4

  • Still on the company's own careers site, checked 4 h agoModerate evidence
  • Specific about the basics: pay, place, level, stack and contract all statedSlight evidence
  • States its salarySlight evidence
1 moreFewer
  • A hiring contact is attached to itSlight evidence

Against it1

  • Posted 5 weeks ago, older than 81% of the open roles we trackModerate evidence

How crowded?

6 checks

Moderate

In its favour2

  • You can message the hiring contact and skip the queueModerate evidence
  • Senior level: far fewer people qualifySlight evidence

Against it1

  • Open for 5 weeks: applications have had time to pile upModerate evidence
32 roles like this are in their Early WindowFound before the big job boards, while the crowd hasn’t arrived

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details14 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • LLMs
Seniority
Staff
Type
Full-time
Equity
Equity offered
Industry
AI
Specialty
ML
Show 8 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Seniority
Staff
Experience
3+ years
Tech stack
  • LLMs

Location

Work model
Office
Region
United States
Offices
  • New York, United States
  • San Francisco, United States
Visa sponsorship
Not sponsored

Compensation

Salary
$165,000 - 325,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Data & AI Engineer Intern

    Salary by agreement

    • Hybrid · Paris
    • Junior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    AI Engineer

    $80,000 - 210,000 / year

    • Office · CA, Austin
    • Senior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Senior AI/ML Engineer

    $200,000 - 260,000 / year

    • Office · San Francisco
    • Senior
  • Early Window: Be the first to open itNo views yetCloses in
    Company hidden

    Member of Technical Staff, ML Infra

    Salary by agreement

    • Office · San Francisco
    • Senior

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason