You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Kaizen Labs

AI/ML Engineer

  • Hybrid

Salary

$240,000 - 280,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

Government technology has let citizens, veterans, public servants and service members down for decades.

The company replaces the aging systems federal agencies depend on with modern software, built carefully. Its work includes a ticketing platform used to visit a presidential library, a DoW marketplace for buying counter-drone systems, and the system Veterans use to access benefits.

Its AI-native modules and harness let the team build in weeks instead of years.

Revenue grew 35x this year. Next year the software is expected to serve over 100 million Americans across dozens of federal agencies.

Founded in 2022, the company is based in New York City and DC and has raised $35 million from NEA, a16z, Accel, 776 and Carpenter Capital.

Residents and public servants rely on this software because they have no alternative, so the models beneath it must be trustworthy.

Responsibilities

  • Reduce reliance on general-purpose models, which carry capabilities the company does not need, miss knowledge it does need, and bring frontier token costs. You will fine-tune, adapt and distill open-weight models into specialized models the company owns, and show when they beat general-purpose options.
  • Success means better public-sector software that costs less to run and is harder to copy, not the biggest model or the most papers.
  • Fine-tune, adapt and distill open-weight models for requirement interpretation, code generation, repository understanding, structured output and software validation.
  • Run the experiment cycle: curate datasets, build training pipelines, and test architectures and methods until an idea becomes a working model.
  • Create evaluations based on real software engineering work that set baselines, reveal failure modes, and separate true gains from benchmark noise.
  • Partner with platform engineers to find where current models fall short, build capabilities that close those gaps, and deploy them to production.
  • Try supervised fine-tuning, synthetic data, preference optimization and reinforcement learning to sharpen model behavior on specialized tasks.
  • Build customer applications without frontier-model token spend, so public budgets fund services instead of inference.
  • Prepare datasets, evals and research practices so the company can eventually train its own models from scratch.

Requirements

  • Hands-on experience training, fine-tuning or adapting language models, working with model weights rather than only APIs or prompts.
  • Solid software engineering skills: reliable training pipelines, debugging of complex systems, and code that other engineers build on.
  • Strong Python and PyTorch, plus working knowledge of transformer architectures, tokenization and language model training.
  • A project showing real model engineering, such as a fine-tuned model, an original training method or a substantial open-source ML contribution. Industry, research and independent work all count, and demonstrated ability outweighs years or credentials.
  • Strong candidates may also have fine-tuned models for code generation, program synthesis or repository understanding.
  • Strong candidates may also design experiments and evaluation sets that separate real improvement from noise or overfitting.
  • Strong candidates may also have experience with synthetic data, distillation, quantization, or preference optimization and RL with verifiable rewards.
  • Strong candidates may also have contributed to open-source model development, published applied ML research or reproduced significant research results.
  • Not a fit if your model experience is prompt engineering and API calls.
  • Not a fit if you would rather publish a result than ship a model people use every day.
  • Not a fit if you hand off notebooks and expect someone else to make them run in production.
  • Not a fit if you assume the biggest model is right and do not want to think about cost.

Conditions

Hybrid role based in New York, NY, with in-office days Monday through Thursday.

You must live in New York City or be able to commute there.

Benefits

  • Medical through Oxford/United (Gold or Platinum PPO), dental through Guardian PPO and vision through Beam, fully covered for employees with 100% coverage for dependents.
  • $100,000 in fully paid life insurance, plus an FSA and a Dependent Care FSA.
  • One Medical membership paid by the company, with same-day primary care, 24/7 virtual visits and offices across the city.
  • Fertility and family-building support through Carrot.
  • 401(k) through Guideline with a 2% company match.
  • 16 weeks fully paid parental leave for birthing parents and 10 weeks fully paid for non-birthing parents.
  • Unlimited PTO with a two-week minimum.
  • The office is closed on all federal holidays, with a company-wide winter break the week of Christmas and offsites throughout the year.
  • Up to $750 one-time home office or desk setup stipend for NYC employees, or $500 for remote employees.
  • $50/month commuter benefit paid by the company.
  • Lunch expensed while in the office, and dinner and Uber rides home expensed if you work in the office past 7pm.
  • A company-provided laptop of your choice.
  • NYC employees get a fully covered Grindhouse gym membership worth $225/month, at the gym across from the 47 W 17th St office and in Williamsburg. Non-NYC employees get $100 per month for gym or fitness reimbursement.
  • $100/month utility stipend, $250/quarter home cleaning stipend, $500/year professional development, $250/year recreation and $300/quarter pet care stipend.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

Kaizen Labs

Office in New York, United States

Also hiring in United States

Your chances

We've checked whether it's still hiring and how crowded it is.

  • 21 checks run
  • 0 red flags

Still hiring?

14 checks

No red flags

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details10 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • PyTorch
Type
Full-time
Specialty
ML
Region
United States
Pay period
Annual
Show 5 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Tech stack
  • Python
  • PyTorch

Location

Work model
Hybrid
Region
United States
Office
  • New York, United States
Remote from
  • United States

Compensation

Salary
$240,000 - 280,000 / year
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason