You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Thinking Machines Lab

Software Engineer, Frameworks & Libraries

  • Office
  • 3-6 years

Salary

$300,000 - 400,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds AI meant to extend people's own judgment and will. It trains frontier models, runs a product that lets people adapt models to their own needs, and designs interfaces for communication between people and AI.

This role turns code built for internal use into open-source core libraries the community can rely on. The code you package powers new model launches and the reference cookbook. When a new model ships, researchers and developers should be able to sample it, post-train it, and evaluate it immediately.

You take work from internal prototype to public library across the full set of model-interaction primitives. Each layer depends on the one below it, so interfaces must compose well, stay stable as models and training methods shift, and hold up for customers using the product.

The role sits between research, infrastructure, and the open-source community and is technical first. It suits someone who cares about API design, backwards compatibility, and developer experience, and who is equally at home reading a tokenizer's chat template or shipping a release.

Responsibilities

  • Turn internal code into external open-source core libraries, such as a renderer library, and maintain them with clear versioning, changelogs, deprecation policies, and release automation
  • Make sure renderers, tokenizers, parsers, and tool-call handling for new models are correct and ready for sampling and post-training on day one
  • Build the layers above the renderer: context compaction, session management, the rollout loop and runtime, a rollout viewer, and graders
  • Turn these libraries into reference recipes and examples in the cookbook that show best practices for supervised and reinforcement learning
  • Design clean, composable, typed APIs between libraries and keep the cookbook, the SDK, and internal training and inference systems compatible
  • Build testing, benchmarking, and correctness tooling, such as token-level parity tests against reference implementations, so users can trust training and sampling results
  • Work with research, infrastructure, and product teams to decide which internal code is ready to open-source and what to generalize next
  • Support the open-source community by triaging issues, reviewing contributions, and turning user feedback into improvements

Requirements

  • Minimum: 4+ years of professional software engineering experience, including building and maintaining libraries or SDKs that other developers use
  • Minimum: strong Python skills across typing, packaging, dependency management, testing, and CI
  • Minimum: experience designing public APIs and handling versioning, backwards compatibility, and deprecations
  • Minimum: working knowledge of how LLMs are trained and sampled, including tokenization, chat formats, and tool calling
  • Minimum: able to work independently across research and engineering teams and take ambiguous internal code to a polished public release
  • Preferred: experience maintaining open-source libraries, especially in machine learning, such as PyTorch, Hugging Face, or similar projects
  • Preferred: hands-on work with LLM post-training, including supervised fine-tuning and reinforcement learning, and the data and rollout pipelines behind them
  • Preferred: experience building agent or rollout infrastructure, such as sandboxed runtimes, long-context management or compaction, session and state handling, or evaluation harnesses
  • Preferred: experience building tools for inspecting model behavior, such as trace or transcript viewers
  • Preferred: familiarity with building graders, reward functions, or evaluation frameworks for language models
  • Preferred: experience with performance-sensitive code, such as streaming parsers or Rust or C++ extensions exposed to Python
  • Preferred: strong views on developer experience, documentation, and examples, and a record of public code, tutorials, or writing that helped others apply technical ideas

Conditions

Based in San Francisco, California or New York, New York

Expected annual salary range is $300,000 - $400,000 USD, depending on background, skills, and experience

Visa sponsorship is offered; the company cannot guarantee every candidate or role, but will work through the process together with a suitable candidate

Benefits

  • Health, dental, and vision benefits
  • Unlimited PTO
  • Paid parental leave
  • Relocation support as needed

Where you’d work

From the office

Relocation offered

Visa sponsored

About the company

Thinking Machines Lab

  • Industry: AI

Offices in San Francisco, United States, New York, United States

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 23 checks run
  • 3 red flags

Still hiring?

14 checks

No red flags

How crowded?

9 checks

3 red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • PyTorch
  • C++
  • Rust
  • LLMs
Type
Full-time
Industry
AI
Region
United States
Pay period
Annual
Show 7 more factsShow less

Role

Category
Development
Experience
4+ years
Tech stack
  • Python
  • PyTorch
  • C++
  • Rust
  • LLMs

Location

Work model
Office
Region
United States
Offices
  • San Francisco, United States
  • New York, United States
Relocation
Offered
Visa sponsorship
Sponsored

Compensation

Salary
$300,000 - 400,000 / year
Pay period
Annual

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason