You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build

This vacancy is closed and no longer takes applications. See open Data & Analytics Jobs

True Talent Solutions Partners

Research Scientist

  • Office
  • 3-6 years

Salary

$150,000 - 200,000/ year

Description

The team builds benchmarks and evaluation methods for advanced language models.

Your work helps AI labs and enterprise teams measure what models can do so they can decide how to use them in production.

Responsibilities

  • Test newly released AI models on a variety of use cases.
  • Create benchmarks from scratch, covering dataset creation and coordinating labelers.
  • Design automated methods that score generated text reliably and at scale.
  • Partner with engineers to build and scale evaluation systems.
  • Work with AI labs and enterprise teams to turn their evaluation needs into research projects.

Requirements

  • At least 3 years of full-time AI or ML research, ideally in benchmarking, evaluation, or language models.
  • A publication record, preferably in NLP or benchmarking, and hands-on work building benchmarks or evaluation methods.
  • Strong Python skills and the ability to write clean, maintainable code. Experience with Django, Flask, or a similar Python HTTP server framework is a plus.
  • Experience with PyTorch or TensorFlow, language modeling, LLM infrastructure, and common deep learning techniques.
  • Solid grounding in computer science and the ability to turn research results into working systems.
  • Experience working in a team development process using Git, code review, and feedback.
  • A degree in computer science, machine learning, or a related field. A Master's or PhD is preferred, but candidates with a Bachelor's and 1 to 3 years of applied experience may also be considered.

Conditions

Base salary of $150,000 to $200,000 per year.

Visa sponsorship is available.

The role is on-site in San Francisco, California.

Where you’d work

From the office

The office

Visa sponsored

About the company

True Talent Solutions Partners

Office in San Francisco, United States

Also hiring in New York, United States, United States, Montreal, Canada and 6 more places

1 of their 32 open roles is remote

Details11 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • PyTorch
  • LLMs
  • TensorFlow
  • NLP
Type
Full-time
Specialty
Data Science
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Science
Experience
3+ years
Tech stack
  • Python
  • PyTorch
  • LLMs
  • TensorFlow
  • NLP

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States
Visa sponsorship
Sponsored

Compensation

Salary
$150,000 - 200,000 / year
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason