You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build

This vacancy is closed and no longer takes applications. See open Data & Analytics Jobs

True Talent Solutions Partners

Member of Technical Staff, ML Systems

  • Office
  • 6+ years

Salary

$180,000 - 260,000/ year

Description

The company builds systems that train and run image, video, and world models at high performance.

The work centers on raising speed and efficiency across GPU kernels, distributed engines, and multi-node systems.

Responsibilities

  • Tune system and GPU speed for both training and inference jobs.
  • Use Nsight and similar tools to find slow spots in kernels, memory, systems, and clusters.
  • Write low-level speedups in CUDA and Triton.
  • Build and enhance distributed training and inference engines used for diffusion models.
  • Make communication faster between GPUs and nodes using NCCL, RDMA, InfiniBand, RoCE, and disaggregated serving.
  • Create benchmark and regression tooling so performance gains hold in production.
  • Shape kernels, runtimes, and models together around what the hardware can do.

Requirements

  • You have 2 or more years working on deep learning training or inference systems, distributed systems, or similar ML systems.
  • You have at least 1 year of recent, hands-on work on ML systems or GPU performance.
  • You have built core features in an inference or training framework such as vLLM, SGLang, TensorRT-LLM, or Megatron, not only deployed or integrated them.
  • You have written CUDA, CUTLASS, Triton, or PTX kernels directly on NVIDIA GPUs.
  • You have a strong grounding in machine learning and computer science, with a degree in computer science or a related quantitative field.
  • You have improved inference or training performance across GPU kernels, runtimes, or distributed execution. Experience with diffusion, video, image, or multimodal workloads is relevant.

Conditions

Base salary runs from $180,000 to $260,000 per year.

Visa sponsorship is available.

The role is on-site in Menlo Park, California, United States.

Where you’d work

From the office

Visa sponsored

About the company

True Talent Solutions Partners

  • Industry: AI

Office in Menlo Park, United States

Also hiring in Munich, Germany, Germany, New York, United States and 7 more places

7 of their 68 open roles are remote

Details13 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • LLMs
  • CUDA
Seniority
Staff
Type
Full-time
Industry
AI
Specialty
ML
Region
United States
Show 7 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Seniority
Staff
Experience
6+ years
Tech stack
  • LLMs
  • CUDA

Location

Work model
Office
Region
United States
Office
  • Menlo Park, United States
Visa sponsorship
Sponsored

Compensation

Salary
$180,000 - 260,000 / year
Pay period
Annual

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason