You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
NVIDIA

Senior Software Engineer, AI Data

  • Office
  • 6+ years

Salary

$152,000 - 241,500/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company pioneered accelerated computing and created the GPU. Its technology underpins gaming, graphics, high-performance computing and AI, from generative AI to autonomous systems.

The Managed AI Research Superclusters team builds the infrastructure, platforms and tools that let researchers and engineers develop next-generation AI and ML systems.

The AI Data group manages how the company's AI research uses data: many petabytes of training data, checkpoints and datasets spread across several clouds and partners.

The team owns the layer between storage and the workload. That covers data placement across file systems, object storage and local NVMe, plus streaming loaders and caches that feed tens of thousands of GPU cores, efficient checkpoint management, and fair quotas across many research groups.

You will help design the data platform on Kubernetes from scratch, working directly with researchers who train the company's own models. Success shows up as faster training steps, shorter restarts and fewer runs lost to full storage volumes. The role suits a builder on a team that is reshaping its own scope.

Responsibilities

  • Design the AI data layer for a multi-cloud GPU fleet, deciding how datasets, checkpoints and scratch data are placed, cached, tiered and moved across storage backends.
  • Build fast data paths for training and RL: streaming loaders from object storage, distributed caches, and checkpoint save and restore across thousands of GPUs, including peer-to-peer and local-first restore.
  • Make data a first-class part of the compute platform with Kubernetes-native APIs, operators and storage integrations, so jobs declare their data needs and the platform mounts, caches and tracks that data on both Slurm and Kubernetes.
  • Run quotas, capacity and data lifecycle for hundreds of research teams: usage attribution, quota enforcement, retention, stale-data cleanup and capacity forecasting before shortages hit.
  • Instrument workloads with I/O telemetry and access analytics that show hot and cold data, metadata pressure and I/O stalls, then use those findings to guide placement and fixes.
  • Own the reliability of what you build, including on-call, incident analysis, and changes that prevent whole classes of data incidents such as full file systems, runaway metadata load and lost checkpoints.

Requirements

  • BS or MS in computer science, computer engineering, electrical engineering or a related field, or equivalent experience.
  • 5+ years building production systems or data infrastructure software.
  • Deep experience with at least one of: parallel or distributed file systems (Lustre, WEKA, VAST, GPFS, Ceph or similar), large-scale object storage (S3 or compatible), or large data pipelines and data lakes.
  • Solid grasp of I/O performance, including throughput, latency, metadata cost, caching, and how access patterns affect each.
  • Strong programming in Go, Rust, C or C++, plus Python for tooling and analysis.
  • A proven record of running a production service and making it measurably better.
  • Clear written and spoken communication with engineers and researchers.
  • Ways to stand out from the crowd:
  • Experience feeding large-scale AI training with data loaders, streaming datasets and storage behavior at thousands of GPUs.
  • Checkpointing at scale: asynchronous or distributed checkpoints, tiered checkpoint storage, and fast restart after failure.
  • Built or operated a distributed cache or AI-oriented storage system, or used node-local NVMe as a managed tier.
  • Built a quota, accounting or capacity system that many teams relied on.
  • Knowledge of RL and agentic workloads and their storage needs: many small reads, environment snapshots, sandbox images and fast fan-out.

Conditions

Base salary depends on location, experience and other objective job-related factors.

Level 3 base salary range: 152,000 USD to 241,500 USD.

Level 4 base salary range: 184,000 USD to 287,500 USD.

Applications are accepted at least until November 13, 2026.

This is an existing vacancy.

The company uses AI tools in its recruiting process.

The company is an equal opportunity employer and does not discriminate on protected characteristics.

Where you’d work

From the office

About the company

NVIDIA

Offices in United States, Austin, United States

Also hiring in Redmond, United States, Seattle, United States, Helsinki, Finland and 13 more places

161 of their 480 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 1 red flag

Still hiring?

14 checks

1 red flag

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • Kubernetes
  • LLMs
  • Go
  • C++
  • Rust
Seniority
Senior
Type
Full-time
Equity
Equity offered
Specialty
Backend
Region
United States
Show 6 more factsShow less

Role

Category
Development
Specialty
Backend
Seniority
Senior
Experience
5+ years
Tech stack
  • Python
  • Kubernetes
  • LLMs
  • Go
  • C++
  • Rust

Location

Work model
Office
Region
United States
Offices
  • United States
  • Austin, United States

Compensation

Salary
$152,000 - 241,500 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason