You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
NVIDIA

Deep Learning Framework Communications Engineer - New College Grad 2026

  • Office

Salary

$124,000 - 195,500/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds GPUs and the software stack around them, working across AI, high performance computing and visualization.

The role brings advanced communication technology into AI software stacks such as PyTorch, TRT-LLM, vLLM, SGLang and JAX.

You will work with the team behind NCCL, NVSHMEM and GPUDirect, the libraries used to scale deep learning and HPC workloads.

Customers run multi-GPU workloads from training on up to 100K GPUs to inference at microsecond latency, and GPU-to-GPU communication performance strongly affects those applications.

The work makes these tools easier to use for the wider community.

This is a chance for someone with an AI background to push the field forward.

Applications are accepted until at least November 18, 2026.

This posting is for an existing vacancy.

Responsibilities

  • Take communication library features into AI frameworks, from proof of concept through performance analysis to production.
  • Analyse AI workloads and frameworks to find multi-GPU communication needs and gains, working hands-on with teams building the latest models.
  • Improve AI compilers so communication is hidden behind compute or fused automatically.
  • Characterise AI workload performance across multi-GPU clusters in depth.
  • Design fault-tolerant and elastic solutions for large or dynamic AI workloads.
  • Write custom communication kernels and fused compute-communication kernels that get the most out of the company platforms.
  • Help shape the roadmap for NCCL and NVSHMEM.
  • Work with a fast-moving team spread across several time zones.

Requirements

  • A B.S., M.S. or PhD in computer science or a related field, or equivalent experience, with software engineering and HPC or AI experience.
  • Experience developing or integrating with deep learning frameworks such as PyTorch and JAX, or inference engines such as TRT-LLM, vLLM and SGLang.
  • Ability to prototype quickly in Python, C++, CUDA, or a related DSL such as Triton or cuTe.
  • A solid understanding of AI models, parallelism and compiler technology such as torch.compile.
  • Experience benchmarking performance on AI clusters, with familiarity with at least one profiler such as the PyTorch profiler or the company Nsight Systems.
  • Understanding of HPC and AI communication concepts, including one-sided versus two-sided communication, elasticity, resiliency and topology discovery.
  • Willingness and drive to learn new domains and tools.
  • Ability to collaborate clearly across teams and time zones.
  • Nice to have: experience with parallel programming on at least one communication runtime such as NCCL, NVSHMEM or MPI, plus a good grasp of computer architecture, hardware-software interaction and operating systems.
  • Nice to have: expertise in training, distributed inference, MoE, reinforcement learning or kernel authoring in CUDA, Triton or cuTe, and experience overlapping compute and communication in distributed runtimes.
  • Nice to have: experience with AI compiler pattern matching and lowering, and a solid understanding of memory hierarchy, consistency models and tensor layout.

Conditions

Base salary depends on location, experience and other objective job-related factors.

Expected base salary is 124,000 USD to 195,500 USD for Level 2, and 152,000 USD to 241,500 USD for Level 3.

The company uses AI tools in parts of its recruiting process.

The company is an equal opportunity employer and does not discriminate on protected characteristics.

Benefits

  • The company is widely regarded as one of the most sought-after employers in technology.
  • Candidates who are creative and self-directed are encouraged to apply.

Where you’d work

From the office

About the company

NVIDIA

Office in United States

Also hiring in Redmond, United States, Seattle, United States, Helsinki, Finland and 14 more places

163 of their 483 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 22 checks run
  • 2 red flags

Still hiring?

15 checks

1 red flag

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details10 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • PyTorch
  • C++
  • LLMs
  • CUDA
Type
Full-time
Equity
Equity offered
Specialty
ML
Region
United States
Pay period
Annual
Show 4 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Tech stack
  • Python
  • PyTorch
  • C++
  • LLMs
  • CUDA

Location

Work model
Office
Region
United States
Office
  • United States

Compensation

Salary
$124,000 - 195,500 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason