System Software Engineer, Performance - CUDA Driver

Description

The AI revolution is not powered by models alone, rather it advances when enormous amounts of computation become fast, efficient, and economical enough to turn new ideas into products people can use on a global scale. Faster training lets research and product teams test the next idea sooner. Lower-latency, higher-throughput inference makes AI assistants and agents more responsive and practical for more people. Shorter time to solution lets scientists and engineers explore more possibilities within the same time and energy budget.

At NVIDIA, performance is not a supporting metric — it is how architectural invention becomes useful computing. CUDA is a critical layer where that transformation happens, sitting beneath the frameworks, libraries, and applications used across AI, deep learning, and HPC, as well as graphics, automotive, robotics, and other CUDA-powered products. That gives this team unusual leverage: reduce overhead in a fundamental launch, synchronization, memory, or data-movement path—or create a new driver or runtime capability—and the improvement can flow through many downstream systems and be repeated across vast numbers of products. One well-designed systems feature can help customers obtain more useful work from GPUs already deployed while informing how future CUDA capabilities and GPU architectures are designed.

We are looking for systems software engineers who want to work at this leverage point. You will design and ship production C/C++ features and optimizations in the CUDA driver and runtime, trace important workloads across application, operating-system, CPU, interconnect, and GPU boundaries, bring up new platforms, and turn evidence into future software and hardware direction. Your work will not end at a benchmark: it can make AI tools more responsive and efficient, help scientists reach answers sooner, and enable intelligent machines and interactive products to operate within demanding real-time constraints. Over time, you can grow from owning critical features and performance paths to setting subsystem direction and leading hardware/software co-design across generations—helping build the computing foundation for the next decade of AI and accelerated computing.

What you'll be doing:

Design, implement, validate, and ship performance-centric features and programming-model capabilities in the CUDA driver and runtime, writing maintainable, well-tested production C/C++.

Optimize critical execution paths—including kernel launch, synchronization, memory management & movement, CPU–GPU coordination, and system interconnect use—for latency, throughput, bandwidth, efficiency, and scalability.

Own complex performance problems end-to-end - understand important workloads, form hypotheses, create focused measurements and models, isolate root causes across software and hardware boundaries, implement production solutions, and validate application-level impact.

Establish performance expectations for current and future platforms, characterize new silicon, close software and hardware gaps, and drive performance readiness through product release.

Translate workload and platform evidence into CUDA API and programming-model improvements, systems-software direction, and measurement-backed recommendations for future hardware architecture and implementation.

Partner with application, library, framework, operating-system, driver, runtime, firmware, GPU architecture, silicon, product, and customer-facing teams; communicate findings clearly and raise engineering quality through design and code reviews.

Lead complex feature development and cross-layer investigations across teams, define performance requirements and technical direction for major subsystems, mentor engineers, and shape hardware/software decisions for future product generations.

What we need to see:

A BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field—or equivalent practical experience — with at least 2 years of relevant systems-software development experience.

Strong production C/C++ systems-programming experience, including delivery of substantial features, optimizations, or production fixes in a complex codebase.

Strong operating systems and concurrency foundations, including threads, synchronization, processes, virtual memory, and user/kernel interactions.

Strong computer-architecture foundations, including processors, memory hierarchy, caching and coherence, data movement, and system interconnects.

Demonstrated success improving real software performance: measuring behavior, identifying the limiting mechanism, implementing an effective solution, and validating the result quantitatively.

Sound technical judgment, ownership of ambiguous problems, and clear communication across organizational and disciplinary boundaries.

Direct CUDA or GPU experience is valuable but is not required when accompanied by deep systems-software, operating-systems, computer-architecture, and performance-engineering foundations.

Ways to stand out from the crowd:

Experience developing GPU or accelerator drivers, runtimes, kernel software, firmware, compilers, or other performance-critical low-level systems.

Experience with pre-silicon analysis, platform bring-up, performance modeling, or hardware/software co-design.

Systems-level performance experience with AI/DL, HPC, graphics, automotive, robotics, or similarly demanding workloads.

Evidence of technical invention(s), such as software-performance patents, novel production designs, or measurement-backed recommendations that influenced a hardware revision or future architecture.

Python or another scripting language used for focused experimentation, data analysis, or visualization.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 124,000 USD - 195,500 USD.

Responsibilities

• Applications for this job will be accepted at least until September 20, 2026.
• This posting is for an existing vacancy.
• NVIDIA uses AI tools in its recruiting processes.
• NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.