Senior Software Architect, AI Systems and Networking

Description

The company's applied research team in the Networking Systems & Software Architecture group works on hard infrastructure problems in AI. The team builds systems software that moves data between GPUs, nodes and storage fast enough for current AI workloads, covering low-level transport tuning, joint hardware and software design, and communication frameworks that connect directly to production AI stacks. The team's scope is growing to include quantum computing interconnects.

This senior architect role means owning modules and projects from first research question through to production code. You make key technical calls, bring in ideas from research and industry, and often build prototypes to test an approach. The job sits between applied research and production engineering.

Responsibilities

• Design and build high-performance communication and memory management libraries for distributed AI.
• Lead hardware and software co-optimization with GPU, DPU, NIC and switch teams using GPUDirect RDMA, NVLink and upcoming interconnects.
• Measure and tune data movement across GPU memory, system DRAM, NVMe and network fabrics.
• Connect networking features into AI serving stacks such as vLLM, SGLang and TensorRT-LLM.
• Maintain and contribute to open-source projects, mentor engineers, run design reviews, and prototype new technologies to judge whether they are viable.

Requirements

• 12+ years in systems software, networking, or both, with a record of owning complex projects.
• MS, PhD or equivalent experience in computer science, computer engineering, electrical engineering or a related field.
• Solid grasp of high-performance networking, including InfiniBand, RoCE, RDMA, NVLink and GPUDirect.
• Strong systems programming in C, C++ or Rust, with skill in profiling and low-level debugging.
• Understanding of ML systems, such as transformer architectures, KV cache behavior, model parallelism, or distributed training and inference.
• Nice to have: experience with ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication needs.
• Nice to have: knowledge of storage networking (NVMe-oF, GPUDirect Storage, S3).
• Nice to have: background in reinforcement learning systems.

Conditions

Base salary depends on location, experience, and pay for similar roles. The base salary range is 224,000 USD - 356,500 USD for Level 5, and 272,000 USD - 431,250 USD for Level 6.

Applications are accepted at least until November 2, 2026.

This posting is for an existing vacancy.

The company uses AI tools in its recruiting process.

The company is an equal opportunity employer and does not discriminate on any basis protected by law.

Benefits

• Competitive salary and a comprehensive benefits package.