Senior Software Engineer, Bare Metal Infrastructure – DGX Cloud

Description

The company runs large-scale GPU infrastructure for demanding AI workloads. The Bare Metal Infrastructure team builds the software that takes newly racked hardware and turns it into reliable, validated production capacity.

You will cover the full bare-metal lifecycle: bringing in new platforms, qualifying firmware, automated provisioning, validation, remediation, and handover to production.

The team relies heavily on AI agents and LLM tools to build software and wants people who will push that further.

Responsibilities

• Design, build, and maintain production services for bare-metal discovery, provisioning, hardware validation, firmware upgrades, auditing, and repair across large GPU fleets.
• Build integrations with Redfish and vendor BMC interfaces to manage server state, collect inventory and health data, enforce configuration, and drive recovery, handling vendor differences in code.
• Contribute to and review code in the Rust codebase, and build supporting tools and services in Go and Python.
• Turn recurring hardware, firmware, and connectivity failures into automated detection, validation, and repair workflows.
• Define and implement automated validation and handoff criteria for new platforms, firmware releases, and rack-scale deployments.
• Debug complex failures across hardware, firmware, Linux, networking, and provisioning services, and feed the findings back into the software.
• Work with server and component vendors and with internal platform, networking, datacenter, and production engineering teams to resolve issues that cross boundaries.
• Use AI agents and LLM tools daily to write, review, and test code and to investigate failures, and help shape how the team builds with AI.

Requirements

• BS or MS in Computer Science, Computer Engineering, or equivalent experience.
• 5+ years building production infrastructure software, automation, or services, including substantial hands-on work with bare-metal server systems.
• Strong programming skills in Rust, Go, or Python, with a record of designing, testing, shipping, and maintaining production code, and willingness to work in Rust regularly.
• Deep knowledge of enterprise server hardware from multiple vendors (Dell, Supermicro, Lenovo, HPE), including BMCs, BIOS/UEFI, and firmware management.
• Direct experience with Redfish and IPMI for provisioning, health inspection, power management, or fault diagnosis, and with network boot (PXE/iPXE, DHCP, HTTP boot).
• Strong Linux knowledge: boot process, kernel and driver interactions, hardware discovery, and low-level failure analysis.
• Solid datacenter networking fundamentals, with the ability to trace connectivity problems across host, management, and infrastructure networks.
• Demonstrated, regular use of AI agents and LLM tools in software development, with a strong interest in improving them and the judgment to validate what they produce.

Conditions

Base salary depends on location, experience, and the pay of employees in similar roles. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

Applications are accepted at least until November 1, 2026.

This is an existing vacancy.

The company uses AI tools in its recruiting processes.

The company is an equal opportunity employer and does not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other legally protected characteristic.