Developer Experience / DevEx

Description

The company builds chips and systems for AI inference, aiming to generate output at thousands of tokens per second while running large models at very long contexts. It was founded in 2022 and is focused on removing the speed and cost limits that hold back deep-reasoning work in fields such as drug discovery, software engineering and materials discovery.

The Developer Experience team sits in the Software organisation, which builds the full software stack for the company's inference systems, from ML compilers, drivers and firmware through runtimes, libraries, developer tooling and simulators, up to datacenter-scale workload deployment. The team shapes how customers work with the inference accelerator. It studies how the system is used, creates and presents that information across the company, and builds tools that help customers use the system well with a short learning curve.

The role requires understanding where inference hardware development currently stands. You will judge which approaches would help engineers find performance gains, and which tools can slot into an LLM engineer's workflow with the least disruption and effort.

Responsibilities

• Find tooling gaps, design the tools, and deliver them so they fit into the existing toolset of LLM engineers.
• Build tools that are useful, easy to learn and easy to use.

Requirements

• You work independently and take the initiative to spot tooling opportunities.
• You have worked in this area before, possibly as a forward deployed engineer or at a company that offers inference services on its own models.
• Experience with inference frameworks such as JAX and/or PyTorch.
• Experience writing software in Python, Rust, C/C++, or a similar language.
• Experience profiling and optimising code written in CUDA, ROCm, OpenCL, or similar.
• Experience monitoring and optimising deployments of LLMs with 50+ billion parameters.
• Experience working with stakeholders across several teams.

Conditions

The role is subject to UK, US and other international export control regulations. Some positions may need extra eligibility checks, and the company will tell candidates about these during the hiring process.

Benefits

• A competitive salary that reflects your experience and the specialised nature of the role.
• Meaningful equity, so everyone shares in the value the company creates.
• Private medical, dental and vision cover, a contributory pension, 25 days of holiday plus bank holidays, and life and critical illness insurance.
• The company has raised $220M from investors including Founders Fund and Accel.