Staff/Senior Staff Software Engineer, Agent Infrastructure

Description

The company is a security-first enterprise AI company that builds foundation models and end-to-end products aimed at real business problems.

It trains and deploys frontier models for enterprises that build their own AI systems.

The team is a mix of researchers, engineers, designers and others, all focused on improving the models and the value customers get from them.

The company is headquartered in Toronto, with offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul.

The team is building the next generation of agentic AI infrastructure. It works across ML systems, distributed infrastructure and developer experience to build the platform that runs autonomous AI agents at scale.

The problems are hard and forward-looking, with few established patterns to follow.

The role suits someone with strong systems skills and ML intuition who can build reliable infrastructure, reason about distributed systems tradeoffs, and see how new agent capabilities change platform design.

If your experience does not match every item below, you are still encouraged to apply.

Responsibilities

• Design secure execution environments for code that agents generate.
• Build identity, authentication and trust boundaries for agents.
• Build model routing and orchestration across different model types and environments.
• Design rate limits, quotas and resource management for agent workflows.
• Build state management, memory and filesystem abstractions for agents.
• Turn promising ML research into production-ready infrastructure.
• Build core platform capabilities for execution, storage and state management.
• Prototype and evaluate new technologies, then help decide what goes into production.
• Work with research teams to shape infrastructure around what future agent systems will need.

Requirements

• Experience building production ML infrastructure with strong systems fundamentals.
• Hands-on work with agentic systems, multi-agent workflows or agent development frameworks.
• Familiarity with model routing and LLM provider frameworks across different model types and environments.
• Experience with scalable, fault-tolerant distributed systems and Kubernetes.
• A record of moving quickly on prototypes and making sound calls on what to productionize.
• Bonus: experience across on-prem, private cloud and public cloud environments.
• Bonus: familiarity with storage systems, embedded databases or filesystem abstractions.
• Bonus: experience with code execution sandboxes such as gVisor, Firecracker, Kata or WASM runtimes.
• Bonus: interest in emerging ML infrastructure, edge inference or browser-native models.
• Bonus: open-source contributions to LLM or agent infrastructure projects.
• Bonus: experience with identity, workload auth or capability-based security systems.

Conditions

Full-time role.

The company is remote-friendly, and it also has offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul, with more opening soon.

Office staff get a daily lunch program, snacks and regular community and social events.

Remote staff who are not near an office get a co-working benefit to work alongside others in their city.

Equal opportunity applies to all applicants, and accommodation requests are handled during recruitment.

The company may use AI-enabled tools to help recruiters screen applicants against the role's criteria, without limiting which applications recruiters review.

Benefits

• Weekly lunch stipend of $75 or £75, or the equivalent in local currency.
• Full health and dental coverage, with a separate mental health budget.
• RRSP matching, 401K and a pension scheme.
• 100% parental leave top-up for up to 6 months, for either parent.
• Annual enrichment budget for arts and culture, fitness and wellness, and quality time, plus a workspace improvement credit.
• Education and learning stipend for conferences, courses and coaching.
• 6 weeks of paid vacation (30 working days).
• Budget for travelling to other offices if you work remotely, plus an annual company offsite.
• $500 home office stipend for everyone to set up a proper workspace.