Software Engineer, Agentic Runtime

Description

The company is building a Work AI platform that combines enterprise search, an AI assistant and AI agents on one secure, open platform. It connects to more than 100 enterprise SaaS tools, lets customers choose among LLMs, and offers APIs so organizations can govern, scale and customize AI without vendor lock-in or long implementation projects.

The company's Enterprise Graph and Personal Knowledge Graph map relationships among people, content and activity to give each employee personalized, context-aware answers. Its agents automate real work across teams using enterprise and public data, both structured and unstructured, historical and real-time. It has been recognized by Fast Company, CNBC, Bloomberg, Forbes and Gartner, serves customers in more than 50 industries, and has over 1,000 employees in more than 25 countries.

The Agentic Runtime team builds the low-latency, reliable and secure foundation behind the company's AI agents and assistant at scale. The team runs core runtime services for multi-turn orchestration, tool calling, model routing, memory, streaming and safety, working across distributed systems, production observability and ML infrastructure.

Responsibilities

• Take runtime problems from design through production launch and ongoing reliability.
• Build and evolve services for session lifecycle, streaming responses (such as gRPC or WebSockets), structured tool execution, memory and state, and policy and guardrails.
• Improve p50 and p95 latency and tail behavior, and tune token and tool budgets for performance, correctness and cost.
• Integrate with LLM providers such as OpenAI, Anthropic and Google Gemini, and with internal evaluation frameworks, to improve quality and predictability.
• Make the platform resilient with fault isolation, retries, timeouts, circuit breaking, backpressure and graceful degradation.
• Add tracing, metrics and logs, and set up playbooks and SLOs for high availability and on-call work.
• Work with product, quality and application teams to decide which roadmap investments matter most.

Requirements

• At least 3 years of software engineering experience building production distributed systems or cloud-native applications.
• A bachelor's degree in computer science or a related field, or equivalent practical experience.
• Strong coding skills in at least one of Python, Go, Java, JavaScript, TypeScript or C++, with attention to reliability, performance and testing.
• A product mindset: you put customer impact first, work to clear SLAs and SLOs, and iterate pragmatically.
• You take ownership, stay positive and proactive, and can lead projects or learn from experienced engineers.
• Experience running services on Kubernetes and on at least one major cloud (GCP, AWS or Azure).
• Familiarity with event and streaming systems (Pub/Sub, Kafka), caching (Redis) and data stores used on low-latency paths.
• Working knowledge of LLM and agent building blocks: tool and function calling, structured outputs, streaming, and model selection and routing.
• Strong observability and debugging skills, including tracing (OpenTelemetry), metrics, dashboards and production investigation.
• Nice to have: experience with policy and guardrails, multi-tenant isolation, rate limiting, concurrency control or cost optimization.

Conditions

This is a hybrid role, with 4 days a week in the Mountain View office.

The standard base salary range is $180,000 to $210,000 per year. Final pay depends on factors such as location, level, job-related knowledge, skills and experience. Some roles may also be eligible for variable compensation, equity and benefits.

The company does not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability or race.

Benefits

• Comprehensive benefits including competitive pay, medical, vision and dental coverage, a generous time-off policy, and a 401k plan you can contribute to.
• A home office improvement stipend on joining, plus annual education and wellness stipends.
• Regular company events and healthy lunches provided daily.