Senior AI Operations Engineer, Enterprise Tech

Description

The Corporate Engineering team is scaling the company's enterprise AI infrastructure, with the goal of making AI capabilities dependable, secure, and available across every team.

The team's work covers enterprise LLM integrations, agentic workflows, and the hybrid cloud infrastructure the company uses for its own AI work.

In this role you will help build, run, and improve the infrastructure behind these capabilities, acting as a technical expert on hard problems and working closely with developers. The function is growing, so you will help shape it.

An estimated $124 trillion of assets is expected to pass to younger generations over the next two decades.

Responsibilities

• Create internal tools, automation, and self-service options that cut manual work in AI operations and make development easier.
• Take ownership of complex troubleshooting and escalations across AI platforms, working with developers and internal teams on issues involving LLM integrations, model behavior, APIs, and performance.
• Run and tune enterprise connections to LLM providers, including Anthropic Claude and Google Gemini, with attention to speed, token use, reliability, and cost.
• Build and improve observability, monitoring, and deployment pipelines for AI workloads, tracking inference latency, API cost, token usage, and error rates.
• Maintain and optimize agentic workflows, orchestration layers, vector databases, and retrieval-augmented generation (RAG) systems for reliability and scale.
• Work with Product, Software Engineering, Business Systems, and AI Strategy to find repeat problems, act on user feedback, and make lasting improvements to enterprise AI.

Requirements

• 5+ years in IT operations, site reliability engineering, or AI infrastructure and support, including running complex production systems.
• Hands-on work with enterprise AI platforms and LLM integrations, especially Anthropic Claude and Google Gemini, covering API integration, prompt operations, and token management.
• Solid Linux administration and scripting or automation in Python, Bash, or similar languages.
• Working knowledge of provisioning, configuration management, and orchestration tools such as Terraform, Ansible, Chef, or Kubernetes.
• Deep understanding of production infrastructure, reliability, monitoring, and troubleshooting on cloud or on-premises systems.
• Able to investigate unclear technical problems on your own, find root causes, and build scalable fixes that stop repeats.
• Strong communicator who works well with developers and cross-functional teams.
• Bonus: GPU clusters; AI workload orchestration (Slurm, Ray); vector databases (Pinecone, Milvus); AI frameworks (LangChain, LlamaIndex); hybrid cloud and bare-metal infrastructure.

Conditions

Based in Menlo Park, CA; New York, NY; or Bellevue, WA, with in-person attendance 3 days a week or more.

Base pay depends on factors such as education, training, experience, location, business needs, and market demand.

Base pay ranges by zone. Zone 1 (Menlo Park, CA; New York, NY; Bellevue, WA; Washington, DC): $153,000 to $180,000 USD. Zone 2 (Denver, CO; Westlake, TX; Chicago, IL): $134,000 to $158,000 USD. Zone 3 (Lake Mary, FL; Clearwater, FL; Gainesville, FL): $119,000 to $140,000 USD.

For locations not listed, pay can be discussed with a recruiter during the interview process.

Beyond base pay, the role is also eligible for bonus, equity, and benefits.

AI tools support parts of recruiting, but hiring teams make all hiring decisions.

Benefits

• Performance-based pay with multipliers for outsized impact, bonus programs, equity, and 401(k) matching.
• 100% paid health insurance for employees, with 90% coverage for dependents.
• Access to a private employee fund that gives eligible US employees exposure to the company's venture funds.
• Access to top AI tools and ongoing AI skill-building for every employee, technical or not.
• Lifestyle wallet, a flexible spending account for wellness, learning, and more.
• Employer-paid life and disability insurance, plus fertility and mental health benefits.
• Time off including company holidays, paid time off, sick time, parental leave, and more.
• Office with catered meals, events, and comfortable workspaces.
• Challenging, high-impact work that grows your career.