You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Freshworks

Staff Backend AI Platform Engineer

  • Hybrid
  • 6+ years

Salary

$225,000 - 278,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

You will be the main technical driver for a team building the core backend services of an agentic AI platform, including reasoning agents, coordination across multiple agents, and workflows judged by their outcomes.

You will work alongside the principal AI architect to turn high-level designs into scalable code. The role is hands-on and needs a technical lead who keeps engineering standards high in a quick-moving setting.

The company builds AI-powered service operations software that helps IT and service teams coordinate people, data, and workflows.

Responsibilities

  • Lead the implementation of agent runtime services covering reasoning, planning, and tool calls.
  • Design and build APIs and SDKs so internal and external teams can create and deploy agent workflows.
  • Build and tune stateful dialog and memory services for multi-turn agents that rely on context.
  • Implement agent-to-agent communication protocols and shared context systems.
  • Lead the move to cloud-native, event-driven services built on microservices or a service mesh.
  • Build task scheduling and long-running jobs with Temporal or Airflow.
  • Improve LLM orchestration for speed and cost through caching, batching, and token tracking.
  • Build and maintain RAG pipelines and connections to vector databases such as Pinecone, Weaviate, or FAISS.
  • Make sure every backend service supports LangSmith evaluation and thorough observability.
  • Implement RBAC, API authentication, and multi-tenant isolation.
  • Set the standard for automated unit, integration, and load testing, and add OpenTelemetry across the system.
  • Guide junior backend engineers and review their code.

Requirements

  • 6+ years of backend engineering experience.
  • 1-2+ years of hands-on experience building AI or ML platforms.
  • Expert-level skill in Java and Python.
  • Hands-on experience with LangChain, LangGraph, or LangSmith.
  • Deep understanding of event-driven architecture, microservices, and Kubernetes.
  • Solid experience with AWS, Terraform, PostgreSQL, and vector databases.
  • Practical experience with workflow engines such as Temporal or Airflow, and with Kafka.
  • Preferred: experience with AI-driven planning systems or dialog state tracking.
  • Preferred: background in enterprise security such as RBAC, SSO, or OAuth2.
  • Preferred: experience at a high-growth SaaS company or startup.
  • Preferred: active open-source contributions to backend or AI frameworks.

Conditions

Hybrid role with onsite work three days a week, Tuesday through Thursday, at the San Mateo, CA headquarters.

Annual base salary range of $225,000-$278,000, and eligibility for a target bonus.

Pay depends on factors including location, experience, job-related skills, and level.

Equal opportunity employer that welcomes people of all backgrounds.

Benefits

  • Medical, dental, vision, disability, and life insurance options.
  • Equity and an employee stock purchase plan (ESPP).
  • Flexible PTO, flexible spending accounts, commuter benefits, and wellness benefits.
  • Adoption and parental leave.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

Freshworks

  • Industry: SaaS

Office in CA, United States

Also hiring in Boston, United States, United States, Berlin, Germany and 2 more places

1 of their 21 open roles is remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 2 red flags

Still hiring?

14 checks

1 red flag

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details14 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • Java
  • PostgreSQL
  • AWS
  • Kubernetes
  • Terraform
  • Kafka
  • LLMs
  • RAG
  • LangChain
  • Vector databases
Seniority
Staff
Type
Full-time
Equity
Equity offered
Industry
SaaS
Specialty
DevOps
Show 8 more factsShow less

Role

Category
DevOps & Infrastructure
Specialty
DevOps
Seniority
Staff
Experience
6+ years
Tech stack
  • Python
  • Java
  • PostgreSQL
  • AWS
  • Kubernetes
  • Terraform
  • Kafka
  • LLMs
  • RAG
  • LangChain
  • Vector databases

Location

Work model
Hybrid
Region
United States
Office
  • CA, United States
Remote from
  • United States

Compensation

Salary
$225,000 - 278,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
SaaS

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason