You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Freshworks

Staff Engineer - Machine Learning

  • Hybrid
  • 6+ years

Salary

$211,000 - 261,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds AI-powered unified service operations for IT and service teams, and is developing an agentic AI platform.

You will be the main technical driver for reasoning-based agents, coordination across multiple agents, and outcome-driven workflows. You will work with the Principal AI Architect to turn high-level designs into scalable systems, building high-performance APIs and orchestration runtimes that use LangChain, LangGraph, and LangSmith. The work is hands-on and runs at speed, so you need to be a technical leader who keeps engineering standards high.

Responsibilities

  • Lead the implementation of the services that run agent reasoning, planning, and tool calls.
  • Design APIs and SDKs so internal and external teams can build and deploy agent workflows.
  • Build and tune stateful dialog and memory services that keep multi-turn agents aware of context.
  • Implement agent-to-agent (A2A) communication protocols and shared context systems.
  • Move the platform to cloud-native, event-driven services built on microservices or a service mesh.
  • Build task scheduling and long-running operations with tools such as Temporal or Airflow.
  • Reduce LLM orchestration cost and latency through caching, batching, and token monitoring.
  • Own RAG pipelines and their integrations with vector databases such as Pinecone, Weaviate, or FAISS.
  • Make sure every backend service supports LangSmith evaluation and full observability.
  • Implement RBAC, API authentication, and multi-tenant isolation.
  • Set the standard for unit, integration, and load testing, and roll out OpenTelemetry across the system.
  • Review code and give technical guidance to more junior backend engineers.

Requirements

  • 6+ years of backend engineering experience.
  • 1-2+ years of hands-on experience building AI/ML platforms.
  • Expert-level programming in Java and Python.
  • Hands-on experience with LangChain, LangGraph, or LangSmith.
  • Deep understanding of event-driven architectures, microservices, and Kubernetes.
  • Solid experience with AWS, Terraform, PostgreSQL, and vector databases.
  • Practical experience with workflow engines such as Temporal or Airflow, and with Kafka.
  • Preferred: experience with AI-driven planning systems or dialog state tracking.
  • Preferred: background in enterprise security, including RBAC, SSO, and OAuth2.
  • Preferred: experience in a high-growth SaaS or startup environment.
  • Preferred: active contributions to open-source backend or AI frameworks.

Conditions

Hybrid role with onsite work 3x/week, Tuesday to Thursday, at the San Mateo, CA headquarters.

Annual base salary of $211,000 - $261,000, plus eligibility for a target bonus.

Pay depends on location, experience, job-related skills, and level.

The company is an equal opportunity employer and welcomes people of all backgrounds.

Benefits

  • Dental, medical, vision, disability, and life insurance options.
  • Equity and ESPP.
  • Flexible PTO, flexible spending accounts, commuter benefits, and wellness benefits.
  • Adoption and parental leave.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

Freshworks

  • Industry: SaaS

Office in CA, United States

Also hiring in Boston, United States, United States, Berlin, Germany and 2 more places

1 of their 21 open roles is remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 1 red flag

Still hiring?

14 checks

1 red flag

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details14 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • PostgreSQL
  • AWS
  • Kubernetes
  • Kafka
  • Airflow
  • LLMs
  • RAG
  • LangChain
  • Vector databases
Seniority
Staff
Type
Full-time
Equity
Equity offered
Industry
SaaS
Specialty
ML
Show 8 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Seniority
Staff
Experience
6+ years
Tech stack
  • Python
  • PostgreSQL
  • AWS
  • Kubernetes
  • Kafka
  • Airflow
  • LLMs
  • RAG
  • LangChain
  • Vector databases

Location

Work model
Hybrid
Region
United States
Office
  • CA, United States
Remote from
  • United States

Compensation

Salary
$211,000 - 261,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
SaaS

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason