You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Honeycomb.io

Senior Software Engineer II - Agentic Intelligence

  • Remote
  • 6+ years

Salary

$183,340 - 206,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds an observability service for developers and works with customers such as HelloFresh, Slack, LaunchDarkly, and Vanguard across several industries.

The company has closed Series D funding, grew past 200 people, and was named to Forbes' America's Best Startups of 2022 and 2023.

The team builds AI agents that investigate, reason about, and act on live observability data inside the agentic workspace where engineers go to understand their systems. The team has already shipped that workspace, the MCP server, and the agent and skills surfaces, and now wants deep agent expertise to add new agents, new surface area, memory, spatial awareness, and better performance on the Bedrock loop.

The data store is fast and accepts high-cardinality data, which is what sets agents built on it apart from agents built on a conventional observability backend. Some work starts as a prototype, and the code is expected to reach production quality.

Responsibilities

  • Build production-grade agents that investigate, reason about, and act on live observability data. Engineers must be able to trust them under pressure, including during active incidents. Take an early prototype to a version that holds up under real production traffic.
  • Own the agent work end to end: scope, build, ship, and maintain the agents, along with the evals that show whether a change is a real improvement or just a difference. The role also includes some fullstack development.
  • Build what only this company's data store makes possible. Its high-cardinality queries return in seconds, so agents can reason over fine-grained signal that a conventional backend cannot serve at this fidelity, such as cross-service correlations, single-trace drill-downs, and before-and-after deploy comparisons.
  • Extend the product and decide what comes next. Ship new capability across the workspace, the MCP server, and skills, including memory, spatial awareness, and a faster Bedrock loop. Argue for the next step with working code, and separate real signal from hype.
  • Set the standard for agent quality: measurable against real evals, maintainable, and honest about limits.
  • Example projects: several agents working one shared investigation, each claiming a hypothesis, posting findings, and narrowing the search so the others finish sooner (see the blog post). An agent that starts when an SLO burn alert fires, forming hypotheses and preparing visualizations before on-call engineers look, to cut time to insight (o11ycon 2026). Skills that capture a team's domain knowledge, such as Kubernetes thresholds, so agents and engineers can both draw on it (o11ycon 2026).

Requirements

  • Experience building LLM-based agent systems that users relied on in production, not demos or research-only fine-tuned models. You know where agent systems break and how to design around those failures.
  • You can take work from rough prototype to production quality without anyone else doing the durable engineering. The team is small and there is no handoff queue.
  • Current views on what has changed in agent design over the past six to twelve months, and how those changes would alter how you build today.
  • Depth in agent architecture, including how a fast, high-cardinality data store changes what an agent can reason about and how to design for that.
  • Product judgment: you can see what the agent layer should do next and make the case with a prototype rather than a deck.
  • Even better: background in observability or developer tools, since engineers are the users and that fluency speeds up ramp-up.
  • Even better: familiarity with eval frameworks, agent tooling, RAG, and prompt engineering.

Conditions

Fully distributed. Where you sit matters less than how you deliver and how you adapt to the culture and processes. Trust, autonomy, and accountability apply from day one.

Base salary is set by experience level and falls between $183,340 - $206,000 USD.

The company cannot currently sponsor or support visa transfers. All hires must verify identity and eligibility to work, as required by law.

Benefits

  • Equity through a generous employee stock program.
  • Pay follows transparent levels tied to experience, so negotiating skill does not change the offer.
  • Unlimited PTO.
  • Distributed-first culture.
  • Home office, co-working, and internet stipend.
  • Full benefits coverage for employees, with extra coverage available for dependents.
  • Up to 16 weeks of paid parental leave, regardless of path to parenthood.
  • Annual development allowance.
  • Further perks beyond these.

Where you’d work

Fully remote

You can work from

  • United States

No visa sponsorship

About the company

Honeycomb.io

  • Industry: SaaS

13 of their 13 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 1 red flag

Still hiring?

14 checks

1 red flag

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details14 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Kubernetes
  • LLMs
  • RAG
Seniority
Senior
Type
Full-time
Equity
Equity offered
Industry
SaaS
Specialty
Backend
Show 8 more factsShow less

Role

Category
Development
Specialty
Backend
Seniority
Senior
Experience
6+ years
Tech stack
  • Kubernetes
  • LLMs
  • RAG

Location

Work model
Remote
Region
United States
Remote from
  • United States
Visa sponsorship
Not sponsored

Compensation

Salary
$183,340 - 206,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
SaaS

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason