Senior Software Engineer, Observability

Description

The company aims to make finance open to everyone, and the Observability team is building the full-stack observability platform that keeps its products and services reliable.

An estimated $124 trillion in assets will pass to younger generations over the next two decades, a shift this role sits right at the center of.

The team builds and runs systems for metrics, logs, distributed tracing and alerting, so engineers can see how the infrastructure behaves and respond quickly when something breaks. The team works with the command center group to hold its systems to 99.9% uptime and treats its observability tooling as a product in its own right.

This is a senior technical lead role on the team of six engineers. You will own the observability control plane from end to end and make architecture decisions that affect the reliability of the company's whole product surface.

The work includes setting the telemetry strategy, controlling ingestion costs, building in-house tools where off-the-shelf options fall short, and bringing AI-driven methods into the platform.

Responsibilities

• Set and carry out the full-stack observability roadmap, covering metrics, logs, traces and alerting across the engineering organization.
• Own and improve the control plane, including telemetry ingestion pipelines, cost management and the tooling that keeps observability components highly available.
• Lead the team of six engineers in building self-service observability tools that let product and infrastructure teams move faster with more confidence.
• Define and maintain SLOs for the observability systems, meeting or exceeding the 99.9% uptime target so the platform is as dependable as the services it watches.
• Work with the command center group and engineering teams across the company on dependency mapping, incident response workflows and observability standards.

Requirements

• 5+ years of software engineering experience, including a record of owning and delivering large-scale observability or infrastructure platform work.
• Deep knowledge of Kubernetes and public cloud, AWS preferred, with the ability to design and run distributed systems at scale without depending on one vendor's tools.
• Strong coding skills in Go, Python or a similar language, and experience adding observability agents, libraries and instrumentation to production code.
• Hands-on experience running an observability control plane or telemetry pipeline in a high-traffic production setting, including ingestion cost control, cardinality management and signal routing.
• Nice to have: experience with the Vector data pipeline or a comparable high-throughput log and metrics routing tool, plus familiarity with Prometheus, Grafana, Honeycomb, Humio or Sentry is a plus.

Conditions

The role is based in the Menlo Park, CA office, with in-person attendance expected at least 3 days per week.

Base pay depends on factors such as education, training, experience, location, business needs and market demand. Base pay ranges by compensation zone: Zone 1 (Menlo Park, CA; New York, NY; Bellevue, WA; Washington, DC) is $196,000 - $230,000 USD; Zone 2 (Denver, CO; Westlake, TX; Chicago, IL) is $172,000 - $202,000 USD; Zone 3 (Lake Mary, FL; Clearwater, FL; Gainesville, FL) is $153,000 - $179,000 USD.

Locations not listed can have pay discussed with the recruiter during interviews.

The company uses AI tools to support parts of recruiting, but hiring teams make all hiring decisions.

Benefits

• The role is also eligible for bonus opportunities, equity and benefits on top of base pay.
• Pay includes multipliers for outsized impact, bonus programs, equity ownership and 401(k) matching.
• Health coverage is 100% paid for employees and 90% covered for dependents.
• Every employee gets access to leading AI tools and ongoing AI skill training, whether technical or not.
• A flexible lifestyle wallet covers wellness, learning and more.
• The company pays for life and disability insurance, and offers fertility and mental health benefits.
• Time off includes company holidays, paid time off, sick time and parental leave.
• The office offers catered meals, events and comfortable workspaces, and the work offers room to grow your career.