You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Booz Allen Hamilton

Observability Platform Architect

  • Hybrid
  • 6+ years

Salary

$86,800/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The team runs observability as a service for the enterprise, using a platform that shows whether business services are healthy so issues are found before users notice them.

The platform covers more than 250 business services across several portfolios and environments.

You will own the platform's architecture, instrumentation strategy and entity model, and build automation that lets a small team run it at this scale.

Much of that automation is now driven by AI agents, so you will decide what those agents may do without oversight and how their decisions are checked.

This is a hands-on engineering role. You will set standards, guide the engineers building to them, and build alongside them.

The ideal candidate has a background in platform engineering, observability or site reliability engineering and has owned an observability platform, not only used one.

U.S. citizenship is required because of the nature of work in this facility.

Responsibilities

  • Turn the service owner's priorities into the platform's technical plan, and direct the team through architecture decisions, design reviews, configuration governance and mentoring.
  • Guide the team's daily technical work.
  • Architect and build the observability platform on Dynatrace, Grafana and ServiceNow Event Management in every environment, including its links to ITSM, CMDB and CI/CD, and prevent environments from becoming separately maintained systems.
  • Keep the platform healthy: handle upgrades, keep licensed consumption within budget, and escalate complex platform issues, major incidents and vendor support cases.
  • Drive OpenTelemetry adoption and automate the platform, covering collector configuration, service onboarding, monitoring agent deployment, tagging and alert provisioning. Deliver this as code through CI/CD and test it in non-production before release.
  • Build and deploy AI agents for detection, triage and remediation that connect to the platform's APIs and tools. Own the platform's AI capability end to end: what agents may do unattended, how recovery is verified, and how incorrect actions are caught.
  • Own signal quality, including coverage, detection accuracy and false positive rate, plus the entity model, dashboards and SLOs leadership relies on. Reduce cost per monitored service.

Requirements

  • 8+ years of engineering experience.
  • 3+ years owning an enterprise observability or APM platform, including its architecture, upgrades, standards, cost and production support.
  • 2+ years setting technical direction for other engineers, through architecture decisions, code review and mentoring.
  • Experience writing and tuning complex queries against observability data, such as DQL or PromQL.
  • Experience replacing recurring manual platform work with production automation, such as automated alert correlation, triage or remediation, and keeping it correct over time.
  • Experience using AI in operations, including vendor AI assistants, LLM tools or agents.
  • Experience with infrastructure as code and CI/CD, such as Terraform, GitHub Actions, Azure DevOps or GitLab, and deploying monitoring agents or collectors at scale across cloud, Kubernetes and hybrid environments.
  • Ability to write, review and ship Python, Go or JavaScript code that works against REST APIs.
  • Bachelor's degree in computer science, information systems or engineering.
  • Nice if you have: deep Dynatrace experience, including Grail, DQL, OpenPipeline, Workflows, Site Reliability Guardian, Davis, Dashboards and the Dynatrace Operator on Kubernetes, with configuration managed through the Terraform provider.
  • Nice if you have: Grafana and its wider stack (Prometheus, Loki, Tempo or Mimir), and knowledge of what it costs to run at scale.
  • Nice if you have: ServiceNow Event Management and CMDB, including event rules, alert correlation and closed-loop incident creation from an observability platform.
  • Nice if you have: experience building LLM-based agents and their tooling, such as agent frameworks or Model Context Protocol (MCP) servers.
  • Nice if you have: OpenTelemetry experience, including collectors, instrumentation, semantic conventions and the practical limits of vendor-neutral instrumentation.
  • Nice if you have: experience running one platform across more than one environment or security boundary and managing the drift and duplication that causes.
  • Nice if you have: ITIL 5 Foundation or ITIL 4 Practitioner: Monitoring and Event Management certification.

Conditions

Full-time and part-time employees who work at least 20 hours a week on a regular basis are eligible for the company's benefit programs. Those below that threshold qualify only for select offerings, which do not include health benefits.

The projected compensation range is $86,800.00 to $198,000.00 per year in USD. Pay depends on location, education, skills, experience, contract affordability and organizational needs. The range shown is typical for this role and is only part of the total compensation.

The posting closes within 90 days of the posting date.

Hiring includes identity verification using biometrics and AI. You must be on camera for interviews and assessments, and your photo may be taken to verify identity.

Using AI or other tools to help with answers during interviews, in person or virtual, is prohibited unless explicitly permitted.

Work model: remote roles may still require occasional in-person work at a company or customer site. Hybrid roles require working from a company or customer site as leadership and the role's needs dictate. Onsite roles are performed full-time at a customer site, working directly with colleagues and customers.

Cameras are generally expected to be on during virtual meetings.

The company does not discriminate on the basis of protected characteristics.

Benefits

  • Health, life, disability, financial and retirement benefits.
  • Paid leave, professional development, tuition assistance, work-life programs and dependent care.
  • A recognition awards program for exceptional performance and demonstrated company values.

Where you’d work

Part of the week in the office

You can work from

  • United States

No visa sponsorship

About the company

Booz Allen Hamilton

Office in United States

Also hiring in San Antonio, United States, Washington, Dc, United States, San Diego, United States and 12 more places

9 of their 856 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 22 checks run
  • 3 red flags

Still hiring?

15 checks

2 red flags

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details11 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • Go
  • Kubernetes
  • Terraform
  • Azure
  • CI/CD
  • GitHub Actions
  • GitLab
  • Prometheus
  • Grafana
  • JavaScript
  • LLMs
Type
Full-time
Region
United States
Pay period
Annual
Show 7 more factsShow less

Role

Category
DevOps & Infrastructure
Experience
8+ years
Tech stack
  • Python
  • Go
  • Kubernetes
  • Terraform
  • Azure
  • CI/CD
  • GitHub Actions
  • GitLab
  • Prometheus
  • Grafana
  • JavaScript
  • LLMs

Location

Work model
Hybrid
Region
United States
Office
  • United States
Remote from
  • United States
Visa sponsorship
Not sponsored

Compensation

Salary
$86,800 / year
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason