You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Booz Allen Hamilton

RAG Application Engineer

  • Hybrid

Salary

$69,400/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The application layer of retrieval-augmented generation (RAG) systems has to run reliably and tie search, models, and metadata into one coherent experience. This role builds that layer.

You will own the full query path: creating embeddings, combining keyword and vector retrieval, reranking results, attaching citations, and applying guardrails to each request. The goal is grounded, high-quality answers for analysts at scale.

The work happens in a secure cloud environment. The team is small enough that you will work daily with cloud, security, data, and site reliability engineers to keep the runtime stable, secure, observable, and ready for mission use.

Responsibilities

  • Design and maintain the runtime logic that drives RAG queries.
  • Build API endpoints and manage integrations with AI models.
  • Enforce authentication and authorization inside service logic.
  • Put retry, timeout, and error-handling behavior in place.
  • Containerize services and work with cloud, security, data, and reliability engineers on retrieval behavior and runtime health.

Requirements

  • Hands-on experience building back-end or platform services in a language such as Python or Java.
  • Experience designing or integrating RAG workflows that use embeddings, hybrid retrieval, vector search, and reranking.
  • Experience building API request pipelines, orchestration logic, and routing for AI model and search calls.
  • Experience enforcing authentication and authorization in service code.
  • Experience building resilient services with retry, backoff, timeout, and error handling, and working with data, search, cloud, and security engineers to tune retrieval.
  • Experience containerizing applications with Docker and deploying them to ECS, EKS, or Kubernetes.
  • Experience instrumenting services with structured logs, metrics, and traces.
  • Ability to turn RAG requirements into clean, maintainable application code.
  • TS/SCI clearance with a polygraph.
  • HS diploma or GED.
  • Nice if you have:
  • Experience using Amazon Bedrock model inference in application workflows.
  • Experience running hybrid retrieval on OpenSearch, combining BM25 and vector search.
  • Experience building citation assembly, grounding validation, or model guardrails.
  • Experience with API gateways, rate limiting, caching, or other high-availability patterns.
  • Experience with message queues or asynchronous workflows, such as Kafka or Amazon SQS.
  • Experience supporting evaluation data pipelines or working alongside evaluation scientists.
  • Experience with infrastructure-as-code tools such as Terraform, CloudFormation, or AWS CDK.
  • Ability to work across several engineering disciplines.
  • Strong communication skills.

Conditions

Selected applicants must pass a security investigation and may need to meet eligibility rules for access to classified information. TS/SCI clearance with a polygraph is required.

Candidates must pass a skills assessment at the minimum proficiency threshold before they can move forward in the hiring process.

Pay depends on location, education, knowledge, skills, competencies, experience, and contract-specific affordability and organizational needs. The projected compensation range is $69,400.00 to $158,000.00 per year (USD). This range is typical for the role and is only one part of total compensation. The posting closes within 90 days of the posting date.

Identity is verified with biometric and AI-based tools to prevent fraud. You must be on camera during interviews and assessments, and your photo may be taken for verification.

Using AI or other tools to help with answers during interviews, whether in person or virtual, is not allowed unless the company gives explicit permission.

Virtual employees are generally expected to keep cameras on in meetings.

Remote roles may still require some in-person work at a company or customer site.

Hybrid roles require working from a company or customer site, as set by your manager and the needs of the role.

Onsite roles are mostly full-time at a customer site, where you will work directly with colleagues and customers as needed.

The company is an equal opportunity employer and does not discriminate.

Benefits

  • Health, life, disability, financial, and retirement benefits.
  • Paid leave, professional development, tuition assistance, work-life programs, and dependent care.
  • A recognition awards program for outstanding performance and strong demonstration of company values.
  • Full-time and part-time employees working at least 20 hours a week on a regular basis can join the benefit programs. Those below that threshold get only select offerings, and health benefits are not included.
  • The Resource page and Employee Benefits page on the careers site explain the full benefits package.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

Booz Allen Hamilton

Office in United States

Also hiring in San Antonio, United States, Washington, Dc, United States, San Diego, United States and 12 more places

9 of their 864 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 22 checks run
  • 1 red flag

Still hiring?

15 checks

1 red flag

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details10 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • Java
  • AWS
  • Kubernetes
  • Docker
  • Terraform
  • Kafka
  • Elasticsearch
  • RAG
  • Vector databases
Type
Full-time
Specialty
Backend
Region
United States
Pay period
Annual
Show 5 more factsShow less

Role

Category
Development
Specialty
Backend
Tech stack
  • Python
  • Java
  • AWS
  • Kubernetes
  • Docker
  • Terraform
  • Kafka
  • Elasticsearch
  • RAG
  • Vector databases

Location

Work model
Hybrid
Region
United States
Office
  • United States
Remote from
  • United States

Compensation

Salary
$69,400 / year
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason