You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Booz Allen Hamilton

Databricks Data Engineer, Lead

  • Hybrid
  • 6+ years

Salary

$77,600/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

Lead hands-on work on Databricks data pipelines: build and maintain them, contribute as an individual engineer, and guide the team technically.

You will mentor a mixed group of analysts, data engineers, developers, and data consumers on a fast-moving agile team, overseeing the assessment, design, build, and upkeep of scalable platforms for clients.

Databricks and AWS experience positions you to lead technically and turn raw data into insights that support analytics across the business.

Responsibilities

  • Build, tune, and extend end-to-end data flows.
  • Run extract, transform, load (ETL) processes.
  • Design data models.
  • Protect data and keep it compliant.
  • Work with cross-functional teams.
  • Raise performance and scalability over time.

Requirements

  • You have 8+ years of experience designing, building, deploying, and managing ETL processes and data pipelines, with thorough logging and solid error handling to diagnose and fix problems.
  • You have 3+ years of experience building, debugging, and tuning data pipelines with Databricks notebooks, clusters, and job orchestration, including Delta Lake, Databricks Delta, and Unity Catalog.
  • You have 3+ years of experience writing Python and PySpark for ETL scripts and custom transformations.
  • You can choose between dimensional and relational data models within a medallion architecture (Bronze, Silver, Gold).
  • You have worked with AWS services such as AWS Glue, Amazon S3, and Amazon RDS.
  • You know how to tune ETL jobs with partitioning, bucketing, and caching, and can troubleshoot slow queries.
  • You can build data models from the first schema definition through to structures that make queries and analytics efficient.
  • You can obtain and keep a Public Trust or Suitability/Fitness determination, as the client requires.
  • You hold a bachelor's degree in Computer Science, Computer Engineering, Engineering, Mathematics, Physics, Information Systems, or Information Technology.
  • Selected candidates will undergo a government investigation and may need to meet the eligibility rules of the U.S. government client.
  • Nice if you have: experience with serverless AWS data services such as AWS Lambda or CloudWatch.
  • Nice if you have: experience with metadata, lineage, and cataloging tools such as AWS Glue Data Catalog or Collibra.
  • Nice if you have: knowledge of data governance, lineage, and compliance rules such as GDPR or CCPA, covering quality, privacy, and security.
  • Nice if you have: the ability to explain complex technical ideas to non-technical people, including architecture tradeoffs.

Conditions

Remote roles may still require in-person work at a company or customer facility.

Hybrid roles require working from a company or customer facility, as your leadership expects and the role needs.

Onsite roles are mainly full-time at a customer facility, where you work directly with colleagues and customers as needed.

Cameras are generally expected to be on in virtual meetings.

You must complete identity verification using biometrics and AI, be on camera for interviews and assessments, and may be photographed for identity checks.

Using AI or other tools to help with interview responses, live or virtual, is prohibited unless explicitly permitted.

Pay depends on location, education, skills, experience, contract affordability, and organizational needs. The projected range is $77,600.00 to $176,000.00 annualized in USD, typical for the role and only one part of total pay.

The posting closes within 90 days of the posting date.

The company is committed to non-discrimination.

Benefits

  • Health, life, disability, financial, and retirement benefits, plus paid leave, professional development, tuition assistance, work-life programs, and dependent care.
  • Recognition awards for exceptional performance and strong demonstration of company values.
  • Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible for benefit programs. Those below that threshold get select offerings only, not health benefits.
  • Full details are on the Resource page and the Employee Benefits page of the careers site.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

Booz Allen Hamilton

Office in United States

Also hiring in San Diego, United States, Washington, Dc, United States, Houston, United States and 12 more places

9 of their 856 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 22 checks run
  • 3 red flags

Still hiring?

15 checks

2 red flags

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • AWS
  • Spark
  • Databricks
Seniority
Lead
Type
Full-time
Specialty
Data Engineering
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Lead
Experience
8+ years
Tech stack
  • Python
  • AWS
  • Spark
  • Databricks

Location

Work model
Hybrid
Region
United States
Office
  • United States
Remote from
  • United States

Compensation

Salary
$77,600 / year
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason