You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Booz Allen Hamilton

Databricks Data Engineer, Senior

  • Hybrid
  • 6+ years

Salary

$77,600/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

This is a senior role where you build and maintain data pipelines in Databricks, work independently on them, and also lead technical work and mentor others on the team.

You will create and tune end-to-end data flows, run ETL processes, design data models, protect data security and compliance, work with other teams, and improve performance and scale. Your Databricks and AWS experience makes you the technical lead for this work and turns raw data into insights the business can use.

The team is multi-disciplinary, with analysts, data engineers, developers, and data consumers, and works in an agile way. You will help assess, design, build, and maintain scalable platforms for clients.

Responsibilities

  • Build, test, and maintain data pipelines inside Databricks, and contribute code as an individual.
  • Create and optimize end-to-end data flows and handle ETL processes.
  • Design data models and keep data secure and compliant.
  • Work with cross-functional teams and keep improving performance and scalability.
  • Lead technical decisions and mentor other members of the team.
  • Oversee the assessment, design, build, and upkeep of client data platforms.

Requirements

  • You have 8+ years designing, developing, deploying, and managing ETL processes and data pipelines, with logging and error handling that let you find and fix problems.
  • You have 3+ years building, debugging, and tuning data pipelines with Databricks notebooks, clusters, and job orchestration, including Delta Lake, Databricks Delta, and Unity Catalog.
  • You have 3+ years writing Python and PySpark for ETL scripts and custom transformations.
  • You know when a dimensional model fits better than a relational one within a medallion architecture (Bronze, Silver, or Gold).
  • You have worked with AWS services such as AWS Glue, Amazon S3, and Amazon RDS.
  • You know ETL performance techniques such as partitioning, bucketing, and caching, and you can troubleshoot slow queries.
  • You can design and implement data models, from defining schemas to structuring data for efficient queries and analytics.
  • You can obtain and keep a Public Trust or Suitability/Fitness determination, depending on client requirements.
  • You hold a bachelor's degree in Computer Science, Computer Engineering, Engineering, Mathematics, Physics, Information Systems, or Information Technology.
  • Nice if you have: experience with AWS serverless data services such as AWS Lambda or CloudWatch.
  • Nice if you have: experience with metadata and cataloging tools such as AWS Glue Data Catalog or Collibra, for lineage and data assets.
  • Nice if you have: knowledge of data governance, lineage, and compliance rules such as GDPR or CCPA, covering quality, privacy, and security.
  • Nice if you have: the ability to explain complex technical ideas to non-technical people, including architecture tradeoffs.
  • Vetting: you will undergo a government investigation and may need to meet the eligibility rules of the U.S. government client.

Conditions

You will go through identity verification using biometrics and AI, and you must be on camera for interviews and assessments. The company may photograph you to confirm your identity.

Using AI or other tools to help with interview answers, in person or virtual, is not allowed unless explicitly permitted.

Remote roles may still require some in-person work at a company or customer site. Hybrid roles require working from a company or customer site as your leadership and the role require. Onsite roles are mainly full-time at a customer site.

Virtual employees are generally expected to keep their cameras on in meetings.

Pay depends on location, your education, skills, and experience, and on contract affordability and organizational needs. The projected range is $77,600.00 to $176,000.00 per year in USD. This is the typical range and only part of total pay. The posting closes within 90 days of the posting date.

The company is an equal opportunity employer and does not discriminate.

Benefits

  • Full-time employees, and part-time employees working at least 20 hours a week regularly, can join the benefit programs, which include health, life, disability, financial, and retirement coverage.
  • Paid leave, professional development, tuition assistance, work-life programs, dependent care, and recognition awards for exceptional performance.
  • Employees below the 20-hour threshold get only select offerings, not health benefits.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

Booz Allen Hamilton

Office in United States

Also hiring in San Antonio, United States, Washington, Dc, United States, San Diego, United States and 12 more places

9 of their 856 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 22 checks run
  • 1 red flag

Still hiring?

15 checks

1 red flag

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • AWS
  • Spark
  • Databricks
Seniority
Senior
Type
Full-time
Specialty
Data Engineering
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Senior
Experience
8+ years
Tech stack
  • Python
  • AWS
  • Spark
  • Databricks

Location

Work model
Hybrid
Region
United States
Office
  • United States
Remote from
  • United States

Compensation

Salary
$77,600 / year
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason