You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Staff Data Engineer

  • Office
  • 6+ years

Salary

Not stated

Similar roles pay $145K - 210K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds autonomous and intelligent platforms for maritime operations. Its Internal Business Tools group builds custom applications, analytics and digital tools for internal operations.

This Staff Data Engineer role centres on architecting and building the enterprise data platform on Databricks.

You will own the medallion design across business units and key domains. The same data feeds internal tools and the analytics business teams run themselves, so you need to understand what it means and how sensitive it is, then build pipelines and access rules to match.

You will also act as the lead technical advisor to business-led analyst teams, embedded with the teams you support. The platform is still taking shape, so the role suits an engineer who sets direction and also writes code.

Responsibilities

  • Design and own the Databricks lakehouse, covering medallion layers, catalog structure, environments and spend.
  • Build batch, change data capture and streaming ingestion from ERP systems, other enterprise platforms and in-house software, so every load can be traced and replayed.
  • Model data in conformed structures with shared business definitions that serve internal tools, analytics and BI.
  • Write reusable pipeline patterns and standards for domain teams to adopt as they come on board.
  • Own data quality, lineage and documentation, including data contracts for published datasets. Send bad records to quarantine rather than discarding them.
  • Set classification, retention and access controls in Unity Catalog for export-controlled, CUI, HR and financial data.
  • Advise business-led analyst teams: define ownership boundaries and onboarding paths, review their work and help them self-serve safely.
  • Work alongside business teams and their leaders to learn how they operate and what data they need, then turn that into platform priorities.
  • Run the platform like production software with CI/CD, infrastructure as code, dev, test and prod promotion, and incident response.
  • Advise on the shared data platform roadmap and document build-versus-buy decisions.
  • Coach engineers and analysts and help grow the data engineering function.

Requirements

  • Required: 10+ years in data engineering, including owning a data platform's architecture in production.
  • Required: 3+ years building production pipelines on Databricks with Delta Lake, Lakeflow Jobs and a medallion architecture.
  • Required: Expert SQL, plus strong Python and PySpark.
  • Required: Experience with batch, CDC and streaming ingestion from enterprise systems such as ERP, HRIS, CRM or MES, and from in-house applications.
  • Required: Strong dimensional and cross-domain data modelling skills.
  • Required: Experience with Unity Catalog and with applying classification and access controls in a regulated or security-sensitive setting.
  • Required: Experience with CI/CD, testing and monitoring for data pipelines.
  • Required: A record of leading technical direction without formal authority.
  • Required: Experience working with non-technical stakeholders, ideally while embedded in a business team, explaining tradeoffs plainly and earning trust as a partner rather than a service provider.
  • Required: Comfort shaping standards on a platform that is still under construction.
  • Required: Bachelor's degree in computer science, engineering, information systems or a related field, or equivalent experience.
  • Preferred: Set up a Databricks environment from an early stage, using Lakeflow Declarative Pipelines, Databricks SQL, Asset Bundles and system tables.
  • Preferred: Databricks Data Engineer Professional or Associate certification.
  • Preferred: Enabled several business domains on one shared platform.
  • Preferred: Fed operational applications, not just reporting, from a lakehouse.
  • Preferred: Built a semantic or metrics layer.
  • Preferred: Used Fivetran, Airbyte or Lakeflow Connect, and Terraform.
  • Preferred: Defense, aerospace, maritime or manufacturing background, including export-controlled data.
  • Preferred: AWS or Azure experience.
  • Preferred: Used AI tools to speed up engineering while judging outputs and handling sensitive data carefully.

Conditions

Mostly desk-based work at a computer, with occasional standing and walking in the office.

Regular keyboard and mouse use, reading screens and documents, and occasional reaching, bending or stooping to reach files or supplies.

Occasionally lift and carry items up to 20 pounds, such as office supplies or packages.

For US-based roles, access to export-controlled information or items requires U.S. Person status: U.S. citizens, legal permanent residents, or certain protected asylees and refugees as defined in 8 U.S.C. 1324b(a)(3).

The company does not discriminate on protected grounds and offers reasonable accommodations to qualified individuals with disabilities.

Benefits

  • Medical cover: the company pays 100% of the employee premium and 80% of the dependent premium.
  • Dental and vision cover: the company pays 100% of the employee premium under the basic plan and 80% for dependents.
  • Generous paid time off and holidays.
  • Paid maternity and paternity leave.
  • Industry-standard salary, with opportunities for performance-based bonuses.
  • 401(k) retirement plan with a company match.
  • Equity options.
  • Basic life insurance and short- and long-term disability cover.
  • Discounted pet insurance, including a 24/7 telehealth helpline.
  • Free lunch, plus unlimited free drinks and snacks in the office.

Where you’d work

From the office

About the company

Company hidden

Office in Austin, United States

Your chances

Still hiring, not crowded yet, and you'd be among the first.

  • 15 checks run
  • 5 good signs
  • 0 red flags

Still hiring?

10 checks

Actively hiring

In its favour2

  • Still on the company's own careers site, checked 1 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence

How crowded?

5 checks

Low

In its favour3

  • In its Early Window: not on the big job boards yetStrong evidence
  • Asks for 10+ years: a narrow poolModerate evidence
  • In the office in Austin: only people nearby can take itSlight evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • SQL
  • AWS
  • Azure
  • Spark
  • Databricks
Seniority
Staff
Type
Full-time
Equity
Equity offered
Specialty
Data Engineering
Region
United States
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Staff
Experience
10+ years
Tech stack
  • Python
  • SQL
  • AWS
  • Azure
  • Spark
  • Databricks

Location

Work model
Office
Region
United States
Office
  • Austin, United States

Compensation

Salary
Salary by agreement
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason