You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Lead Data Engineer

  • Hybrid
  • 6+ years

Salary

$275,000 - 315,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company is an AI coworker that runs order-to-cash work end to end, covering order management, credit, collections, payments, cash application, disputes and deductions, until the cash reaches the bank.

More details are at the company's site.

Responsibilities

  • You will lead the data engineering team by hiring and managing its engineers and owning its roadmap, while still building and reviewing pipelines yourself.
  • Client data arrives from many systems, mostly ERPs, and each customer's invoices, payments, customers and other order-to-cash records come in with a different structure and different gaps. You will make sure your team's pipelines ingest, clean, model and deliver this data on time and accurately to the product, customer dashboards and AI agents.
  • The stack uses Python, Postgres, Estuary CDC into Snowflake, and dbt for transformation and testing. Sigma powers customer dashboards, and Ask the company, the analytics agent, queries the same Snowflake models. Customers receive data through Snowflake data sharing, and Inngest and DBOS run scheduled jobs. The base is built, and most of the layers above it are yet to be designed.
  • Hire, manage and develop the data engineering team, and raise its standards through design and code review.
  • Set the data roadmap with product, engineering and leadership, deciding what the team works on and in what order.
  • Build and operate ingestion pipelines that bring client data into Snowflake, including CDC from Postgres via Estuary, backfills and schema changes.
  • Define how data is modelled in Snowflake, setting dbt standards for structure, testing, review and deployment.
  • Monitor pipeline health and send alerts on replication lag, failed or late runs, stale tables and unexpected volume changes.
  • Check completeness and accuracy of data for every customer so problems are found before customers report them.
  • Keep core receivables metrics identical in the product, dashboards and Ask the company.
  • Reduce data latency and warehouse cost as volume and customer count grow.

Requirements

  • You have 5+ years of hands-on experience building and running production data pipelines using Python and SQL.
  • You have led a data team as a manager or tech lead and have hired and developed engineers.
  • You have deep production experience with Snowflake. This is required. You also know dbt well and have clear views on good practice.
  • You have run CDC from a production database into a warehouse and understand how it fails.
  • You have carried out a large data cleanup from start to finish, tracing gaps to their source system by system, backfilling millions of rows without interrupting live syncs, and adding checks to prevent recurrence.
  • You have decided how to handle a source system that lacks a needed field and documented the rule so everyone applies it the same way.
  • You have agreed data contracts with customers for files and data shares and pushed back when the data they sent fell short.
  • You care about data quality and observability, including testing, freshness, lineage and alerting.
  • You have worked with multi-tenant data where each customer's data differs.
  • You can set priorities across many stakeholders and explain trade-offs clearly.
  • Big plus: experience with financial data such as invoices, payments, ERP exports and order-to-cash.
  • Big plus: you have built pipelines that feed ML models or AI agents.
  • Big plus: you have shipped customer-facing analytics such as embedded dashboards or data shares.

Conditions

US compensation.

The package includes a top-of-market salary and equity.

Benefits

  • Medical, dental and vision insurance for you.
  • 401(k) with a match.
  • Equity.
  • Flexible PTO.
  • Parental leave.
  • The company is an equal opportunity employer and does not discriminate on any protected characteristic. Reasonable accommodations are available during the application and interview process on request.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

Company hidden

Offices in San Francisco, United States, New York City, United States

Your chances

Still hiring, not crowded yet, and you'd be among the first.

  • 17 checks run
  • 7 good signs
  • 1 red flag

Still hiring?

11 checks

Actively hiring

In its favour4

  • Still on the company's own careers site, checked 1 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence
  • Specific about the basics: pay, place, level, stack and contract all statedSlight evidence
1 moreFewer
  • A tight salary range, set for one seat: $275K to $315KSlight evidence

How crowded?

6 checks

Low

In its favour3

  • In its Early Window: not on the big job boards yetStrong evidence
  • Lead level: far fewer people qualifySlight evidence
  • Asks for dbt, which only 1% of open roles doSlight evidence

Against it1

  • Pays more than 93% of similar roles: that draws applicantsSlight evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details13 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • SQL
  • PostgreSQL
  • dbt
  • Snowflake
Seniority
Lead
Type
Full-time
Equity
Equity offered
Specialty
Data Engineering
Region
United States
Show 7 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Seniority
Lead
Experience
5+ years
Tech stack
  • Python
  • SQL
  • PostgreSQL
  • dbt
  • Snowflake

Location

Work model
Hybrid
Region
United States
Offices
  • San Francisco, United States
  • New York City, United States
Remote from
  • United States

Compensation

Salary
$275,000 - 315,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason