You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Flow Traders

Core Data Engineer

  • Office

Salary

$165,000 - 210,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company is hiring a Core Data Engineer to take full ownership of its most foundational data: the Security Master, reconciled ETF compositions, high-resolution historical market data, and records of trades, orders, quotes and inquiries.

Clean, dependable data sits at the center of the company's direction. It cuts complexity and routine support work for teams across the business and is essential to the growth of quantitative trading approaches.

You will design these products and build them on the in-house Data Platform, using automated, monitored pipelines so people can rely on the data when they need it. You will also deepen your knowledge of these datasets, find better ways to use existing data and look for new sources. Working with teams across the company, you will help systems account for data from the start, streamline data workflows and help stakeholders get more from the data.

The products you own will be used daily across every division and will be a core part of the firm's growth in the years ahead.

Responsibilities

  • Work alongside quants to turn loosely defined research questions into datasets that are aligned, adjusted, point-in-time correct, documented and reproducible.
  • Build, maintain and run pipelines for these products, write quality checks, fix daily operational issues and automate manual steps.
  • Create checks and alerts for the problems that could damage a strategy, and leave out the ones that only add noise.
  • Build shared foundations that every researcher and trading desk relies on: reference data, instrument identifiers, corporate actions and vendor feeds.
  • Help keep critical pipelines running across time zones, since markets in several regions and digital asset markets that never close depend on this data.

Requirements

  • Required: experience in analytics or data engineering, ideally at a startup or scale-up going through rapid growth.
  • Required: solid data modelling and data quality practice, including tests, data contracts, lineage and production observability.
  • Required: strong Python skills, ideally with familiarity with another statically typed language.
  • Required: working knowledge of SQL, relational databases and version control systems.
  • Required: proven experience handling large datasets and familiarity with big data tools.
  • Required: you have owned something in production, not only built it.
  • Required: you enjoy working directly with the people who use your data.
  • Required: strong interpersonal and communication skills to collaborate with both technical and non-technical stakeholders.
  • Required: ability to balance individual stakeholder needs against data quality, consistency and broad usefulness.
  • Strongly preferred: experience with financial data such as prices, market data, transactions and instruments.
  • Strongly preferred: familiarity with point-in-time data, look-ahead bias and survivorship bias.
  • Strongly preferred: experience with a modern cloud data stack, such as Spark or Databricks, dbt, a cloud warehouse and orchestration.
  • Strongly preferred: experience with Airflow, Kafka and GCP (especially GKE, Dataproc and BigQuery).
  • Strongly preferred: experience with Polars, Pandas, Spark, Apache Beam or Apache NiFi.
  • Strongly preferred: experience at a trading firm, systematic fund, brokerage, crypto exchange or market data company.
  • Strongly preferred: on-call or incident response experience.

Conditions

The base salary range is $165,000 to $210,000. Where a candidate falls within the range depends on factors such as experience, location and specific skill set.

Base ranges are set using reliable market research.

Under New York City salary transparency law, total compensation for this role includes that base range plus annual discretionary variable remuneration.

You will be part of one global team and work across time zones to support the data.

Benefits

  • Eligible for an annual discretionary variable remuneration, allocated on the basis of company, group and individual performance and contribution.
  • All employees can share in the company's success.

Where you’d work

From the office

About the company

Flow Traders

  • Industry: FinTech

Office in New York, United States

Also hiring in Amsterdam, Netherlands

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 3 red flags

Still hiring?

14 checks

2 red flags

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details9 facts · Role, Location, Compensation, Company
Tech stack
  • Python
  • SQL
  • Kubernetes
  • dbt
  • Kafka
  • Spark
  • Databricks
  • Airflow
  • BigQuery
Industry
FinTech
Specialty
Data Engineering
Region
United States
Pay period
Annual
Show 4 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Tech stack
  • Python
  • SQL
  • Kubernetes
  • dbt
  • Kafka
  • Spark
  • Databricks
  • Airflow
  • BigQuery

Location

Work model
Office
Region
United States
Office
  • New York, United States

Compensation

Salary
$165,000 - 210,000 / year
Pay period
Annual

Company

Industry
FinTech

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason