You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Exa

Software Engineer, Knowledge Engine – Data Infrastructure

  • Office

Salary

$180,000 - 350,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

Our Knowledge Platform team builds the company's knowledge engine, which merges information from the web and other sources into one of the largest open-domain knowledge graphs, holding hundreds of billions of evidence-backed claims. The engine has two parts: construction pipelines that judge what to trust, and retrieval systems that work out the best way to query it. The aim is to let AI agents answer any factual question about the world with unmatched precision and completeness.

You will build the pipelines that construct this knowledge, taking inputs from a web crawl running at 100k docs/s to vendor datasets, and forming a graph of what is true that stays accurate as the underlying data changes.

This is new ground at very large scale. No ready-made system exists for building a model of the world from the open web, so you will make foundational choices on how claims are represented, resolved, trusted and tracked over time. Everything built on top relies on those choices.

Example projects include taking a new billion-row dataset from first delivery to queryable entities in days rather than months, keeping a graph of hundreds of billions of claims current so a web change reaches it in minutes, and building a system that holds one evidence-backed record for every company and person in the world, resolved across the web and every ingested source.

Responsibilities

  • Combine the live web crawl, vendor deliveries, APIs and other off-web sources into one typed graph, extracting ontology-shaped claims from pages and records, each with its provenance, timestamp and confidence.
  • Onboard each new source in a clean, versioned, append-only form that handles schema changes, late and corrected records, and replayable cursors, so every claim can be traced to the exact delivery behind it.
  • Resolve entities across billions of records through blocking, pairwise scoring and clustering into canonical people, companies, places and publications, then run truth discovery that weighs source reliability, recency and corroboration to settle conflicting claims.
  • Keep the graph current and convergent. Because streams arrive continuously, out of order and at different rates, build incremental jobs over change data feeds that apply diffs, are idempotent and resumable, reach the same state however runs overlap, fail or replay, and expose only committed, consistent versions to readers.
  • Measure precision and completeness with labeled evaluations for extraction and resolution, per-source coverage and correctness metrics, and lineage that shows which source or stage failed and why.

Requirements

  • You have built and run large distributed data pipelines in production over petabytes of structured and unstructured data, using Spark on a lakehouse format such as Delta Lake, Iceberg or Hudi.
  • You understand incremental processing well, including change data capture, idempotent writes, backfills and reprocessing.
  • You are strong in Python and at least one systems language, and you can read and tune Spark query plans.
  • You care about correctness, reliability and data quality as much as scale.
  • Bonus: experience with entity resolution, record linkage, knowledge graphs or ontologies.
  • Bonus: experience with information extraction or truth discovery at scale.
  • Bonus: experience with Lance or other columnar or vector-native formats.

Where you’d work

From the office

About the company

Exa

  • Industry: AI

Office in Zurich, Switzerland

Also hiring in San Francisco, United States, Sydney, Australia, New York City, United States and 1 more place

3 of their 23 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 1 red flag

Still hiring?

14 checks

No red flags

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details10 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • Spark
Type
Full-time
Industry
AI
Specialty
Data Engineering
Region
Europe
Pay period
Annual
Show 4 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Tech stack
  • Python
  • Spark

Location

Work model
Office
Region
Europe
Office
  • Zurich, Switzerland

Compensation

Salary
$180,000 - 350,000 / year
Pay period
Annual

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason