You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Data Scientist

  • Hybrid

Salary

$265,000 - 380,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company's Integrity team protects people and businesses that use ChatGPT, Codex, and the API against fraud, abuse, and harmful misuse. The team covers payment and promotional abuse, compromised accounts and API credentials, business and advertiser integrity, and emerging misuse of frontier AI capabilities. It also helps product teams measure real usage so abuse does not skew product growth decisions.

Integrity Data Science works out where to intervene and whether those interventions succeed. A payment control can stop fraud but also block legitimate purchases, and a launch can ease onboarding while opening new routes for abuse. The role measures both sides of those trade-offs.

The role centers on finding new abuse patterns, sizing their impact, and leading the analysis behind decisions on detection, enforcement, and product launches. You will work with Product, Engineering, Research, Policy, and Operations to turn findings into fixes and measure their effect after release.

Responsibilities

  • Look into unusual activity across products, estimate how widespread each problem is, who it hits, and what it costs users or the business, then recommend where to focus.
  • Set outcome metrics, guardrails, and baselines, and build monitoring that flags shifts in abuse, customer friction, and operational performance.
  • Help build and assess detection rules, classifiers, and human review workflows. Use labeled samples and review results to find what the systems miss, where they wrongly flag legitimate activity, and how those errors differ across users and products.
  • Design randomized holdouts, or use quasi-experimental or observational methods when randomization is not practical. Estimate fraud losses prevented and harm avoided, along with effects on legitimate users, revenue, compute costs, and review workload. Recommend whether to launch, expand, adjust, or retire a control.
  • Find where signals, review decisions, or enforcement actions break down. Work with partners to close those gaps and build reusable datasets, analyses, and investigation tools.

Requirements

  • Use AI tools to dig into large, messy datasets, test hypotheses fast, and automate recurring analyses.
  • Be fluent in SQL and Python, and check AI-generated queries, code, and conclusions against the underlying data.
  • Have strong statistical judgment and experience with experimentation, causal inference, or observational analysis. Be able to draw conclusions from incomplete or biased labels and explain how uncertainty affects a decision.
  • Take ownership of open-ended problems, from choosing what to measure through recommending an action to checking whether it worked.
  • Communicate clearly with technical and nontechnical colleagues and explain the trade-offs behind a recommendation.
  • Experience in integrity, trust and safety, fraud or risk analytics, security analytics, or applied ML evaluation is helpful. Experience evaluating detection systems, human review, or LLM-based classifiers is a plus.

Conditions

Background checks are run under applicable law. Qualified applicants with arrest or conviction records are considered in line with the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act for US-based candidates.

For unincorporated Los Angeles County workers, the company reasonably believes criminal history may have a direct, adverse, and negative relationship with these duties, which could lead to withdrawal of a conditional offer: protecting entrusted computer hardware from theft, loss, or damage; returning all hardware and the data on it at termination or end of assignment; and keeping proprietary, confidential, and non-public information confidential. The job also requires access to secure, protected IT systems and related data security obligations.

The company is an equal opportunity employer and does not discriminate on race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other legally protected characteristics.

Where you’d work

Part of the week in the office

The office

You can work from

  • United States

About the company

Company hidden

  • Industry: AI

Office in San Francisco, United States

Your chances

Still hiring, not crowded yet, and you'd be among the first.

  • 17 checks run
  • 5 good signs
  • 1 red flag

Still hiring?

11 checks

Actively hiring

In its favour3

  • Still on the company's own careers site, checked 1 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence
  • States its salarySlight evidence

How crowded?

6 checks

Low

In its favour2

  • In its Early Window: not on the big job boards yetStrong evidence
  • Hybrid in San Francisco: only people nearby can take itSlight evidence

Against it1

  • Pays more than 95% of similar roles: that draws applicantsSlight evidence

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details11 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • SQL
  • LLMs
Type
Full-time
Industry
AI
Specialty
Data Science
Region
United States
Pay period
Annual
Show 5 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Science
Tech stack
  • Python
  • SQL
  • LLMs

Location

Work model
Hybrid
Region
United States
Office
  • San Francisco, United States
Remote from
  • United States

Compensation

Salary
$265,000 - 380,000 / year
Pay period
Annual

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason