You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Anthropic

Technical Program Manager, External Evaluators

  • Hybrid
  • 6+ years

Salary

$290,000 - 365,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds AI systems that are reliable, interpretable and steerable, aiming for AI that is safe and beneficial for users and society.

The company is growing quickly, and its team includes researchers, engineers, policy experts and business leaders.

The company gives independent outside evaluators access to its models, staff and safety practices so they can judge risks, processes and policies.

This role builds and strengthens relationships with outside reviewers and embedded evaluators to help grow a frontier evaluation community.

The company is a public benefit corporation based in San Francisco.

Research is done by one close team on a few large projects, favoring impact over narrow problems, treating AI work as an empirical science, and valuing clear communication.

Responsibilities

  • Act as the main contact for current evaluator partners and expand the support they need to work well and publish rigorous, independent findings.
  • Build and run the pipeline of new organizations, guiding each one from first conversation through contract, onboarding and daily access to a published report.
  • Within 6 months, you should be able to take a new evaluator from contract talks to a first published report with little involvement from senior leaders.
  • Define the stages and tiers for working with evaluators, and write information access policies that meet their needs while protecting security and confidential data.
  • Work with Research, Security, Legal and IT to turn evaluator access and information requests into fast, well-recorded decisions.
  • Lead the technical design of evaluator access with Security, IT and infrastructure teams, covering permissions, environments and monitoring, and close gaps between policy and controls without slowing evaluators.
  • Run report review against agreed timelines and redaction standards, while keeping evaluators free to publish their own conclusions.
  • Work with researchers and engineers to turn evaluators' questions on training, monitoring and alignment into needs for model access, data, tooling and compute, and plan capacity for each evaluator.
  • Convert evaluators' technical findings into research and engineering work with named owners and dates, and track how the company responds.
  • Give leadership regular progress updates and clear guidance on working with evaluators.
  • Gather feedback from evaluators and internal teams, hold retrospectives, and revise policies and practices.
  • Use the company's AI models and work with engineers to build program tools such as access provisioning, request tracking and report review.
  • Support the wider evaluator community by sharing what the company learns about running independent evaluation well.

Requirements

  • Have led complex technical programs with engineering or research teams, from unclear goals through delivery.
  • Have managed relationships with outside organizations, including scoping work, negotiating contracts, setting expectations and resolving disagreements.
  • Be strong at program management, including planning, tracking milestones and dependencies, and managing risk across many concurrent workstreams.
  • Understand how frontier AI models are trained, evaluated and monitored well enough to set technical requirements, spot technical risks and challenge tradeoffs with researchers and engineers.
  • Show sound judgment and discretion with confidential and sensitive information.
  • Hold a bachelor's degree or an equivalent mix of education, training and/or experience, in a field relevant to the role, shown through coursework, training or professional work.
  • Bring years of experience that match the internal job level for the position.

Conditions

The annual salary range is $290,000 to $365,000 USD.

Expect to be in an office at least 25% of the time, though some roles require more.

Visa sponsorship is available but not for every role or candidate. If an offer is made, the company will make every reasonable effort to get you a visa, with help from an immigration lawyer.

Candidates who do not meet every listed qualification are encouraged to apply.

Benefits

  • Competitive compensation and benefits.
  • Optional equity donation matching.
  • Generous vacation and parental leave.
  • Flexible working hours.

Where you’d work

Part of the week in the office

Visa sponsored

About the company

Anthropic

  • Industry: AI

Offices in San Francisco, United States, New York City, United States

Also hiring in Paris, France, London, United Kingdom, Seattle, United States and 6 more places

12 of their 119 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 22 checks run
  • 3 red flags

Still hiring?

14 checks

No red flags

How crowded?

8 checks

3 red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details13 facts · Role, Location, Compensation, Employment, Company
Seniority
Lead
Type
Full-time
Equity
Equity offered
Industry
AI
Specialty
Project Manager
Region
United States
Show 7 more factsShow less

Role

Category
Product & Project
Specialty
Project Manager
Seniority
Lead
Experience
6+ years

Location

Work model
Hybrid
Region
United States
Offices
  • San Francisco, United States
  • New York City, United States
Visa sponsorship
Sponsored

Compensation

Salary
$290,000 - 365,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason