You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Black Forest Labs

Machine Learning Engineer - AI Safety

  • Office

Salary

$220,000 - 280,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds foundation models for visual intelligence, trained together on images, video, audio, and action so they can see, generate, and understand the world.

The founding team pioneered latent diffusion, the technique behind widely used image generation. The company now works on generative media at scale, machines that act in the physical world, and computer use.

Its models rank at the top of public benchmarks and run in production on some of the largest platforms. The company is a small, fast-growing research lab with labs in Freiburg and San Francisco, competing with much larger firms.

The company's products give people strong tools to create new media in many formats. The same model quality also lets bad actors make harmful, copyright-infringing, or illegal content.

The role centers on building and improving the moderation system, a layered stack of detection models. Solutions are chosen case by case, from fine-tuning classical models to RAG-based agents to lightweight semantic embeddings, balancing accuracy, cost, latency, and scale. The work requires creativity and broad knowledge of machine learning methods, plus real interest in AI safety and integrity. You will work with legal, policy, go-to-market, and infrastructure teams.

Responsibilities

  • Build machine learning models and systems that detect harmful or illegal content across many categories and modalities.
  • Work with the core infrastructure team to bring these models into a large-scale production serving pipeline.
  • Review customer requests and feedback about moderation decisions and adjust quickly when needed.
  • Work with legal, policy, and product teams to write moderation policies that can be enforced technically, catch violations effectively, and keep the user experience positive.

Requirements

  • You have deployed vision-language models at scale to classify multimodal content.
  • You have built AI systems on top of leading open-source vision-language models.
  • You have tuned classifiers, built evaluation sets, measured precision and recall at chosen thresholds, and monitored for drift.
  • You are comfortable across the whole machine learning lifecycle, from research and experiments to large-scale deployment.
  • You understand adversarial abuse of generative AI, including prompt obfuscation, jailbreaks, output laundering, and other evasion methods.
  • You have worked in moderation or safety, ideally across text, image, video, and audio.
  • You have reduced vision-language model inference latency at scale.
  • You have built non-VLM safety classifiers, such as classical machine learning models.
  • You have domain knowledge or experience in content copyright, child safety moderation, or both.

Conditions

The team is distributed but maintains real offices. This role is based in San Francisco.

You will be in the office at least 2 days a week, or one full week every other week.

Base annual salary is US $220,000 - $280,000 USD, plus equity.

Where you’d work

From the office, 1 to 2 days a week in the office

The office

About the company

Black Forest Labs

  • Industry: AI

Office in San Francisco, United States

Also hiring in Germany, Berlin, Germany, London, United Kingdom and 2 more places

1 of their 6 open roles is remote

Your chances

We've checked whether it's still hiring and how crowded it is.

  • 21 checks run
  • 0 red flags

Still hiring?

14 checks

No red flags

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • LLMs
  • RAG
Type
Full-time
Equity
Equity offered
Industry
AI
Specialty
ML
Region
United States
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Tech stack
  • LLMs
  • RAG

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States
Days in the office
1 to 2 days

Compensation

Salary
$220,000 - 280,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason