You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Black Forest Labs

Forward Deployed Engineer, ML Infrastructure & Inference

  • Office
  • 6+ years

Salary

$273,000 - 395,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds the base layer for visual intelligence: multimodal models trained jointly on images, video, audio and action, to see, generate and understand the world.

The founding team pioneered latent diffusion and Stable Diffusion. With FLUX, the company is moving into generative media at scale, machines that act in the physical world, and computer use.

FLUX models rank at the top of public benchmarks and run in production on some of the largest platforms. The company is a small, fast-growing research lab that competes with much bigger firms, with labs in Freiburg and San Francisco.

Responsibilities

  • Build custom endpoints and pipelines on FLUX for customers, including multi-step workflows, prompt harnesses and upsampling, pre- and post-processing, moderation and safety layers, and FLUX combined with VLMs and other models.
  • Take customer use cases from scoping through proof of concept to a production endpoint, on BFL's infrastructure or the customer's.
  • Deploy FLUX models and custom pipelines into customer production environments, from on-premise to BFL-hosted integrations, covering serving setup, GPU sizing and scaling.
  • Profile customer workloads, apply existing inference optimizations to meet cost and latency targets, and work with BFL's inference team on deeper optimization.
  • Build evaluation sets and harnesses against customer requirements, and detect quality regressions between model versions.
  • Help customers tailor models to their use case through finetuning and LoRA training pipelines, on their infrastructure or BFL's.
  • Advise customers on deployment architecture and on the trade-offs between BFL-hosted and self-hosted setups for cost, latency, security and compliance.
  • Pass field learnings to BFL's research and platform teams, and turn repeated customer work into reusable tooling, reference architectures and documentation.
  • Serve as a technical leader within the FDE team, set standards for applied and deployment work, and mentor other engineers.

Requirements

  • 6+ years of engineering experience, with substantial time building and running ML systems in production.
  • Hands-on experience building and serving ML models from model code to API, using tools such as PyTorch, model serving frameworks and GPU workloads.
  • Experience building end-to-end applied ML systems that combine several models, with evaluation and safety or moderation components.
  • Solid infrastructure skills: Kubernetes, containerization, observability, and at least one major cloud platform (AWS, GCP or Azure).
  • Experience working directly with customer engineering teams in complex enterprise settings, including security reviews and regulated or air-gapped environments.
  • Strong Python skills and comfort reading and changing model code.
  • Ability to explain complex technical trade-offs clearly to engineers and non-technical stakeholders, both inside and outside the company.
  • Willingness to take on Technical Deployment Lead (TDL) responsibility for strategic accounts, owning the technical relationship and delivery end to end.
  • Willingness to travel occasionally, nationally and internationally, for team offsites and customer work.
  • Prior knowledge of diffusion models and/or flow matching, plus relevant finetuning and distillation techniques.
  • Inference optimization experience, with a record of improving latency, throughput or cost per generation.
  • Experience using LLMs or VLMs for prompt harnesses, captioning or evaluation.
  • Experience with open-source FLUX ecosystem tooling such as ComfyUI, diffusers and common trainer frameworks.
  • Experience serving video generation models.
  • Open-source contributions to inference, serving or diffusion model projects.
  • Previous work as a forward deployed engineer, solutions architect or ML platform engineer at an AI lab or cloud provider.

Conditions

Distributed team with real offices. This role is based in San Francisco and requires being in the office at least 2 days a week, or one full week every other week.

Values: Obsessed, Low Ego, Bold and Kind.

Compensation: USD 273-395K plus equity, depending on profile.

Benefits

  • Equity, in addition to the USD 273-395K base range.

Where you’d work

From the office, 1 to 2 days a week in the office

The office

About the company

Black Forest Labs

  • Industry: AI

Office in San Francisco, United States

Also hiring in Germany, Berlin, Germany, London, United Kingdom and 2 more places

2 of their 7 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 1 red flag

Still hiring?

14 checks

No red flags

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details13 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • AWS
  • Kubernetes
  • PyTorch
  • Azure
  • LLMs
Type
Full-time
Equity
Equity offered
Industry
AI
Specialty
Forward Deployed
Region
United States
Show 7 more factsShow less

Role

Category
Solutions & Support
Specialty
Forward Deployed
Experience
6+ years
Tech stack
  • Python
  • AWS
  • Kubernetes
  • PyTorch
  • Azure
  • LLMs

Location

Work model
Office
Region
United States
Office
  • San Francisco, United States
Days in the office
1 to 2 days

Compensation

Salary
$273,000 - 395,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
AI

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason