The role is a Forward Deployed Engineer working embedded within the customer's team, mainly with large enterprise and public sector accounts.
You turn their problems into production-grade solutions and stay with the customer until those solutions are widely adopted and show measurable value.
You are the day-to-day technical partner for the customer and the link between their teams and the company's Customer Engineering, Product and Engineering teams.
The company builds open and enterprise-grade AI tooling, including the open-source Haystack framework and the Haystack Enterprise Platform (HEP). It was founded in 2018, is backed by GV and Balderton, and is remote-first.
Responsibilities
Work inside the customer's team, following their delivery and governance processes, ways of working and environments.
Advise the customer on use case priorities, architecture and roadmap, linking their goals to HEP.
Scope well-defined solutions with clear success metrics and a baseline, working with the Value Engineer.
Plan ahead for the customer's future needs and keep a customer-specific AI roadmap up to date.
Take technical ownership from proof of concept to production, covering agents and orchestration, workflows, RAG pipelines, indexing and embeddings, model optimization, evaluations, cost management and API and system integrations.
Apply current state-of-the-art methods to the customer's hardest problems and build reliable, secure, production-grade systems in their environment.
Monitor solution performance together with the customer and fix problems in the AI layer quickly.
Build and share reference architectures and reusable components that speed up future engagements.
Make sure the solutions are used and deliver measurable quality and business impact.
Run structured evaluations and keep improving retrieval quality, prompts and model behaviour based on real usage and feedback.
Enable the customer's team to run and extend the solutions alone through documentation, runbooks, knowledge transfer and training.
Identify new use cases, teams and stakeholders and pass them to the account team.
Gather evidence of the value delivered against the kick-off baseline to support contract renewal.
Feed field insights back to Product and Engineering to shape HEP.
Requirements
Native German language skills.
Hands-on experience putting AI applications into production, including RAG, agents, data preprocessing, retrieval and embeddings.
A record of building trusted, long-term relationships with technical and business stakeholders, and communicating clearly with each of them.
Experience designing and running agent evaluations and improving quality using real usage data.
Familiarity with agent frameworks and vector databases.
Strong Python and production engineering skills, including testing, CI/CD, code review and observability.
Experience running AI solutions in enterprise production environments, including monitoring, troubleshooting and incident handling.
Solid understanding of enterprise integration: APIs, authentication (OIDC/SAML), security and compliance.
Good knowledge of current LLM and agentic systems, and the judgment to tell when they are ready for production.
Experience scoping and estimating work on long-running engagements, covering effort, assumptions, risks and deliverables.
Haystack experience is a big plus.
Forward-deployed or consulting experience on long, embedded engagements.
Basic frontend skills (React, TypeScript) for user-facing workflows.
Fine-tuning experience (PEFT, LoRA).
Conditions
Remote-first, with flexible hours.
Berlin HQ, which is dog-friendly.
Benefits
Choice of tools and technology.
30 days vacation, plus extra days for sick leave to care for family.
Competitive salary and stock options for every team member.
A monthly allowance for sports and mental health support through Oliva.