You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
SAP IT Business Systeme

Principal Machine Learning Engineer

  • Hybrid
  • 6+ years
  • English (B2)

Salary

Not stated

Similar roles pay $195K - 260K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

You will shape the company's AI strategy and act as a trusted advisor on ML work, designing architectures, leading large-scale deployments, and making sure solutions meet performance and security standards.

You need deep knowledge of advanced ML system architecture, scalable model deployment, and ML platform capabilities, plus working familiarity with modern AI application development. That covers LLMs, retrieval-augmented generation (RAG), prompt engineering, vector search, agent workflows, and model evaluation.

You will serve as the technical link between customer needs and product capabilities. This means working directly with stakeholders, gathering requirements, clarifying vague requests, and proposing solutions that deliver customer value.

The role calls for experience with large-scale ML architecture, advanced MLOps and observability, model governance and explainability, and tuning for both performance and cost. You will also mentor engineers and set standards others follow.

The skills listed for the role include design and architecture, leadership and impact, working with ambiguity, engineering excellence, quality focus, context engineering, AI output quality assurance, agentic AI practice, AI-assisted automation and prototyping, AI adoption, learning agility, collaboration, complex problem solving, creative thinking, and clear communication.

The company is an enterprise applications and business AI provider that has served finance, procurement, HR, supply chain, and customer experience customers for more than 50 years. The team builds and operates ML systems at scale.

Responsibilities

  • Design and optimize large-scale ML systems, including LLM capabilities and the infrastructure behind them.
  • Build new infrastructure and define architectural and operational standards for ML engineering.
  • Ensure ML solutions meet business, performance, scalability, and governance requirements.
  • Drive adoption of modern ML techniques and enable safe experimentation.
  • Guide technical direction across products and make sure systems are production-ready and aligned with product goals.
  • Mentor engineers and influence teams and products beyond your own group, including people who do not report to you.

Requirements

  • 10+ years of software engineering experience and a record of delivering complex systems.
  • Bachelor's degree in computer science, mathematics, physics, or a related field.
  • Hands-on experience running AI/ML in production, including LLMs, RAG, prompt engineering, vector search, agent workflows, and model evaluation.
  • Expertise in distributed systems design and architecture for large enterprise products.
  • Strong programming skills, proficiency with ML frameworks, and a solid grasp of MLOps practices.
  • Excellent English communication and the ability to work well in global, multicultural teams.

Conditions

The salary range is listed in the job posting. Final pay falls within that range and depends on education, skills, experience, location, and role scope, as decided during selection.

Any variable incentive is target-based, and actual payout depends on company and individual performance.

Applicant information is handled confidentially under EEO guidelines.

Use of AI in the application process must follow the company's published ethical guidelines, and breaches may lead to disqualification.

Benefits

  • Variable incentive opportunities and additional benefits may be offered, subject to the terms of the relevant plans and policies.
  • Benefits summary and eligibility are published on the company's North America benefits page.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

SAP IT Business Systeme

  • Industry: SaaS

Office in Palo Alto, United States

Also hiring in Munchen, Germany, United Kingdom, Reston, United States and 23 more places

3 of their 103 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 19 checks run
  • 3 red flags

Still hiring?

13 checks

2 red flags

How crowded?

6 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details14 facts · Role, Location, Compensation, Employment, Company, Requirements
Tech stack
  • LLMs
  • RAG
  • Vector databases
Seniority
Principal
Type
Full-time
Industry
SaaS
Specialty
ML
Region
United States
Show 8 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Seniority
Principal
Experience
10+ years
Tech stack
  • LLMs
  • RAG
  • Vector databases

Location

Work model
Hybrid
Region
United States
Office
  • Palo Alto, United States
Remote from
  • United States

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Full-time

Company

Industry
SaaS

Requirements

Languages
  • English (B2)

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason