You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
TetraScience

Senior Software Platform Engineer, MLOps

  • Office
  • 6+ years

Salary

$170,000 - 220,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds a scientific data and AI cloud for biopharma companies, and this platform is the core layer that its enterprise customers depend on for secure, compliant scientific data and AI features.

This is a senior role on the team that combines distributed systems with MLOps. You will help build and run central parts of the AI and data infrastructure that customers and other engineering teams rely on.

You will work with Applied AI engineers, data engineers, and platform teams to deliver cloud services and MLOps infrastructure for production AI and ML workflows, and you will take major parts of the AI platform from design through production. You will also work with the Lead Platform Engineer and Applied AI teams on how the components fit together and help set direction through design reviews.

The scope covers the model and prompt lifecycle, evaluation and observability, tenant and data boundaries around prompts and retrieval, and the cost and latency controls needed to run production AI at scale.

The model serving, MCP, and agent features you build are used directly by scientists at some of the largest pharmaceutical companies, working on their own data under their compliance obligations. The role suits someone who has shipped AI/ML infrastructure that external users depend on, not just internal tools.

Responsibilities

  • Design, build, and run the services and APIs that let customers run models and agents on their own scientific data, and that Applied AI and data engineering teams build on.
  • Manage the model and prompt lifecycle in your area using Databricks MLflow and AWS Bedrock, covering registration, versioning, asset bundles, staged promotion, rollback, and multi-model serving.
  • Build the inference path for real-time and batch AI workloads, including routing, batching, caching, concurrency control, capacity planning, large binary inputs such as instrument images, and graceful degradation under load.
  • Integrate LLMs into production systems with retrieval-augmented generation (RAG), and build agent capabilities including tool and function calling, MCP-based tooling, and agent runtimes.
  • Work with the security team to build protections into the platform, including guardrails, defenses against prompt injection and tool abuse, PII and PHI handling, and strict tenant data boundaries across prompts, retrieval, and tool calls.
  • Build evaluation and quality tooling so AI can ship safely: offline and online eval harnesses, golden datasets, CI regression gates, A/B and shadow deployments, and drift and hallucination detection in production.
  • Set up monitoring, alerting, logging, and distributed tracing for the services you own, and define SLIs and SLOs that suit systems with probabilistic outputs.
  • Build the reproducibility and lineage a validated pharma environment requires, with versioned data, code, prompts, and model artifacts and an audit trail that stands up to customer and regulatory review.
  • Write infrastructure-as-code and deployment automation for the services you own using CloudFormation and AWS CDK, working with the team that owns production deployments to support multi-tenant infrastructure, online upgrades, and on-demand compute.
  • Take ownership of production readiness with Applied AI engineers, data engineers, and platform teams, covering performance, reliability, and model cost in production, plus incident response and runbooks.
  • Take part in design reviews, write design docs and technical documentation for your components, and mentor mid-level engineers.
  • Assess new frameworks, serving runtimes, and model providers, and recommend whether to build or buy, with clear reasoning.

Requirements

  • 7+ years of professional software and infrastructure engineering experience, including building and running distributed, cloud-native systems in production.
  • Experience owning a significant service or component technically, including design decisions on scalability, performance, and cost.
  • Hands-on experience building and maintaining production AI/ML infrastructure, including model deployment and lifecycle management, for users outside your own team. Experience limited to pipelines for your own team is not a fit.
  • Hands-on experience running LLM-based systems in production, including RAG architecture, retrieval and embedding design, prompt and model versioning, and tool or function calling. Prototyping with an SDK is not enough: you have run these systems under real traffic, latency budgets, and failure modes.
  • Experience building security into a multi-tenant platform, including authorization boundaries between tenants and handling sensitive data such as PII and PHI, with an understanding of LLM risks such as prompt injection and tool abuse.
  • Strong TypeScript and Python skills for building reliable APIs and backend services, and the judgment to review AI-generated code for correctness, security, and fit.
  • Production experience with a model registry and serving stack, ideally Databricks MLflow, including registration, versioning, asset bundles, and serving workflows.
  • Experience using AI evaluation as a release gate rather than after-the-fact reporting, including eval harnesses, regression gates, and drift or quality monitoring for non-deterministic systems.
  • Experience designing scalable, secure, versioned, and extensible REST APIs with OpenAPI.
  • Working knowledge of AWS and containerized workloads such as Docker, familiarity with CloudFormation or CDK, and the ability to contribute to CI/CD pipelines and deployment automation.
  • Experience with observability and SLI/SLO practice for production systems, including monitoring, alerting, and distributed tracing.
  • Clear communication with customers and cross-functional teams, and the ability to shape technical direction on teams you do not manage.

Conditions

Stock options are offered at a VC-backed Series C company.

No visa sponsorship is available for this position.

Flexible working arrangements are available.

The posted salary range is $170,000-$220,000 USD and reflects the target baseline for this role. Final pay depends on your specific experience, localized market data, and internal team equity.

Benefits

  • Competitive compensation.
  • Stock options at a VC-backed Series C company.
  • Employer pays 100% of benefits for eligible employees and their immediate family members.
  • 401(k).
  • Unlimited paid time off (PTO).
  • Flexible working arrangements.
  • Company-paid life insurance and LTD/STD.

Where you’d work

From the office

No visa sponsorship

About the company

TetraScience

  • Industry: HealthTech

Office in United States

Also hiring in St. Louis, United States, Boston, United States, London, United Kingdom and 1 more place

Your chances

We've checked whether it's still hiring and how crowded it is.

  • 21 checks run
  • 0 red flags

Still hiring?

14 checks

No red flags

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details14 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • AWS
  • Docker
  • CI/CD
Seniority
Senior
Type
Full-time
Equity
Equity offered
Industry
HealthTech
Specialty
DevOps
Show 8 more factsShow less

Role

Category
DevOps & Infrastructure
Specialty
DevOps
Seniority
Senior
Experience
7+ years
Tech stack
  • Python
  • AWS
  • Docker
  • CI/CD

Location

Work model
Office
Region
United States
Office
  • United States
Visa sponsorship
Not sponsored

Compensation

Salary
$170,000 - 220,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Company

Industry
HealthTech

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason