You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Red Cell Partners

ML Engineer, Retrieval & Grounded Generation

  • Remote
  • 3-6 years

Salary

$135,000 - 170,000/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company is an incubation firm that builds and invests in fast-scaling technology businesses across healthcare, cyber, and national security.

Its insights business uses AI, mathematical optimization, data analytics, and software engineering to keep complex systems performing when disruption hits, linking decisions to operational goals and helping customers anticipate, assess, and reduce disruption impacts.

This is a QA role on an AI-enabled decision-support system. You will own quality end to end: the test plan, the automated coverage, and the evidence that delivered work matches what was specified.

Product sets the acceptance criteria. You turn them into executable tests and hold engineering, platform, and other delivery teams to them.

You report through the Product Lead and take direction from product, while working with engineering and platform daily. The aim is to verify the specification rather than the implementation, because a suite written from the code can pass and still miss what the customer asked for.

The reporting line does not lower the engineering bar. You will write code and build real automation, and you need to read the application code well enough to test it properly.

You will be the first dedicated quality engineering hire, so you set the approach rather than inherit one. The team expects current tooling, including AI assistance in engineering work.

Success means a customer-accepted test plan that holds as the system grows, acceptance criteria that can be verified before development starts, automated coverage running as a release gate, sampled audits that catch wrong automated decisions, performance evidence at realistic load, and a release trail that shows why any version shipped.

Responsibilities

  • Own the system test plan covering functional, integration, performance, and load testing, and keep it as a formal deliverable.
  • Turn the acceptance criteria set by product into executable tests.
  • Before development begins, review acceptance criteria with product and flag requirements that are ambiguous or cannot be verified as written.
  • Hold engineering, platform, and partner teams to the acceptance criteria, and define the evidence that must exist before a change counts as complete.
  • Work with engineering day to day, close enough to test well and independent enough to report what testing shows.
  • Plan and run user acceptance testing with the customer, and track findings to resolution.
  • Build and maintain automated test suites, and integrate them into the CI/CD pipeline as release gates.
  • Set an automated coverage standard, hold to it, and report against it.
  • Build performance and load tests that validate the system under its expected user load.
  • Keep regression coverage current across releases.
  • Build and maintain labeled evaluation sets with subject-matter experts whose time is limited.
  • Design and run sampled audits that confirm automated decisions were correct.
  • Measure and report what the system misses alongside what it gets right.
  • Measure how often users override the system, and report the trend.
  • Document how each committed measure is computed, what data it uses, and what evidence accompanies a release.
  • Produce this evidence independently of the people building the models.
  • Maintain the version inventory across builds, models, configurations, and thresholds.
  • Produce test reports, evaluation records, and rollback criteria for each release.
  • With platform engineering, confirm that test environments match production closely enough for results to be meaningful.
  • Enforce the release gate so no release ships without the evidence its acceptance requires.

Requirements

  • 5+ years in software quality engineering, test automation, or software engineering with substantial dedicated test ownership.
  • A considered view on how testing should be done, and the judgment to know which practices are worth enforcing. You will set the standard here.
  • Strong coding in a test automation language and framework, such as Python with pytest, or JavaScript or TypeScript with Playwright, Cypress, or Selenium. Python is the main language of this stack, and you must be able to read and reason about the application code under test.
  • Daily use of AI-assisted development, with a clear sense of where it adds value and where its output needs verification. AI tooling is expected to be part of how test coverage is built.
  • Demonstrated experience building automated test suites and wiring them into CI/CD as release gates.
  • Experience owning a test plan through review and acceptance.
  • A habit of testing against the requirement rather than the implementation, including working with product owners or end users to establish what correct means.
  • Experience with performance and load testing, including knowing what a result does and does not demonstrate.
  • Working statistical literacy, including sampling design and the confidence a measurement can support.
  • Experience measuring what a system misses, not only what it gets right.
  • Willingness to report results the team did not want, and to keep measurement independent of the people whose work it evaluates.
  • Ability to gate work owned by people who do not report to you, and enough credibility with engineers that the gate holds.
  • Clear, audit-ready written documentation, since much of this role's output is evidence others read.
  • Willingness to hold a release and explain the reason to people who want it shipped.
  • Preferred: an active Top Secret clearance.
  • Preferred: experience in government DevSecOps, RMF, or ATO environments, and producing test evidence for a formal accreditation or audit.
  • Preferred: contract and API testing, test data management, and building test infrastructure others can extend.
  • Preferred: using language models to generate and maintain test coverage, and practices that keep generated tests meaningful rather than merely passing.
  • Preferred: performance tools such as JMeter, k6, Locust, or comparable.
  • Preferred: validating machine learning or model output, including groundedness and citation checking, and analyzing where users disagreed with a system recommendation.
  • Preferred: domain experience with systems where an incorrect result carries real cost, and where testing had to satisfy an outside reviewer.
  • Preferred: model cards, NIST AI RMF, or comparable responsible AI practice.
  • Preferred: Section 508 and WCAG verification.

Conditions

Fully remote, with a results-based way of working.

Travel of up to 25% to the company headquarters, customer sites, and vendor facilities, as required.

US citizenship is required.

An active US Secret clearance is required. The work runs in a controlled government cloud and needs a favorable investigation and CAC eligibility from the start.

Elevated security requirements apply to parts of the work and are discussed during the interview process.

The salary range is $135,000 to $170,000, reflecting typical pay for this role based on experience, skills, and other factors.

Applications are checked by third-party hiring platforms for accuracy and possible fraud, and flagged applications may be declined.

Benefits

  • Competitive salary, bonus, and equity package.
  • 100% employer paid comprehensive health coverage, including medical, dental, and vision, for you and your family.
  • Paid maternity and paternity leave of 14 weeks at normal pay.
  • Unlimited PTO, with management approval.
  • A flexible work environment where you manage your own day.
  • Optional 401K, FSA, and equity incentives.
  • Mental health support through a third-party provider.
  • Cost-effective GLP-1 medication options through a third-party provider.
  • Opportunities for professional development and continued learning.
  • A career track with potential for rapid advancement as the firm grows.

Where you’d work

Fully remote

You can work from

  • United States

No visa sponsorship

About the company

Red Cell Partners

16 of their 16 open roles are remote

Your chances

We've checked whether it's still hiring and how crowded it is.

  • 21 checks run
  • 0 red flags

Still hiring?

14 checks

No red flags

How crowded?

7 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
Type
Full-time
Equity
Equity offered
Specialty
ML
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Experience
5+ years
Tech stack
  • Python

Location

Work model
Remote
Region
United States
Remote from
  • United States
Visa sponsorship
Not sponsored

Compensation

Salary
$135,000 - 170,000 / year
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason