You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Equinix

AI Engineer, Trust & Evaluation

  • Hybrid
  • 3-6 years

Salary

Not stated

Similar roles pay $155K - 235K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company is a digital infrastructure business that works to shorten the path to connectivity.

This is a newly created role on the AI engineering team, focused on the evaluation and trust features of the company's GenAI platform.

You would build features that let teams test their agents at scale, including golden datasets, synthetic test data, LLM-as-judge scoring, and quality monitoring for agents in production.

You would also build and test the controls agents run under, such as agent identity, access, guardrails and data boundaries, and trace agent failures to their cause and fix them in the platform.

You work alongside senior engineers and with product, platform and security partners to turn defined problems into secure, observable and performant solutions.

Success means platform features ship on schedule with tests and documentation, teams evaluate their agents without specialist help, and every release has an evaluation record.

Over time, you take on larger and less defined work each quarter with less guidance.

Responsibilities

  • Build evaluation features: dataset creation and versioning, golden datasets, synthetic test data and reusable metric templates.
  • Build scoring for agents, including code-based checks, LLM-as-judge, tool-call accuracy and grounding checks.
  • Build human review features that compare judge scores with human reviewers, and recalibrate scoring when agreement drops.
  • Run evaluations at scale before releases, on every change to a prompt, model or tool, and on agents in production.
  • Write evaluation playbooks so agent builders can assess their own agents.
  • Keep results traceable to the agent, model, prompt and dataset versions tested, and record who approved each release.
  • Build and test trust controls: agent identity, per-user access to connected systems, tool permissions, guardrails and data boundaries.
  • Run adversarial tests and red-teaming, including prompt injection, out-of-scope requests and data-boundary tests, and turn findings into fixes and regression tests.
  • Work with security and governance teams to convert policy requirements into automated checks.
  • Investigate agent failures and performance problems end to end, and follow each one until the cause is fixed.
  • Build test and performance tooling, including end-to-end agent tests, load and latency tests, and failure diagnostics.
  • Turn production failures and user feedback into regression tests so defects do not come back.
  • Write tested, reviewed and documented code, and contribute to shared libraries and tooling.
  • Build and test to security, data privacy and responsible AI requirements.

Requirements

  • You have 1-4 years of experience in AI/ML or software engineering, and internships and applied research count.
  • You hold a bachelor's degree in computer science, engineering, data science, mathematics or a related field, or can show equivalent experience.
  • You are proficient in Python and work with good habits in version control, testing and code review.
  • You have experience building backend services or platform features.
  • You have built evaluation or test systems for ML or LLM applications, not just used them, and you can read failures from logs or traces.
  • You have working knowledge of LLM applications, including prompting, retrieval and agents.
  • You understand evaluation statistics such as sampling, confidence intervals and variance across runs, and you can measure agreement between reviewers.
  • You can write SQL and analyze results.
  • You communicate clearly in writing and in speech.
  • You have built evaluation or observability features used by many teams or at scale.
  • You have used LLM evaluation and observability tools, and tracing standards such as OpenTelemetry.
  • You have done red-teaming or adversarial testing of LLM systems.
  • You have worked with identity and access standards such as OAuth 2.0, OIDC and delegated access.
  • You have experience with performance, load or test engineering.
  • You have worked with agent frameworks, MCP or A2A.
  • You have experience with Google Cloud (Vertex AI, GKE) and Kubernetes.
  • You are familiar with AI risk frameworks such as NIST AI RMF and ISO 42001.
  • You hold an MS in a related field.

Conditions

Full-time position based in the Toronto office in Canada.

The base pay range is 102,000 - 152,000 CAD per year, based on role, level and location.

Pay is set by job-related skills, experience and education or training, and the range may change over time.

The range covers base pay only and excludes bonus, benefits and equity. You are eligible for a bonus, and equity may be offered depending on the position.

Equal access is available to all applicants, including people with disabilities, and the company uses AI in its hiring process.

Benefits

  • Access to an employee assistance program.
  • Healthcare coverage that complements the provincial system, plus life, disability and optional plans for you and eligible family members.
  • Retirement and savings options: a defined contribution pension plan, a group RRSP and a TFSA.
  • Vacation, personal time and paid holidays.
  • Eligibility rules apply to some benefits, and plan terms can change at the company's discretion.

Where you’d work

Part of the week in the office

You can work from

  • Canada

About the company

Equinix

Offices in Toronto, Canada, Canada

Also hiring in London, United Kingdom, United Kingdom, Dallas, United States and 15 more places

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 19 checks run
  • 1 red flag

Still hiring?

13 checks

1 red flag

How crowded?

6 checks

No red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • SQL
  • Google Cloud
  • Kubernetes
  • LLMs
Type
Full-time
Equity
Equity offered
Specialty
ML
Region
Canada
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Experience
4+ years
Tech stack
  • Python
  • SQL
  • Google Cloud
  • Kubernetes
  • LLMs

Location

Work model
Hybrid
Region
Canada
Offices
  • Toronto, Canada
  • Canada
Remote from
  • Canada

Compensation

Salary
Salary by agreement
Pay period
Annual
Equity
Equity offered

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason