You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Hitachi

Agentic Systems Architect

  • Hybrid
  • 6+ years

Salary

Not stated

Similar roles pay $155K - 240K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company is a global digital solutions and transformation business, and this role sits in its Cloud & Data Engineering function.

You will build end-to-end agentic systems that connect data, analytics and operations.

The work pairs agent infrastructure (LLMs, tools, memory, MCP) with data architecture (lakehouses, semantic layers, knowledge graphs) so reasoning over complex data stays safe, governed and cost-controlled.

You will work alongside talented colleagues, with room for autonomy, ownership and knowledge sharing.

Candidates who do not match every requirement are still encouraged to apply.

Job code: LI-MS2

Responsibilities

  • Design multi-agent orchestration, such as orchestrator-worker and hierarchical patterns, and justify the architecture for each business use case.
  • Build constrained agents with explicit guardrails, scoring gates and approval workflows for high-impact actions.
  • Architect MCP servers for enterprise integration, defining authentication, role-based access, and stateful or stateless patterns.
  • Create metric, dimension and business logic layers on Databricks.
  • Implement text-to-SQL with cost estimation and query safeguards.
  • Design knowledge graphs or ontologies for supplier and parts relationships, planning entity resolution and multi-hop queries.
  • Choose a vector database (OpenSearch, Pinecone or native Databricks) and design chunking, hybrid retrieval and metadata filtering.
  • Set up tracing for agents covering inputs, reasoning, tool calls, latency, tokens, cost and model versions.
  • Build evaluation frameworks that act as release gates, using golden sets, LLM-as-judge and regression tests.
  • Track cost per decision, alert on runaway loops and enforce per-tenant budgets.
  • Design secure deployment across identity, secrets and compute, plus versioning, canary rollouts and on-call runbooks.

Requirements

  • Required: 10+ years of experience across software engineering, platform engineering or systems architecture.
  • Required: 2+ years shipping production LLM or agent applications, not prototypes.
  • Required: hands-on work with multi-agent frameworks, including loops, tool calling, memory and constraints.
  • Required: experience building and deploying MCP servers, including transport, authentication and statefulness.
  • Required: experience shipping evaluation frameworks such as golden sets and LLM-as-judge as release gates, and measuring agent quality in production.
  • Required: experience designing or working with a lakehouse on AWS, Databricks or similar, including semantic layers, text-to-SQL and governance.
  • Required: production experience with vector databases, with knowledge of ANN, HNSW and chunking trade-offs, or experience building or maintaining knowledge graphs (RDF/OWL, Neo4j, property graphs) with entity resolution and relationship inference.
  • Required: experience building observability for multi-step workflows, tracing tokens, latency, cost and model versions with tools such as OpenTelemetry or Dynatrace.
  • Required: FinOps or cost optimization in cloud systems, with a record of controlling runaway compute or API costs.
  • Required: Python, REST API design, infrastructure as code with Terraform, CI/CD, and AWS cloud infrastructure.
  • Hands-on Databricks work with Genie, Mosaic AI Agent Framework and Unity Catalog.
  • Automotive or supply-chain domain expertise.
  • GraphRAG or multi-hop reasoning patterns.
  • Model routing and cost optimization, such as choosing between Haiku and Opus.
  • Human-in-the-loop approval workflows.
  • Prompt versioning and systematic evaluation.

Conditions

Flexible working arrangements are offered, depending on role and location.

The company welcomes applicants regardless of protected characteristics and will provide reasonable accommodations during recruitment on request.

Benefits

  • Industry-leading benefits, support and services focused on holistic health and wellbeing.

Where you’d work

Part of the week in the office

You can work from

  • United States

About the company

Hitachi

Offices in Dallas, United States, United States

Also hiring in Krakow, Poland, Sweden, Italy and 41 more places

9 of their 194 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 19 checks run
  • 1 red flag

Still hiring?

13 checks

No red flags

How crowded?

6 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details11 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • SQL
  • AWS
  • Terraform
  • Elasticsearch
  • CI/CD
  • LLMs
  • Vector databases
Type
Full-time
Specialty
Backend
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Development
Specialty
Backend
Experience
10+ years
Tech stack
  • Python
  • SQL
  • AWS
  • Terraform
  • Elasticsearch
  • CI/CD
  • LLMs
  • Vector databases

Location

Work model
Hybrid
Region
United States
Offices
  • Dallas, United States
  • United States
Remote from
  • United States

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Full-time

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason