You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Early Window: Closes in
Company hidden

Intern, Architecture Research Engineer

  • Office
  • 0-3 years

Salary

Not stated

Similar roles pay $100K - 170K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The role is an internship on the architecture research side of the AGI Computing Lab, which designs scalable platforms for future AI and ML workloads, balancing performance, memory, and energy use.

The project centres on placing Mixture-of-Experts models across distributed accelerators at scale, treating placement as a core design question.

The company builds technology used in smartphones, electric vehicles, hyperscale data centers, and IoT devices.

The company asks each candidate to submit no more than 10 applications across all open jobs within a 6-month period.

Responsibilities

  • Research how to place, replicate, and migrate experts when serving Mixture-of-Experts models.
  • Tune expert placement together with parallelism strategy, memory hierarchy, and interconnect topology.
  • Measure expert load imbalance, drift over time, and affinity across layers using real workloads.
  • Extend analytical simulators and design space exploration tools to model MoE serving and assess hardware design points.
  • Work with the compiler and runtime teams to build placement-aware scheduling.
  • Help with ML systems and architecture research, including writing research papers.
  • Keep up with new developments in ML architectures and LLM serving.
  • Take on other tasks as assigned.

Requirements

  • Enrolled in a Master's or PhD program in Computer Science or Electrical Engineering is preferred.
  • At least 1 academic quarter or semester must remain after the internship.
  • Research experience in distributed ML systems or AI hardware such as GPUs, TPUs, and NPUs.
  • Published papers at Microarchitecture, Systems, or ML Systems conferences are preferred.
  • Experience building simulators or performance models for large-scale ML systems.
  • Understanding of system-level behaviour in MoE inference and expert parallelism.
  • Familiarity with PyTorch or JAX, and with LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM.
  • Knowledge of optimization methods such as integer linear programming or graph partitioning is a plus.
  • Strong analytical and problem-solving skills.
  • Excellent communication and interpersonal skills.
  • Able to work independently and as part of a team.
  • Adapts your style to the situation and to the varied norms of colleagues around the world.
  • Learns quickly, approaches problems with curiosity and resilience, and looks for data to build understanding.
  • Collaborates well, builds relationships, offers support, and welcomes other people's ideas.
  • Brings new ideas and adjusts quickly to change.

Conditions

Based onsite at the San Jose headquarters every day, under the company's Flexible Work policy.

Reports to the Sr. Director.

The hourly base pay range is $28 to $68 USD for this level across all US locations and functions, varying by work location, knowledge, skills, and experience.

The company is an equal opportunity employer and welcomes people of all backgrounds.

Benefits

  • Medical, dental, and vision coverage, plus an inclusive rewards plan for physical and emotional wellbeing.
  • Relocation stipend if your new office is 50+ miles from your home.
  • Monthly housing stipend for a summer internship lease.
  • Charitable giving match and regular volunteer opportunities.
  • On-demand wellness apps and paid therapy sessions.
  • Onsite café and gym, plus virtual fitness classes.
  • A flexible environment that lets you choose your own balance.

Where you’d work

From the office

Relocation offered

About the company

Company hidden

Office in San Jose, United States

Your chances

Still hiring, moderately crowded, and you'd be among the first.

  • 17 checks run
  • 4 good signs
  • 2 red flags

Still hiring?

11 checks

Actively hiring

In its favour2

  • Still on the company's own careers site, checked 1 h agoModerate evidence
  • Found in the last 48 hours, before the big job boardsModerate evidence

How crowded?

6 checks

Moderate

In its favour2

  • In its Early Window: not on the big job boards yetStrong evidence
  • In the office in San Jose: only people nearby can take itSlight evidence

Against it2

  • Entry level: the most applied-to level there isModerate evidence
  • Offers relocation: people from other countries apply tooSlight evidence
67 roles like this are in their Early WindowFound before the big job boards, while the crowd hasn’t arrived

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • PyTorch
  • LLMs
Seniority
Intern
Type
Internship
Specialty
ML
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
ML
Seniority
Intern
Experience
0-3 years
Tech stack
  • PyTorch
  • LLMs

Location

Work model
Office
Region
United States
Office
  • San Jose, United States
Relocation
Offered

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Internship

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason