You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Samsung Semiconductor

Intern, AI System Architecture Research Scientist

  • Office
  • 0-3 years

Salary

Not stated

Similar roles pay $60K - 150K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The Architecture Research Lab is working on memory bandwidth and communication bottlenecks, two of the largest obstacles in AI today. The team builds next-generation AI systems that get past these limits and make developers more productive, using the company's memory technologies.

This internship looks at how memory systems must change for agentic AI. Agents run for long stretches across many turns, and their context grows faster than memory capacity and bandwidth can keep up. That gap erodes their accuracy and speed.

You will learn to design and optimize memory hierarchies for AI inference, model the performance and explore the design space of AI systems, characterize agentic and long-context LLM workloads, and turn research into publications and future products.

The company is a global technology leader whose components appear in smartphones, electric vehicles, hyperscale data centers and IoT devices.

Responsibilities

  • Characterize LLM and agentic inference workloads, including multi-turn sessions, growing context and reuse across requests, and derive their memory capacity, bandwidth and latency needs.
  • Research memory hierarchies that combine HBM, near-memory compute, emerging tiers such as High Bandwidth Flash, and host or CXL memory. Study how model weights and KV cache are placed, moved, reused and compressed across these tiers.
  • Propose architectures and system optimizations, from hardware features to runtime and memory-management policies, that keep long-horizon agents accurate within memory limits.
  • Build and extend performance models and simulators, and run design-space explorations across throughput, capacity and cost.
  • Measure how memory optimizations affect accuracy on long-context and agentic benchmarks using open models.
  • Lead research from problem definition through results, working with architects, memory technologists and system-software researchers.
  • Publish at top-tier venues, contribute invention disclosures, and help shape product directions.
  • Complete other assigned responsibilities.

Requirements

  • Currently enrolled in a PhD program in Computer Science, with 3+ years of study in the field preferred.
  • At least 1 academic quarter or semester remaining after the internship.
  • Strong background in AI system architecture and memory systems, including memory hierarchy, DRAM/HBM and data movement.
  • Deep understanding of LLM and agentic inference, including prefill and decode, KV cache and long-context workloads, and how memory optimizations such as KV-cache compression or eviction affect accuracy.
  • Experience with performance analysis and modeling of AI systems, such as roofline analysis, and building or extending simulators or analytical models to test architecture ideas.
  • Hands-on research experience managing model state across memory tiers, such as KV-cache paging, reuse, offloading, compression or eviction, or weight offloading for large and MoE models, in serving stacks like vLLM, SGLang or LMCache.
  • Strong programming skills in Python and C/C++, plus experience with PyTorch.
  • First-author or major-contributor publications at top-tier computer architecture, systems or machine learning venues preferred.
  • You build relationships, welcome new approaches, explore new ideas and adapt quickly to change.
  • You bring curiosity and resilience, and you look for data to build understanding.
  • You adapt your style to the situation and to the diverse norms of colleagues around the world.
  • You build relationships, offer support with humility and welcome different approaches.

Conditions

Work onsite at the San Jose headquarters every day, in line with the company's flexible work policy.

Reports to a Principal Engineer.

Equal opportunity applies; the company values an inclusive culture and a diverse workforce.

Benefits

  • Hourly base pay of $28 to $68 USD. This range covers all roles at this level across all US locations and functions, and actual pay varies by location, job-related knowledge, skills and experience.
  • Medical, dental and vision coverage, plus an inclusive rewards plan that supports your whole self.
  • Relocation stipend if you live 50+ miles from your new office.
  • Monthly housing stipend to help cover a lease for your summer internship.
  • Charitable giving match and regular volunteering opportunities.
  • On-demand wellness apps and paid therapy sessions.
  • Onsite café and gym, plus virtual fitness classes.
  • A flexible environment so you can find your own work-life balance.

Where you’d work

From the office

Relocation offered

About the company

Samsung Semiconductor

Office in San Jose, United States

Also hiring in United States

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 2 red flags

Still hiring?

14 checks

No red flags

How crowded?

7 checks

2 red flags

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment
Tech stack
  • Python
  • PyTorch
  • C++
  • LLMs
Seniority
Intern
Type
Internship
Specialty
Data Science
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Science
Seniority
Intern
Experience
3+ years
Tech stack
  • Python
  • PyTorch
  • C++
  • LLMs

Location

Work model
Office
Region
United States
Office
  • San Jose, United States
Relocation
Offered

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Internship

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason