Unboxing the AI Stack
Chip · L08 · Chips & Memory

HBM3E

HBM3E is the extended version of HBM3, the high-bandwidth memory (HBM) that AI accelerators carry next to the processor; SK hynix calls it the fifth generation of HBM, after HBM, HBM2, HBM2E and HBM3.1 Like other HBM it stacks DRAM dies and links them with through-silicon vias, and Micron says HBM needs more wafers and more cleanroom space than conventional DRAM to make the same number of bits on the same technology node.2 SK hynix said on March 19, 2024 that it had begun volume production of HBM3E, the first maker to do so by its own account, for supply to a customer from late March, and that the product processes up to 1.18 TB of data per second.1

It is the memory on most of the accelerators in AI Accelerators With the Most HBM per Chip (October 2026): ten of the thirteen ranked parts use HBM3E. They run from AMD’s Instinct MI350X and MI355X, tied for #1 at 288 GB and 8 TB/s,3 through NVIDIA’s Blackwell GPUs at 186 GB in the GB200 NVL72 and 180 GB in the HGX B200,4 to NVIDIA’s H200 at 141 GB and 4.8 TB/s.5 The third part tied at #1, NVIDIA’s Rubin, is the one ranked accelerator on HBM4 instead.

Counterpoint Research estimated in September 2026 that most HBM revenue in the second quarter of 2026 came from HBM3E, with HBM4 shipments expected to become visible in earnest only from the second half of the year.6 For HBM in general, TrendForce reports that GPU and ASIC makers are weighing 8-high stacks, which use fewer DRAM dies than 12-high ones, and projects 8-high parts to carry a premium of roughly 10–20% per gigabit over 12-high in 2027 because each stack still needs a base die.7 Both figures are in The Memory Crunch, by the Numbers.

Illustration: the ten layers of the AI stack, with Chips & Memory, HBM3E’s layer, pulled out.

Key facts

GenerationExtended HBM3; fifth generation of HBM, per SK hynix1
First volume productionMarch 2024, SK hynix (by its own account)1
SK hynix’s first HBM3E, processing speedUp to 1.18 TB per second Vendor-stated1
Most HBM3E on a shipping accelerator288 GB (AMD MI350X, MI355X) Vendor-stated3
Blackwell GPU, GB200 NVL72186 GB HBM3E, 8 TB/s Vendor-stated4
H200141 GB HBM3E, 4.8 TB/s Vendor-stated5
Share of HBM revenue, Q2 2026Most of it (Counterpoint Research) Estimate6

As of . Makers write HBM3E and HBM3e interchangeably. How figures are labeled.

Appears in

Sources

  1. SK hynix Newsroom, “SK hynix Begins Volume Production of Industry’s First HBM3E” (March 19, 2024), retrieved 2026-10-13.
  2. Micron Technology, Form 10-Q for the quarter ended May 28, 2026, filed with the SEC June 25, 2026, retrieved 2026-10-13.
  3. AMD, AMD Instinct MI355X GPUs (specifications), retrieved 2026-10-13.
  4. NVIDIA, NVIDIA Blackwell Datasheet (PDF), retrieved 2026-10-13.
  5. NVIDIA, NVIDIA H200 GPU, retrieved 2026-10-13.
  6. Counterpoint Research, SK하이닉스 HBM 점유율 50%로 하락…삼성 33%로 추격 (global HBM market share, Q2 2026; in Korean), September 3, 2026, retrieved 2026-10-13.
  7. TrendForce, “HBM Supply Constraints Persist, 2027 Price Outlook Revised Upward with Blended ASP Forecast to Rise 121% YoY, Says TrendForce”, press release, September 29, 2026, retrieved 2026-10-13.