Skip to content
Live
Trending storyPast story

HBM market mature

1 reports1 outlets26 days agoUpdate

The story so far

AI overview

HBM was once popular by the end of 2025 for meeting AI inference demands through high bandwidth, but the market has matured, and a single architecture no longer dominates. HBM was popular by the end of 2025 because it could meet AI inference demands through high bandwidth; inference decoding is a memory-limited operation, and only HBM can achieve bandwidth speeds to effectively serve models. But the market has matured, and different chips perform differently in training, pre-fetching, or decoding.

AI-written from the reports · Updated 26 days ago

Latest23 Oct, 18:56
Where is Groq in China?

Coverage timeline

Follow the coverage to see every side of the story.

23 Oct
  1. ChinaTalk
    Where is China’s Groq?

    HBM was once popular at the end of 2025, as it could meet AI inference needs through high bandwidth, but the market has matured, single architecture no longer dominates, and different chips perform differently in training, pre-fetching, or decoding.