Skip to content
Live
Trending storyPast story

EdgeRock-4B open-sourced, KV Cache reduced by 99.1%

1 reports1 outlets24 days agoUpdate

The story so far

AI overview

Rockchip Matrix, under Rockchip Technology, has released and open-sourced EdgeRock-4B in collaboration with universities such as HKUST and CMU. The model has a fixed KV Cache of 72MiB in a 256K context, reducing by 99.1% compared to the original model Qwen3.5-4B. The model weights and inference code are open-sourced, supporting text and image inference, and are commercially available. The team states that more parameter-scale EdgeRock models are being developed.

AI-written from the reports · Updated 23 days ago

Coverage timeline

Follow the coverage to see every side of the story.

26 Oct
  1. QbitAIFeatured
    Rockchip Matrix, in collaboration with CUHK and CMU, has open-sourced EdgeRock-4B, reducing KV Cache by 99.1%.

    Rockchip Technology's Rockchip Matrix, in collaboration with CUHK and CMU, has released and open-sourced EdgeRock-4B, with a fixed KV Cache of 72MiB under 256K context, reducing the source model Qwen3.5-4B by 99.1%.