Skip to content
Live
Trending storyPast story

llama-modchip enables the 284B DeepSeek model to run on pure CPU with 64GB memory

1 reports1 outlets10 days agoUpdate

The story so far

No overview yet — start with the coverage timeline below.

Coverage timeline

Follow the coverage to see every side of the story.

8 Nov
  1. Hacker News · 300+Featured
    Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU

    llama-modchip releases a set of ggml/llama.cpp core patches and quantization transcoding tools, compressing the 284.33B DeepSeek-V4-Flash to 56.56 GiB (1.71 bpw), which can run on a pure CPU machine with 64 GB memory, with a peak memory of 57.61 GiB under 256K context and no need for swap.