Players use retired Intel Optane memory to run the 2.8 trillion parameter Kimi K3 model, outputting 1.5 tokens per second

Users have successfully run the Kimi K3 model with Intel Optane Persistent Memory, which has been discontinued, without a graphics card, achieving 2.8 trillion parameters. The initial generation speed was approximately 0.85 tokens per second, and it increased to 1.50 tokens per second after disabling the DAX function. The 3-bit quantization test only reached 0.75 tokens per second, and generating 50,000 tokens took 18.5 hours.