I'm making LLMs work on small and old devices

The smolmaxxing project enables large language models to run on old devices like Xiaomi TV boxes and iPad Air by customizing the kernel, optimizing memory usage, and streaming weights from flash storage. On Xiaomi TV boxes, the Qwen3.5-2B model processes 7.7 tokens per second, and the Ling-mini-2.0 model processes 5.1 tokens per second. Support for more devices is coming soon.