Edge0 open sources 145B and 120B edge-side models and inference frameworks.
Edge0 open-sourced the Edge0-145B and Edge0-120B two edge models, and also released a unified inference framework and deployment tools. Officially, the 145B model can run locally on compatible laptops, with peak memory of 29GB, decoding speed of 80+ tokens/s, pre-filling speed of 1100+ tokens/s, supporting context lengths of 128K–256K.
Why it matters: The original text provides actual memory, speed, and multiple benchmark comparisons of the edge 145B model, which can be used to judge the practical boundaries of running cutting-edge models locally.















