Skip to content
Live
ITHome · AI·· 17 hours ago62

llama.cpp 1.0.0 released: supports over 150 model architectures, significantly improving the ability to run large models locally.

Brief overview

llama.cpp version 1.0.0 has been released, supporting over 150 model architectures, marking API/ABI incompatible changes with the major version number; the ggml underlying engine has been enhanced, supporting dynamic loading of multiple hardware backends, improving the performance of locally deployed large models.

Source: ITHome · AI · ithome.com