ITHome · AI·· 17 hours ago62
llama.cpp 1.0.0 released: supports over 150 model architectures, significantly improving the ability to run large models locally.
Brief overview
llama.cpp version 1.0.0 has been released, supporting over 150 model architectures, marking API/ABI incompatible changes with the major version number; the ggml underlying engine has been enhanced, supporting dynamic loading of multiple hardware backends, improving the performance of locally deployed large models.
Source: ITHome · AI · ithome.com