Skip to content
Live
ITHome · AI·· 39 minutes ago65

European cloud service company OVHcloud open sources AI model Olala mini 7A1B

Brief overview

OVHcloud has launched its first AI model family Olala, open-sourcing Olala mini 7A1B, which uses a hybrid attention mechanism, with a total of 700 million parameters and 100 million activation parameters, using BF16 format, an 8GB GPU can achieve 160 TPS, and the context length is 32K. The total cost of model training is 7 million euros, and subsequent versions will expand to 128K context and improve mathematical capabilities. The parameter scale of Olala 2.0 will be >100B.

Source: ITHome · AI · ithome.com