OVHcloud open-sources AI model Olala mini 7A1B
The story so far
European cloud service provider OVHcloud has open-sourced the AI model Olala mini 7A1B, which uses a hybrid attention mechanism, with a total of 700 million parameters and 100 million activation parameters, using BF16 format, an 8GB GPU can achieve 160 TPS, and the context length is 32K. The total cost of model training is 7 million euros, and subsequent versions will expand to 128K context and improve mathematical capabilities. The parameter scale of Olala 2.0 will be >100B.
AI-written from the reports · Updated 20 minutes ago
Coverage timeline
Follow the coverage to see every side of the story.
- ITHome · AIEuropean cloud service company OVHcloud open sources AI model Olala mini 7A1B
OVHcloud has launched its first AI model family Olala, open-sourcing Olala mini 7A1B, which uses a hybrid attention mechanism, with a total of 700 million parameters and 100 million activation parameters, using BF16 format, an 8GB GPU can achieve 160 TPS, and the context length is 32K. The total cost of model training is 7 million euros, and subsequent versions will expand to 128K context and improve mathematical capabilities. The parameter scale of Olala 2.0 will be >100B.
Heat over time
Not enough data yet to draw a trend.