Skip to content
Live
Trending storyDeveloping

OVHcloud open-sources AI model Olala mini 7A1B

1 reports1 outlets39 minutes agoUpdate

The story so far

AI overview

European cloud service provider OVHcloud has open-sourced the AI model Olala mini 7A1B, which uses a hybrid attention mechanism, with a total of 700 million parameters and 100 million activation parameters, using BF16 format, an 8GB GPU can achieve 160 TPS, and the context length is 32K. The total cost of model training is 7 million euros, and subsequent versions will expand to 128K context and improve mathematical capabilities. The parameter scale of Olala 2.0 will be >100B.

AI-written from the reports · Updated 20 minutes ago

Coverage timeline

Follow the coverage to see every side of the story.

17 Nov
  1. ITHome · AI
    European cloud service company OVHcloud open sources AI model Olala mini 7A1B

    OVHcloud has launched its first AI model family Olala, open-sourcing Olala mini 7A1B, which uses a hybrid attention mechanism, with a total of 700 million parameters and 100 million activation parameters, using BF16 format, an 8GB GPU can achieve 160 TPS, and the context length is 32K. The total cost of model training is 7 million euros, and subsequent versions will expand to 128K context and improve mathematical capabilities. The parameter scale of Olala 2.0 will be >100B.

Heat over time

Not enough data yet to draw a trend.