Sakana AI held a seminar: Jürgen Schmidhuber talks about the past and future of AI, Japan will challenge language models, world models, and physical AI

Jürgen Schmidhuber, professor at the Sakana AI Symposium, presented a speech reviewing the many ideas that contributed to modern deep learning and generative AI from the 1980s to the 1990s, and introduced the LSTM paper proposed in 1990. Sakana AI announced the development of a pre-trained model, planning to release a small language model named 'Sawara Small' in spring 2027.