Sakana AI 东京举办研讨会,宣布从头预训练语言模型 Sakana Sawara
Sakana AI 在东京办了场研讨会,Jürgen Schmidhuber 来演讲,还宣布要自己从预训练开始造模型,2027 年出第一个小模型。
Sakana AI 于 10 月 26 日在东京 Hitotsubashi Hall 举办研讨会,超过 400 人到场,Jürgen Schmidhuber 发表主题演讲,他于 9 月出任该公司首席科学顾问。Sakana AI 的 CEO David Ha 与他回顾了 2018 年论文 World Models 的合作。首席科学家 Takuya Akiba 介绍了 Sakana Sawara 语言模型系列,将从预训练开始从头构建。首个模型 Sawara Small(暂定名)计划于 2027 年春季发布。
Sakana AI Symposium: Building the Future of Language Models, World Models, and Physical AI from Japan
Event Report (English): https://t.co/dW29YYm0bv
On October 26, we hosted the symposium “From World Models to Real-World AI” at Hitotsubashi Hall in Tokyo. More than 400 people joined us for a keynote by Professor Jürgen Schmidhuber (@SchmidhuberAI), who became our Chief Scientific Advisor in September, and a conversation with our CEO David Ha, his co-author on the 2018 paper “World Models.”
In his keynote, Jürgen traced the path to today’s AI through the work of researchers around the world, including Shun-ichi Amari and Kunihiko Fukushima in Japan, as well as his own 1990 work on world models and artificial curiosity.
Our Chief Scientist Takuya Akiba also introduced “Sakana Sawara” (provisional name), a new language model series we are building from scratch, starting with pre-training. If everything goes smoothly, the first model, a small model called “Sawara Small” (provisional name), will be released in spring 2027.
Perhaps half of the AI Jürgen has envisioned has been realized through generative AI. The other half, artificial scientists that design their own experiments and physical AI that works in the real world, has yet to scale. We believe that opportunity lies especially outside the big labs, and that Japan is one of the most promising places to pursue it. We hope this symposium becomes a starting point for shaping the next era of AI in Japan, together with companies and research institutions across the country.
Videos will be added later. A big thank you to everyone who joined us! 🐟