A team of researchers from the Tokyo Institute of Technology, Fujitsu and others have announced the development of a large language model that can ser

Japan team uses Fugaku supercomputer to develop language model for AI

submited by

Style Pass

2024-05-11 15:00:08

A team of researchers from the Tokyo Institute of Technology, Fujitsu and others have announced the development of a large language model that can serve as a foundation for generative artificial intelligence, using the Japanese supercomputer Fugaku.

Trained extensively on data in Japanese, which account for 60% of the total training data, the Fugaku-LLM model revealed Friday is expected to lead to research on generative AI tailored to domestic needs.

In May 2023, the researchers — also including those from Tohoku University, Nagoya University, the government-backed research institute Riken, CyberAgent and Kotoba Technologies — launched the project employing the supercomputer jointly developed by Fujitsu and Riken.

Fugaku-LLM's high Japanese language ability is demonstrated when it answers questions about poems by haiku master Matsuo Basho fluently, they said.

Unlike most other models with Japanese language capabilities, which employ continual learning, Fugaku-LLM is trained from scratch using the team's own data that do not contain harmful ones so the entire learning process can be understood, they said, adding that it is superior in terms of transparency and safety.