Fugaku-LLM

About

The Fugaku-LLM family comprises large language models developed using the Fugaku supercomputer, one of the most powerful computational systems in Japan. These models, including the Fugaku-LLM-13B, are distinguished by their 13 billion parameters, making them significantly larger than many other Japanese models, which typically have fewer than 7 billion parameters. Fugaku-LLM models are trained from scratch using proprietary Japanese data, ensuring high transparency and safety. They excel in Japanese language tasks, achieving top scores in benchmarks like the Japanese MT-Bench, particularly in humanities and social sciences. The models are designed for both research and commercial applications, leveraging advanced distributed parallel learning techniques to maximize the supercomputer's performance.

Specifications(1 models)

Available From(1 provider)

Microsoft Foundry

Pricing

Frequently Asked Questions

What is Fugaku-LLM?

The Fugaku-LLM family comprises large language models developed using the Fugaku supercomputer, one of the most powerful computational systems in Japan. These models, including the Fugaku-LLM-13B, are distinguished by their 13 billion parameters, making them significantly larger than many other Japanese models, which typically have fewer than 7 billion parameters. Fugaku-LLM models are trained from scratch using proprietary Japanese data, ensuring high transparency and safety. They excel in Japanese language tasks, achieving top scores in benchmarks like the Japanese MT-Bench, particularly in humanities and social sciences. The models are designed for both research and commercial applications, leveraging advanced distributed parallel learning techniques to maximize the supercomputer's performance.

How many models are in the Fugaku-LLM family?

The Fugaku-LLM family contains 1 model.

What is the latest Fugaku-LLM model?

The latest model is Fugaku-LLM 13B, released in 2024-01.

How much does Fugaku-LLM cost?

Fugaku-LLM models are available at $0.81/1M input tokens through providers like Microsoft Foundry.

Models(1)