BigScience Bloom
BigScience Bloom
BigScience Bloom is a large, multilingual language model.
Description
BigScience Bloom is an autoregressive Large Language Model (LLM) trained to generate text from a given prompt. It is a multilingual model that has been trained on vast amounts of text data using industrial-scale computational resources. This model is part of the BigScience project, which aims to study and create very large language models. It is the result of a collaboration of over 1000 researchers from 70+ countries and 250+ institutions. The training of the BLOOM model took 117 days on the Jean Zay supercomputer in France, with a compute grant worth an estimated €3M.
Key Features
- Autoregressive text generation.
- Multilingual support.
- Trained on large amounts of text data.
- Utilizes industrial-scale computational resources.
Use Cases
- Language generation.
- Text completion.
- Creative writing.
- Translation.
Reviews
0 reviews
Leave a review