Russian developers created a new language model, Alice AI Foundation LLM, from scratch. It contains 80 billion parameters. A dataset of 18 trillion tokens was used to train it. When processing requests, about 3 billion parameters are activated at once, which reduces the demand for computing resources.

The model will become the technological foundation for the further development of Russian AI services. On its basis, they plan to build systems that can solve more complex tasks using reasoning and independently carry out sequences of actions.

The model parameters have been published in the public domain.

@blackponed