OELLM News & articles

Together with Open-sci, we are releasing open-sci-ref 0.01 - a research-dense transformer model family. Our aim is to establish scaling laws that enable ranking of datasets and other hyperparameters. With all the intermediate checkpoints tra...

Through a joint collaboration between the HPLT and OpenEuroLLM initiatives, we announce the release of 38 monolingual reference models with 2.15B parameters. Full models and intermediate checkpoints every 1,000 steps can be downloaded from t...

The EuroHPC AI Factory Large Scale call has allocated 3 million GPU hours on the Leonardo Booster (CINECA, Italy) to develop "MultiSynt: an open multilingual synthetic dataset for LLM pre-training”. This ini...

The OpenEuroLLM consortium initiated its work already in February, with the objective of building truly open foundation models for European languages.
Strategic and sustained investments in AI infrastructure, coupled with an environment of transp...

Europe's leading AI companies and research institutions combine their forces and expertise to develop next-generation open-source language models in an unprecedented collaboration to advance European AI capabilities, the OpenEuroLLM project.
A co...