Wake up, baby! Germany has joined the race of frontier LLMs with its sovereign model "Kolibri".
And it's Open-Source, too!
Beats Qwen2635B, Nemotron3 Super, and Mistral Small 4 in the Math, Science, and Code arena! 🎉
The underlying architecture: custom MoE Transformer
Small bird, fast wings, Kolibri is here.
78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe.
Now the weights are yours. Run it on your own hardware, under Apache 2.0.