Kolibri uses a mixture-of-experts architecture with 78B total parameters and 3.46B active parameters, supporting a 1M token context window. It was built to comply with the EU AI Act and GDPR, utilizing a bilingual tokenizer where 21.3% of pre-training tokens are German. While released under an Apache 2.0 license for local hosting, researcher Ethan Mollick noted the system was fine-tuned on synthetic data generated by Chinese models GLM and Qwen.
