Title: European languages %E2%80%94 %D0%91%D0%B5%D0%BD%D1%87%D0%BC%D0%B0%D1%80%D0%BA%D0%BE%D0%B2%D0%B5 | LLM EU Canonical: https://llmeu.com/bg/benchmarks/eu-languages/ Markdown mirror: https://llmeu.com/bg/benchmarks/eu-languages.md Machine-readable: https://llmeu.com/llms.txt (index) - https://llmeu.com/llms-full.txt (full catalogue) - https://llmeu.com/llms-catalogue.json # European languages %D0%9A%D0%B0%D1%87%D0%B5%D1%81%D1%82%D0%B2%D0%BE %D0%BD%D0%B0 %D0%BC%D0%BE%D0%B4%D0%B5%D0%BB%D0%B0 %D0%B2%D1%8A%D1%80%D1%85%D1%83 %D0%BF%D1%80%D0%B5%D0%B2%D0%B5%D0%B4%D0%B5%D0%BD%D0%B8 %D0%B1%D0%B5%D0%BD%D1%87%D0%BC%D0%B0%D1%80%D0%BA%D0%BE%D0%B2%D0%B5 %D0%BD%D0%B0 %D0%B5%D0%B2%D1%80%D0%BE%D0%BF%D0%B5%D0%B9%D1%81%D0%BA%D0%B8 %D0%B5%D0%B7%D0%B8%D1%86%D0%B8. %D0%A0%D0%B5%D0%B4%D0%BE%D0%B2%D0%B5%D1%82%D0%B5 EU21 %D0%B8%D0%B4%D0%B2%D0%B0%D1%82 %D0%BE%D1%82 %D0%BE%D1%86%D0%B5%D0%BD%D0%BA%D0%B0%D1%82%D0%B0 OpenGPT-X, %D0%BF%D1%83%D0%B1%D0%BB%D0%B8%D0%BA%D1%83%D0%B2%D0%B0%D0%BD%D0%B0 %D1%81 Teuken 7B Instruct v0.6, %D0%BA%D0%BE%D1%8F%D1%82%D0%BE %D0%BF%D1%80%D0%B5%D0%B2%D0%B5%D0%B6%D0%B4%D0%B0 ARC, HellaSwag, TruthfulQA %D0%B8 MMLU %D0%BD%D0%B0 21-%D1%82%D0%B5 %D0%B5%D0%B7%D0%B8%D0%BA%D0%B0 %D0%BD%D0%B0 %D0%95%D0%A1, %D0%BA%D0%BE%D0%B8%D1%82%D0%BE %D0%BE%D0%B1%D1%85%D0%B2%D0%B0%D1%89%D0%B0, %D0%B8 %D0%BE%D1%82%D1%87%D0%B8%D1%82%D0%B0 %D0%B5%D0%B4%D0%BD%D0%B0 %D1%81%D1%80%D0%B5%D0%B4%D0%BD%D0%B0 %D1%81%D1%82%D0%BE%D0%B9%D0%BD%D0%BE%D1%81%D1%82 %D0%B7%D0%B0 %D0%BC%D0%BE%D0%B4%D0%B5%D0%BB. %D0%A0%D0%B5%D0%B4%D1%8A%D1%82 MMMLU %D0%B5 %D1%81%D0%BE%D0%B1%D1%81%D1%82%D0%B2%D0%B5%D0%BD%D0%B0%D1%82%D0%B0 %D0%BC%D0%BD%D0%BE%D0%B3%D0%BE%D0%B5%D0%B7%D0%B8%D1%87%D0%BD%D0%B0 MMLU %D1%81%D1%82%D0%BE%D0%B9%D0%BD%D0%BE%D1%81%D1%82 %D0%BD%D0%B0 Google %D0%B7%D0%B0 Gemma 4. The EU21 numbers are OpenGPT-X%E2%80%99s, taken from the Teuken 7B Instruct v0.6 model card and the accompanying evaluation preprint; they are machine-translated benchmarks, not native-language test sets. The MMMLU number is Google%E2%80%99s own. LLM EU has run no evaluation and has not verified either harness.