Title: European languages %E2%80%94 Tagarmharcanna | LLM EU
Canonical: https://llmeu.com/ga/benchmarks/eu-languages/
Markdown mirror: https://llmeu.com/ga/benchmarks/eu-languages.md
Machine-readable: https://llmeu.com/llms.txt (index) - https://llmeu.com/llms-full.txt (full catalogue) - https://llmeu.com/llms-catalogue.json

# European languages

C%C3%A1il%C3%ADocht samhlacha ar thagarmharcanna aistrithe teangacha Eorpacha. Tagann na sraitheanna EU21 %C3%B3n meast%C3%B3ireacht OpenGPT-X a foils%C3%ADodh le Teuken 7B Instruct v0.6, a aistr%C3%ADonn ARC, HellaSwag, TruthfulQA agus MMLU go dt%C3%AD na 21 teanga AE a chumhda%C3%ADonn s%C3%A9 agus a thuairisc%C3%ADonn me%C3%A1n amh%C3%A1in in aghaidh na samhla. Is %C3%A9 an tsraith MMMLU figi%C3%BAr MMLU ilteangach Google f%C3%A9in do Gemma 4.

The EU21 numbers are OpenGPT-X%E2%80%99s, taken from the Teuken 7B Instruct v0.6 model card and the accompanying evaluation preprint; they are machine-translated benchmarks, not native-language test sets. The MMMLU number is Google%E2%80%99s own. LLM EU has run no evaluation and has not verified either harness.