Title: European languages %E2%80%94 Benchmarks | LLM EU
Canonical: https://llmeu.com/pt/benchmarks/eu-languages/
Markdown mirror: https://llmeu.com/pt/benchmarks/eu-languages.md
Machine-readable: https://llmeu.com/llms.txt (index) - https://llmeu.com/llms-full.txt (full catalogue) - https://llmeu.com/llms-catalogue.json

# European languages

Qualidade do modelo em benchmarks traduzidos para l%C3%ADnguas europeias. As linhas EU21 v%C3%AAm da avalia%C3%A7%C3%A3o OpenGPT-X publicada com Teuken 7B Instruct v0.6, que traduz ARC, HellaSwag, TruthfulQA e MMLU para as 21 l%C3%ADnguas da UE que abrange e reporta uma m%C3%A9dia por modelo. A linha MMMLU %C3%A9 o pr%C3%B3prio valor MMLU multilingue da Google para Gemma 4.

The EU21 numbers are OpenGPT-X%E2%80%99s, taken from the Teuken 7B Instruct v0.6 model card and the accompanying evaluation preprint; they are machine-translated benchmarks, not native-language test sets. The MMMLU number is Google%E2%80%99s own. LLM EU has run no evaluation and has not verified either harness.