Title: European languages %E2%80%94 Benchmarki | LLM EU
Canonical: https://llmeu.com/sl/benchmarks/eu-languages/
Markdown mirror: https://llmeu.com/sl/benchmarks/eu-languages.md
Machine-readable: https://llmeu.com/llms.txt (index) - https://llmeu.com/llms-full.txt (full catalogue) - https://llmeu.com/llms-catalogue.json

# European languages

Kakovost modela na prevedenih merilih evropskih jezikov. Vrstice EU21 izhajajo iz evalvacije OpenGPT-X, objavljene s Teuken 7B Instruct v0.6, ki prevaja ARC, HellaSwag, TruthfulQA in MMLU v 21 jezikov EU, ki jih pokriva, in poro%C4%8Da eno povpre%C4%8Dje na model. Vrstica MMMLU je Googlova lastna ve%C4%8Djezi%C4%8Dna %C5%A1tevilka MMLU za Gemmo 4.

The EU21 numbers are OpenGPT-X%E2%80%99s, taken from the Teuken 7B Instruct v0.6 model card and the accompanying evaluation preprint; they are machine-translated benchmarks, not native-language test sets. The MMMLU number is Google%E2%80%99s own. LLM EU has run no evaluation and has not verified either harness.