Title: European languages %E2%80%94 %CE%A3%CF%85%CE%B3%CE%BA%CF%81%CE%B9%CF%84%CE%B9%CE%BA%CE%AD%CF%82 %CE%B4%CE%BF%CE%BA%CE%B9%CE%BC%CE%AD%CF%82 | LLM EU
Canonical: https://llmeu.com/el/benchmarks/eu-languages/
Markdown mirror: https://llmeu.com/el/benchmarks/eu-languages.md
Machine-readable: https://llmeu.com/llms.txt (index) - https://llmeu.com/llms-full.txt (full catalogue) - https://llmeu.com/llms-catalogue.json

# European languages

%CE%A0%CE%BF%CE%B9%CF%8C%CF%84%CE%B7%CF%84%CE%B1 %CE%BC%CE%BF%CE%BD%CF%84%CE%AD%CE%BB%CE%BF%CF%85 %CF%83%CE%B5 %CE%BC%CE%B5%CF%84%CE%B1%CF%86%CF%81%CE%B1%CF%83%CE%BC%CE%AD%CE%BD%CE%B1 benchmarks %CE%B5%CF%85%CF%81%CF%89%CF%80%CE%B1%CF%8A%CE%BA%CF%8E%CE%BD %CE%B3%CE%BB%CF%89%CF%83%CF%83%CF%8E%CE%BD. %CE%9F%CE%B9 %CF%83%CE%B5%CE%B9%CF%81%CE%AD%CF%82 EU21 %CF%80%CF%81%CE%BF%CE%AD%CF%81%CF%87%CE%BF%CE%BD%CF%84%CE%B1%CE%B9 %CE%B1%CF%80%CF%8C %CF%84%CE%B7%CE%BD %CE%B1%CE%BE%CE%B9%CE%BF%CE%BB%CF%8C%CE%B3%CE%B7%CF%83%CE%B7 OpenGPT-X %CF%80%CE%BF%CF%85 %CE%B4%CE%B7%CE%BC%CE%BF%CF%83%CE%B9%CE%B5%CF%8D%CF%84%CE%B7%CE%BA%CE%B5 %CE%BC%CE%B5 %CF%84%CE%BF Teuken 7B Instruct v0.6, %CF%84%CE%BF %CE%BF%CF%80%CE%BF%CE%AF%CE%BF %CE%BC%CE%B5%CF%84%CE%B1%CF%86%CF%81%CE%AC%CE%B6%CE%B5%CE%B9 %CF%84%CE%B1 ARC, HellaSwag, TruthfulQA %CE%BA%CE%B1%CE%B9 MMLU %CF%83%CF%84%CE%B9%CF%82 21 %CE%B3%CE%BB%CF%8E%CF%83%CF%83%CE%B5%CF%82 %CF%84%CE%B7%CF%82 %CE%95%CE%95 %CF%80%CE%BF%CF%85 %CE%BA%CE%B1%CE%BB%CF%8D%CF%80%CF%84%CE%B5%CE%B9 %CE%BA%CE%B1%CE%B9 %CE%B1%CE%BD%CE%B1%CF%86%CE%AD%CF%81%CE%B5%CE%B9 %CE%AD%CE%BD%CE%B1%CE%BD %CE%BC%CE%AD%CF%83%CE%BF %CF%8C%CF%81%CE%BF %CE%B1%CE%BD%CE%AC %CE%BC%CE%BF%CE%BD%CF%84%CE%AD%CE%BB%CE%BF. %CE%97 %CF%83%CE%B5%CE%B9%CF%81%CE%AC MMMLU %CE%B5%CE%AF%CE%BD%CE%B1%CE%B9 %CF%84%CE%BF %CE%B4%CE%B9%CE%BA%CF%8C %CF%84%CE%B7%CF%82 %CF%80%CE%BF%CE%BB%CF%8D%CE%B3%CE%BB%CF%89%CF%83%CF%83%CE%BF MMLU %CF%84%CE%B7%CF%82 Google %CE%B3%CE%B9%CE%B1 %CF%84%CE%BF Gemma 4.

The EU21 numbers are OpenGPT-X%E2%80%99s, taken from the Teuken 7B Instruct v0.6 model card and the accompanying evaluation preprint; they are machine-translated benchmarks, not native-language test sets. The MMMLU number is Google%E2%80%99s own. LLM EU has run no evaluation and has not verified either harness.