Reasoning and mathematics
Μαθηματικά διαγωνισμών (AIME) και επιστημονικές ερωτήσεις μεταπτυχιακού επιπέδου (GPQA) όπως δημοσιεύονται από τους εκδότες μοντέλων. Αυτά είναι τα σημεία αναφοράς που αναφέρονται συχνότερα για μοντέλα συλλογιστικής και αυτά που είναι πιο ευαίσθητα στις ρυθμίσεις δειγματοληψίας.
Every score in this set is republished from the model publisher’s own model card or vendor report and names that source per entry. LLM EU has run no evaluation, has not reproduced any score, and has not verified the harness settings. Vendor-reported numbers are self-reported and are labelled as such on the model cards. AIME and GPQA scores are sampling-sensitive: number of samples, temperature and tool access are stated on the individual model cards and are not uniform across these rows.
| Μοντέλα | score | source |
|---|---|---|
| GLM-4.7-Flash | 91.6 | link |
| NVIDIA Nemotron 3 Super 120B-A12B | 90.21 | link |
| Gemma 4 31B IT | 89.2 | link |
| Magistral Small 1.2 | 77.34 | link |
| DeepSeek-R1 | 79.8 | link |
| DeepSeek-R1 | 71.5 | link |
| Phi-4 | 56.1 | link |