Qabbel
Llama 3.1 8B Instruct vs Llama 3.1 70B Instruct
Qiegħed żewġ mudelli sa erbgħa ma' xulxin fuq l-oqsma li jiddeċiedu deployment: kuntest, prezz, reġjun, liċenzja, lingwi, hosting, u x'hu verifikat.
| Llama 3.1 8B Instruct | Llama 3.1 70B Instruct | |
|---|---|---|
| Fornitur | Meta | Meta |
| Parametri | 8.03B | 70.6B |
| Tieqa tal-kuntest | 131k | Mhux verifikat: il-fornitur ma ddokumentax din id-dikjarazzjoni. |
| Liċenzja | llama3.1 | llama3.1 |
| Modalitajiet | text | text |
| Data tar-rilaxx | 23 Lul 2024 | 16 Lul 2024 |
| Lingwi | Qawwi: en, de, fr, it, pt, es Adekwat: hi, th | Qawwi: en, de, fr, it, pt, es Adekwat: hi, th |
| Piżijiet miftuħa | iva | iva |
| Kompiti | Spiża baxxa, Irkupru (RAG), Sommarizzazzjoni, Appoġġ multilingwi, Appoġġ lill-klijenti | Appoġġ multilingwi, Raġunament, Sommarizzazzjoni |
Fejn żewġ mudelli jvarjaw, din it-tabella turi d-differenza u tieqaf. LLM EU ma tippubblikax badge ta' rebbieħ mingħajr punteġġ dokumentat għal dik il-kompitu, u figura nieqsa tibqa' nieqsa minflok ma ssir żero.
Meta tużah
Llama 3.1 8B Instruct
Saħħiet
- 128k-token context window at the 8B size class
- very broad tooling and quantisation support
- published EU21 evaluation against European-focused models
Limiti
- Llama 3.1 Community License, not an OSI licence, with a 700M MAU threshold
- English-centric training data; weaker on smaller EU languages
- released July 2024 and behind current 8B models
Kompiti
Spiża baxxa, Irkupru (RAG), Sommarizzazzjoni, Appoġġ multilingwi, Appoġġ lill-klijenti
Llama 3.1 70B Instruct
Saħħiet
- open weights are published on Hugging Face and can be downloaded without a vendor agreement
- the model page lists 6 languages the European Union publishes in, including en, de, fr, it
- instruction-tuned checkpoint with a chat template in the repository
Limiti
- catalogue only — LLM EU does not run this model, and nothing on this card implies an LLM EU endpoint
- no evaluation has been run by LLM EU
- the published configuration records no context window, so the card carries none
- at 70.6B parameters, self-hosting needs a high-memory accelerator
Kompiti
Kompiti: Sommarizzazzjoni, Appoġġ multilingwi