Llama 3.1 8B Instruct
Nazadnje pregledano:
Suverenost in gostovanje
Ta model je v katalogu za referenco. Na LLM EU še ni gostovan in noben lastni endpoint ga tukaj ne streže. Zahteve zanj gredo neposredno k ponudniku, pod lastnimi pogoji tega ponudnika.
Povzetek
Llama 3.1 8B Instruct je Meta-ov srednje majhen model za navodila s kontekstnim oknom 128k žetonov in podporo za klicanje orodij, izdan pod licenco Llama 3.1 Community License. Ta licenca dovoljuje komercialno uporabo, vendar zahteva licenco od Mete nad 700 milijonov mesečno aktivnih uporabnikov in dodaja politiko sprejemljive uporabe. Ostaja eden najbolj prenesenih odprtih kontrolnih točk in standardna izhodiščna točka; v evropski jezikovni evalvaciji OpenGPT-X dosega 0,563 na EU21.
Specifikacije
- Ponudnik
- Meta (US)
- Kontekstno okno
- 131k
- Parametri
- 8.03B
- Modalnosti
- text
- Licenca
- llama3.1 · licence
- Odprte uteži
- yes
- Datum izdaje
- 23. jul. 2024
- Naloge
- Nizki stroški, Pridobivanje (RAG), Povzemanje, Večjezična podpora, Podpora strankam
Jeziki
Močno: en, de, fr, it, pt, es
Zadostno: hi, th
Močno
- en
- de
- fr
- it
- pt
- es
Zadostno
- hi
- th
Ni preverjeno: ponudnik te trditve ni dokumentiral. — a language is listed as strong only where a source claims it; the card links the evidence where one exists.
Kdaj ga uporabiti
Prednosti
- 128k-token context window at the 8B size class
- very broad tooling and quantisation support
- published EU21 evaluation against European-focused models
Omejitve
- Llama 3.1 Community License, not an OSI licence, with a 700M MAU threshold
- English-centric training data; weaker on smaller EU languages
- released July 2024 and behind current 8B models
Pogosto zastavljena vprašanja
Is Llama 3.1 8B Instruct served on LLM EU?
It has no endpoint in the catalogue, so it is catalogue only — not hosted on LLM EU yet, with no region and no retention to report. A card whose status is "listed" is a catalogue entry, not a running deployment.
Under what licence is Llama 3.1 8B Instruct released?
Llama 3.1 8B Instruct is recorded under llama3.1. The recorded licence text is https://www.llama.com/llama3_1/license/. The weights are downloadable (open_weights is true). LLM EU republishes the licence id and the link and gives no legal advice; the licence text governs.
How large is Llama 3.1 8B Instruct, and what context window does it have?
Llama 3.1 8B Instruct is recorded at 8.03B (safetensors total 8,030,261,248) (source: https://huggingface.co/api/models/meta-llama/Llama-3.1-8B-Instruct), with a context window of 131072 tokens (source: https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct).