Title: Sruth%C3%BA %E2%80%94 LLM EU
Canonical: https://llmeu.com/ga/docs/streaming/
Markdown mirror: https://llmeu.com/ga/docs/streaming.md
Machine-readable: https://llmeu.com/llms.txt (index) - https://llmeu.com/llms-full.txt (full catalogue) - https://llmeu.com/llms-catalogue.json

Tosaigh

- [T%C3%BAs tapa](/ga/docs/quickstart/)
- [Cons%C3%B3l](/ga/docs/console/)
- [Imirce](/ga/docs/migration/)
- [Tagairt API](/ga/docs/api/)

Tagairt

- [F%C3%ADordheimhni%C3%BA](/ga/docs/authentication/)
- [Cr%C3%ADochphoint%C3%AD](/ga/docs/endpoints/)
- [Earr%C3%A1id%C3%AD](/ga/docs/errors/)
- [Teorainneacha r%C3%A1ta](/ga/docs/rate-limits/)
- [Sruth%C3%BA](/ga/docs/streaming/)
- [Polasaithe](/ga/docs/policies/)
- [R%C3%B3d%C3%BA agus beartas](/ga/docs/routing/)
- [C%C3%B3naitheacht agus r%C3%A9igi%C3%BAin](/ga/docs/residency/)
- [Fianaise agus f%C3%ADor%C3%BA](/ga/docs/evidence/)
- [Comhoiri%C3%BAnacht OpenAI](/ga/docs/openai-compat/)

Oibri%C3%BA

- [F%C3%A9in-%C3%B3st%C3%A1il](/ga/docs/self-hosting/)

# Sruth%C3%BA

Conas a thagann cr%C3%ADochn%C3%BA sruthaithe ar an sreang, cad a iompra%C3%ADonn an fr%C3%A1ma deireanach, agus cad a tharla%C3%ADonn nuair a dh%C3%ADcheangla%C3%ADonn cliant.

## An t-iompar

Socraigh stream: true agus is %C3%A9 text/event-stream an freagra: r%C3%A9ad JSON amh%C3%A1in in aghaidh gach l%C3%ADne data:, agus l%C3%ADne fholamh ina dhiaidh gach ceann. T%C3%A1 an maol%C3%A1n%C3%BA d%C3%ADchumasaithe ionas nach gcoinn%C3%ADonn seachfhreastala%C3%AD fr%C3%A1ma%C3%AD siar.

```
HTTP/1.1 200 OK
content-type: text/event-stream; charset=utf-8
cache-control: no-cache, no-transform
connection: keep-alive
```

## Na fr%C3%A1ma%C3%AD

Iompra%C3%ADonn an ch%C3%A9ad fhr%C3%A1ma r%C3%B3l an ch%C3%BAnt%C3%B3ra, ansin fr%C3%A1ma amh%C3%A1in in aghaidh gach deilt, ansin fr%C3%A1ma le finish_reason agus an bloc r%C3%B3daithe, ansin cr%C3%ADochn%C3%B3ir amh%C3%A1in go beacht. L%C3%A9ann cliant a leanann an fhorm%C3%A1id an cr%C3%ADochn%C3%B3ir agus stopann s%C3%A9; n%C3%AD fh%C3%A9adfaidh s%C3%A9 cr%C3%ADochn%C3%B3ir at%C3%A1 ar iarraidh a mheas mar fhreagra ioml%C3%A1n.

```
data: {"id":"chatcmpl-%E2%80%A6","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"role":"assistant"},"finish_reason":null}]}

data: {"id":"chatcmpl-%E2%80%A6","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"Hallo"},"finish_reason":null}]}

data: {"id":"chatcmpl-%E2%80%A6","object":"chat.completion.chunk","choices":[{"index":0,"delta":{},"finish_reason":"stop"}],"llmeu":{%E2%80%A6}}

data: [DONE]
```

## Taisteala%C3%ADonn an bloc r%C3%B3daithe leis an bhfr%C3%A1ma deireanach

Iompra%C3%ADonn an fr%C3%A1ma deireanach an r%C3%A9ad llmeu c%C3%A9anna a thugann an freagra neamhshruthaithe ar ais: trace_id, model_used, model_version, provider, endpoint_id, inference_region, sovereignty_class, policy_id, retention agus an meastach%C3%A1n costais. I m%C3%B3d sruthaithe n%C3%AD bh%C3%ADonn %C3%BAs%C3%A1id ar eolas ach ag an deireadh, agus sin an f%C3%A1th a dtaisteala%C3%ADonn an bloc leis an bhfr%C3%A1ma deireanach seachas leis an gc%C3%A9ad fhr%C3%A1ma.

## D%C3%ADcheangla%C3%ADonn cliant

Stopann d%C3%BAnadh an naisc an obair agus scr%C3%ADobhann s%C3%A9 an rian leis an m%C3%A9id a t%C3%A1irgeadh iarbh%C3%ADr. Is glao a tharla f%C3%B3s %C3%A9 iarratas cealaithe, mar sin taispe%C3%A1ntar in %C3%BAs%C3%A1id %C3%A9; n%C3%AD thaifeadtar %C3%A9 mar chr%C3%ADochn%C3%BA cr%C3%ADochnaithe.

## An rud nach f%C3%A9idir a shruth%C3%BA

Is freagra%C3%AD JSON aonair iad leabuithe agus an API ard%C3%A1in. Is earr%C3%A1id bhail%C3%ADochta %C3%A9 stream: true ar bhealach neamhshruthaithe, n%C3%AD fillteadh ci%C3%BAin ar aon fhr%C3%A1ma amh%C3%A1in.