PrepGenAICerts

Streaming & Websocket Transport vs. Token Cost

Core

Distinguish SDKs from raw REST and sync/async/streaming transport · Difficulty 1/5

0%
streamingwebsocketsserver-sent-eventstechnical-fundamentals

Explanation

Streaming Delivers Tokens Incrementally

Rather than waiting for the full response to complete before returning anything, **Streaming uses a persistent event stream -- typically server-sent events (SSE)** -- to deliver tokens to the client incrementally as they're generated. This lets an application start rendering or processing output before generation finishes, improving perceived latency (time-to-first-token).

Websockets for Realtime/Bidirectional Cases

Some realtime or bidirectional integrations (for example, voice or live-conversation interfaces) use websockets instead of a one-directional SSE stream, since websockets support two-way communication over a single persistent connection.

Transport Is Not a Cost Lever

The critical distinction: Streaming and websocket choices are transport/delivery concerns -- they change *how* and *when* tokens arrive at the client, not *how many* tokens are generated or billed. A streamed response and a non-streamed response for the same request generate and bill the same number of output tokens; Streaming only changes the delivery pattern.

Common exam traps

  • Assuming Streaming reduces token cost or the number of tokens generated -- it changes delivery timing, not billing.
  • Confusing Streaming (incremental delivery of a single response) with websockets (a bidirectional connection), or assuming every Claude integration requires websockets -- most Streaming use cases only need SSE.

Key Takeaways

  • Streaming delivers tokens incrementally via a persistent event stream (typically server-sent events), improving time-to-first-token
  • Websockets support bidirectional communication and are used for some realtime/bidirectional integrations
  • Streaming/websocket choice is a transport concern -- it changes delivery, not token count or billing
  • A streamed and non-streamed call for the same request bill the same number of tokens

Glossary Terms

Related Concepts

PrepGenAICerts.com is an independent third-party exam-prep platform for the Claude Certified Architect (CCA-F) certification. We are not affiliated with, endorsed by, or acting on behalf of Anthropic PBC.

Note: New premium upgrades are temporarily paused while we resolve an issue with our payment provider. Existing premium members retain full access.