Your Foundry SDK chat client needs to show the assistant's reply appearing word-by-word as it's generated, instead of waiting for the whole response. What should you use?
- A. Multiple separate short prompts stitched together after each finishes
- B. A batch inference endpoint intended for offline scoring
- C. A synchronous call that blocks until the entire response is generated, then reprints it letter by letter client-side
- D. A streaming response call that yields partial output chunks as they are produced✓ Correct
Explanation
Streaming is the SDK pattern for incremental output: the client receives and displays chunks as the model generates them, giving a live typing effect. Faking it by re-printing a completed response letter by letter is not real streaming, chaining separate prompts changes the task, and batch endpoints are built for offline, non-interactive scoring rather than live chat.