Courses/Building AI Applications/Cost, Latency and Shipping

Streaming and Latency

After this lesson you can separate time-to-first-token from total time, decide when to stream, and shave the latency the user actually feels.