Back to Blog

Related posts

Read more »

Chasing 240 FPS in LLM Chat UIs

TL;DR I built a benchmark suite to test various optimizations for streaming LLM responses in a React UI. Key takeaways: 1. Build a proper state first, then opt...