Sticky Sessions Won't Save Your AI Chat: 6 Questions Before You Run a .NET Chat Backend on Two Nodes
This story is from 2026-11-16. It is preserved in the archive; the latest stories are on the live feed.
Scaling a normal API is a solved problem: make the servers stateless, put the state in a database, add nodes. An AI chat backend follows the same recipe and still goes wrong, because a chat turn is slow, costs money, depends on history, and gets retried by clients all the time. When I moved a C# ch…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-16 12:53 · DEV Community — AI
Sticky Sessions Won't Save Your AI Chat: 6 Questions Before You Run a .NET Chat Backend on Two Nodes