tanghoongAug 28月2日
Sync or async for an AI support chatbot
If customer A is waiting for the LLM, does customer B have to wait too? The answer is an architecture decision, and it matters long before you have a thousand customers.
Tag標籤
11 post篇文章
If customer A is waiting for the LLM, does customer B have to wait too? The answer is an architecture decision, and it matters long before you have a thousand customers.