Kjetil
Contributor

I should also mention that the LLM Chain calls an Azure Open AI endpoint as a final step which then streams the answer back to the client. This means that each request remains open for the response generation.