Hey there,
Under normal circumstances, an agent should take about 3 to 5 seconds to respond. This is the typical time an agent needs to process the input and generate a response.
On some occasions, especially during traffic spikes, the response time can extend up to 10 seconds. However, that’s very unlikely and should not be a frequent occurrence.
My agent is taking 30 seconds to respond
Now, if you’re noticing your agent is taking around 30 seconds or more to respond, this could signify another issue. It’s possible your OpenAI account might be suffering from a slowdown or there may be a throttling issue, affecting specific API keys and OpenAI organizations.
While there’s no official explanation as to why this might occur, the best course of action in such a case would be to try using an API key from another account. If that doesn’t work, you can still use OpenRouter.
You can read more about this issue here: GPT-3.5 API is 30x slower than ChatGPT equivalent prompt - #69 by fred5 - API - OpenAI Developer Community
I hope this helps! If you have further questions or need assistance, feel free to reach out.
Cheers,
Fatos, Founder of Answerly.