azureazure-openai

Azure Server responded with status 429. Error message: {'error': {'code': '429', 'message': 'Rate limit is exceeded. Try again in 57 seconds.'}}

The token I used to ask this question is only 16 tokens. I searched the internet for the error I received

Server responded with status 429. Error message: {'error': {'code': '429', 'message': 'Rate limit is exceeded. Try again in 57 seconds.'}}

and it suggested that I should scale my services. I scaled my search service to the maximum 36/36, but I still encountered the same error.

How to resolve this issue?

Solution

  • I resolved the issue by adjusting the Tokens per Minute rate limit to a higher value. Initially, it was set to the default of about 10,000. enter image description here