Skip to main content

​
Overview

You can configure LLM rate limits and throttling settings in the Token Rate Limits section of the Admin Panel. Rate limits can be applied globally, by User, or by User Group. Rate Limits