github:jyao-SUSE-power-group/dsh-provider-rate-limit
modelgit
Rate-limits LLM requests per provider and per model using a reservation-based token bucket, with queue or reject modes, plus gateway identity rules that rewrite user-agent and inject custom headers.
下载量 / Downloads
0
Install
dsh plugin --profile web add github:jyao-SUSE-power-group/dsh-provider-rate-limit
Sandbox test
This plugin has not been tested yet. Submit a test →