fujin/anthropic-proxy
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
29 Commits 1 Branch 0 Tags
eda66ff7d41971610b22033e2e3ac95d70866a85
Commit Graph

3 Commits

Author SHA1 Message Date
Alexander eda66ff7d4 refactor(ratelimit): remove in-memory per-window token tracking 
Token counts per rate limit window are now derived in Grafana via
increase(counter[5h/168h]) on the existing cumulative OTel counters.
Removes TokensIn/Out from Window, RecordTokens, setResetTime, and
the window_tokens observable gauges.
 2026-04-14 13:49:05 +02:00
Alexander 744abc1d24 fix(ratelimit): clear window token counters on reset from response headers 
UpdateFromHeaders was silently updating ResetsAt without clearing token
counters. When a window rolled over, the poll method would see ResetsAt
already updated and skip the reset. Extract setResetTime helper used by
both code paths.
 2026-04-14 13:37:06 +02:00
Alexander fac9578975 feat(ratelimit): track per-window token usage and utilization 
Poll /api/oauth/usage every 5 min and extract utilization from
/v1/messages response headers for real-time updates. Track proxy
tokens in/out per rate limit window (5h/7d), resetting on window
change. Expose as OTel observable gauges for Grafana dashboards.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-14 12:51:31 +02:00