Bdsh-live-token-stats
better-er/dsh-live-token-stats
Live token stats under the DSH Web composer: streamed tokens/s, output token and first-byte latency, plus per-step estimate-vs-actual reconciliation using the official BPE tokenizer, to tell a slow stream from a stalled one.
44 days agoUsage & BillingMIT