Budget for context tokens
Keep output space aside and calculate input capacity wey remain.
Your numbers
Input budget wey still remain
Use the actual tokenizer and provider limits. E no fetch or verify context windows, output caps, hidden overhead or prices here.
Compare scenarios
You fit keep up to three snapshots for this tab. Loading one go replace the present inputs.
Formula
Use A = W−S−H−O. W na context capacity, S na system and tool tokens, H na existing history, O na reserved output, and A na input capacity wey remain. All di terms na token counts.
Keep output space aside and calculate input capacity wey remain.
Example wey show the calculation
- Model context-window size (tokens)
- 32000
- Tokens for system and tools
- 2000
- Tokens for history wey already dey
- 10000
- Tokens wey you reserve for output
- 4000
- Tokens for each new document chunk
- 2000
- Input budget wey still remain
- 16,000 tokens
- Whole new chunks wey fit enter
- 8
- Amount wey pass di budget
- 0 tokens
Where e fit work and limits
Use the actual tokenizer and provider limits. E no fetch or verify context windows, output caps, hidden overhead or prices here.
We check inputs for missing values and allowed ranges. Result wey pass the finite numeric range no go show. Rounding affect wetin display, while calculation use the model numeric precision.
Check your units and assumptions before you rely on result. Changing label no convert currency or physical unit.
Version of di formula: 3863a060f33a · Example don get check: