Uncertainty with Shannon Entropy
Measure uncertainty for probability distribution with separate outcomes.
Your numbers
Entropy value
Use consistent units. Result follow the assumptions wey you enter.
Compare scenarios
You fit keep up to three snapshots for this tab. Loading one go replace the present inputs.
Formula
Use H = −Σpᵢlog₂(pᵢ). pᵢ na probability fractions wey total one. Terms wey get zero probability contribute zero. Di logarithm base make entropy H get bits as unit.
Measure uncertainty for probability distribution with separate outcomes.
Example wey show the calculation
- Probabilities wey add up to 1
- 0.5, 0.5
- Entropy value
- 1 bit
- Effective number of equally likely outcomes
- 2
Where e fit work and limits
Use consistent units. Result follow the assumptions wey you enter.
We check inputs for missing values and allowed ranges. Result wey pass the finite numeric range no go show. Rounding affect wetin display, while calculation use the model numeric precision.
Check your units and assumptions before you rely on result. Changing label no convert currency or physical unit.
Version of di formula: 54c4ae799ba2 · Example don get check: