Castedo Variance vs entropy of one-hot vectors
- Last update: 2021-06-29
- Status: archived with doi
- Issues (on gitlab.com)
- Archived preprint: doi:10/hpd6
Abstract
DOCUMENT TYPE: Open Study Answer
QUESTION: What is the relationship between the variance and entropy of independent one-hot vectors?
This document proves inequalities relating variance, collision entropy and Shannon entropy of sequences of independent one-hot vectors.
Read
-
As web page
with annotations - As PDF
Feedback and questions welcome
Even critical comments!
- Send email
-
Post an issue
on gitlab.com
-
Annotate
with Hypothesis
