Dyadic distribution

From Wikipedia, the free encyclopedia

A dyadic (or 2-adic) distribution is a specific type of discrete probability distribution that is of some theoretical importance in data compression.

Definition

A dyadic distribution is a probability distribution whose probability mass function is

f(i)=2^{-x_{i}}

where $x_{i}$ is some whole number.

It is possible to find a binary code defined on this distribution, which has an average code length that is equal to the entropy.^[1]

References

^ Cover, T.M., Joy A. Thomas, J.A. (2006) Elements of information theory, Wiley. ISBN 0-471-24195-4

Cover, T.M., Joy A. Thomas, J.A. (2006) Elements of information theory, Wiley. ISBN 0-471-24195-4

Probability distributions (list)

Discrete
univariate

with finite support	Benford Bernoulli Beta-binomial Binomial Categorical Hypergeometric Negative Poisson binomial Rademacher Soliton Discrete uniform Zipf Zipf–Mandelbrot
with infinite support	Beta negative binomial Borel Conway–Maxwell–Poisson Discrete phase-type Delaporte Extended negative binomial Flory–Schulz Gauss–Kuzmin Geometric Logarithmic Mixed Poisson Negative binomial Panjer Parabolic fractal Poisson Skellam Yule–Simon Zeta

Continuous
univariate

supported on a bounded interval	Arcsine ARGUS Balding–Nichols Bates Beta Generalized Beta rectangular Continuous Bernoulli Irwin–Hall Kumaraswamy Logit-normal Noncentral beta PERT Raised cosine Reciprocal Triangular U-quadratic Uniform Wigner semicircle
supported on a semi-infinite interval	Benini Benktander 1st kind Benktander 2nd kind Beta prime Burr Chi Chi-squared Noncentral Inverse Scaled Dagum Davis Erlang Hyper Exponential Hyperexponential Hypoexponential Logarithmic F Noncentral Folded normal Fréchet Gamma Generalized Inverse gamma/Gompertz Gompertz Shifted Half-logistic Half-normal Hotelling's T-squared Hartman–Watson Inverse Gaussian Generalized Kolmogorov Lévy Log-Cauchy Log-Laplace Log-logistic Log-normal Log-t Lomax Matrix-exponential Maxwell–Boltzmann Maxwell–Jüttner Mittag-Leffler Nakagami Pareto Phase-type Poly-Weibull Rayleigh Relativistic Breit–Wigner Rice Truncated normal type-2 Gumbel Weibull Discrete Wilks's lambda
supported on the whole real line	Cauchy Exponential power Fisher's z Kaniadakis κ-Gaussian Gaussian q Generalized hyperbolic Generalized logistic (logistic-beta) Generalized normal Geometric stable Gumbel Holtsmark Hyperbolic secant Johnson's S_U Landau Laplace Asymmetric Logistic Noncentral t Normal (Gaussian) Normal-inverse Gaussian Skew normal Slash Stable Student's t Tracy–Widom Variance-gamma Voigt
with support whose type varies	Generalized chi-squared Generalized extreme value Generalized Pareto Marchenko–Pastur Kaniadakis κ-exponential Kaniadakis κ-Gamma Kaniadakis κ-Weibull Kaniadakis κ-Logistic Kaniadakis κ-Erlang q-exponential q-Gaussian q-Weibull Shifted log-logistic Tukey lambda

Mixed
univariate

continuous- discrete	Rectified Gaussian

Multivariate
(joint)

Discrete:
Ewens
Multinomial
- Dirichlet
- Negative
Continuous:
Dirichlet
- Generalized
Multivariate Laplace
Multivariate normal
Multivariate stable
Multivariate t
Normal-gamma
- Inverse
Matrix-valued:
LKJ
Matrix beta
Matrix normal
Matrix t
Matrix gamma
- Inverse
Wishart
- Normal
- Inverse
- Normal-inverse
- Complex
Uniform distribution on a Stiefel manifold

Directional

Univariate (circular) directional: Circular uniform; Univariate von Mises; Wrapped normal; Wrapped Cauchy; Wrapped exponential; Wrapped asymmetric Laplace; Wrapped Lévy
Bivariate (spherical): Kent
Bivariate (toroidal): Bivariate von Mises
Multivariate: von Mises–Fisher; Bingham

Degenerate
and singular

Degenerate: Dirac delta function
Singular: Cantor

Families

Categories: