Indecomposable distribution
Encyclopedia
In probability theory
, an indecomposable distribution is a probability distribution
that cannot be represented as the distribution of the sum of two or more non-constant independent
random variable
s: Z ≠ X + Y. If it can be so expressed, it is decomposable: Z = X + Y. If, further, it can be expressed as the distribution of the sum of two or more independent identically distributed random variables, then it is divisible: Z = X1 + X2.
Probability theory
Probability theory is the branch of mathematics concerned with analysis of random phenomena. The central objects of probability theory are random variables, stochastic processes, and events: mathematical abstractions of non-deterministic events or measured quantities that may either be single...
, an indecomposable distribution is a probability distribution
Probability distribution
In probability theory, a probability mass, probability density, or probability distribution is a function that describes the probability of a random variable taking certain values....
that cannot be represented as the distribution of the sum of two or more non-constant independent
Statistical independence
In probability theory, to say that two events are independent intuitively means that the occurrence of one event makes it neither more nor less probable that the other occurs...
random variable
Random variable
In probability and statistics, a random variable or stochastic variable is, roughly speaking, a variable whose value results from a measurement on some type of random process. Formally, it is a function from a probability space, typically to the real numbers, which is measurable functionmeasurable...
s: Z ≠ X + Y. If it can be so expressed, it is decomposable: Z = X + Y. If, further, it can be expressed as the distribution of the sum of two or more independent identically distributed random variables, then it is divisible: Z = X1 + X2.
Indecomposable
- The simplest examples are Bernoulli distributions: if
-
- then the probability distribution of X is indecomposable.
- Proof: Given non-constant distributions U and V, so that U assumes at least two values a, b and V assumes two values c, d, with a < b and c < d, then U + V assumes at least three distinct values: a + c, a + d, b + d (b + c may be equal to a + d, for example if one uses 0, 1 and 0, 1). Thus the sum of non-constant distributions assumes at least three values, so the Bernoulli distribution is not the sum of non-constant distributions.
- Suppose a + b + c = 1, a, b, c ≥ 0, and
-
- This probability distribution is decomposable (as the sum of two Bernoulli distributions) if
- and otherwise indecomposable. To see, this, suppose U and V are independent random variables and U + V has this probability distribution. Then we must have
-
- for some p, q ∈ [0, 1], by similar reasoning to the Bernoulli case (otherwise the sum U + V will assume more than three values). It follows that
- This system of two quadratic equations in two variables p and q has a solution (p, q) ∈ [0, 1]2 if and only if
- Thus, for example, the discrete uniform distribution on the set {0, 1, 2} is indecomposable, but the binomial distribution assigning respective probabilities 1/4, 1/2, 1/4 is decomposable.
- An absolutely continuousAbsolute continuityIn mathematics, the relationship between the two central operations of calculus, differentiation and integration, stated by fundamental theorem of calculus in the framework of Riemann integration, is generalized in several directions, using Lebesgue integration and absolute continuity...
indecomposable distribution. It can be shown that the distribution whose density functionProbability density functionIn probability theory, a probability density function , or density of a continuous random variable is a function that describes the relative likelihood for this random variable to occur at a given point. The probability for the random variable to fall within a particular region is given by the...
is
- is indecomposable.
Decomposable
- All infinitely divisibleInfinite divisibility (probability)The concepts of infinite divisibility and the decomposition of distributions arise in probability and statistics in relation to seeking families of probability distributions that might be a natural choice in certain applications, in the same way that the normal distribution is...
distributions are a fortiori decomposable; in particular, this includes the stable distributions, such as the normal distribution.
- The uniform distributionUniform distribution (continuous)In probability theory and statistics, the continuous uniform distribution or rectangular distribution is a family of probability distributions such that for each member of the family, all intervals of the same length on the distribution's support are equally probable. The support is defined by...
on the interval [0, 1] is decomposable, since it is the sum of the Bernoulli variable that assumes 0 or 1/2 with equal probabilities and the uniform distribution on [0, 1/2]. Iterating this yields the infinite decomposition:
- where the independent random variables Xn are each equal to 0 or 1 with equal probabilities – this is a Bernoulli trial of each digit of the binary expansion.
- A sum of indecomposable random variables is necessarily decomposable (as it is a sum), and in fact may a fortiori be an infinitely divisible distribution (not just decomposable as the given sum). Suppose a random variable Y has a geometric distribution
- on {0, 1, 2, ...}. For any positive integer k, there is a sequence of negative-binomially distributedNegative binomial distributionIn probability theory and statistics, the negative binomial distribution is a discrete probability distribution of the number of successes in a sequence of Bernoulli trials before a specified number of failures occur...
random variables Yj, j = 1, ..., k, such that Y1 + ... + Yk has this geometric distribution. Therefore, this distribution is infinitely divisible. But now let Dn be the nth binary digit of Y, for n ≥ 0. Then the Ds are independent and
- and each term in this sum is indecomposable.
Related concepts
At the other extreme from indecomposability is infinite divisibilityInfinite divisibility (probability)The concepts of infinite divisibility and the decomposition of distributions arise in probability and statistics in relation to seeking families of probability distributions that might be a natural choice in certain applications, in the same way that the normal distribution is...
.
- Cramér's theoremCramér's theoremIn mathematical statistics, Cramér's theorem is one of several theorems of Harald Cramér, a Swedish statistician and probabilist.- Normal random variables :...
shows that while the normal distribution is infinitely divisible, it can only be decomposed into normal distributions. - Cochran's theoremCochran's theoremIn statistics, Cochran's theorem, devised by William G. Cochran, is a theorem used in to justify results relating to the probability distributions of statistics that are used in the analysis of variance.- Statement :...
shows that decompositions of a sum of squares of normal random variables into sums of squares of linear combinations of these variables are always independent chi-squared distributions.
See also
- Cramér's theoremCramér's theoremIn mathematical statistics, Cramér's theorem is one of several theorems of Harald Cramér, a Swedish statistician and probabilist.- Normal random variables :...
- Cochran's theoremCochran's theoremIn statistics, Cochran's theorem, devised by William G. Cochran, is a theorem used in to justify results relating to the probability distributions of statistics that are used in the analysis of variance.- Statement :...
- Infinite divisibility (probability)Infinite divisibility (probability)The concepts of infinite divisibility and the decomposition of distributions arise in probability and statistics in relation to seeking families of probability distributions that might be a natural choice in certain applications, in the same way that the normal distribution is...