Poisson distribution

Poisson distribution

 Parameters Probability mass function The horizontal axis is the index k, the number of occurrences. The function is only defined at integer values of k. The connecting lines are only guides for the eye. Cumulative distribution function The horizontal axis is the index k, the number of occurrences. The CDF is discontinuous at the integers of k and flat everywhere else because a variable that is Poisson distributed only takes on integer values. λ > 0 (real) k ∈ { 0, 1, 2, 3, ... } \frac{\lambda^k}{k!} e^{-\lambda} \frac{\Gamma(\lfloor k+1\rfloor, \lambda)}{\lfloor k\rfloor !}, or e^{-\lambda} \sum_{i=0}^{\lfloor k\rfloor} \frac{\lambda^i}{i!}\ , or Q(\lfloor k+1\rfloor,\lambda) (for k\ge 0, where \Gamma(x, y) is the incomplete gamma function, \lfloor k\rfloor is the floor function, and Q is the regularized gamma function) \lambda \approx\lfloor\lambda+1/3-0.02/\lambda\rfloor \lceil\lambda\rceil - 1, \lfloor\lambda\rfloor \lambda \lambda^{-1/2} \lambda^{-1} \lambda[1 - \log(\lambda)] + e^{-\lambda}\sum_{k=0}^\infty \frac{\lambda^k\log(k!)}{k!} (for large \lambda) \frac{1}{2}\log(2 \pi e \lambda) - \frac{1}{12 \lambda} - \frac{1}{24 \lambda^2} - \qquad \frac{19}{360 \lambda^3} + O\left(\frac{1}{\lambda^4}\right) \exp(\lambda (e^{t} - 1)) \exp(\lambda (e^{it} - 1)) \exp(\lambda(z - 1))

In probability theory and statistics, the Poisson distribution (French pronunciation ; in English usually ), named after French mathematician Siméon Denis Poisson, is a discrete probability distribution that expresses the probability of a given number of events occurring in a fixed interval of time and/or space if these events occur with a known average rate and independently of the time since the last event.[1] The Poisson distribution can also be used for the number of events in other specified intervals such as distance, area or volume.

For instance, an individual keeping track of the amount of mail they receive each day may notice that they receive an average number of 4 letters per day. As it is reasonable to assume that receiving one piece of mail will not affect the arrival times of future pieces of mail—that pieces of mail from a wide range of sources arrive independently of one another—the number of pieces of mail received per day would obey a Poisson distribution.[2] Other examples might include: the number of phone calls received by a call center per hour, the number of decay events per second from a radioactive source, or the number of taxis passing a particular street corner per hour.

Contents

• History 1
• Definition 2
• Properties 3
• Mean 3.1
• Median 3.2
• Higher moments 3.3
• Other properties 3.4
• Poisson Races 3.5
• Related distributions 4
• Occurrence 5
• Law of rare events 5.1
• Multi-dimensional Poisson process 5.2
• Other applications in science 5.3
• Generating Poisson-distributed random variables 6
• Parameter estimation 7
• Maximum likelihood 7.1
• Confidence interval 7.2
• Bayesian inference 7.3
• Simultaneous estimation of multiple Poisson means 7.4
• Bivariate Poisson distribution 8
• Notes 10
• References 11

History

The distribution was first introduced by Siméon Denis Poisson (1781–1840) and published, together with his probability theory, in 1837 in his work Recherches sur la probabilité des jugements en matière criminelle et en matière civile (“Research on the Probability of Judgments in Criminal and Civil Matters”).[3] The work theorized about the number of wrongful convictions in a given country by focusing on certain random variables N that count, among other things, the number of discrete occurrences (sometimes called "events" or “arrivals”) that take place during a time-interval of given length. The result had been given previously by Abraham de Moivre (1711) in De Mensura Sortis seu; de Probabilitate Eventuum in Ludis a Casu Fortuito Pendentibus in Philosophical Transactions of the Royal Society, p. 219.[4]

A practical application of this distribution was made by Ladislaus Bortkiewicz in 1898 when he was given the task of investigating the number of soldiers in the Prussian army killed accidentally by horse kicks; this experiment introduced the Poisson distribution to the field of reliability engineering.[5]

Definition

A discrete random variable X  is said to have a Poisson distribution with parameter λ > 0, if, for k = 0, 1, 2, …, the probability mass function of X  is given by:[6]

\!f(k; \lambda)= \Pr(X=k)= \frac{\lambda^k e^{-\lambda}}{k!},

where

The positive real number λ is equal to the expected value of X and also to its variance[7]

\lambda=\operatorname{E}(X)=\operatorname{Var}(X).

The Poisson distribution can be applied to systems with a large number of possible events, each of which is rare. How many such events will occur during a fixed time interval? Under the right circumstances, this is a random number with a Poisson distribution.

Properties

Mean

\operatorname{E}|X-\lambda|= 2\exp(-\lambda) \frac{\lambda^{\lfloor\lambda\rfloor + 1}}{ \lfloor\lambda\rfloor!} .
• The mode of a Poisson-distributed random variable with non-integer λ is equal to \scriptstyle\lfloor \lambda \rfloor, which is the largest integer less than or equal to λ. This is also written as floor(λ). When λ is a positive integer, the modes are λ and λ − 1.
• All of the cumulants of the Poisson distribution are equal to the expected value λ. The nth factorial moment of the Poisson distribution is λn.

Median

Bounds for the median (ν) of the distribution are known and are sharp:[8]

\lambda - \ln 2 \le \nu < \lambda + \frac{1}{3}.

Higher moments

m_k = \sum_{i=1}^k \lambda^i \left\{\begin{matrix} k \\ i \end{matrix}\right\},
where the {braces} denote Stirling numbers of the second kind.[9] The coefficients of the polynomials have a combinatorial meaning. In fact, when the expected value of the Poisson distribution is 1, then Dobinski's formula says that the nth moment equals the number of partitions of a set of size n.
• Sums of Poisson-distributed random variables:
If X_i \sim \mathrm{Pois}(\lambda_i)\, i=1,\dots,n are independent, and \lambda=\sum_{i=1}^n \lambda_i, then Y = \left( \sum_{i=1}^n X_i \right) \sim \mathrm{Pois}(\lambda).[10] A converse is Raikov's theorem, which says that if the sum of two independent random variables is Poisson-distributed, then so is each of those two independent random variables.[11]

Other properties

D_{\mathrm{KL}}(\lambda\|\lambda_0) = \lambda_0 - \lambda + \lambda \log \frac{\lambda}{\lambda_0}.
• Bounds for the tail probabilities of a Poisson random variable X \sim \text{Pois}(\lambda) can be derived using a Chernoff bound argument.[14]
P(X \geq x) \leq \frac{e^{-\lambda} (e \lambda)^x}{x^x}, \text{ for } x > \lambda ,
P(X \leq x) \leq \frac{e^{-\lambda} (e \lambda)^x}{x^x}, \text{ for } x < \lambda .
\left\{(k+1) f(k+1)-\lambda f(k)=0,f(0)=e^{-\lambda }\right\}

Poisson Races

Let X \sim Poi(\lambda), and Y \sim Poi(\mu), be independent random variables, with \lambda < \mu then we have that,

\frac{e^{-(\sqrt{\mu} -\sqrt{\lambda})^2 }}{(\lambda + \mu)^2} - \frac{e^{-(\lambda + \mu)}}{2\sqrt{\lambda \mu}} - \frac{e^{-(\lambda + \mu)}}{4\lambda \mu} \leq P(X - Y \geq 0) \leq e^{- (\sqrt{\mu} -\sqrt{\lambda})^2}

The upper bound is proved using a standard Chernoff bound.

The lower bound can be proved by noting that P(X-Y\geq0| X+Y=i) is a the probability that Z \geq \frac{i}{2}, where Z \sim Bin\left(i, \frac{\lambda}{\lambda+\mu}\right), which is lower bounded by \frac{1}{(i+1)^2} e^{\left(2D\left(0.5|| \frac{\lambda}{\lambda+\mu}\right)\right)} , where D is relative entropy (See the entry on bounds on tails of binomial distributions for details). Further noting that X+Y \sim Poi(\lambda+\mu), and computing a lower bound on the unconditional probability gives the result.

Related distributions

• If X_1 \sim \mathrm{Pois}(\lambda_1)\, and X_2 \sim \mathrm{Pois}(\lambda_2)\, are independent, then the difference Y = X_1 - X_2 follows a Skellam distribution.
• If X_1 \sim \mathrm{Pois}(\lambda_1)\, and X_2 \sim \mathrm{Pois}(\lambda_2)\, are independent, then the distribution of X_1 conditional on X_1+X_2 is a binomial distribution.
Specifically, given X_1+X_2=k, \!X_1\sim \mathrm{Binom}(k, \lambda_1/(\lambda_1+\lambda_2)).
More generally, if X1, X2,..., Xn are independent Poisson random variables with parameters λ1, λ2,..., λn then
given \sum_{j=1}^n X_j=k, X_i \sim \mathrm{Binom}\left(k, \frac{\lambda_i}{\sum_{j=1}^n\lambda_j}\right). In fact, \{X_i\} \sim \mathrm{Multinom}\left(k, \left\{\frac{\lambda_i}{\sum_{j=1}^n\lambda_j}\right\}\right).
• If X \sim \mathrm{Pois}(\lambda)\, and the distribution of Y, conditional on X = k, is a binomial distribution, Y \mid (X = k) \sim \mathrm{Binom}(k, p), then the distribution of Y follows a Poisson distribution Y \sim \mathrm{Pois}(\lambda \cdot p)\,. In fact, if \{Y_i\} , conditional on X = k, follows a multinomial distribution, \{Y_i\} \mid (X = k) \sim \mathrm{Multinom}\left(k, p_i\right), then each Y_i follows an independent Poisson distribution Y_i \sim \mathrm{Pois}(\lambda \cdot p_i), \rho(Y_i, Y_j) = 0.
• The Poisson distribution can be derived as a limiting case to the binomial distribution as the number of trials goes to infinity and the expected number of successes remains fixed — see law of rare events below. Therefore it can be used as an approximation of the binomial distribution if n is sufficiently large and p is sufficiently small. There is a rule of thumb stating that the Poisson distribution is a good approximation of the binomial distribution if n is at least 20 and p is smaller than or equal to 0.05, and an excellent approximation if n ≥ 100 and np ≤ 10.[15]
F_\mathrm{Binomial}(k;n, p) \approx F_\mathrm{Poisson}(k;\lambda=np)\,
• The Poisson distribution is a special case of discrete compound Poisson distribution (or stuttering Poisson distribution) with only a parameter.[16] The discrete compound Poisson distribution can be deduced from the limiting distribution of univariate multinomial distribution. It is also a special case of a compound Poisson distribution.
• For sufficiently large values of λ, (say λ>1000), the normal distribution with mean λ and variance λ (standard deviation \sqrt{\lambda}) is an excellent approximation to the Poisson distribution. If λ is greater than about 10, then the normal distribution is a good approximation if an appropriate continuity correction is performed, i.e., P(X ≤ x), where (lower-case) x is a non-negative integer, is replaced by P(X ≤ x + 0.5).
F_\mathrm{Poisson}(x;\lambda) \approx F_\mathrm{normal}(x;\mu=\lambda,\sigma^2=\lambda)\,
• Variance-stabilizing transformation: When a variable is Poisson distributed, its square root is approximately normally distributed with expected value of about \sqrt \lambda and variance of about 1/4.[17][18] Under this transformation, the convergence to normality (as λ increases) is far faster than the untransformed variable. Other, slightly more complicated, variance stabilizing transformations are available,[18] one of which is Anscombe transform. See Data transformation (statistics) for more general uses of transformations.
• If for every t > 0 the number of arrivals in the time interval [0, t] follows the Poisson distribution with mean λt, then the sequence of inter-arrival times are independent and identically distributed exponential random variables having mean 1/λ.[19]
• The cumulative distribution functions of the Poisson and chi-squared distributions are related in the following ways:[20]
and[21]
\Pr(X=k)=F_{\chi^2}(2\lambda;2(k+1)) -F_{\chi^2}(2\lambda;2k) .

Occurrence

Applications of the Poisson distribution can be found in many fields related to counting:[22]

The Poisson distribution arises in connection with Poisson processes. It applies to various phenomena of discrete properties (that is, those that may happen 0, 1, 2, 3, ... times during a given period of time or in a given area) whenever the probability of the phenomenon happening is constant in time or space. Examples of events that may be modelled as a Poisson distribution include:

• The number of soldiers killed by horse-kicks each year in each corps in the Prussian cavalry. This example was made famous by a book of Ladislaus Josephovich Bortkiewicz (1868–1931).
• The number of yeast cells used when brewing Guinness beer. This example was made famous by William Sealy Gosset (1876–1937).[23]
• The number of phone calls arriving at a call centre within a minute. This example was made famous by A.K. Erlang (1878 – 1929).
• Internet traffic.
• The number of goals in sports involving two competing teams.[24]
• The number of deaths per year in a given age group.
• The number of jumps in a stock price in a given time interval.
• Under an assumption of homogeneity, the number of times a web server is accessed per minute.
• The number of mutations in a given stretch of DNA after a certain amount of radiation.
• The proportion of cells that will be infected at a given multiplicity of infection.
• The arrival of photons on a pixel circuit at a given illumination and over a given time period.
• The targeting of V-1 flying bombs on London during World War II.[25]

Gallagher in 1976 showed that the counts of prime numbers in short intervals obey a Poisson distribution provided a certain version of an unproved conjecture of Hardy and Littlewood is true.[26]

Law of rare events

Comparison of the Poisson distribution (black lines) and the binomial distribution with n=10 (red circles), n=20 (blue circles), n=1000 (green circles). All distributions have a mean of 5. The horizontal axis shows the number of events k. Notice that as n gets larger, the Poisson distribution becomes an increasingly better approximation for the binomial distribution with the same mean.

The rate of an event is related to the probability of an event occurring in some small subinterval (of time, space or otherwise). In the case of Poisson distribution, one assumes that there exists a small enough subinterval for which the probability of an event occurring twice is "negligible". With this assumption one can derive the Poisson distribution from the Binomial one, given only the information of expected number of total events in the whole interval. Indeed let this total number be \lambda. Divide the whole interval into n subintervals I_1,\dots,I_n of equal size, such that n > \lambda (since we are only interested in very small portions of the interval this assumption is meaningful). This means that the expected number of events in an interval I_k for each k is equal to \lambda/n. Now we assume that the occurrence of an event in the whole interval can be seen as a Bernoulli trial, where the i^{th} trial corresponds to looking whether an event happens at the subinterval I_i with probability \lambda/n. Indeed the expected number of total events in n such trials would be \lambda, the expected number of total events in the whole interval. Hence for each subdivision of the interval we have approximated the occurrence of the event as a Bernoulli process of the form \textrm{B}(n,\lambda/n). As we have noted before we want to consider only very small subintervals. Therefore we take the limit as n goes to infinity. In this case the binomial distribution converges to what is known as the Poisson distribution by the Poisson limit theorem.

In several of the above examples—such as, the number of mutations in a given sequence of DNA—the events being counted are actually the outcomes of discrete trials, and would more precisely be modelled using the binomial distribution, that is

X \sim \textrm{B}(n,p). \,

In such cases n is very large and p is very small (and so the expectation np is of intermediate magnitude). Then the distribution may be approximated by the less cumbersome Poisson distribution

X \sim \textrm{Pois}(np). \,

This approximation is sometimes known as the law of rare events,[27] since each of the n individual Bernoulli events rarely occurs. The name may be misleading because the total count of success events in a Poisson process need not be rare if the parameter np is not small. For example, the number of telephone calls to a busy switchboard in one hour follows a Poisson distribution with the events appearing frequent to the operator, but they are rare from the point of view of the average member of the population who is very unlikely to make a call to that switchboard in that hour.

The word law is sometimes used as a synonym of probability distribution, and convergence in law means convergence in distribution. Accordingly, the Poisson distribution is sometimes called the law of small numbers because it is the probability distribution of the number of occurrences of an event that happens rarely but has very many opportunities to happen. The Law of Small Numbers is a book by Ladislaus Bortkiewicz (Bortkevitch)[28] about the Poisson distribution, published in 1898. Some have suggested that the Poisson distribution should have been called the Bortkiewicz distribution.[29]

Multi-dimensional Poisson process

The poisson distribution arises as the distribution of counts of occurrences of events in (multidimensional) intervals in multidimensional Poisson processes in a directly equivalent way to the result for unidimensional processes. Thus, if D is any region the multidimensional space for which |D|, the area or volume of the region, is finite, and if N(D) is count of the number of events in D, then

P(N(D)=k)=\frac{(\lambda|D|)^k e^{-\lambda|D|}}{k!} .

Other applications in science

In a Poisson process, the number of observed occurrences fluctuates about its mean λ with a standard deviation \sigma_k =\sqrt{\lambda}. These fluctuations are denoted as Poisson noise or (particularly in electronics) as shot noise.

The correlation of the mean and standard deviation in counting independent discrete occurrences is useful scientifically. By monitoring how the fluctuations vary with the mean signal, one can estimate the contribution of a single occurrence, even if that contribution is too small to be detected directly. For example, the charge e on an electron can be estimated by correlating the magnitude of an electric current with its shot noise. If N electrons pass a point in a given time t on the average, the mean current is I=eN/t; since the current fluctuations should be of the order \sigma_I=e\sqrt{N}/t (i.e., the standard deviation of the Poisson process), the charge e can be estimated from the ratio t\sigma_I^2/I.

An everyday example is the graininess that appears as photographs are enlarged; the graininess is due to Poisson fluctuations in the number of reduced silver grains, not to the individual grains themselves. By correlating the graininess with the degree of enlargement, one can estimate the contribution of an individual grain (which is otherwise too small to be seen unaided). Many other molecular applications of Poisson noise have been developed, e.g., estimating the number density of receptor molecules in a cell membrane.

\Pr(N_t=k) = f(k;\lambda t) = \frac{e^{-\lambda t} (\lambda t)^k}{k!} .

In Causal Set theory the discrete elements of spacetime follow a Poisson distribution in the volume.

Generating Poisson-distributed random variables

A simple algorithm to generate random Poisson-distributed numbers (pseudo-random number sampling) has been given by Knuth (see References below):

algorithm poisson random number (Knuth):
init:
Let L ← e−λ, k ← 0 and p ← 1.
do:
k ← k + 1.
Generate uniform random number u in [0,1] and let p ← p × u.
while p > L.
return k − 1.


While simple, the complexity is linear in the returned value k, which is λ on average. There are many other algorithms to overcome this. Some are given in Ahrens & Dieter, see References below. Also, for large values of λ, there may be numerical stability issues because of the term e−λ. One solution for large values of λ is rejection sampling, another is to use a Gaussian approximation to the Poisson.

Inverse transform sampling is simple and efficient for small values of λ, and requires only one uniform random number u per sample. Cumulative probabilities are examined in turn until one exceeds u.

algorithm Poisson generator based upon the inversion by sequential search:[30]
init:
Let x ← 0, p ← e−λ, s ← p.
Generate uniform random number u in [0,1].
do:
x ← x + 1.
p ← p * λ / x.
s ← s + p.
while u > s.
return x.


Parameter estimation

Maximum likelihood

Given a sample of n measured values ki  = 0, 1, 2, ..., for i = 1, ..., n, we wish to estimate the value of the parameter λ of the Poisson population from which the sample was drawn. The maximum likelihood estimate is [31]

\widehat{\lambda}_\mathrm{MLE}=\frac{1}{n}\sum_{i=1}^n k_i. \!

Since each observation has expectation λ so does this sample mean. Therefore the maximum likelihood estimate is an unbiased estimator of λ. It is also an efficient estimator, i.e. its estimation variance achieves the Cramér–Rao lower bound (CRLB). Hence it is MVUE. Also it can be proved that the sum (and hence the sample mean as it is a one-to-one function of the sum) is a complete and sufficient statistic for λ.

To prove sufficiency we may use the factorization theorem. Consider partitioning the probability mass function of the joint Poisson distribution for the sample into two parts: one that depends solely on the sample \mathbf{x} (called h(\mathbf{x})) and one that depends on the parameter \lambda and the sample \mathbf{x} only through the function T(\mathbf{x}). Then T(\mathbf{x}) is a sufficient statistic for \lambda.

P(\mathbf{x})=\prod_{i=1}^n\frac{\lambda^x e^{-\lambda}}{x!}=\frac{1}{\prod_{i=1}^n x_i!} \times \lambda^{\sum_{i=1}^n x_i}e^{-n\lambda}

Note that the first term, h(\mathbf{x}), depends only on \mathbf{x}. The second term, g(T(\mathbf{x})|\lambda), depends on the sample only through T(\mathbf{x})=\sum_{i=1}^nx_i. Thus, T(\mathbf{x}) is sufficient.

To find the parameter λ that maximizes the probability function for the Poisson population, we can use the logarithm of the probability function:

\begin{align} L(\lambda) & = \ln \prod_{i=1}^n f(k_i \mid \lambda) \\ & = \sum_{i=1}^n \ln\!\left(\frac{e^{-\lambda}\lambda^{k_i}}{k_i!}\right) \\ & = -n\lambda + \left(\sum_{i=1}^n k_i\right) \ln(\lambda) - \sum_{i=1}^n \ln(k_i!). \end{align}

We take the derivative of L with respect to λ and compare it to zero:

\frac{\mathrm{d}}{\mathrm{d}\lambda} L(\lambda) = 0 \iff -n + \left(\sum_{i=1}^n k_i\right) \frac{1}{\lambda} = 0. \!

Solving for λ gives a stationary point.

\lambda = \frac{\sum_{i=1}^n k_i}{n}

So λ is the average of the ki values. Obtaining the sign of the second derivative of L at the stationary point will determine what kind of extreme value λ is.

\frac{\partial^2 L}{\partial \lambda^2} = -\lambda^{-2}\sum_{i=1}^n k_i

Evaluating the second derivative at the stationary point gives:

\frac{\partial^2 L}{\partial \lambda^2} = - \frac{n^2}{\sum_{i=1}^n k_i}

which is the negative of n times the reciprocal of the average of the ki. This expression is negative when the average is positive. If this is satisfied, then the stationary point maximizes the probability function.

For completeness, a family of distributions is said to be complete if and only if E(g(T)) = 0 implies that P_\lambda(g(T)) = 0) = 1 for all \lambda. If the individual X_i are iid \mathrm{Po}(\lambda), then T(\mathbf{x})=\sum_{i=1}^nX_i\sim \mathrm{Po}(n\lambda). Knowing the distribution we want to investigate, it is easy to see that the statistic is complete.

E(g(T))=\sum_{t=0}^\infty g(t)\frac{(n\lambda)^te^{-n\lambda}}{t!}=0

For this equality to hold, it is obvious that g(t) must be 0. This follows from the fact that none of the other terms will be 0 for all t in the sum and for all possible values of \lambda. Hence, E(g(T)) = 0 for all \lambda implies that P_\lambda(g(T)) = 0) = 1, and the statistic has been shown to be complete.

Confidence interval

The confidence interval for the mean of a Poisson distribution can be expressed using the relationship between the cumulative distribution functions of the Poisson and chi-squared distributions. The chi-squared distribution is itself closely related to the gamma distribution, and this leads to an alternative expression. Given an observation k from a Poisson distribution with mean μ, a confidence interval for μ with confidence level 1 – α is

\tfrac 12\chi^{2}(\alpha/2; 2k) \le \mu \le \tfrac 12 \chi^{2}(1-\alpha/2; 2k+2),

or equivalently,

F^{-1}(\alpha/2; k,1) \le \mu \le F^{-1}(1-\alpha/2; k+1,1),

where \chi^{2}(p;n) is the quantile function (corresponding to a lower tail area p) of the chi-squared distribution with n degrees of freedom and F^{-1}(p;n,1) is the quantile function of a Gamma distribution with shape parameter n and scale parameter 1.[20][32] This interval is 'exact' in the sense that its coverage probability is never less than the nominal 1 – α.

When quantiles of the Gamma distribution are not available, an accurate approximation to this exact interval has been proposed (based on the Wilson–Hilferty transformation):[33]

k \left( 1 - \frac{1}{9k} - \frac{z_{\alpha/2}}{3\sqrt{k}}\right)^3 \le \mu \le (k+1) \left( 1 - \frac{1}{9(k+1)} + \frac{z_{\alpha/2}}{3\sqrt{k+1}}\right)^3,

where z_{\alpha/2} denotes the standard normal deviate with upper tail area α / 2.

For application of these formulae in the same context as above (given a sample of n measured values ki each drawn from a Poisson distribution with mean λ), one would set

k=\sum_{i=1}^n k_i ,\!

calculate an interval for μ = , and then derive the interval for λ.

Bayesian inference

In Bayesian inference, the conjugate prior for the rate parameter λ of the Poisson distribution is the gamma distribution.[34] Let

\lambda \sim \mathrm{Gamma}(\alpha, \beta) \!

denote that λ is distributed according to the gamma density g parameterized in terms of a shape parameter α and an inverse scale parameter β:

g(\lambda \mid \alpha,\beta) = \frac{\beta^{\alpha}}{\Gamma(\alpha)} \; \lambda^{\alpha-1} \; e^{-\beta\,\lambda} \qquad \text{ for } \lambda>0 \,\!.

Then, given the same sample of n measured values ki as before, and a prior of Gamma(α, β), the posterior distribution is

\lambda \sim \mathrm{Gamma}\left(\alpha + \sum_{i=1}^n k_i, \beta + n\right). \!

The posterior mean E[λ] approaches the maximum likelihood estimate \widehat{\lambda}_\mathrm{MLE} in the limit as \alpha\to 0,\ \beta\to 0.

The posterior predictive distribution for a single additional observation is a negative binomial distribution,[35] sometimes called a Gamma–Poisson distribution.

Simultaneous estimation of multiple Poisson means

Suppose X_1, X_2, \dots, X_p is a set of independent random variables from a set of p Poisson distributions, each with a parameter \lambda_i, i=1,\dots,p, and we would like to estimate these parameters. Then, Clevenson and Zidek[36] show that under the normalized squared error loss L(\lambda,{\hat \lambda})=\sum_{i=1}^p \lambda_i^{-1} ({\hat \lambda}_i-\lambda_i)^2, when p>1, then, similar as in Stein's famous example for the Normal means, the MLE estimator {\hat \lambda}_i = X_i is inadmissible.

In this case, a family of minimax estimators is given for any 0 < c \leq 2(p-1) and b \geq (p-2+p^{-1}) as[37]

{\hat \lambda}_i = \left(1 - \frac{c}{b + \sum_{i=1}^p X_i}\right) X_i, \qquad i=1,\dots,p.

Bivariate Poisson distribution

This distribution has been extended to the bivariate case.[38] The generating function for this distribution is

g( u, v ) = \exp[ ( \theta_1 - \theta_{12} )( u - 1 ) + ( \theta_2 - \theta_{12} )(v - 1) + \theta_{12} ( uv - 1 ) ]

with

\theta_1, \theta_2 > \theta_{ 12 } > 0 \,

The marginal distributions are Poisson(θ1) and Poisson(θ2) and the correlation coefficient is limited to the range

0 \le \rho \le \min\left\{ \frac{ \theta_1 }{ \theta_2 }, \frac{ \theta_2 }{ \theta_1 } \right\}

A simple way to generate a bivariate Poisson distribution X_1,X_2 is to take three independent Poisson distributions Y_1,Y_2,Y_3 with means \lambda_1,\lambda_2,\lambda_3 and then set X_1 = Y_1 + Y_3,X_2 = Y_2 + Y_3. The probability function of the bivariate Poisson distribution is

\begin{align} & \Pr(X_1=k_1,X_2=k_2) \\ = {} & \exp\left(-\lambda_1-\lambda_2-\lambda_3\right) \frac{\lambda_1^{k_1}}{k_1!} \frac{\lambda_2^{k_2}}{k_2!} \sum_{k=0}^{\min(k_1,k_2)} \binom{k_1}{k} \binom{k_2}{k} k! \left( \frac{\lambda_3}{\lambda_1\lambda_2}\right)^k \end{align}

Notes

1. ^ Frank A. Haight (1967). Handbook of the Poisson Distribution. New York: John Wiley & Sons.
2. ^ "Statistics | The Poisson Distribution". Umass.edu. 2007-08-24. Retrieved 2014-04-18.
3. ^ S.D. Poisson, Probabilité des jugements en matière criminelle et en matière civile, précédées des règles générales du calcul des probabilitiés (Paris, France: Bachelier, 1837), page 206.
4. ^ a b c Johnson, N.L., Kotz, S., Kemp, A.W. (1993) Univariate Discrete distributions (2nd edition). Wiley. ISBN 0-471-54897-9, p157
5. ^ Ladislaus von Bortkiewicz, Das Gesetz der kleinen Zahlen [The law of small numbers] (Leipzig, Germany: B.G. Teubner, 1898). On page 1, Bortkiewicz presents the Poisson distribution. On pages 23–25, Bortkiewicz presents his famous analysis of "4. Beispiel: Die durch Schlag eines Pferdes im preussischen Heere Getöteten." (4. Example: Those killed in the Prussian army by a horse's kick.).
6. ^ Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers, Roy D. Yates, David Goodman, page 60.
7. ^ For the proof, see : Proof wiki: expectation and Proof wiki: variance
8. ^ Choi KP (1994) On the medians of Gamma distributions and an equation of Ramanujan. Proc Amer Math Soc 121 (1) 245–251
9. ^ Riordan, John (1937). "Moment recurrence relations for binomial, Poisson and hypergeometric frequency distributions". Annals of Mathematical Statistics 8: 103–111. Also see Haight (1967), p. 6.
10. ^ E. L. Lehmann (1986). Testing Statistical Hypotheses (second ed.). New York: Springer Verlag. page 65.
11. ^ Raikov, D. (1937). On the decomposition of Poisson laws. Comptes Rendus (Doklady) de l' Academie des Sciences de l'URSS, 14, 9–11. (The proof is also given in von Mises, Richard (1964). Mathematical Theory of Probability and Statistics. New York: Academic Press.)
12. ^ Laha, R. G. and Rohatgi, V. K. Probability Theory. New York: John Wiley & Sons. p. 233.
13. ^ Johnson, N.L., Kotz, S., Kemp, A.W. (1993) Univariate Discrete distributions (2nd edition). Wiley. ISBN 0-471-54897-9, p159
14. ^ Michael Mitzenmacher and Eli Upfal. Probability and Computing: Randomized Algorithms and Probabilistic Analysis. Cambridge University Press. p. 97.
15. ^ NIST/SEMATECH, '6.3.3.1. Counts Control Charts', e-Handbook of Statistical Methods, accessed 25 October 2006
16. ^ Huiming, Zhang; Yunxiao Liu; Bo Li (2014). "Notes on discrete compound Poisson model with applications to risk theory". Insurance: Mathematics and Economics 59: 325–336.
17. ^ page 196 gives the approximation and higher order terms.
18. ^ a b Johnson, N.L., Kotz, S., Kemp, A.W. (1993) Univariate Discrete distributions (2nd edition). Wiley. ISBN 0-471-54897-9, p163
19. ^ S. M. Ross (2007). Introduction to Probability Models (ninth ed.). Boston: Academic Press. pp. 307–308.
20. ^ a b Johnson, N.L., Kotz, S., Kemp, A.W. (1993) Univariate Discrete distributions (2nd edition). Wiley. ISBN 0-471-54897-9, p171
21. ^ Johnson, N.L., Kotz, S., Kemp, A.W. (1993) Univariate Discrete distributions (2nd edition). Wiley. ISBN 0-471-54897-9, p153
22. ^ "The Poisson Process as a Model for a Diversity of Behavioural Phenomena"
23. ^ Philip J. Boland. "A Biographical Glimpse of William Sealy Gosset". The American Statistician, Vol. 38, No. 3. (Aug., 1984), pp. 179–183. Retrieved 2011-06-22.
24. ^ Dave Hornby. "Football Prediction Model: Poisson Distribution". calculate the probability of outcomes for a football match, which in turn can be turned into odds which we can use to identify value in the market..
25. ^ Aatish Bhatia. "What does randomness look like?". Within a large area of London, the bombs weren’t being targeted. They rained down at random in a devastating, city-wide game of Russian roulette.
26. ^ P.X., Gallagher (1976). "On the distribution of primes in short intervals". Mathematika 23: 4–9.
27. ^ A. Colin Cameron, Pravin K. Trivedi (1998). Regression Analysis of Count Data. Retrieved 2013-01-30. (p.5) The law of rare events states that the total number of events will follow, approximately, the Poisson distribution if an event may occur in any of a large number of trials but the probability of occurrence in any given trial is small.
28. ^
29. ^
30. ^ Luc Devroye, Non-Uniform Random Variate Generation (Springer-Verlag, New York, 1986), chapter 10, page 505 http://luc.devroye.org/rnbookindex.html
31. ^ Paszek, Ewa. "Maximum Likelihood Estimation – Examples".
32. ^ Garwood, F. (1936). "Fiducial Limits for the Poisson Distribution". Biometrika 28 (3/4): 437–442.
33. ^
34. ^ Fink, Daniel (1997) A Compendium of Conjugate Priors
35. ^ Gelman et al., Bayesian Data Analysis, 2nd ed. (2005) p. 60.
36. ^ Clevenson ML, Zidek JV (1975) Simultaneous Estimation of the Means of Independent Poisson Laws. Journal of the American Statistical Association 70(351a)
37. ^ Berger JO (1985) Statistical Decision Theory and Bayesian Analysis, 2nd Edition. Springer
38. ^ Loukas S, Kemp CD (1986) The index of dispersion test for the bivariate Poisson distribution. Biometrics 42(4) 941–948

References

• Joachim H. Ahrens, Ulrich Dieter (1974). "Computer Methods for Sampling from Gamma, Beta, Poisson and Binomial Distributions". Computing 12 (3): 223–246.
• Joachim H. Ahrens, Ulrich Dieter (1982). "Computer Generation of Poisson Deviates". ACM Transactions on Mathematical Software 8 (2): 163–179.
• Ronald J. Evans, J. Boersma, N. M. Blachman, A. A. Jagers (1988). "The Entropy of a Poisson Distribution: Problem 87-6". SIAM Review 30 (2): 314–317.
• Donald E. Knuth (1969). Seminumerical Algorithms. The Art of Computer Programming, Volume 2.