Copied from Wikipedia.
In probability theory and statistics, the chi-square distribution (also chi-squared or distribution) is one of the most widely used theoretical probability distributions in inferential statistics, i.e. in statistical significance tests. It is useful because, under reasonable assumptions, easily calculated quantities can be proven to have distributions that approximate to the chi-square distribution if the null hypothesis is true.
is distributed according to the chi-square distribution. This is usually written
The chi-square distribution has one parameter: - a positive integer that specifies the number of degrees of freedom (i.e. the number of )
The chi-square distribution is a special case of the gamma distribution.
The best-known situations in which the chi-square distribution are used are the common chi-square tests for goodness of fit of an observed distribution to a theoretical one, and of the independence of two criteria of classification of qualitative data. However, many other statistical tests lead to a use of this distribution. One example is Friedman's analysis of variance by ranks.
Probability density function
A probability density function of the chi-square distribution is
Cumulative distribution function
Its cumulative distribution function is:
The characteristic function of the Chi-square distribution is
The chi-square distribution has numerous applications in inferential statistics, for instance in chi-square tests and in estimating variances. It enters the problem of estimating the mean of a normally distributed population and the problem of estimating the slope of a regression line via its role in Student's t-distribution. It enters all analysis of variance problems via its role in the F-distribution, which is the distribution of the ratio of two independent chi-squared random variables divided by their respective degrees of freedom.
If , then as tends to infinity, the distribution of tends to normality. However, the tendency is slow (the skewness is and the kurtosis excess is ) and two transformations are commonly considered, each of which approaches normality faster than itself:
Fisher empirically showed that is approximately normally distributed with mean and unit variance. It is possible to arrive at the same normal approximation result by using moment matching. To see this, consider the mean and the variance of a Chi-distributed random variable , which are given by and , where is the Gamma function. The particular ratio of the Gamma functions in has the following series expansion :
When , this ratio can be approximated as follows:
Then, simple moment matching results in the following approximation of : , from which it follows that .
Wilson and Hilferty showed in 1931 that is approximately normally distributed with mean and variance .
Note that 2 degrees of freedom lead to an exponential distribution.
The information entropy is given by
where is the Digamma function.
- is an exponential distribution if (with 2 degrees of freedom).
- is a chi-square distribution if for independent that are normally distributed.
- If the have nonzero means, then is drawn from a noncentral chi-square distribution.
- The chi-square distribution is a special case of the gamma distribution, in that .
- is an F-distribution if where and are independent with their respective degrees of freedom.
- is a chi-square distribution if where are independent and .
- if is chi-square distributed, then is chi distributed.
- in particular, if (chi-square with 2 degrees of freedom), then is Rayleigh distributed.
- if are i.i.d. random variables, then where .
- if , then
|noncentral chi-square distribution|
|noncentral chi distribution|
- Cochran's theorem
- Inverse-chi-square distribution
- Degrees of freedom (statistics)
- Fisher's method for combining independent tests of significance
- Noncentral chi-square distribution
- Course notes on Chi-Square Goodness of Fit Testing from Yale University Stats 101 class. Example includes hypothesis testing and parameter estimation.
- On-line calculator for the significance of chi-square, in Richard Lowry's statistical website at Vassar College.
- Distribution Calculator Calculates probabilities and critical values for normal, t-, chi2- and F-distribution
- Chi-Square Calculator for critical values of Chi-Square in R. Webster West's applet website at University of South Carolina
- Chi-Square Calculator from GraphPad
- Table of Chi-squared distribution