The folded normal distribution is the distribution of the absolute value of a random variable with a normal distribution. As has been emphasized before, the normal distribution is perhaps the most important in probability and is used to model an incredible variety of random phenomena. Since one may only be interested in the magnitude of a normally distributed variable, the folded normal arises in a very natural way. The name stems from the fact that the probability measure of the normal distribution on \( (-\infty, 0] \) is folded over
to \( [0, \infty) \). Here is the formal definition:
Suppose that \( Y \) has a normal distribution with mean \( \mu \in \R \) and standard deviation \( \sigma \in (0, \infty) \). Then \( X = |Y| \) has the folded normal distribution with parameters \( \mu \) and \( \sigma \).
So in particular, the folded normal distribution is a continuous distribution on \([0, \infty)\).
Suppose that \( Z \) has the standard normal distribution. Recall that \( Z \) has probability density function \( \phi \) and distribution function \( \Phi \) given by \begin{align} \phi(z) & = \frac{1}{\sqrt{2 \pi}} e^{-z^2 / 2}, \quad z \in \R \\ \Phi(z) & = \int_{-\infty}^z \phi(x) \, dx = \int_{-\infty}^z \frac{1}{\sqrt{2 \pi}} e^{-x^2 / 2} \, dx, \quad z \in \R \end{align} The standard normal distribution is so important that \( \Phi \) is considered a special function and can be computed using most mathematical and statistical software. If \( \mu \in \R \) and \( \sigma \in (0, \infty) \), then \( Y = \mu + \sigma Z \) has the normal distribution with mean \( \mu \) and standard deviation \( \sigma \), and therefore \( X = |Y| = |\mu + \sigma Z| \) has the folded normal distribution with parameters \( \mu \) and \( \sigma \). For the remainder of this discussion we assume that \(X\) has this folded normal distribution.
\( X \) has distribution function \( F \) given by \begin{align} F(x) & = \Phi\left(\frac{x - \mu}{\sigma}\right) - \Phi\left(\frac{-x - \mu}{\sigma}\right) = \Phi\left(\frac{x - \mu}{\sigma}\right) + \Phi\left(\frac{x + \mu}{\sigma}\right) - 1 \\ & = \int_0^x \frac{1}{\sigma \sqrt{2 \pi}} \left\{\exp\left[-\frac{1}{2}\left(\frac{y + \mu}{\sigma}\right)^2\right] + \exp\left[-\frac{1}{2} \left(\frac{y - \mu}{\sigma}\right)^2\right] \right\} \, dy, \quad x \in [0, \infty) \end{align}
For \( x \in [0, \infty) \), \begin{align} F(x) & = \P(X \le x) = \P(|Y| \le x) = \P(|\mu + \sigma Z| \le x) = \P(-x \le \mu + \sigma Z \le x) \\ & = \P\left(\frac{-x - \mu}{\sigma} \le Z \le \frac{x - \mu}{\sigma}\right) = \Phi\left(\frac{x - \mu}{\sigma}\right) - \Phi\left(\frac{-x - \mu}{\sigma} \right) \end{align} which gives the first expression. The second expression follows since \( \Phi(-z) = 1 - \Phi(z) \) for \( z \in \R \). Finally, the integral formula follows from the form of \( \Phi \) given above and simple substitution.
We cannot compute the quantile function \( F^{-1} \) in closed form, but values of this function can be approximated.
Open the quantile app and select the folded normal distribution, and set the view to CDF. Vary the parameters and note the shape of the distribution function. For selected values of the parameters, compute the median and the first and third quartiles.
\( X \) has probability density function \( f \) given by \begin{align} f(x) & = \frac{1}{\sigma} \left[\phi\left(\frac{x - \mu}{\sigma}\right) + \phi\left(\frac{x + \mu}{\sigma}\right)\right] \\ & = \frac{1}{\sigma \sqrt{2 \pi}} \left\{\exp\left[-\frac{1}{2}\left(\frac{x + \mu}{\sigma}\right)^2\right] + \exp\left[-\frac{1}{2} \left(\frac{x - \mu}{\sigma}\right)^2\right] \right\}, \quad x \in [0, \infty) \end{align}
Open the special distribution simulator and select the folded normal distribution. Vary the parameters \( \mu \) and \( \sigma \) and note the shape of the probability density function. For selected values of the parameters, run the simulation 1000 times and compae the empirical density function to the true probability density function.
Note that the folded normal distribution is unimodal for some values of the parameters and decreasing for other values. Note also that \( \mu \) is not a location parameter nor is \( \sigma \) a scale parameter; both influence the shape of the probability density function.
We cannot compute the the mean of the folded normal distribution in closed form, but the mean can at least be given in terms of \( \Phi \). Once again, we assume that \(X\) has the folded normal distribution with parmaeters \(\mu \in \R\) and \(\sigma \in (0, \infty)\).
The first two moments of \( x \) are
From the definition, we can assume \(X = |\mu + \sigma Z|\) where \(Z\) has the standard normal distribution. Then \begin{align} E(X) & = \E(|\mu + \sigma Z|) = \E(\mu + \sigma Z; Z \ge -\mu / \sigma) - \E(\mu + \sigma Z; Z \le -\mu / \sigma) \\ & = \E(\mu + \sigma Z) - 2 \E(\mu + \sigma Z: Z \le - \mu / \sigma) = \mu -2 \mu \Phi(-\mu / \sigma) - 2 \sigma \E(Z; Z \le -\mu / \sigma) \end{align} So we just need to compute the last expected value. Using the change of variables \( u = z^2 / 2 \) we get \[ \E(Z; Z \le -\mu / \sigma) = \int_{-\infty}^{-\mu/\sigma} z \frac{1}{\sqrt{2 \pi}} e^{-z^2/2} \, dz = -\int_{\mu^2/2\sigma^2}^\infty \frac{1}{\sqrt{2\pi}} e^{-u} \, du = -\frac{1}{\sqrt{2 \pi}} e^{-\mu^2/2 \sigma^2} \] Substituting gives the result in (a). For (b), let \(Y\) have the normal distribution with mean \(\mu\) and standard deviation \(\sigma\) so that we can take \(X = |Y|\). Then \( \E(X^2) = \E(Y^2) = \var(Y) + [\E(Y)]^2 = \sigma^2 + \mu^2 \).
In particular, the variance of \( X \) is \[ \var(X) = \mu^2 + \sigma^2 - \left\{\mu \left[1 - 2 \Phi\left(-\frac{\mu}{\sigma}\right)\right] + \sigma \sqrt{\frac{2}{\pi}} \exp\left(-\frac{\mu^2}{2 \sigma^2}\right) \right\}^2\]
Open the special distribution simulator and select the folded normal distribution. Vary the parameters and note the size and location of the mean \(\pm\) standard deviation bar. For selected values of the parameters, run the simulation 1000 times and compare the empirical mean and standard deviation to the true mean and standard deviation.
The most important relation is the one between the folded normal distribution and the normal distribution in definition : If \( Y \) has a normal distribution then \( X = |Y| \) has a folded normal distribution. The folded normal distribution is also related to itself through a symmetry property that is perhaps not completely obvious from the initial definition:
For \( \mu \in \R \) and \( \sigma \in (0, \infty) \), the folded normal distribution with parameters \( -\mu \) and \( \sigma \) is the same as the folded normal distribution with parameters \( \mu \) and \( \sigma \).
We give two proofs. For the first, note that the PDF in is unchanged if \( \mu \) is replaced with \( -\mu \).
For the second proof, suppose that \(Y\) has the normal distribution with mean \(\mu\) and standard deviation \(\sigma\) so that \(|Y|\) has the folded normal distribution with parameters \(\mu\) and \(\sigma\). Then \(-Y\) has the normal distribution with mean \(-\mu\) and standard deviation \(\sigma\) so that \(|-Y|\) has the folded normal distribution with parameters \(-\mu\) and \(\sigma\). But \(|Y| = |-Y|\).
The folded normal distribution is also closed under scale transformations.
Suppose that \( X \) has the folded normal distribution with parameters \( \mu \in \R \) and \( \sigma \in (0, \infty) \) and that \( b \in (0, \infty) \). Then \( b X \) has the folded normal distribution with parameters \( b \mu \) and \( b \sigma \).
Once again from definition , we can assume \( X = |Y| \) where \( Y \) has the normal distribution with mean \( \mu \) and standard deviation \( \sigma \). But then \( b X = b |Y| = |b Y| \), and \( b Y \) has the normal distribution with mean \( b \mu \) and standard deviation \( b \sigma \).
When \( \mu = 0 \), results for the folded normal distribution are much simpler, and fortunately this special case is the most important one. We are more likely to be interested in the magnitude of a normally distributed variable when the mean is 0, and moreover, this distribution arises in the study of Brownian motion.
Suppose that \( Z \) has the standard normal distribution and that \( \sigma \in (0, \infty) \). Then \( X = \sigma |Z| \) has the half-normal distribution with scale parameter \( \sigma \). If \( \sigma = 1 \) so that \( X = |Z| \), then \( X \) has the standard half-normal distribution.
For our next discussion, suppose that \( X \) has the half-normal distribution with parameter \( \sigma \in (0, \infty) \). Once again, \( \Phi \) and \( \Phi^{-1} \) denote the distribution function and quantile function, respectively, of the standard normal distribution.
The distribution function \( F \) and quantile function \( F^{-1} \) of \( X \) are \begin{align} F(x) & = 2 \Phi\left(\frac{x}{\sigma}\right) - 1 = \int_0^x \frac{1}{\sigma} \sqrt{\frac{2}{\pi}} \exp\left(-\frac{y^2}{2 \sigma^2}\right) \, dy, \quad x \in [0, \infty) \\ F^{-1}(p) & = \sigma \Phi^{-1}\left(\frac{1 + p}{2}\right), \quad p \in [0, 1) \end{align}
Open the quantile app and select the folded normal distribution. Select CDF view and keep \( \mu = 0 \). Vary \( \sigma \) and note the shape of the CDF. For various values of \( \sigma \), compute the median and the first and third quartiles.
The probability density function \( f \) of \( X \) is given by \[ f(x) = \frac{2}{\sigma} \phi\left(\frac{x}{\sigma}\right) = \frac{1}{\sigma} \sqrt{\frac{2}{\pi}} \exp\left(-\frac{x^2}{2 \sigma^2}\right), \quad x \in [0, \infty) \]
Open the special distribution simulator and select the folded normal distribution. Keep \( \mu = 0 \) and vary \( \sigma \), and note the shape of the probability density function. For selected values of \( \sigma \), run the simulation 1000 times and compare the empricial density function to the true probability density function.
In the standard Brownian motion process, the maximum position on an interval \( [0, t] \), where \(t \in (0, \infty)\), has the half-normal distribution with parameter \(\sqrt t\).
Open the Brownian motion app and select the maximum position variable. Vary \(t\) and note the shape of the probability density function. Run the simulation 1000 times and observe the Brownian motion sample paths. Compare the empricial density function to the true probability density function.
The moments of the half-normal distribution can be computed explicitly. Once again we assume that \( X \) has the half-normal distribution with parameter \( \sigma \in (0, \infty) \).
For \( n \in \N \) \begin{align} \E(X^{2n}) & = \sigma^{2n} \frac{(2n)!}{n! 2^n}\\ \E(X^{2n+1}) & = \sigma^{2n+1} 2^n \sqrt{\frac{2}{\pi}} n! \end{align}
As in the definition in , we can take \( X = \sigma |Z| \) where \( Z \) has the standard normal distribution. The even order moments of \( X \) are the same as the even order moments of \( \sigma Z \). These were computed in the section on the normal distribution. For the odd order moments we again use the simple substitution \( z = x^2 / 2 \) to get \[ \E(X^{2n+1}) = \sigma^{2n+1} \int_0^\infty x^{2n+1} \sqrt{\frac{2}{\pi}} e^{-x^2/2} \, dx = \sigma^{2n+1} 2^n \sqrt{\frac{2}{\pi}} \int_0^\infty z^n e^{-z} \, dz = \sigma^{2n+1} 2^n \sqrt{\frac{2}{\pi}} n!\]
In particular, we have \( \E(X) = \sigma \sqrt{2/\pi} \) and \( \var(X) = \sigma^2(1 - 2 / \pi) \)
Open the special distribution simulator and select the folded normal distribution. Keep \( \mu = 0 \) and vary \( \sigma \), and note the size and location of the mean \(\pm\) standard deviation bar. For selected values of \( \sigma \), run the simulation 1000 times and compare the mean and standard deviation to the true mean and standard deviation.
Next are the skewness and kurtosis of the half-normal distribution.
Skewness and kurtosis
Skewness and kurtosis are functions of the standard score and so do not depend on the scale parameter \(\sigma\). The results then follow by letting \(\sigma = 1\) and using the standard computational formulas for skewness and kurtosis in terms of the moments of the half-normal distribution in .
Once again, the most important relation is the one in definition : If \( Y \) has a normal distribution with mean 0 then \( X = |Y| \) has a half-normal distribution. Since the half normal distribution is a scale family, it is trivially closed under scale transformations.
Suppose that \( X \) has the half-normal distribution with parameter \( \sigma \) and that \( b \in (0, \infty) \). Then \( b X \) has the half-normal distribution with parameter \( b \sigma \).
The standard half-normal distribution is also a special case of the chi distribution.
The standard half-normal distribution is the chi distribution with 1 degree of freedom.
If \( Z \) is a standard normal variable, then \( Z^2 \) has the chi-square distribution with 1 degree of freedom, and hence \( \left|Z\right| = \sqrt{Z^2} \) has the chi distribution with 1 degree of freedom.