Directional statistics (also circular statistics or spherical statistics) is the subdiscipline of statistics that deals with directions (unit vectors in Euclidean space, Rn), axes (lines through the origin in Rn) or rotations in Rn. More generally, directional statistics deals with observations on compact Riemannian manifolds including the Stiefel manifold.
The fact that 0 degrees and 360 degrees are identical angles, so that for example 180 degrees is not a sensible mean of 2 degrees and 358 degrees, provides one illustration that special statistical methods are required for the analysis of some types of data (in this case, angular data). Other examples of data that may be regarded as directional include statistics involving temporal periods (e.g. time of day, week, month, year, etc.), compass directions, dihedral angles in molecules, orientations, rotations and so on.
Circular distributions
Any probability density function (pdf) Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \ p(x)} on the line can be "wrapped" around the circumference of a circle of unit radius.[2] That is, the pdf of the wrapped variable Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \theta = x_w=x \bmod 2\pi\ \ \in (-\pi,\pi]} is Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p_w(\theta) = \sum_{k=-\infty}^{\infty}{p(\theta+2\pi k)}.}
This concept can be extended to the multivariate context by an extension of the simple sum to a number of Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle F} sums that cover all dimensions in the feature space: Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p_w(\boldsymbol\theta) = \sum_{k_1=-\infty}^{\infty} \cdots \sum_{k_F=-\infty}^\infty {p(\boldsymbol\theta + 2\pi k_1\mathbf{e}_1 + \dots + 2\pi k_F\mathbf{e}_F)}} where Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \mathbf{e}_k = (0, \dots, 0, 1, 0, \dots, 0)^{\mathsf{T}}} is the Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle k} -th Euclidean basis vector.
The following sections show some relevant circular distributions.
von Mises circular distribution
The von Mises distribution is a circular distribution which, like any other circular distribution, may be thought of as a wrapping of a certain linear probability distribution around the circle. The underlying linear probability distribution for the von Mises distribution is mathematically intractable; however, for statistical purposes, there is no need to deal with the underlying linear distribution. The usefulness of the von Mises distribution is twofold: it is the most mathematically tractable of all circular distributions, allowing simpler statistical analysis, and it is a close approximation to the wrapped normal distribution, which, analogously to the linear normal distribution, is important because it is the limiting case for the sum of a large number of small angular deviations. In fact, the von Mises distribution is often known as the "circular normal" distribution because of its ease of use and its close relationship to the wrapped normal distribution (Fisher, 1993).
The pdf of the von Mises distribution is: Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(\theta;\mu,\kappa) = \frac{e^{\kappa\cos(\theta-\mu)}}{2\pi I_0(\kappa)}} where Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle I_0} is the modified Bessel function of order 0.
Circular uniform distribution
The probability density function (pdf) of the circular uniform distribution is given by Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle U(\theta) = \frac 1 {2\pi}.}
It can also be thought of as Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \kappa = 0} of the von Mises above.
Wrapped normal distribution
The pdf of the wrapped normal distribution (WN) is: Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle WN(\theta;\mu,\sigma) = \frac{1}{\sigma \sqrt{2\pi}} \sum^{\infty}_{k=-\infty} \exp \left[\frac{-(\theta - \mu - 2\pi k)^2}{2 \sigma^2} \right] = \frac{1}{2\pi}\vartheta\left(\frac{\theta-\mu}{2\pi},\frac{i\sigma^2}{2\pi}\right) } where μ and σ are the mean and standard deviation of the unwrapped distribution, respectively and Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vartheta(\theta,\tau)} is the Jacobi theta function: Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vartheta(\theta,\tau) = \sum_{n=-\infty}^\infty (w^2)^n q^{n^2} } where Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle w \equiv e^{i\pi \theta}} and Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q \equiv e^{i\pi\tau}.}
Wrapped Cauchy distribution
The pdf of the wrapped Cauchy distribution (WC) is: Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle WC(\theta;\theta_0,\gamma) = \sum_{n=-\infty}^\infty \frac{\gamma}{\pi(\gamma^2+(\theta+2\pi n-\theta_0)^2)} = \frac{1}{2\pi}\,\,\frac{\sinh\gamma}{\cosh\gamma-\cos(\theta-\theta_0)}} where Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \gamma} is the scale factor and Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \theta_0} is the peak position.
Wrapped Lévy distribution
The pdf of the wrapped Lévy distribution (WL) is: Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f_{WL}(\theta;\mu,c) = \sum_{n=-\infty}^\infty \sqrt{\frac{c}{2\pi}}\,\frac{e^{-c/2(\theta+2\pi n-\mu)}}{(\theta+2\pi n-\mu)^{3/2}}} where the value of the summand is taken to be zero when Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \theta+2\pi n-\mu \le 0} , Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle c} is the scale factor and Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \mu} is the location parameter.
Projected normal distribution
The projected normal distribution is a circular distribution representing the direction of a random variable with multivariate normal distribution, obtained by radial projection of the variable over the unit (n-1)-sphere. Due to this, and unlike other commonly used circular distributions, it is not symmetric nor unimodal.
Distributions on higher-dimensional manifolds
There also exist distributions on the two-dimensional sphere (such as the Kent distribution[3]), the N-dimensional sphere (the von Mises–Fisher distribution[4]) or the torus (the bivariate von Mises distribution[5]).
The matrix von Mises–Fisher distribution[6] is a distribution on the Stiefel manifold, and can be used to construct probability distributions over rotation matrices.[7]
The Bingham distribution is a distribution over axes in N dimensions, or equivalently, over points on the (N − 1)-dimensional sphere with the antipodes identified.[8] For example, if N = 2, the axes are undirected lines through the origin in the plane. In this case, each axis cuts the unit circle in the plane (which is the one-dimensional sphere) at two points that are each other's antipodes. For N = 4, the Bingham distribution is a distribution over the space of unit quaternions (versors). Since a versor corresponds to a rotation matrix, the Bingham distribution for N = 4 can be used to construct probability distributions over the space of rotations, just like the Matrix-von Mises–Fisher distribution.
These distributions are for example used in geology,[9] crystallography[10] and bioinformatics.[1] [11] [12]
Moments
The raw vector (or trigonometric) moments of a circular distribution are defined as
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle m_n=\operatorname E(z^n)=\int_\Gamma P(\theta) z^n \, d\theta }
where Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \Gamma} is any interval of length Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 2\pi} , Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P(\theta)} is the PDF of the circular distribution, and Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle z=e^{i \theta}} . Since the integral Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P(\theta)} is unity, and the integration interval is finite, it follows that the moments of any circular distribution are always finite and well defined.
Sample moments are analogously defined:
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{m}_n=\frac{1}{N}\sum_{i=1}^N z_i^n. }
The population resultant vector, length, and mean angle are defined in analogy with the corresponding sample parameters.
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \rho=m_1 }
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle R=|m_1| }
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \theta_n=\operatorname{Arg}(m_n). }
In addition, the lengths of the higher moments are defined as:
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle R_n=|m_n| }
while the angular parts of the higher moments are just Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (n \theta_n) \bmod 2\pi} . The lengths of all moments will lie between 0 and 1.
Measures of location and spread
Various measures of central tendency and statistical dispersion may be defined for both the population and a sample drawn from that population.[13]
Central tendency
The most common measure of location is the circular mean. The population circular mean is simply the first moment of the distribution while the sample mean is the first moment of the sample. The sample mean will serve as an unbiased estimator of the population mean.
When data is concentrated, the median and mode may be defined by analogy to the linear case, but for more dispersed or multi-modal data, these concepts are not useful.
Dispersion
The most common measures of circular spread are:
- The circular variance. For the sample the circular variance is defined as: Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{\operatorname{Var}(z)} = 1 - \overline{R} } and for the population Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \operatorname{Var}(z) = 1 - R } Both will have values between 0 and 1.
- The circular standard deviation Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S(z) = \sqrt{\ln(1/R^2)} = \sqrt{-2\ln(R)} } Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{S}(z) = \sqrt{\ln(1/{\overline{R}}^2)} = \sqrt{-2\ln({\overline{R}})} } with values between 0 and infinity. This definition of the standard deviation (rather than the square root of the variance) is useful because for a wrapped normal distribution, it is an estimator of the standard deviation of the underlying normal distribution. It will therefore allow the circular distribution to be standardized as in the linear case, for small values of the standard deviation. This also applies to the von Mises distribution which closely approximates the wrapped normal distribution. Note that for small Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S(z)} , we have Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S(z)^2 = 2 \operatorname{Var}(z)} .
- The circular dispersion Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \delta = \frac{1-R_2}{2R^2}} Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{\delta}=\frac{1-{\overline{R}_2}}{2{\overline{R}}^2} } with values between 0 and infinity. This measure of spread is found useful in the statistical analysis of variance.
Distribution of the mean
Given a set of N measurements Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle z_n=e^{i\theta_n}} the mean value of z is defined as:
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{z}=\frac{1}{N}\sum_{n=1}^N z_n }
which may be expressed as
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{z} = \overline{C}+i\overline{S} }
where
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{C} = \frac{1}{N}\sum_{n=1}^N \cos(\theta_n) \text{ and } \overline{S} = \frac{1}{N}\sum_{n=1}^N \sin(\theta_n) }
or, alternatively as:
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{z} = \overline{R}e^{i\overline{\theta}} }
where
- Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{R} = \sqrt{{\overline{C}}^2+{\overline{S}}^2} \text{ and } \overline{\theta} = \arctan (\overline{S} / \overline{C}). }
The distribution of the mean angle (Failed to parse (SVG with PNG fallback (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{\theta}} ) for a circular pdf P(θ) will be given by:
where is over any interval of length and the integral is subject to the constraint that and are constant, or, alternatively, that and are constant.
The calculation of the distribution of the mean for most circular distributions is not analytically possible, and in order to carry out an analysis of variance, numerical or mathematical approximations are needed.[14]
The central limit theorem may be applied to the distribution of the sample means. (main article: Central limit theorem for directional statistics). It can be shown[14] that the distribution of approaches a bivariate normal distribution in the limit of large sample size.
Goodness of fit and significance testing
For cyclic data – (e.g., is it uniformly distributed) :
- Rayleigh test for a unimodal cluster
- Kuiper's test for possibly multimodal data.
See also
References
- ↑ 1.0 1.1 Hamelryck, Thomas; Kent, John T.; Krogh, Anders (2006). "Hamelryck, T., Kent, J., Krogh, A. (2006) Sampling realistic protein conformations using local structural bias. PLoS Comput. Biol., 2(9): e131". PLOS Computational Biology. 2 (9): e131. Bibcode:2006PLSCB...2..131H. doi:10.1371/journal.pcbi.0020131. PMC 1570370. PMID 17002495.
- ↑ Bahlmann, C., (2006), Directional features in online handwriting recognition, Pattern Recognition, 39
- ↑ Kent, J (1982) The Fisher–Bingham distribution on the sphere. J Royal Stat Soc, 44, 71–80.
- ↑ Fisher, RA (1953) Dispersion on a sphere. Proc. Roy. Soc. London Ser. A., 217, 295–305
- ↑ Mardia, KM. Taylor; CC; Subramaniam, GK. (2007). "Protein Bioinformatics and Mixtures of Bivariate von Mises Distributions for Angular Data". Biometrics. 63 (2): 505–512. doi:10.1111/j.1541-0420.2006.00682.x. PMID 17688502. S2CID 14293602.
- ↑ Pal, Subhadip; Sengupta, Subhajit; Mitra, Riten; Banerjee, Arunava (September 2020). "Conjugate Priors and Posterior Inference for the Matrix Langevin Distribution on the Stiefel Manifold". Bayesian Analysis. 15 (3): 871–908. doi:10.1214/19-BA1176. ISSN 1936-0975. S2CID 209974627.
- ↑ Downs (1972). "Orientational statistics". Biometrika. 59 (3): 665–676. doi:10.1093/biomet/59.3.665.
- ↑ Bingham, C. (1974). "An Antipodally Symmetric Distribution on the Sphere". Ann. Stat. 2 (6): 1201–1225. doi:10.1214/aos/1176342874.
- ↑ Peel, D.; Whiten, WJ.; McLachlan, GJ. (2001). "Fitting mixtures of Kent distributions to aid in joint set identification" (PDF). J. Am. Stat. Assoc. 96 (453): 56–63. doi:10.1198/016214501750332974. S2CID 11667311.
- ↑ Krieger Lassen, N. C.; Juul Jensen, D.; Conradsen, K. (1994). "On the statistical analysis of orientation data". Acta Crystallogr. A50 (6): 741–748. doi:10.1107/S010876739400437X.
- ↑ Kent, J.T., Hamelryck, T. (2005). Using the Fisher–Bingham distribution in stochastic models for protein structure. In S. Barber, P.D. Baxter, K.V.Mardia, & R.E. Walls (Eds.), Quantitative Biology, Shape Analysis, and Wavelets, pp. 57–60. Leeds, Leeds University Press
- ↑ Boomsma, Wouter; Mardia, Kanti V.; Taylor, Charles C.; Ferkinghoff-Borg, Jesper; Krogh, Anders; Hamelryck, Thomas (2008). "A generative, probabilistic model of local protein structure". Proceedings of the National Academy of Sciences. 105 (26): 8932–8937. Bibcode:2008PNAS..105.8932B. doi:10.1073/pnas.0801715105. PMC 2440424. PMID 18579771.
- ↑ Fisher, NI., Statistical Analysis of Circular Data, Cambridge University Press, 1993. ISBN 0-521-35018-2
- ↑ 14.0 14.1 Jammalamadaka, S. Rao; Sengupta, A. (2001). Topics in circular statistics. New Jersey: World Scientific. ISBN 978-981-02-3778-3. Retrieved 2011-05-15.
Books on directional statistics
- Batschelet, E. Circular statistics in biology, Academic Press, London, 1981. ISBN 0-12-081050-6.
- Fisher, N. I., Statistical Analysis of Circular Data, Cambridge University Press, 1993. ISBN 0-521-35018-2
- Fisher, N. I., Lewis, T., Embleton, BJJ. Statistical Analysis of Spherical Data, Cambridge University Press, 1993. ISBN 0-521-45699-1
- Jammalamadaka S. Rao and SenGupta A. Topics in Circular Statistics, World Scientific, 2001. ISBN 981-02-3778-2
- Mardia, K. V. and Jupp P., Directional Statistics (2nd edition), John Wiley and Sons Ltd., 2000. ISBN 0-471-95333-4
- Ley, C. and Verdebout, T., Modern Directional Statistics, CRC Press Taylor & Francis Group, 2017. ISBN 978-1-4987-0664-3