Great article, but I wish it would have made a more explicit mention of the* central limit theorem (CLT), which I think is what makes the normal distribution "normal." For those not familiar, here is the jist: suppose you have `n` independent, finite-variance random variables with support in the real numbers (so things like count R.V.s work). Asymptotically, as n->infinity, the distribution of the mean will approach a normal distribution. Usually, n doesn't have to be big for this to be a reasonable approximation. n~30 is often fine. The CLT extends in a
To me, this is one of the most astonishing things about probability theory, as well as one of the most useful.
The normal distribution is just one of a class of "stable distributions," all sharing the properties of sums of their R.V.s being in the same family.
The same idea can be generalized much further. The underlying idea is the distribution of "things" as they get asymptotically "bigger." The density of eigenvalues of random matrices with I.I.D entries approach the Wigner Semicircle Distribution, which is exactly what it sounds like. It plays the role of the normal distribution in the very practically-promising theory of free (noncommutative) probability.
> The best way to do that, I think, is to do away entirely with the symbolic and mathematical foundations, and to derive what Gaussians are, and all their fundamental properties from purely geometric and visual principles. That’s what we’ll do in this article.
Perhaps I have a different understanding of "symbolic". The article proceeds to use various symbolic expressions and equations. Why say this above if you're not going to follow through? Visuals are there but peppered in.
> You can see that the data is clustered around the mean value. Another way of saying this is that the distribution has a definite scale. [..] it might theoretically be possible to be 2 meters taller than the mean, but that’s it. People will never be 3 or 4 meters taller than the mean, no matter how many people you see.
The way the author defines definite scale is that there is a max and a minimum, but that is not true for a gaussian distribution. It is also not true that if we keep sampling wealth (an example of a distribution without definite scale used in the article), there is no limit to the maximum.
Gaussian, Gaussian, Gaussian. Important to understand Gaussians, but also to recognize how profoundly non-Gaussian, in particular multimodal, the world is. And to build systems that navigate and optimize over such distributions.
(Not complaining about this article, which is illuminating).
mjhay ·8 hours ago
To me, this is one of the most astonishing things about probability theory, as well as one of the most useful.
The normal distribution is just one of a class of "stable distributions," all sharing the properties of sums of their R.V.s being in the same family.
The same idea can be generalized much further. The underlying idea is the distribution of "things" as they get asymptotically "bigger." The density of eigenvalues of random matrices with I.I.D entries approach the Wigner Semicircle Distribution, which is exactly what it sounds like. It plays the role of the normal distribution in the very practically-promising theory of free (noncommutative) probability.
https://en.wikipedia.org/wiki/Wigner_semicircle_distribution
Further reading:
https://terrytao.wordpress.com/2010/01/05/254a-notes-2-the-c...
*there's a few normal distribution CLTs, but this is the intuitive one that usually matters in practice
Show replies
tylerneylon ·5 hours ago
Or if not, does anyone know how to reach the author? I may have missed it, but I didn't even see the author's name anywhere on the site.
Show replies
lamename ·10 hours ago
Perhaps I have a different understanding of "symbolic". The article proceeds to use various symbolic expressions and equations. Why say this above if you're not going to follow through? Visuals are there but peppered in.
Show replies
wodenokoto ·12 hours ago
The way the author defines definite scale is that there is a max and a minimum, but that is not true for a gaussian distribution. It is also not true that if we keep sampling wealth (an example of a distribution without definite scale used in the article), there is no limit to the maximum.
Show replies
hughw ·9 hours ago
(Not complaining about this article, which is illuminating).
Show replies