statistics

Credit: Pixabay/CC0 Public Domain An economist at Harvard University has found that on hot days, people working for the U.S. Postal Service are more likely to harass a colleague or discriminate against them. In her paper published in Proceedings of the National Academy of Sciences, Ayushi Narayana describes her analysis of Equal Employment Opportunity Commission (EEOC) reports made by people working for USPS and compared them…

Examples of colored graphs designating symmetries of four-dimensional data: Vertices and edges of the same color and shape in a graph are mapped to each other by a symmetry permutation preserving the structure of data. Credit: Hideyuki Ishi, Osaka Metropolitan University An international research team led by scientists from Osaka Metropolitan University has developed a method to identify symmetries in multi-dimensional data…

Learn the math and methods behind the libraries you use daily as a data scientistImage by AuthorTo more formally address the need for a statistics lecture series on Medium, I have started to create a series of statistics boot camps, as seen in the title above. These will build on one another and as such will be numbered accordingly. The motivation for doing so is to democratize the knowledge of statistics in a ground up fashion to address the need for more formal statistics training in the data science community. These…

Photo by Алекс Арцибашев on UnsplashA compilation of learnings about statistics for Data Science, selected from courses that I took.In this post, I want to share the most important learnings about Statistics for Data Science that I selected and summarized from a few courses that I took along my journey in learning data science so far.As I constantly write in my posts, I am not a statistician and I don’t have a background in any STEM related area. That said, when I am learning stats, sometimes the concepts are a bit harder…

How experiments update knowledge leading to accurate probability estimatesDice-players and a bird-seller gathered around a stone slab — Master of the Gamblers — oil on canvas (public domain image taken from Wikipedia)By studying a cheat’s winnings, it is possible to find out with what probability he will get points, without knowing his resources, by applying Bayes’ Theorem. In this story we see how performing some “experiments” makes it possible to correctly estimate the probability of an event happening, even if we do…

Learn the math and methods behind the libraries you use daily as a data scientistImage by AuthorTo more formally address the need for a statistics lecture series on Medium, I have started to create a series of Statistics Bootcamps, as seen in the title above. These will build on one another and as such will be numbered accordingly. The motivation for doing so is to democratize the knowledge of statistics in a ground up fashion to address the need for more formal statistics training in the data science community. These…

Statistically re-engineer your data to make it skewedPhoto by Chris Liverani on UnsplashThe normal distribution and its characteristics have been discussed extensively. We must also have a good understanding of its descriptive statistics. Have you, however, ever attempted to left- or right-skew a completely normally distributed dataset in order to test for its normality or observe the effects on its numerous descriptive statistics. If not, please continue since this is what we are going to do in this article.Let me…

Statistics BootcampLearn the math and methods behind the libraries you use daily as a data scientistImage by AuthorTo more formally address the need for a statistics lecture series on Medium, I have started to create a series of Statistics Bootcamps, as seen in the title above. These will build on one another and as such will be numbered accordingly. The motivation for doing so is to democratize the knowledge of statistics in a ground up fashion to address the need for more formal statistics training in the data science…

The practical first step in a data science projectImagine that you’re a data scientist who has been hired to estimate the average height of pine trees in the forest pictured below.How tall are the trees in this forest? Photo by Marita Kavelashvili on Unsplash(Note: the links in this article take you to my lighthearted explanations of any jargon terms that crop up.)If we were to perfectly measure every single tree, we would get something far better than an estimate; we would get a fact. The actual truth about the heights…

Learn the math and methods behind the libraries you use daily as a data scientistImage by AuthorTo more formally address the need for a statistics lecture series on Medium, I have started to create a series of Statistics Bootcamps, as seen in the title above. These will build on one another and as such will be numbered accordingly. The motivation for doing so is to democratize the knowledge of statistics in a ground up fashion to address the need for more formal statistics training in the data science community. These…