Exploratory

Photo by Luke Chesser on Unsplash· Abstract· Casual Introduction to Data Science & Analytics∘ Skills of a Data Scientist∘ Key lessons from the Industry· What are the different analytics levels?· What is Sweetviz?· Analyzing Data with Sweetviz∘ Step 1: Install Sweetviz and Read Raw Data∘ Step 2: Create the Report∘ Step 3: Display the Report∘ Generating EDA summary by Category· Conclusion· ReferenceWith just one line of code, the open-source Python module Sweetviz can create stunning visualizations for exploratory data…

Here’s my exploratory data analysis on honey in the USA, using a few lines of codePhoto by Aaron Burden on UnsplashDisclaimer: This article may sound offensive to the vegan people who follow me and read the stories. While I am sorry in advance for that, please be aware that this exercise doesn’t want to promote the usage, consumption, or selling of honey.In the following article, we are going to do an exploratory data analysis on the production and consumption of honey in the US.In particular:We will start by giving a…

Telling actionable stories with dataPhoto by Kyle Glenn on UnsplashIntroductionIn this article, I will share four common mistakes in data exploration and how you can avoid them.Exploratory data analysis (EDA) is the discovery of trends and patterns in data using graphical representations and summary statistics. Popular graphs for EDA include scatter plots, bar charts, histograms, donut charts, and heat maps. In addition, summary statistics which are measures for describing a dataset include count, mean, median, standard…

Arabica 1.0 improves time series text data analysis with an extended set of featuresPhoto by Sincerely Media on UnsplashIn the real world, text data is frequently collected as time series. Some examples include companies collecting product reviews where the quality of their products might change. Politicians’ public statements can vary over the political cycle. Central bankers’ announcements are one of the ways how central banks affect the financial markets nowadays. For these reasons, text data often has a time dimension…

Google is trying to blow up how you think about search. To say it’s pivoting to compete in a world where TikTok and Instagram are changing the way the internet works would be an overstatement… but not a big one. Google now exists on a more visual, more interactive internet, in which users want to be surprised and delighted as often as they just want an answer to their questions. In that world, what is a search engine even for? The Google you see tomorrow might not be completely different, but the change is already…

A practical add-on for PandasPhoto by Vidar Nordli-Mathisen on UnsplashSidetable is an open-source pandas utility library created by Chris Moffitt. It creates summary tables for pandas DataFrames, which is quite useful in exploratory data analysis.What sidetable does can also be achieved with pandas but it simplifies the process. You can get a decent overview of the data with just one line of code.As of writing this article, sidetable has 5 functions and it is being improved. Thus, we might expect more to come soon. We…

Arabica provides unigrams, bigrams, and trigrams frequencies by a period in a single line of code. Learn more in this tutorial.Photo by Artem Sapegin on UnsplashText data is often recorded as a time series with significant variability over time. Some examples of time-series text data include Twitter tweets, product reviews, and newspaper headlines. Exploratory analysis of such datasets is a non-trivial coding task. Arabica makes it simple in a single line of python code.Arabica takes a data frame of text data as the…

Andrew Tarantola / Engadget: Meta unveils Make-A-Scene, an exploratory AI research project that turns a user's sketches and text descriptions into 2,048 x 2,048-pixel images — Text-to-image generation is the hot algorithmic process right now, with OpenAI's Craiyon (formerly DALL-E mini) and Google's Imagen AIs unleashing tidal waves … Andrew Tarantola / Engadget: Meta unveils Make-A-Scene, an exploratory AI research project that turns a user's sketches and text descriptions into 2,048 x…

What is exploratory analysis, how it is structured and how to apply it in Python with the help of Pandas and other data analysis and visualization librariesPhoto by Holly Mandarich on UnsplashExploratory data analysis (EDA) is an especially important activity in the routine of a data analyst or scientist.It enables an in depth understanding of the dataset, define or discard hypotheses and create predictive models on a solid basis.It uses data manipulation techniques and several statistical tools to describe and understand…

Geographical data, Exploratory Data AnalysisA tutorial on how to use QGis to perform EDA of geographical data which is provided as CSV.Photo by Annie Spratt on UnsplashA data scientist may have to deal with geographic data. In this case, in addition to the classic methods of data exploration, you can also use specific tools for managing geographic data.In this article, I describe how to use QGis to perform a preliminary exploration of a geographic dataset. As an example, I use the dataset relating to the mobility of taxi…