medium

Discussing five subtle limitations of PandasPhoto by Georg Bommeli on UnsplashThanks to the Pandas library, handling, analyzing, and processing tabular data in Python has never been as effortless and straightforward as it is today.Contemporarily, the Pandas API provides an extensive collection of functionalities to manage tabular data, intending to serve almost every data science project, such as:Input and Output operationsData FilteringTable JoinsData visualizationDuplicate data handling, and many more, which you can…

Back to basics — coding neural network using NumPy aloneRecently I was explaining the concept of the neural network to my mother; I couldn’t go beyond the usual trope of inputs, hidden layers, outputs etc. I don’t think I did a very good job at that and it led me to think — Do I understand them myself or am I merely pretending that I understand them?I took a piece of paper, made a few diagrams of connected networks, and on a jupyter notebook coded the entire network using Keras layers. It took me less than 10 lines to…

PROGRAMMING & SOFTWARE ENGINEERINGGetting started with Medium APIMedium API Cover Image — By the AuthorHey guys!This is the “Getting Started” Guide for the Medium API (Unofficial Version), listed on the RapidAPI Platform.This REST API helps you to quickly extract data from medium.com, without any hassle.Video by the AuthorUsing Medium API, you can get —User’s — Info, Articles, Top Articles, Followers, Following, InterestsArticle’s — Info, Responses, Content, MarkdownPublication’s — Info, Articles, NewsletterTop Feeds,…

How much energy will you be able to generate with your solar panels? Make your own calculations to stay in controlPhoto by Mariana Proença on UnsplashThe last couple of months I have been in the process of selecting a supplier to install solar panels on my house. What I noticed was that all suppliers use their own calculations and the fact that my house has no default orientation makes it difficult for them. I am in the unlucky situation that the majority of the solar panels need to be placed on a vertical wall instead of…

Few tech CEOs can claim to have steered the course of online conversation more than Ev Williams. In 1999 he co-founded Blogger, which helped to take blogging mainstream with a well designed, free tool that sold to Google four years later. In 2006 Williams and his co-founder followed with Twitter, which remains one of the most influential social networks in the world. Five years later, after a stint as Twitter CEO and much turmoil, Williams announced his next act: Medium, a publishing platform that sought to split the…

Twitter co-founder Evan Williams is stepping as CEO of Medium. Williams announced the decision on Tuesday. Writing on (where else?), he said he’s handing the company over to Tony Stubblebine, the CEO of Coach.me. Stubblebine may not be a household name, but the two have a long history together. Before Williams went on to create Twitter with and a few others, he and Stubblebine worked at Odeo, the podcasting startup Williams founded in 2005 with Noah Glass. “Tony is a builder, a writer, an open-minded thinker, and a keen…

Photo by Kyler Nixon on UnsplashThis blog looks at some Airflow features valuable for managing resources in a workflow. We will explore some interrelated concepts that affect resource utilisation of the underlying infrastructure for any data pipelines. In particular, we will explore the following concepts :Airflow Pools for capping resource allocation to a group of tasks based on a predefined metric.Parallelism & Concurrency for efficiently scaling the pipelines to utilise the available infrastructure fully.Priority…

How to build a key component of sustainable and clean energy using machine learning at the edgePhoto by Robert Linder on UnsplashThe goal of non-intrusive load monitoring (NILM) is to recover the energy consumption of individual appliances from the aggregate mains signal, which is a measure of the total electricity consumption of a building or house. NILM is also known as energy disaggregation and both terms will be used interchangeably in this article.R. Gopinath, et al., nicely summarizes the rational behind NILM in the…

Step-by-step examples and different use cases of Pandas GroupByPhoto by Anthony Intraversato on UnsplashIn the data science community, Pandas has become a very popular framework for processing and manipulating data. It’s based upon Python, a very simple and versatile language we are all familiar with. It offers many useful functions to help us transform data into the format we want. One of them is groupby, a function that can partition DataFrame rows into groups based on the values of certain columns.When I was first…

Common Ways to Reduce ML Prediction Latency to Sub X msCommon ways to reduce ML prediction latency. Image by authorMachine Learning (ML) systems don’t exist until they are deployed.Unfortunately, prediction latency is one of those edges that hurt badly.And, it hurts too late in the product cycle.Stop optimizing that model! Focus on ML serving latency first.FOCUS ON THE ML SERVING LATENCY FIRST.THAT’S WHAT THE CLIENT SEES FIRST.So what are some common ways to reduce ML Latency?Here is one way to organize the known patterns…