Techno Blender
Digitally Yours.
Browsing Tag

Berlemont

A Comprehensive Guide of Neural Networks Activation Functions: How, When, Why? | by Kevin Berlemont, PhD | Sep, 2022

Picture generated from Stability Diffusion using the title as promptIn artificial neural networks (ANN), the units are designed to be a loose copy of biological neurons in the brain. The first artificial neuron was designed by McCulloch and Pitts in 1943 and consisted of a linear threshold unit. This was to mimic that artificial neurons do not just output the raw input they receive, but instead, output the result of the activation function. This behavior is inspired by biological neurons, where a neuron will fire or not…

6 Dimensionality Reduction Techniques | by Kevin Berlemont, PhD | May, 2022

How and when to use themPhoto by Rodion Kutsaiev from PexelsIn the age of big data, data scientists are using datasets that possess more and more features. This leads to a very well know effect: the curse of dimensionality. When the number of features increases, after a certain point, the performance of the model will decrease. This is due to the fact that the density of the data points is going to decrease as the dimensionality increases (without adding any samples). One of the main consequences to this, is that it…