# Deep Learning

## Activation Functions: Step Function

Activation Functions: Step function – So in the last article, we saw different types of algorithms like backpropagation algorithm the Delta rule chain rule Etc… Read More »Activation Functions: Step Function

## Sigmoid Activation Function

Sigmoid Activation Function – We saw what was the activation functions. We had a gentle introduction regarding. What was the step function and why we… Read More »Sigmoid Activation Function

## Rectified Linear Unit

Rectified Linear Unit – The topic for today’s article is rectified linear unit. That is ReLU activation function. So in the last articless, we saw… Read More »Rectified Linear Unit

## The Chain Rule

The Chain Rule – The topic for today’s article is the chain rule. So you all might have come across this particular equation or this… Read More »The Chain Rule

## Vanishing & Exploding Gradients

Vanishing & Exploding Gradients – The topic for today’s article is vanishing and exploding gradients. So this has something to do with their normal grading… Read More »Vanishing & Exploding Gradients

## Hyperbolic Tangent Activation Function

Hyperbolic Tangent Activation Function – We saw what was he sigmoid function? So in that, we had a problem of Vanishing gradient, and we could… Read More »Hyperbolic Tangent Activation Function

## Softmax Activation Function: Deep Learning

Softmax Activation Function – Today I want to see the role of softmax function in deep neural networks. So for that let’s take one example… Read More »Softmax Activation Function: Deep Learning

## 10 Activation Functions: Basics of Neural Network

10 Activation Functions: Basics of Neural Network – So what are activation functions? In a neural network activation function helps neuron to get activated or… Read More »10 Activation Functions: Basics of Neural Network

## How to Design a Neural Network

How to Design a Neural Network – We will talk about how to design a neural network in 2020, covering some of the useful techniques… Read More »How to Design a Neural Network