Exponential Linear Unit (ELU)

Exponential Linear Unit (ELU) is an activation function which is an improved to ReLU. We have explored ELU in depth along with pseudocode.

Table of contents:

IntroductionMathematical Definition of ELULearning Using the Derivative of ELUPseudocode of ELU

Prerequisite: Types of activation functions

Introduction

Convolutional neural networks work by establishing layers of nodes, which are basically centers of data processing that communicate or work together towards learning. So, nodes get inp...