Common Activation Functions used in neural networks - Sigmoid / Logistic function , Softmax function, ReLU (Rectified Linear Units), identity, hyperbolic tangent.