This is a layer of neurons that applies the non-saturating activation
Description
function f(x)=max(0,x). It increases the nonlinear properties of the decision function and of the overall network without affecting the receptive fields of the convolution layer.