MORE ILLUSTATIONS OF THE S FUNCTIONS Out out=1(1-e」 Out tanh Net/2) (a) Sigmoid function (b) tanh function Out Net Out =+1 Net >0 Out= 1. Net>>0 1, Net<0 undefined. Net =o undefined. Neto. (e) Signum function (a) Step function Common non-linear functions used for synaptic inhibition. Soft non- linearity: (a) Sigmoid and (b) tanh: Hard non-linearity. (c) Si gnum and (a) Step