Exploding the Machine Learning Circle: New Activation Function SELU Introduced
Selected from arXiv Compiled by Machine Heart Contributors: Jiang Siyuan, Smith, Li Yazhou Recently, a paper titled “Self-Normalizing Neural Networks” published on arXiv has garnered significant attention in the community. It introduces the Scaled Exponential Linear Unit (SELU), which brings in a self-normalizing property. This unit mainly uses a function g to map the mean … Read more