Why Bigger Neural Networks Are Better: A NeurIPS Study

Why Bigger Neural Networks Are Better: A NeurIPS Study

Reported by New Intelligence Editor: LRS [New Intelligence Overview] It has almost become a consensus that bigger neural networks are better, but this idea contradicts traditional function fitting theory. Recently, researchers from Microsoft published a paper at NeurIPS proving the necessity of large-scale neural networks mathematically, suggesting they should be even larger than expected. As … Read more