Dynamic Neural Networks: Key Challenges and Solutions
Originally from Zhiyuan Community [Column: Key Issues]In recent years, we have witnessed increasingly powerful neural network models, such as AlexNet, VGG, GoogleNet, ResNet, DenseNet, and the recently popular Transformer. The processes used by these neural networks can be summarized as follows: 1) Fixed network architecture, initializing network parameters; 2) Training phase: optimizing network parameters on … Read more