generalization

New Research: MoE + General Experts Solve Conflicts in Multimodal Models

by
New Research: MoE + General Experts Solve Conflicts in Multimodal Models

Hong Kong University of Science and Technology & Southern University of Science and Technology & Huawei Noah’s Ark Lab | WeChat Official Account QbitAI Fine-tuning can make general large models more adaptable to specific industry applications. However, researchers have now found that: Performing “multi-task instruction fine-tuning” on multimodal large models may lead to “learning more … Read more

Why Bigger Neural Networks Are Better: A NeurIPS Study

by
Why Bigger Neural Networks Are Better: A NeurIPS Study

Reported by New Intelligence Editor: LRS [New Intelligence Overview] It has almost become a consensus that bigger neural networks are better, but this idea contradicts traditional function fitting theory. Recently, researchers from Microsoft published a paper at NeurIPS proving the necessity of large-scale neural networks mathematically, suggesting they should be even larger than expected. As … Read more