Author｜Jack Chih-Hsu Lin Source｜AI Park Compiled by｜ronghuaiyang Introduction 18 PyTorch tips you should know. Debugging deep learning pipelines is like finding the right combination of gears Why Should You Read This Article? The training/inference process of deep learning models involves many steps. With limited time and resources, the faster each iteration is, the quicker the … Read more
Introduction Want to know how those large-scale neural networks are trained? OpenAI summarizes in an article: Besides needing many GPUs, algorithms are also crucial! Many advancements in AI today are attributed to large neural networks, especially the pre-trained models provided by large companies and research institutions, which have significantly propelled the progress of downstream tasks. … Read more
Source: Read Chip Technology This article is approximately 4800 words, and it is recommended to read it in 10 minutes. This article introduces 9 tips for training neural networks using Pytorch. Image Source: unsplash.com/@dulgier In fact, your model may still be at the level of the Stone Age. You might still be training with 32-bit … Read more
Click the above “Beginner’s Guide to Vision” to select “Star” or “Top” Heavyweight content delivered first-hand This article is sourced from | Visual Algorithms Don’t let your neural network end up like this Let’s face it, your model might still be stuck in the Stone Age. I bet you’re still using 32-bit precision or GASP … Read more
Author: Jack Chih-Hsu Lin<br/>Translator: Chen Zhi Yan<br/>Proofreader: Wang Zi Yue<br/><br/><br/><br/>About 4600 words, recommended reading time 9 minutes.<br/>18 essential PyTorch speed-up tips: how they work and methods. Adjusting the deep learning pipeline is like finding the right gear combination (Image source: Tim Mossholder) Why Read This Blog? The training/inference process of deep learning models involves multiple … Read more
Introduction This article discusses how to apply torch for mixed precision computation, data parallelism, and distributed computing. Author丨Not Important What Name @ Zhihu Link丨https://zhuanlan.zhihu.com/p/360697168 Due to recent programs requiring high speed, I wanted to get results quickly, so I specifically learned about mixed precision computation and parallel operations. Since there are already many articles explaining … Read more
Click on the above “Beginner’s Guide to Vision” to select and add “Star” or “Pin“ Heavy content delivered first Author | OpenMMLab Editor | Jishi Platform Original link: https://zhuanlan.zhihu.com/p/430123077 Introduction With the rapid development of deep learning, the explosion of model parameters has raised increasingly high requirements for GPU memory capacity. How to train models … Read more
Click the "Xiaobai Learns Vision" above, select "Star" or "Top" Heavyweight content delivered at the first time Source丨https://zhuanlan.zhihu.com/p/430123077 Introduction With the rapid development of deep learning, the explosive growth of model parameters has put higher demands on the memory capacity of GPUs. How to train models on GPUs with small memory capacity has always been … Read more
MLNLP community is a well-known machine learning and natural language processing community both domestically and internationally, covering NLP master’s and doctoral students, university teachers, and corporate researchers. The vision of the community is to promote communication and progress between the academic and industrial sectors of natural language processing and machine learning, especially for beginners. Reprinted … Read more
Author: Nicolas Affiliation: Researcher at Zhuiyi Technology AI Lab Research Direction: Information Extraction, Machine Reading Comprehension Do you want to experience double the training speed? Do you want to instantly double your GPU memory? If I tell you that it only takes three lines of code, would you believe it? In this article, the author … Read more