GPU

Optimize PyTorch Performance for Speed and Memory Efficiency

by
Optimize PyTorch Performance for Speed and Memory Efficiency

Author: Jack Chih-Hsu Lin<br/>Translator: Chen Zhi Yan<br/>Proofreader: Wang Zi Yue<br/><br/><br/><br/>About 4600 words, recommended reading time 9 minutes.<br/>18 essential PyTorch speed-up tips: how they work and methods. Adjusting the deep learning pipeline is like finding the right gear combination (Image source: Tim Mossholder) Why Read This Blog? The training/inference process of deep learning models involves multiple … Read more

Beginner’s Guide to Pytorch for Deep Learning

by
Beginner's Guide to Pytorch for Deep Learning

Click the above “Beginner’s Visual Learning”, select to add a star mark or “pin” Important content delivered promptly Datawhale Insights Author: Li Zuxian, Datawhale University Group Member, Shenzhen University With the development of deep learning, deep learning frameworks have begun to emerge in large numbers. Especially in the past two years, giants like Google, Facebook, … Read more

Understanding PyTorch Memory Management Mechanism

by
Understanding PyTorch Memory Management Mechanism

Author丨Mia Luo @ Zhihu (Authorized Reprint) Source丨https://zhuanlan.zhihu.com/p/486360176Editor丨Xiaoshutong, Jizhi Shutong 1. Background Introduction The analysis of the PyTorch memory management mechanism mainly aims to reduce the impact of “memory fragmentation”. A simple example is: As shown in the figure above, suppose we want to allocate 800MB of memory. Although the total free memory is 1000MB, the … Read more

Exclusive: PyTorch Model Performance Analysis and Optimization

by
Exclusive: PyTorch Model Performance Analysis and Optimization

Translated by: Lin Likun Proofread by: zrx This article is about 6700 words long and is recommended for a 10-minute read. This article discusses the performance analysis and optimization of PyTorch models. Photo by Torsten Dederichs, uploaded to Unsplash Training deep learning models, especially large ones, can be an expensive endeavor. Performance optimization is one … Read more

13 Tips for Using PyTorch Effectively

by
13 Tips for Using PyTorch Effectively

Click on the above “Beginner Learning Vision”, select to add “Star” or “Top” Essential resources delivered promptly This is for academic sharing only and does not represent the views of this public account. Please contact us for removal if there is any infringement. Reposted from Zhihu author丨z.defying@Zhihu Source丨https://zhuanlan.zhihu.com/p/76459295 This article整理了13则PyTorch使用的小窍门，包括了指定GPU编号、梯度裁剪、扩展单张图片维度等实用技巧，能够帮助工作者更高效地完成任务。 Table of Contents 1. Specify … Read more

17 Methods to Speed Up PyTorch Training!

by
17 Methods to Speed Up PyTorch Training!

Click the "Little White Learning Vision" above, select to add "Star" or "Top" Important content delivered first Master these 17 methods to accelerate your PyTorch deep learning training in the most effortless way. Recently, a post on Reddit has gone viral. The topic is about how to speed up PyTorch training. The original author is … Read more

7 Tips to Enhance PyTorch Performance

by
7 Tips to Enhance PyTorch Performance

Kaggle Competition Tips Author:William Falcon, Source: AI Park Introduction Some small details can indeed improve speed. Over the past 10 months, during my work with PyTorch Lightning, the team and I have encountered many styles of structuring PyTorch code, and we have identified some key places where people inadvertently introduce bottlenecks. We are very careful … Read more

Lightning Attention-2: Unlimited Sequence Length, Constant Computational Cost, Higher Modeling Accuracy

by
Lightning Attention-2: Unlimited Sequence Length, Constant Computational Cost, Higher Modeling Accuracy

Lightning Attention-2 is a new type of linear attention mechanism that aligns the training and inference costs of long sequences with those of a 1K sequence length. The limitations on sequence length in large language models greatly restrict their applications in the field of artificial intelligence, such as multi-turn dialogue, long text understanding, and the … Read more