How TorchDynamo Works: New Compilation Features in PyTorch

How TorchDynamo Works: New Compilation Features in PyTorch

Source: DeepHub IMBA This article is about 4900 words long and is recommended for a reading time of over 10 minutes. Whether running on high-performance GPUs or edge devices, TorchDynamo adapts to provide optimal performance. Optimizing model performance is crucial in deep learning, especially for applications that require fast execution and real-time inference. However, PyTorch … Read more

Understanding and Implementing Diffusion Models in PyTorch

Understanding and Implementing Diffusion Models in PyTorch

In the previous article, we introduced OpenAI Sora, which has once again shocked the AI community with its text-to-video model, and mentioned that Sora is essentially a diffusion model + Transformer. This article continues to discuss the development, principles, and coding practices of diffusion models. The catalyst for diffusion models began with the introduction of … Read more

Beginner’s Guide to Pytorch for Deep Learning

Beginner's Guide to Pytorch for Deep Learning

Click the above “Beginner’s Visual Learning”, select to add a star mark or “pin” Important content delivered promptly Datawhale Insights Author: Li Zuxian, Datawhale University Group Member, Shenzhen University With the development of deep learning, deep learning frameworks have begun to emerge in large numbers. Especially in the past two years, giants like Google, Facebook, … Read more

10 Basic Tensor Operations in PyTorch

10 Basic Tensor Operations in PyTorch

Source: DeepHub IMBA This article is about 2000 words long and is recommended to be read in 5 minutes. This article will introduce some basic tensor operations in PyTorch. PyTorch is a scientific computing package based on Python. Its flexibility allows for easy integration of new data types and algorithms, and the framework is also … Read more

An Overview of Nineteen Loss Functions in Pytorch

An Overview of Nineteen Loss Functions in Pytorch

Click the "Little White Learns Vision" above, choose to add "Star" or "Top" Heavy content delivered to you immediately For academic sharing only, does not represent the position of this public account, please contact for deletion if there is any infringement Reprinted from:Author:mingo_敏 Original link: https://blog.csdn.net/shanglianlm/article/details/85019768 Introduction This article summarizes nineteen loss functions, introducing their … Read more

Summary of Memory Saving Strategies in PyTorch

Summary of Memory Saving Strategies in PyTorch

Click the "Xiaobai Learns Vision" above, select "Star" or "Top" Heavyweight content delivered at the first time Source丨https://zhuanlan.zhihu.com/p/430123077 Introduction With the rapid development of deep learning, the explosive growth of model parameters has put higher demands on the memory capacity of GPUs. How to train models on GPUs with small memory capacity has always been … Read more

Try These 4 Advanced Optimization Techniques in Deep Learning If Your PyTorch Optimizer Isn’t Performing Well

Try These 4 Advanced Optimization Techniques in Deep Learning If Your PyTorch Optimizer Isn't Performing Well

Source: DeepHub IMBA This article is approximately 3700 words long, recommended reading time is over 10 minutes. This article will introduce four advanced optimization techniques that may outperform traditional methods in certain tasks, especially when faced with complex optimization problems. In the field of deep learning, the choice of optimizer is crucial for model performance. … Read more

Common Methods for Building Neural Networks with PyTorch

Common Methods for Building Neural Networks with PyTorch

Click the above “Mechanical and Electronic Engineering Technology” to follow us The following uses various methods to construct the network structure shown in the figure below: 1.1 Inheriting nn.Module Base Class to Build Model import torch from torch import nn import torch.nn.functional as F class Model_Seq(nn.Module): """ Build model by inheriting the base class nn.Module … Read more

Mastering Neural Network Construction With PyTorch in Ten Minutes

Mastering Neural Network Construction With PyTorch in Ten Minutes

Editor’s Note In this article, we will implement a simple neural network from scratch using PyTorch. Before reading this article, we assume you already understand how neural networks work. Reprinted from丨GuYueJu Recently, I noticed some beginner friends around me holding various PyTorch guides, typing code while reading, and in the end, they became mere typists. … Read more