AI Agent

Speed Up Training by Up to 100 Times! Open Source Differentiable Logic Gate Networks Based on PyTorch

by
Speed Up Training by Up to 100 Times! Open Source Differentiable Logic Gate Networks Based on PyTorch

Click the “Little White Learns Vision” above, and choose to add “Bookmark” or “Pin“ Important content delivered first Editor’s Recommendation This article explores logic gate networks aimed at machine learning tasks through learning combinations of logic gates. These networks consist of logic gates such as AND and XOR. To achieve effective training, this article proposes … Read more

Visualization Tools in PyTorch for Deep Learning

by
Visualization Tools in PyTorch for Deep Learning

Reprinted from | Xinzhiyuan Author | JinHui Source | https://zhuanlan.zhihu.com/p/220403674 1 『Visualization of Network Structure』 When training a neural network, in addition to observing the trend of the loss function with each step or epoch to establish a basic understanding of the network optimization, we can also use some additional visualization libraries to visualize our … Read more

New PyTorch API: Implementing Various Attention Variants with FlashAttention Performance

by
New PyTorch API: Implementing Various Attention Variants with FlashAttention Performance

MLNLP community is a well-known machine learning and natural language processing community both domestically and internationally, covering NLP graduate students, university professors, and corporate researchers. The vision of the community is to promote communication and progress between the academic and industrial circles of natural language processing and machine learning both domestically and internationally, especially for … Read more

Training Larger Models on GPU with Gradient Checkpointing in PyTorch

by
Training Larger Models on GPU with Gradient Checkpointing in PyTorch

Source: Deephub Imba This article is approximately 3200 words long and is recommended to be read in 7 minutes. This article will introduce gradient checkpointing, a technique that allows you to train larger models on the GPU at the cost of increased training time. We will implement it in PyTorch and train a classifier model. … Read more

Comprehensive Guide to Image Augmentation Using Pytorch

by
Comprehensive Guide to Image Augmentation Using Pytorch

Click on the above“Beginner’s Vision Learning” to selectStar or “Top” Important content delivered at the first time Recently, in a research project, I started to understand the importance of image augmentation techniques. The goal of the project is to train a robust generative model capable of reconstructing the original image. The problem being addressed is … Read more

4-Minute PyTorch Tutorial: Hands-On Linear Regression

by
4-Minute PyTorch Tutorial: Hands-On Linear Regression

Follow our WeChat public account “ML_NLP“ Set as “Starred“, important content delivered first-hand! Produced by Big Data Digest Compiled by: Hong Yingfei, Ning Jing PyTorch is one of the deep learning framework libraries, an open-source deep learning platform from Facebook, providing seamless connection from research prototype to production deployment. This article aims to introduce the … Read more

Best Practices and Code Templates for PyTorch

by
Best Practices and Code Templates for PyTorch

Click on the above “Beginner’s Guide to Vision”, select to add “Star” or “Top” Heavyweight content, delivered first time Author:Igor Susmelj Translation: ronghuaiyang Introduction Since PyTorch 1.0, more and more people have chosen to use PyTorch. Today, we introduce a GitHub project where the author summarizes a very useful set of best practices for using … Read more

Optimize PyTorch Performance for Speed and Memory Efficiency

by
Optimize PyTorch Performance for Speed and Memory Efficiency

Author: Jack Chih-Hsu Lin<br/>Translator: Chen Zhi Yan<br/>Proofreader: Wang Zi Yue<br/><br/><br/><br/>About 4600 words, recommended reading time 9 minutes.<br/>18 essential PyTorch speed-up tips: how they work and methods. Adjusting the deep learning pipeline is like finding the right gear combination (Image source: Tim Mossholder) Why Read This Blog? The training/inference process of deep learning models involves multiple … Read more

How to Install PyTorch

by
How to Install PyTorch

1. Download and install Visual Studio Code choose the appropriate version to install 2. Download and install conda and configure the environment Download method one: official website download Download method two: Tsinghua mirror installation 3. conda environment configuration Open advanced system settings on your computer and click on system environment variables: Find path and then … Read more

An Introduction to PyTorch Geometric for Graph Neural Networks

by

Hello everyone, I’m Cat Brother! Today let’s talk about PyTorch Geometric, abbreviated as PyG. This is a library based on PyTorch specifically designed for handling Graph Neural Networks (GNN). If you’re interested in graph data such as social networks, recommendation systems, molecular structures, etc., then PyG is an excellent choice! PyG provides many efficient operations … Read more