Understanding PyTorch Distributed Training

Understanding PyTorch Distributed Training

Follow us on WeChat “ML_NLP“ Add us to your “Favorites“, get heavy content delivered to you first! Source丨SenseTime Academic Editor丨Jishi Platform 0 Introduction With the widespread adoption of large-scale machine learning, the emergence of ultra-large deep learning models, and the rapid development of distributed learning methods such as federated learning, distributed machine learning model training … Read more

Practical Image Retrieval with Pytorch

Practical Image Retrieval with Pytorch

Click on the above “Beginner’s Visual Learning” to choose to add star or pin. Heavyweight content delivered first time With the emergence of e-commerce and online websites, the application of image retrieval in our daily lives has been increasing. Companies like Amazon, Alibaba, and Myntra have been heavily utilizing image retrieval technology. Of course, image … Read more

Understanding PyTorch Internals: Insights from Core Developer Edward Z. Yang

Understanding PyTorch Internals: Insights from Core Developer Edward Z. Yang

Follow the WeChat public account “ML_NLP“ Set as “Starred“, heavy content delivered instantly! Compiled by: Machine Heart, Author: Edward Z. Yang Edward Z. Yang, a PhD student at Stanford University and a research engineer at Facebook AI Research, is one of the core developers of the PyTorch open-source project. He gave a talk on the … Read more

Collection of Common PyTorch Code Snippets

Collection of Common PyTorch Code Snippets

Click the above “Beginner’s Guide to Vision“, select to add “Star” or “Pin“ Heavyweight content delivered first-hand Zhang Hao: Master’s student at the School of Computer Science, Nanjing University, focusing on computer vision and machine learning, particularly visual recognition and deep learning. Personal homepage: http://lamda.nju.edu.cn/zhangh/ Original Zhihu link: https://zhuanlan.zhihu.com/p/59205847? This code is based on PyTorch … Read more

PyTorch Data Import Mechanism and Standardized Code Template

PyTorch Data Import Mechanism and Standardized Code Template

Click the above “Beginner Learning Vision“, select to add “Star” or “Pin“ Important content delivered promptly As a popular deep learning framework, PyTorch seems to be surpassing TensorFlow in popularity. According to previous statistics, while TensorFlow still dominates the industry, PyTorch has gained a strong presence in top conferences in the fields of vision and … Read more

Ultimate Guide to Installing PyTorch 2.2 with GPU

Ultimate Guide to Installing PyTorch 2.2 with GPU

1. Deep Learning Workstation 1.1 Configuration First, here is the computer configuration diagram: Upgraded the configuration using the company’s office computer. Except for the graphics card and power supply, other hardware is original from the company computer. 1.2 Graphics Card If you have the budget, go directly for RTX4090, but cannot reuse the company computer … Read more

Visualizing PyTorch Deep Learning Training with tensorboardX

Visualizing PyTorch Deep Learning Training with tensorboardX

Click the above “Beginner’s Guide to Vision” to choose “Bookmark” or “Pin” Important resources delivered promptly Previously, I mentioned PyTorch’s dedicated visualization tool visdom, refer to the PyTorch deep learning training visualization tool visdom. However, many TensorFlow users were accustomed to using TensorBoard for training visualization. To enable PyTorch users to also use TensorBoard, developers … Read more

13 Pytorch Image Augmentation Methods Summary (With Code)

13 Pytorch Image Augmentation Methods Summary (With Code)

Click the "Xiaobai Learns Vision" above, choose to add "Star" or "Top" Heavyweight content delivered at the first time Author丨Jiefa Shouzhangsheng@Zhihu Link丨https://zhuanlan.zhihu.com/p/559887437 Using data augmentation techniques can increase the diversity of images in the dataset, thereby improving the performance and generalization ability of the model. The main image augmentation techniques include: Resize Grayscale Transformation Normalization … Read more

PyTorch Code Snippets Compilation for High Frequency Use

PyTorch Code Snippets Compilation for High Frequency Use

Source: About Data Analysis and Visualization This article is approximately 8000 words long and is recommended for a reading time of over 10 minutes. This article is a collection of commonly used code snippets for PyTorch, covering five aspects: basic configuration, tensor processing, model definition and operation, data processing, and model training and testing, along … Read more

Understanding the XGBoost Algorithm

Understanding the XGBoost Algorithm

XGBoost (eXtreme Gradient Boosting) has become quite popular in various competitions in recent years due to its excellent predictive performance. Below, we will introduce its principles. Principle First, we need to understand that XGBoost is an improvement of the GBDT algorithm. During the k-th iteration, the loss function of GBDT can be denoted as L(y,F[k](x)). … Read more