Unexpected Results of Technological Evolution: How Games and Cryptocurrency Became AI’s “Computing Power Base”?

Unexpected Results of Technological Evolution: How Games and Cryptocurrency Became AI's "Computing Power Base"?

In the recently passed spring, we witnessed the largest tech carnival of the new century. Describing the development of artificial intelligence (AI) in the past few months as “springing up like bamboo shoots after a rain” would be too conservative; “big bang” might be a more appropriate description — even Lu Qi, the former president … Read more

17 Ways to Speed Up PyTorch Training

17 Ways to Speed Up PyTorch Training

Reproduced from: Machine Heart Master these 17 methods to accelerate your PyTorch deep learning training in the most effortless way. Recently, a post on Reddit gained massive popularity. The topic is about how to speed up PyTorch training. The original author is LORENZ KUHN, a master’s student in computer science at ETH Zurich. The article … Read more

How to Achieve High-Performance PyTorch: 10 Pitfalls to Avoid

How to Achieve High-Performance PyTorch: 10 Pitfalls to Avoid

Click on the above “Beginner’s Guide to Vision”, choose to add “Star” or “Top” Essential insights delivered promptly IntroductionWhat does a high-performance PyTorch training pipeline look like? Is it about achieving the highest accuracy model? The fastest runtime? Easy to understand and extend? Or easily parallelized? The answer is, it includes all of the above. … Read more

Optimizing PyTorch Speed And Memory Efficiency (2022)

Optimizing PyTorch Speed And Memory Efficiency (2022)

Author|Jack Chih-Hsu Lin Source|AI Park Compiled by|ronghuaiyang Introduction 18 PyTorch tips you should know. Debugging deep learning pipelines is like finding the right combination of gears Why Should You Read This Article? The training/inference process of deep learning models involves many steps. With limited time and resources, the faster each iteration is, the quicker the … Read more

How Graphics Cards Empower Artificial Intelligence

How Graphics Cards Empower Artificial Intelligence

Click the blue text“Jiu Bian” to follow me. Today I want to discuss a very niche topic—graphics cards and artificial intelligence. As you may have noticed, the 2023 World Artificial Intelligence Conference (WAIC) is being held in Shanghai these days. During this conference, Elon Musk opened the event, and AMD’s Lisa Su, along with numerous … Read more

OpenAI Secrets Revealed: A Guide to Training Large Neural Networks

OpenAI Secrets Revealed: A Guide to Training Large Neural Networks

Introduction Want to know how those large-scale neural networks are trained? OpenAI summarizes in an article: Besides needing many GPUs, algorithms are also crucial! Many advancements in AI today are attributed to large neural networks, especially the pre-trained models provided by large companies and research institutions, which have significantly propelled the progress of downstream tasks. … Read more

Speed Up Large Model Training by 40% with One GPU and Few Lines of Code!

Speed Up Large Model Training by 40% with One GPU and Few Lines of Code!

Mingmin from Aofeisi Quantum Bit | Public Account QbitAI It must be said that to enable more people to use large models, the tech community is indeed coming up with various tricks! Not open enough models? Some people are taking matters into their own hands to create free open-source versions. For example, the recently popular … Read more

Step-by-Step Guide to Fine-Tuning QWEN2.5

Step-by-Step Guide to Fine-Tuning QWEN2.5

Introduction This practical guide uses the 0.5B model of QWEN2.5 for fine-tuning on the Ruozhi Bar dataset. As we all know, there are many absurd questions in the Ruozhi Bar.Although these nonsensical questions may seem like forced ambiguity of Chinese semantics from a human perspective, they actually provide high-quality training data for the model to … Read more

Compiling and Installing GPU-Supported TensorFlow 1.8.0 from Source on Ubuntu 18.04

Compiling and Installing GPU-Supported TensorFlow 1.8.0 from Source on Ubuntu 18.04

When I first used Linux, the first thing I wanted to do was install the GPU version of TensorFlow. I found a great guide, but even considering that, I spent over 40 hours on the installation. In this article, I want to save you time and share my experience. Below you will find an updated … Read more

Installing and Downloading TensorFlow on Windows, Linux, and Mac OS

Installing and Downloading TensorFlow on Windows, Linux, and Mac OS

Installing TensorFlow on Windows Installing Python First, you need to install Python on your Windows system. It is recommended to use the official Python distribution, which is Anaconda, as it comes with many scientific computing libraries, such as numpy and scipy, which are also used in TensorFlow. You can download and install Anaconda from the … Read more