How Neural Networks Recognize Your Dog

How Neural Networks Recognize Your Dog

Author | Bu Er Bei Dou Source | Principle Scientists use a “neural network” similar to the human brain to analyze a complex distortion in spacetime known as “gravitational lensing“. In a paper recently published in Nature, researchers from the SLAC National Accelerator Laboratory and Stanford University stated that the artificial intelligence neural network they … Read more

The Rise and Fall of Neural Networks in the 1990s

The Rise and Fall of Neural Networks in the 1990s

Excerpt from andreykurenkov Author: Andrey Kurenkov Translated by Machine Heart Contributors: salmoner, Electronic Sheep, Sister Niu Niu, Ben, Slightly Chubby This is part three of the History of Neural Networks and Deep Learning (see Part One, Part Two). In this section, we will continue to explore the rapid development of research in the 1990s and … Read more

Dynamic Localization of Spatio-Temporal Graph Neural Networks

Dynamic Localization of Spatio-Temporal Graph Neural Networks

Spatio-temporal data is the foundation of many intelligent applications, revealing the causal relationships between measurements at a specific location and historical data from the same or other locations. In this context, Adaptive Spatio-Temporal Graph Neural Networks (ASTGNNs) have emerged as a powerful tool for modeling these dependencies, particularly through data-driven approaches rather than predefined spatial … Read more

Exploring NVIDIA Blackwell GPU Features Beyond Neural Rendering

Exploring NVIDIA Blackwell GPU Features Beyond Neural Rendering

During CES 2025, NVIDIA unveiled the GPU based on the Blackwell architecture and showcased the performance and features of NVIDIA RTX AI technology at its Editor’s Day event. Subsequently, NVIDIA held a further communication sharing session in Shenzhen, detailing the Blackwell architecture GPU and its functionalities. So, what other aspects are worth our in-depth exploration? … Read more

What Are Artificial Neural Networks?

What Are Artificial Neural Networks?

*This article is from the 22nd issue of “Banyue Tan” in 2024 The 2024 Nobel Prize in Physics has unexpectedly honored the achievement of “fundamental discoveries and inventions to promote the use of artificial neural networks for machine learning.” What exactly are artificial neural networks? Can their potential really be compared to fundamental physical sciences? … Read more

Understanding the Nine Layers of Attention Mechanism

Understanding the Nine Layers of Attention Mechanism

This article is written by: Electric Light Phantom Alchemist Graduate topic Top 1, Shanghai Jiao Tong University Computer Science first place, first prize in high school physics competition, meme master, national award in computer science from Shanghai Jiao Tong University, currently a PhD student at CUHK https://zhuanlan.zhihu.com/p/362366192 Attention has become a hot topic in the … Read more

Next-Generation Attention Mechanism: Lightning Attention-2

Next-Generation Attention Mechanism: Lightning Attention-2

Click above toComputer Vision Alliance get more insights For academic sharing only, does not represent the position of this public account. Contact for deletion in case of infringement. Reprinted from: Machine Heart Recommended notes from 985 AI PhD Zhou Zhihua’s “Machine Learning” handwritten notes are officially open-source! Includes PDF download link, 2500 stars on GitHub! … Read more

Attention Mechanism Bug: Softmax as the Culprit Affecting All Transformers

Attention Mechanism Bug: Softmax as the Culprit Affecting All Transformers

“The stone from other hills can serve to polish jade.” Only by standing on the shoulders of giants can we see further and go farther. On the path of scientific research, we need to leverage favorable conditions to move forward faster. Therefore, we have specially collected and organized some practical code links, datasets, software, programming … Read more

Nine Layers of Understanding Attention Mechanism

Nine Layers of Understanding Attention Mechanism

↑ ClickBlue Text Follow the Extreme City Platform Author丨Electric Light Phantom Alchemy@Zhihu (Authorized) Source丨https://zhuanlan.zhihu.com/p/362366192 Editor丨Extreme City Platform Extreme City Guide Attention has become popular in the entire AI field, whether in machine vision or natural language processing, it is inseparable from Attention, transformer, or BERT. The author of this article follows the EM nine-layer tower … Read more

Next-Generation Attention Mechanism: Lightning Attention-2

Next-Generation Attention Mechanism: Lightning Attention-2

Click the card below to follow Computer Vision Daily. AI/CV heavy content delivered promptly. Click to enter—>【CV Technology】 WeChat group Scan to join the CVer Academic Circle, to gain access to the latest top conference/journal paper ideas and materials from beginner to advanced in CV, as well as cutting-edge projects and applications! Highly recommended for … Read more