Understanding Deep Learning: Basics of Artificial Neural Networks

Understanding Deep Learning: Basics of Artificial Neural Networks

Reprinted from Yunqi Community as required ID: yunqiinsight Author | doflamingo Introduction I have touched on deep learning during my studies, but only superficially. In this era of data and algorithms, it is necessary to get closer to the algorithms. Therefore, from the perspective of an engineer, I hope to record the basics of deep … Read more

Optical Illusions: Blind Spots of Neural Networks

Optical Illusions: Blind Spots of Neural Networks

Click the image for details↑ Human vision is an extraordinary ability. Although it has evolved over millions of years in specific environments, it can accomplish tasks that early visual systems have never experienced. Reading is a great example, such as recognizing cars, airplanes, road signs, and other man-made objects. However, the visual system also has … Read more

A Survey of Graph Neural Networks (GNN)

A Survey of Graph Neural Networks (GNN)

Graph neural networks (GNNs) have gained widespread attention and are applied in scenarios such as recommendation systems, knowledge graphs, and traffic analysis due to their advantages in handling non-Euclidean space data and complex features. The irregularity of large-scale graph structures, the complexity of node features, and the dependency of training samples put immense pressure on … Read more

Essential Resources for Graph Neural Networks

Essential Resources for Graph Neural Networks

Resource Sharing Edited by: Rabbit Unknowingly, 2019 is about to pass Time flies, and you have accompanied us for another year This year We have compiled 33 papers and 165 news updates Prepared 46 paper interpretations Shared 38 pieces of technical content Held 6 sessions of AI Talking And organized 1 offline salon called “Graph … Read more

Deep Painterly Harmonization: Merging Art with AI

Deep Painterly Harmonization: Merging Art with AI

Li Zi from A Fei Si Quantum Bit | WeChat Official Account QbitAI ”Master, can you help me Photoshop my face onto the model in the street photo? Oh right, not just that, it has to look like the model…” Extracting an element from one photo and seamlessly blending it into another seems like a … Read more

Exploding the Machine Learning Circle: New Activation Function SELU Introduced

Exploding the Machine Learning Circle: New Activation Function SELU Introduced

Selected from arXiv Compiled by Machine Heart Contributors: Jiang Siyuan, Smith, Li Yazhou Recently, a paper titled “Self-Normalizing Neural Networks” published on arXiv has garnered significant attention in the community. It introduces the Scaled Exponential Linear Unit (SELU), which brings in a self-normalizing property. This unit mainly uses a function g to map the mean … Read more

Methods for Neural Network Compression and Acceleration

Methods for Neural Network Compression and Acceleration

Abstract: This issue discusses the technological innovations in neural network compression and acceleration at different levels, mainly involving three aspects: (1) neural network compression and its hardware-software co-design methods; (2) neural network compression software frameworks and compilation optimization techniques; (3) automation of neural network compression and support for new architectures. It aims to help readers … Read more

What Is Artificial Neural Network?

What Is Artificial Neural Network?

Welcome to the special winter vacation premium column “High-Tech Lessons for Kids” launched by Science Popularization China! Artificial intelligence, as one of the most cutting-edge technologies today, is changing our lives at an astonishing pace. From smart voice assistants to self-driving cars, from AI painting to machine learning, it opens up a future full of … Read more

Understanding Attention Mechanism and Transformer in NLP

Understanding Attention Mechanism and Transformer in NLP

This article summarizes the attention mechanism in natural language processing (NLP) in a Q&A format and provides an in-depth analysis of the Transformer. Table of Contents 1. Analysis of Attention Mechanism1. Why introduce the attention mechanism?2. What types of attention mechanisms are there? (How are they classified?)3. What is the computational process of the attention … Read more

Summary and Code Implementation of Attention Mechanism in Deep Learning (2017-2021)

Summary and Code Implementation of Attention Mechanism in Deep Learning (2017-2021)

Follow the official account "ML-CVer" Set as "Star", DLCV messages will be delivered! Author丨mayiwei1998 Source丨GiantPandaCV Editor丨极市平台 Abstract Due to the network structures in many papers being embedded into code frameworks, the code tends to be redundant. The author of this article has organized and reproduced the core code based on Attention networks from recent years. … Read more