Introduction to Natural Language Processing

Introduction to Natural Language Processing

Introduction Natural Language Processing is a subfield of computer science, information engineering, and artificial intelligence, which involves the interaction between computers and human languages, processing and analyzing large amounts of natural language data through programming. 1Natural Language Processing(NLP) = Computer Science + AI + Computational Linguistics In other words, natural language processing is the ability … Read more

Overview of 7 Models for Text Classification Using CNN

Overview of 7 Models for Text Classification Using CNN

Follow the official account “ML_NLP“ Set as “Starred“, receive heavy content promptly! Selected by | Ahmed BESBES Author | Ahmed Besbes Transferred from | Machine Heart This article introduces 7 models for text classification tasks, including traditional bag-of-words models, recurrent neural networks, convolutional neural networks commonly used in computer vision tasks, and RNN + CNN. … Read more

Step-by-Step NLP Guide: Extract Text Features Using ELMo

Step-by-Step NLP Guide: Extract Text Features Using ELMo

Author: PRATEEK JOSHI Translator: Han Guojun Proofreader: Li Hao This article is approximately 3500 words, and is recommended to be read in 15 minutes. This article will introduce the principles of ELMo and how it differs from traditional word embeddings, followed by practical demonstrations of its effectiveness. Introduction I am dedicated to researching issues related … Read more

Breaking the BERT Ceiling: 11 Techniques to Boost NLP Classification SOTA

Breaking the BERT Ceiling: 11 Techniques to Boost NLP Classification SOTA

Follow the public account “ML_NLP“ Set as “Starred“, heavy content delivered first-hand! Source | Xixiaoyao’s Cute Selling House At this point in 2020, our focus on NLP classification tasks is no longer about how to construct models or being fixated on what classification models look like. Just like the current focus in the CV field, … Read more

Deep Learning Methods for NLP Text Classification

Deep Learning Methods for NLP Text Classification

Li Dakang1 minute ago 1. The purpose of this library is to explore methods for NLP text classification using deep learning. 2. It has various benchmark models for text classification. 3. It also supports multi-label classification, where multiple labels are associated with sentences or documents. Although many of these models are quite simple and may … Read more

NLP Text Classification Deep Learning Methods Library

NLP Text Classification Deep Learning Methods Library

This article is reprinted with authorization from the WeChat public account “Robot Circle” (WeChat ID: ROBO_AI) The length of this article is 4473 words, and it is recommended to read it in 10 minutes This article introduces a library of NLP text classification deep learning methods and its 12 models. The purpose of this library … Read more

Simple Architecture of Label Embedding and Attention Mechanism in Hierarchical Text Classification

Simple Architecture of Label Embedding and Attention Mechanism in Hierarchical Text Classification

Hierarchical Attention-based Framework Introduction Hierarchical Text Classification (HTC) refers to a given hierarchical label system (typically a tree structure or directed acyclic graph structure) that predicts the label path of the text (the parent node labels contain the child node labels along the path). Generally, there is at least one label at each level, making … Read more

Gzip + KNN Outperforms BERT Classification Performance

Gzip + KNN Outperforms BERT Classification Performance

Paper Introduction “Low-Resource” Text Classification: A Parameter-Free Classification Method with Compressors https://aclanthology.org/2023.findings-acl.426/ This paper introduces a new method for text classification, providing a non-parametric alternative to Deep Neural Networks (DNNs). Although DNNs are widely used due to their high accuracy, they require a large amount of labeled data and millions of parameters, making their computational … Read more

Gzip + kNN Text Classification Beats Transformer with 14 Lines of Code

Gzip + kNN Text Classification Beats Transformer with 14 Lines of Code

A few days ago, the ACL 2023 awards were announced, attracting significant attention. Among the many papers included, one titled “Low-Resource Text Classification: A Parameter-Free Classification Method with Compressors” has started to generate much discussion. This paper was jointly completed by the University of Waterloo and AFAIK, but it is neither an award-winning paper nor … Read more

Text Classification Based on Word2Vec and CNN: Overview & Practice

Text Classification Based on Word2Vec and CNN: Overview & Practice

Click the “Expert Knowledge” above to follow and get professional AI knowledge! ▌Introduction The traditional Vector Space Model (VSM) assumes that feature items are independent of each other, which does not align with reality. To address this issue, a distributed representation of text (e.g., in the form of word embeddings) can be employed, representing text … Read more