From BERT to ALBERT: A Comprehensive Overview

From BERT to ALBERT: A Comprehensive Overview

Follow the WeChat public account “ML_NLP“ Set as “Starred“, heavy content delivered first time! ALBERT Recommendation: Although the BERT model itself is very effective, this effectiveness relies on a large number of model parameters, so the time and resource costs required to train a BERT model are very high, and such a complex model can … Read more

Training CT-BERT Model on COVID-19 Data from Twitter

Training CT-BERT Model on COVID-19 Data from Twitter

Author: Chen Zhiyan This article is about 3000 words, recommended reading time is 7 minutes. This article introduces the use of the BERT model to automatically classify, filter, and summarize a large amount of COVID-19 information on Twitter. Twitter has always been an important source of news, and during the COVID-19 pandemic, the public can … Read more

Step-By-Step Guide to Text Classification Using Bert

Step-By-Step Guide to Text Classification Using Bert

Author: GjZero Tags: Bert, Chinese Classification, Sentence Vector This article is about 1500 words, recommended reading time is 8 minutes. This article starts from practice, guiding everyone through the tutorial on Chinese text classification using Bert and its use as a sentence vector. Bert Introduction The Bert model is a language representation model released by … Read more

How to Quickly Use BERT?

How to Quickly Use BERT?

Follow the public account “ML_NLP“ Set as “Starred“, important content delivered first! Source | Zhihu Address | https://zhuanlan.zhihu.com/p/112235454 Author | TotoroWang Editor | Machine Learning Algorithms and Natural Language Processing Public Account This article has been authorized by the author and is prohibited from secondary reproduction Introduction Since I have been working on BERT models … Read more

Understanding Bert’s MASK Mechanism and Its Variants

Understanding Bert's MASK Mechanism and Its Variants

Follow the public account “ML_NLP“ Set as “Starred” to receive heavy content promptly! Bert is a pre-trained model that has dominated the leaderboard of natural language processing tasks since its introduction; numerous improved pre-trained models based on it have also emerged. This article does not explain what Bert is, but attempts to compare and analyze … Read more

Deconstructing BERT: Extracting 6 Patterns from Millions of Parameters

Big Data Digest and Baidu NLP jointly produced Compiled by: Andy Proofread by: Baidu NLP, Long Xincheng Original Author: Jesse Vig Some intuitive patterns emerge in BERT’s intricate attention networks. 2018 was a turning point in the field of natural language processing, with a series of deep learning models achieving the best results on various … Read more

Common Pitfalls When Practicing BERT

Common Pitfalls When Practicing BERT

Follow the public account “ML_NLP“ Set it as “Starred“, delivering heavy content to you first! Source | Zhihu Address | https://zhuanlan.zhihu.com/p/69389583 Author | Lao Song’s Tea Book Club Editor | Machine Learning Algorithms and Natural Language Processing Public Account This article is for academic sharing only. If there is an infringement, please contact the backend … Read more

Detailed Insights into BERT/Transformer

Detailed Insights into BERT/Transformer

Follow the WeChat account “ML_NLP“ Set as “Starred“, heavy content delivered first-hand! Source | Zhihu Link | https://zhuanlan.zhihu.com/p/132554155 Author | Haichen Wei Editor | Machine Learning Algorithms and Natural Language Processing WeChat Account This article is for academic sharing only, if there is any infringement, please contact the backend for deletion. With the continuous development … Read more

Text Matching Methods Series – BERT Matching Model

Text Matching Methods Series – BERT Matching Model

Follow the official account “ML_NLP“ Set as “Starred“, essential content delivered promptly! From | Zhihu Address | https://zhuanlan.zhihu.com/p/85506365 Author | debuluoyi Editor | Machine Learning Algorithms and Natural Language Processing Official Account This article is for academic sharing only. If there is infringement, please contact us to delete it. 1. Overview Before introducing deep interaction … Read more

Summary of BERT-Related Models

Summary of BERT-Related Models

Follow the official account “ML_NLP“ Set as “Starred“, heavy content delivered instantly! Reprinted from|PaperWeekly ©PaperWeekly Original · Author|Xiong Zhiwei School|Tsinghua University Research Direction|Natural Language Processing BERT has gained significant success and attention since its introduction in 2018. Based on this, various related models have been proposed in academia to improve BERT. This article attempts to … Read more