Comparative Evaluation of BERT and ERNIE in NLP

Comparative Evaluation of BERT and ERNIE in NLP

Yunzhong from Aofeisi Quantum Bit Report | WeChat Official Account QbitAI How do BERT and ERNIE, the two most关注的 models in the NLP field, perform? Recently, someone conducted a comparison test, and the results were surprising and delightful in a Chinese language environment. What are the specific details? Let’s take a look at this technical … Read more

Innovations in the Era of BERT: Applications of BERT in NLP

Innovations in the Era of BERT: Applications of BERT in NLP

Article Author: Zhang Junlin, Senior Algorithm Expert at Weibo AI Lab Content Source: Deep Learning Frontier Notes @ Zhihu Column Community Production: DataFun Note: You are welcome to leave messages in the background to submit to DataFun. BERT has brought great surprises to people, but it has been about half a year since then, and … Read more

Understanding BERT Transformer: More Than Just Attention Mechanism

Understanding BERT Transformer: More Than Just Attention Mechanism

Big Data Digest and Baidu NLP Jointly Produced Author: Damien Sileo Translators: Zhang Chi, Yi Hang, Long Xin Chen BERT is a natural language processing model recently proposed by Google, which performs exceptionally well in many tasks such as question answering, natural language inference, and paraphrasing, and it is open-source. Therefore, it is very popular … Read more

Taiwan Researcher Challenges BERT’s NLP Superiority

Taiwan Researcher Challenges BERT's NLP Superiority

Original Article from New Intelligence Editors: Zhang Jia, Jin Lei [New Intelligence Overview] The Google NLP model BERT, which once broke 11 records, has recently faced skepticism from netizens: the model’s success in some benchmark tests is merely due to exploiting false statistical cues in the dataset, and without them, it might perform worse than … Read more

BERT Model: A Quick Start Guide

BERT Model: A Quick Start Guide

Selected from GitHub Author: Jay Alammar Contributors: Wang Zijia, Geek AI If you are a natural language processing practitioner, you must have heard of the recently popular BERT model.This article is a detailed tutorial on using a simplified version of the BERT model—DisTillBERT to complete the sentiment classification task of sentences, making it an invaluable … Read more

Exploring Xiaomi’s Practical Applications of BERT in NLP

Exploring Xiaomi's Practical Applications of BERT in NLP

Machine Heart Column Author: Xiaomi AI Lab NLP Team When a technology is applied in practice, it often encounters various challenges. Taking BERT as an example, when adapting to business needs, engineers need to make various adjustments according to specific scenarios. This article introduces the practical exploration of the Xiaomi AI Lab NLP team in … Read more

ASR Error Correction Based on BERT

ASR Error Correction Based on BERT

Guest Speaker: Wei Tianwen, Xiaomi AI Department Edited by: Li Shuna Source: DataFunTalk Introduction: Xiao Ai is an intelligent voice system developed by Xiaomi, widely used in smartphones, bands, speakers, TVs, and other electronic products, supporting various voice interaction scenarios such as casual conversation, Q&A, and voice control. The accuracy of Automatic Speech Recognition (ASR) … Read more

The Art of Fine-Tuning BERT

The Art of Fine-Tuning BERT

Authorized Reprint from Andy’s Writing Room Author:ANDY The BERT pre-trained model is like a pig ready for cooking, and fine-tuning is the cooking method. The pig’s head can be made into fragrant and rich roasted pig head meat, the trotters can be made into hearty braised trotters, and the various cuts like pork belly and … Read more

Understanding Deep Learning: From Neurons to BERT

Understanding Deep Learning: From Neurons to BERT

Ali Sister’s Guide: BERT, a landmark in the field of natural language processing, did not appear out of nowhere; it has its development principles behind it. Today, the Ant Financial Wealth Dialogue Algorithm Team has organized and compared the development history of deep learning models in the field of natural language processing. From simple neurons … Read more

From Word2Vec to BERT: The Evolution of NLP Pre-trained Models

From Word2Vec to BERT: The Evolution of NLP Pre-trained Models

Natural Language Processing Author: Zhang Junlin Source: Deep Learning Frontier Notes Zhihu Column Original Link: https://zhuanlan.zhihu.com/p/49271699 The theme of this article is the pre-training process in natural language processing (NLP). It will roughly explain how pre-training techniques in NLP have gradually developed into the BERT model, naturally illustrating how the ideas behind BERT were formed, … Read more