ULMFiT

NLP Development Trends from Classic Models Like ULMFiT, Transformer, and BERT

by
NLP Development Trends from Classic Models Like ULMFiT, Transformer, and BERT

Natural Language Processing (NLP) is a subfield of computer science, information engineering, and artificial intelligence, focusing on human-computer language interaction and exploring how to process and utilize natural language. The research on NLP can be traced back to the Turing test, evolving from rule-based research methods to the currently popular statistical models and methods, transitioning … Read more

The Arrival of ImageNet Era in NLP: Word Embeddings Are Dead

by
The Arrival of ImageNet Era in NLP: Word Embeddings Are Dead

Selected fromthe Gradient Author：Sebastian Ruder Translated by Machine Heart In the field of computer vision, models pre-trained on ImageNet are commonly used for various CV tasks such as object detection and semantic segmentation. In contrast, in the field of natural language processing (NLP), we typically only use pre-trained word embedding vectors to encode the relationships … Read more