This article is reproduced from:NLP Intelligence Bureau Since Google introduced the pre-trained language model BERT, various applications of language models have emerged. However, most models were proposed in English contexts, and their performance often declines to varying degrees when transferred to Chinese contexts. Previously, my friends and I participated in the CCKS machine reading comprehension … Read more
Follow the public account “ML_NLP“ Set as “Starred“, heavy content delivered in real-time! Reprinted from | DataFunTalk Welfare at the end of the article! We will randomly select 10 lucky fans to each receive a copy of the latest work from Harbin Institute of Technology SCIR Laboratory“Natural Language Processing: Methods Based on Pre-trained Models (Full … Read more
💡 Paper Title: Knowledge Graph Enhanced Large Language Model Editing, ACL Findings, 2024 🔗 Paper Link: https://arxiv.org/abs/2402.13593 Background and Motivation Large language models excel in various tasks due to their powerful generative capabilities and the rich knowledge they contain. However, issues such as outdated knowledge and factual errors may exist within these models, limiting their … Read more
This article is approximately 3900 words long and is recommended for an 8-minute read. In this article, we demonstrate that Causal Attention can be rewritten in the form of an RNN. In recent years, RNNs have rekindled interest among researchers and users due to their linear training and inference efficiency, hinting at a “Renaissance” in … Read more
Introduction This article builds a complete Chinese speech recognition system, including acoustic models and language models, capable of recognizing input audio signals as Chinese characters. The system implements acoustic model and language model modeling in speech recognition based on deep frameworks, where the acoustic models include CNN-CTC, GRU-CTC, CNN-RNN-CTC, and the language models include transformer … Read more
1. Introduction On June 27, the authoritative technology magazine “MIT Technology Review” announced the list of the 50 smartest companies in the world for 2017. iFlytek ranked first in China and sixth globally. The companies ahead of iFlytek are: NVIDIA, SpaceX, Amazon, 23andMe, and Alphabet. “MIT Technology Review” stated that “iFlytek’s voice assistant is the … Read more
(Scan the QR code at the bottom of this page to learn more about the course) When it comes to Wenxin Yiyan, everyone is likely familiar with it. Developed by Baidu, Wenxin Yiyan is an advanced AI language model that can accurately continue the context, engage in smooth conversations, answer questions, or complete tasks based … Read more
The development and training of large language models is extremely challenging, and training Chinese large language models is even more difficult due to various reasons. On one hand, the proportion of Chinese information on the global internet is relatively small. In systematic knowledge such as academic papers and specialized websites across various industries, the proportion … Read more
AIGC (Artificial Intelligence Generative Content) refers to content that is automatically created and generated by AI. It represents a revolutionary innovation—using advanced artificial intelligence technology to automatically create and generate a wide variety of content. When AI receives task instructions given by humans, it can cleverly interpret and process them into our natural language, and … Read more
Introduction LLaMA is a large language model released by Meta AI in February 2023. As the first model in this series, LLaMA is a pure base language model designed to provide an open and efficient platform for general language understanding and generation. There are four versions available: 7B, 13B, 33B, and 65B (65 billion). Regarding … Read more