Wishing You a Prosperous Year of the Rat HAPPY 2020’S NEW YEAR Author:Tea Book Club of Lao Song Zhihu Column:NLP and Deep Learning Research Direction:Natural Language Processing Source:AINLP Introduction BERT has achieved great success in the field of natural language understanding, but it performs poorly in natural language generation due to the language model used … Read more
In the first three articles of this series, we introduced the concept of large language models (link), training methods (link), and core capabilities (link). However, using GPT effectively is still not a simple task. The key to mastering AIGC lies in writing effective prompts. Prompt: Refers to a segment of text input provided to the … Read more
In the field of artificial intelligence, GPT (Generative Pre-trained Transformer) models are popular for their powerful text generation capabilities. However, due to resource limitations, individual users may find it difficult to run and train such large models directly. Fortunately, there are some open-source projects like Ollama and Open-WebUI that can help us set up a … Read more
Machine translation originated from research in Natural Language Processing (NLP), which is an intersection of linguistics and artificial intelligence, and can be seen as the practice of empowering translation through artificial intelligence technology. Currently, large language models represented by GPT, through deep learning on massive amounts of data, have gained powerful semantic analysis capabilities, allowing … Read more
Approximately 3500 words, recommended reading time 10 minutes. Today, we will explore the core technologies behind large models! 1. Transformer The Transformer model is undoubtedly the solid foundation of large language models, ushering in a new era in deep learning. In the early stages, Recurrent Neural Networks (RNNs) were the core means of handling sequential … Read more
SUFE MBA/EMBA On December 19, 2024, the “2024 International Online Education Conference” hosted by the China Central Radio and Television Station and organized by Genesis Blue Ocean was successfully held in Beijing. The theme of this conference is “Empowering Education with Technology to Shape the Future”, bringing together authoritative experts in education, renowned principals, and … Read more
Claude is an AI chatbot developed by Anthropic, similar to ChatGPT, founded by a former vice president of OpenAI. Although it may not match GPT-4, it excels in continuous conversation, writing novels, coding, and explaining concepts. Claude is currently in a free usage phase; you just need to register for a Slack account, and it … Read more
(This article is based on Professor Liu Jia’s keynote speech at the “Tencent Academy Classmates Meeting – Smart Future: AI Hefei Study Tour”) Author | Liu Yanni Since the advent of ChatGPT on November 30, 2022, generative artificial intelligence has emerged like the morning star, heralding a technological revolution that leads a new era. The … Read more
Follow the public account “ML_NLP“ Set as “Starred“, heavy content delivered to you first! Source | Zhihu Address | https://zhuanlan.zhihu.com/p/69290203 Author | Ph0en1x Editor | WeChat public account on Machine Learning Algorithms and Natural Language Processing This article is for academic sharing only. If there is any infringement, please contact us to delete it. This … Read more
This article will cover theessence of Transformer, the principles of Transformer, and improvements in Transformer architecture in three aspects to help you understand Transformer. 1. Essence of Transformer Transformer Architecture: It mainly consists of four parts: input section (input-output embeddings and position encoding), multi-layer encoder, multi-layer decoder, and output section (output linear layer and Softmax). … Read more