Large Language Models

Educational Applications of Large Language Models: Principles, Status, and Challenges

by
Educational Applications of Large Language Models: Principles, Status, and Challenges

Abstract: Large Language Models (LLMs) are natural language processing technologies used to describe vast amounts of text through vector representations and generative probabilities. Recently, with the emergence of representative products like ChatGPT, which has garnered widespread attention in the education sector due to its excellent capabilities in generation, comprehension, logical reasoning, and dialogue, research on … Read more

Google & Hugging Face: The Strongest Language Model Architecture for Zero-Shot Capability

by
Google & Hugging Face: The Strongest Language Model Architecture for Zero-Shot Capability

This article is approximately 2000 words long and takes about 5 minutes to read. If the goal is the model's zero-shot generalization capability, the decoder structure + language model task is the best; if multitask finetuning is also needed, the encoder-decoder structure + MLM task is the best. From GPT-3 to prompts, more and more … Read more

CMU Liu Pengfei: The Fourth Paradigm of NLP

by
CMU Liu Pengfei: The Fourth Paradigm of NLP

Written by | Liu Pengfei Edited by | Jia Wei Source | AI Technology Review In the past two years, the research paradigm based on pre-training + fine-tuning has rapidly swept the entire field of NLP. This research paradigm is widely recognized as a revolutionary paradigm in NLP research, with previous paradigms including “expert systems,” … Read more

Precise Induction of Language Model Knowledge Through Prompt Construction

by
Precise Induction of Language Model Knowledge Through Prompt Construction

NLP Paradigm Evolution Fully Supervised Learning (Non-neural Network): Trains a specific task model only on the input-output sample dataset for the target task, heavily relying on feature engineering. Fully Supervised Learning (Neural Network): Combines feature learning with model training, shifting the research focus to architecture engineering, which designs a network architecture (like CNN, RNN, Transformer) … Read more

How to Write Prompts for Large Language Models in Mathematical Modeling Competitions

by
How to Write Prompts for Large Language Models in Mathematical Modeling Competitions

In large language models, a “prompt” refers to the input text provided to the model to instruct or guide it to produce specific outputs. Its main function is to inform the model about what kind of information the user wants to obtain or what kind of task they want to complete. For example, when using … Read more

Overview of Large Models for Time Series and Spatio-Temporal Data

by
Overview of Large Models for Time Series and Spatio-Temporal Data

This article is about 11,000 words long and is recommended to be read in over 10 minutes. This is a survey overview of large models for time series and spatio-temporal data. Time-related data, especially time series and spatio-temporal data, are ubiquitous in real-world applications. These data capture measurements of dynamic systems and are generated in … Read more

Understanding Conversational Implicature in GPT-4

by
Understanding Conversational Implicature in GPT-4

Originally published by Xi Xiaoyao Technology Original author | Xie Nian Nian In interpersonal communication, especially when using a profound language like Chinese, people often do not answer questions directly but instead use implicit, obscure, or indirect expressions. Humans can accurately interpret some implied meanings based on past experiences or understanding of the speaker, as … Read more

Understanding Prompt Techniques for Large Language Models

by
Understanding Prompt Techniques for Large Language Models

MLNLP Community is a well-known machine learning and natural language processing community at home and abroad, covering NLP master’s and doctoral students, university teachers, and corporate researchers. The Vision of the Community is to promote communication and progress between the academic and industrial circles of natural language processing and machine learning at home and abroad, … Read more

Exploring Use Cases for Large Language Models, NLP Modeling, and Agents

by
Exploring Use Cases for Large Language Models, NLP Modeling, and Agents

Source: FIN AI Exploration Big Data Digest This article is approximately 2400 words long and is suggested to be read in 5 minutes. In the short term, Agents mainly focus on improving efficiency. In the domestic large language model field, applications are flourishing. Here are a few observations I have made recently: Smaller parameter models … Read more

New Opportunities for Intelligent Film Production: A Review of Multimodal Technology Development at CVPR 2024

by
New Opportunities for Intelligent Film Production: A Review of Multimodal Technology Development at CVPR 2024

This article was published in the “Modern Film Technology” 2024, Issue 7. Expert Commentary Film is an organic combination of visual and auditory arts, presenting an unparalleled audiovisual experience to the audience through the transmission of sight and sound. Multimodal technology synergistically utilizes visual, auditory, textual, and other information to accomplish tasks that are difficult … Read more