Supervised Fine-tuning

Prompt Design and Fine-tuning of Large Language Models

by
Prompt Design and Fine-tuning of Large Language Models

This article mainly introduces prompt design, supervised fine-tuning of large language models (SFT), and the application of LLM in the mobile Tmall AI shopping assistant project. Basic Principles of ChatGPT “Speaking AI”, “Agent” In summary, it can be broken down into the following steps: Preprocess text: The input text for ChatGPT needs to be preprocessed. … Read more

Qwen2.5 Technical Report

by
Qwen2.5 Technical Report

In December 2024, the paper “Qwen2.5 Technical Report” from Tongyi Qianwen was released. This report introduces Qwen2.5, a series of comprehensive large language models (LLMs) designed to meet diverse needs. Compared to previous iterations, Qwen 2.5 has made significant improvements in both pre-training and post-training phases. In terms of pre-training, the high-quality pre-training dataset has … Read more