Fine-tuning

Understanding Alibaba’s Qwen Model and Local Deployment

by
Understanding Alibaba's Qwen Model and Local Deployment

Introduction Overview Pre-training Data Sources Pre-processing Tokenization Model Design Extrapolation Capability Model Training Experimental Results Deployment Testing Alignment Supervised Fine-tuning (SFT) RM Model Reinforcement Learning Alignment Results (Automatic and Human Evaluation) Automatic Evaluation Human Evaluation Deployment Testing Conclusion Introduction This article mainly introduces the Chinese large model Alibaba Qwen, specifically including model details interpretation and … Read more

Understanding Fine-Tuning of Neural Network Models

by
Understanding Fine-Tuning of Neural Network Models

This article will coverthe essence of fine-tuningthe principles of fine-tuning, and the applications of fine-tuning in three aspects to help you understand model fine-tuning Fine-tuning . Fine-tuning Model Fine-tuning The Essence of Fine-tuning How to Utilize Pre-trained Models?Two popular methods are Transfer Learning and Fine-tuning. Transfer Learning is a broader concept that includes various methods … Read more

LLaMA Factory Fine-Tuning Guide

by
LLaMA Factory Fine-Tuning Guide

About LLaMA Factory In today’s rapidly advancing field of artificial intelligence, how to efficiently fine-tune and deploy large language models (LLMs) has become a hot topic in research and application. LLaMA Factory, as an open-source fine-tuning framework, has emerged in this context. It aims to provide developers with a simple and efficient tool to quickly … Read more

Experience Local Deployment of VisualGLM-6B Multimodal Dialogue Model

by
Experience Local Deployment of VisualGLM-6B Multimodal Dialogue Model

The VisualGLM-6B multimodal dialogue model used in this article is open-sourced by Zhizhu AI and the KEG Lab of Tsinghua University. It can describe images and answer related knowledge questions. This article will guide you to experience the capabilities of this multimodal dialogue model by personally feeling its practical effects through local deployment. 1. Environment … Read more

The Art of Fine-Tuning BERT

by
The Art of Fine-Tuning BERT

Authorized Reprint from Andy’s Writing Room Author:ANDY The BERT pre-trained model is like a pig ready for cooking, and fine-tuning is the cooking method. The pig’s head can be made into fragrant and rich roasted pig head meat, the trotters can be made into hearty braised trotters, and the various cuts like pork belly and … Read more

RAG vs Fine-Tuning: A Guide for Domain-Specific AI Models

by
RAG vs Fine-Tuning: A Guide for Domain-Specific AI Models

Machine Heart Report Editor: Rome Retrieval-Augmented Generation (RAG) and Fine-tuning are two common methods to enhance the performance of large language models. So, which method is better? Which is more efficient when building applications in specific domains? This paper from Microsoft serves as a reference for your choice. When constructing large language model applications, there … Read more