Llama 3.2 Model Fine-Tuning Guide

Llama 3.2 Model Fine-Tuning Guide

1. Basic Description 1. The models from ollama are all stripped-down versions. 2. They are relatively weak in distributed environments. 3. ollama is lightweight and suitable for individual users, but not for enterprise users. 4. ollama only performs model inference (used for running models). 5. ollama uses GGUF for quantization. 6. Engineering deployment generally does … Read more

Comprehensive Guide to Fine-Tuning Qwen7b

Comprehensive Guide to Fine-Tuning Qwen7b

Warning: This may be the easiest to understand, easiest to run example for efficient fine-tuning of various open-source LLM models, supporting both multi-turn and single-turn dialogue datasets. We constructed a toy dataset of three rounds of dialogue that modifies the self-awareness of the large model, using the QLoRA algorithm, which can complete fine-tuning in just … Read more

Improving Stable Diffusion: Training Style-Specific LoRA Models

Improving Stable Diffusion: Training Style-Specific LoRA Models

” Click the above “GameLook” ↑↑↑, subscribe to WeChat “ Text-to-image is just the beginning of AI generation capabilities. Nowadays, with the increasing exploration by peers, many have started training stylized models through Stable Diffusion, turning AI into a specific artistic style creator. Recently, a developer shared their experiences and techniques for training stylized LoRA … Read more

Sun Yat-sen University Open Source Diffusion Model Framework

Sun Yat-sen University Open Source Diffusion Model Framework

Machine Heart Column Machine Heart Editorial Department In recent years, image generation models based on Diffusion Models have emerged one after another, showcasing stunning generation effects. However, the existing research model code frameworks suffer from excessive fragmentation, lacking a unified framework system, leading to challenges such as “difficult migration,” “high barriers,” and “poor quality” in … Read more

Getting Started with Stable Diffusion WebUI

Getting Started with Stable Diffusion WebUI

This article mainly introduces the practical operation methods of Stable Diffusion WebUI, covering prompt derivation, LoRA models, VAE models, and ControlNet applications, along with actionable examples of text-to-image and image-to-image generation. It is suitable for students interested in Stable Diffusion but feeling confused about using Stable Diffusion WebUI. We hope this article can reduce the … Read more

Master Stable Diffusion: Understanding LoRA, Dreambooth, and Hypernetworks

Master Stable Diffusion: Understanding LoRA, Dreambooth, and Hypernetworks

” Click the above “GameLook” ↑↑↑, Subscribe to WeChat “ As the capabilities of generative AI technology improve, more and more peers are focusing on enhancing research and development efficiency through AI models. There are many popular AI models in the industry, such as the drawing tool Midjourney, the versatile Stable Diffusion, and OpenAI’s recently … Read more

LongQLoRA: Efficiently Extending LLaMA2-13B Context Length

LongQLoRA: Efficiently Extending LLaMA2-13B Context Length

Click the card below to follow the “LiteAI” public account This article will introduce our work on efficiently extending the context length of large models with low resources:LongQLoRA. It will involve knowledge related to Position Interpolation and QLoRA, and we recommend combining it with previous articles to help understand this work: Illustration of RoPE Rotational … Read more