Python

High-Speed Download of HuggingFace Models in China

by
High-Speed Download of HuggingFace Models in China

Author: Apathy Link: https://zhuanlan.zhihu.com/p/669120427 Note: This article has been tested and is effective, highly recommended. Users in China can use the official HuggingFace download tool huggingface-cli and hf_transfer to download models and datasets from the HuggingFace mirror site at high speed. HuggingFace-Download-Acceleratorgithub.com/LetheSec/HuggingFace-Download-Accelerator Quick Start 1. Clone the project to your local machine: git clone https://github.com/LetheSec/HuggingFace-Download-Accelerator.git … Read more

LlamaIndex: A Python Library for Building Intelligent Query Systems

by
LlamaIndex: A Python Library for Building Intelligent Query Systems

In the world of artificial intelligence and machine learning, intelligent query systems have become an indispensable part. Whether in search engines, recommendation systems, or customer service chatbots, we need a system that can intelligently understand and process user queries. LlamaIndex (formerly known as GPT Index) is a powerful Python library specifically designed to help developers … Read more

LlamaIndex Data Framework: A Beginner’s Guide

by
LlamaIndex Data Framework: A Beginner's Guide

What Is LlamaIndex? LlamaIndex is a data framework designed to enable LLM-based applications to ingest, structure, and access private or domain-specific data. It offers both Python and TypeScript versions. https://docs.llamaindex.ai/en/stable/index.html LLMs provide a natural language interface between humans and data. The widely available models are pre-trained on a large amount of publicly available data, such … Read more

LlamaIndex: A Data-Focused LLM Framework Similar to LangChain

by
LlamaIndex: A Data-Focused LLM Framework Similar to LangChain

Welcome to LlamaIndex 🦙 LlamaIndex (formerly GPT Index) is a data framework for ingesting, structuring, and accessing private or domain-specific data for LLM applications. 🚀 Why Choose LlamaIndex?[1] At their core, LLMs provide a natural language interface between humans and inferred data. The widely available models are pre-trained on a large amount of publicly available … Read more

Practical LLM RAG: Key Steps to Unlock Custom LlamaIndex

by
Practical LLM RAG: Key Steps to Unlock Custom LlamaIndex

1. Introduction to LlamaIndex LlamaIndex is a Python library created by Jerry Liu that enables efficient text search and summarization of large document collections using language models.Developers can quickly add private/custom data to enhance existing LLMs with LlamaIndex. It provides personalized and data-driven responses without the need for retraining large models. Due to the limited … Read more

Practical Implementation of Context Mode in ChatEngine

by
Practical Implementation of Context Mode in ChatEngine

Overview The ContextChatEngine class is a contextual chat engine designed to provide a smooth chat experience by retrieving contextual information from the chat and using a language model (LLM) to generate responses based on system prompts. It is a simple chat mode built on top of a data retriever. For each chat interaction: First, retrieve … Read more

LlamaIndex Practical Application – ChatEngine ReAct Agent Mode

by
LlamaIndex Practical Application - ChatEngine ReAct Agent Mode

Overview ReAct is an agent-based chat mode built on top of a data query engine. For each chat interaction, the agent enters a ReAct loop: First, decide whether to use the query engine tool and propose appropriate input (Optional) Use the query engine tool and observe its output Decide whether to repeat or give a … Read more

LlamaIndex Practical Guide – Overview of Query Engine Usage

by
LlamaIndex Practical Guide - Overview of Query Engine Usage

Overview The Query Engine is a generic interface that allows you to query data. It accepts natural language queries and returns rich responses. It is typically (but not always) built on one or more indexes through a retriever. You can combine multiple query engines to achieve more advanced functionality. Note: If you want to have … Read more

Using LlamaIndex to Create Custom Agent Functions

by
Using LlamaIndex to Create Custom Agent Functions

Overview This article introduces how to use LlamaIndex to write your own Agent handling functions. Note that this article uses a locally deployed LLM supported by Ollama for practical implementation, rather than remotely calling the OpenAI API. The goal of this article is to save the output content to a PDF file and then stop … Read more