LlamaIndex

Building a Q&A Bot with Local Knowledge Base Using LlamaIndex and Qwen1.5

by
Building a Q&A Bot with Local Knowledge Base Using LlamaIndex and Qwen1.5

01 Introduction What is RAG LLMs can produce misleading “hallucinations”, depend on information that may be outdated, and are inefficient when handling specific knowledge, lacking deep insights in specialized fields, while also having some deficiencies in reasoning capabilities. It is against this backdrop that Retrieval-Augmented Generation (RAG) technology has emerged, becoming a significant trend in … Read more

LlamaIndex: A Python Library for Building Intelligent Query Systems

by
LlamaIndex: A Python Library for Building Intelligent Query Systems

In the world of artificial intelligence and machine learning, intelligent query systems have become an indispensable part. Whether in search engines, recommendation systems, or customer service chatbots, we need a system that can intelligently understand and process user queries. LlamaIndex (formerly known as GPT Index) is a powerful Python library specifically designed to help developers … Read more

The Rise of Domestic AI: Integrating Zhipu AI with LlamaIndex for Data Processing

by
The Rise of Domestic AI: Integrating Zhipu AI with LlamaIndex for Data Processing

After a year of development, domestic AI has gradually matured. Today, let’s look at how people can combine the domestic star product Zhipu AI with the LlamaIndex data framework to handle daily tasks. Domestic AI Products As we all know, the AI and large model field has been extremely hot this past year. In August, … Read more

LlamaIndex Data Framework: A Beginner’s Guide

by
LlamaIndex Data Framework: A Beginner's Guide

What Is LlamaIndex? LlamaIndex is a data framework designed to enable LLM-based applications to ingest, structure, and access private or domain-specific data. It offers both Python and TypeScript versions. https://docs.llamaindex.ai/en/stable/index.html LLMs provide a natural language interface between humans and data. The widely available models are pre-trained on a large amount of publicly available data, such … Read more

How to Enhance LLM Capabilities with Private Data?

by
How to Enhance LLM Capabilities with Private Data?

The explosive popularity of ChatGPT proves the capabilities of large language models (LLMs) in generating knowledge and reasoning. However, ChatGPT is a model pre-trained on public datasets, which may not provide specific answers or results related to user businesses. So, how can we maximize the capabilities of LLMs using private data? LlamaIndex can solve this … Read more

LlamaIndex: A Data-Focused LLM Framework Similar to LangChain

by
LlamaIndex: A Data-Focused LLM Framework Similar to LangChain

Welcome to LlamaIndex 🦙 LlamaIndex (formerly GPT Index) is a data framework for ingesting, structuring, and accessing private or domain-specific data for LLM applications. 🚀 Why Choose LlamaIndex?[1] At their core, LLMs provide a natural language interface between humans and inferred data. The widely available models are pre-trained on a large amount of publicly available … Read more

Practical LLM RAG: Key Steps to Unlock Custom LlamaIndex

by
Practical LLM RAG: Key Steps to Unlock Custom LlamaIndex

1. Introduction to LlamaIndex LlamaIndex is a Python library created by Jerry Liu that enables efficient text search and summarization of large document collections using language models.Developers can quickly add private/custom data to enhance existing LLMs with LlamaIndex. It provides personalized and data-driven responses without the need for retraining large models. Due to the limited … Read more

LlamaIndex: A New Document Summary Index for QA Systems

by
LlamaIndex: A New Document Summary Index for QA Systems

In this blog post, we introduce a brand new data structure in LlamaIndex: the Document Summary Index. We describe how it helps provide better retrieval performance compared to traditional semantic search, along with an example. https://github.com/jerryjliu/llama_index 1 Background One of the core scenarios for large language models (LLM) is question answering on user data. To … Read more

Advanced RAG – Composable Retrieval with LlamaIndex

by
Advanced RAG - Composable Retrieval with LlamaIndex

LlamaIndex is a simple and flexible data framework that connects custom data sources with large language models. LlamaIndex provides comprehensive support for RAG. Advanced RAG (Retrieval-Augmented Generation) techniques can be modeled using a composable hierarchical abstraction. The retrieved text can be linked to the following elements: Retriever Text Pipeline Query Engine The retrieval of RAG … Read more

LlamaIndex Practical Application – ChatEngine ReAct Agent Mode

by
LlamaIndex Practical Application - ChatEngine ReAct Agent Mode

Overview ReAct is an agent-based chat mode built on top of a data query engine. For each chat interaction, the agent enters a ReAct loop: First, decide whether to use the query engine tool and propose appropriate input (Optional) Use the query engine tool and observe its output Decide whether to repeat or give a … Read more