Data Retrieval

Unlocking Efficient Data Retrieval with Query Construction Techniques in RAG Systems

by
Unlocking Efficient Data Retrieval with Query Construction Techniques in RAG Systems

Click 👇🏻 to follow, article from “ With the expanding application of large language models (LLMs), Retrieval-Augmented Generation (RAG) has become a mature technology. The popularity of products like txt2sql and ChatBI highlights the increasing importance of query construction techniques. This article analyzes the process of query construction and illustrates, through examples, how to transform … Read more

Rethinking RAG Relevance: Similarity Does Not Equal Relevance

by
Rethinking RAG Relevance: Similarity Does Not Equal Relevance

Recently, while reading some materials about RAG systems, I discovered an interesting phenomenon: the relevance issue of RAG is far more complex than we imagine. Whether from the perspective of data retrieval or the understanding of relevance by large models, the performance of RAG is filled with challenges and opportunities. Today, I would like to … Read more

Solving RAG’s Challenges: From Demo to Production

by
Solving RAG's Challenges: From Demo to Production

Introduction Many product managers and engineers familiar with RAG often complain, “It only takes a week to produce a demo with RAG, but it takes at least six months to reach a production-level standard!” This is a realistic issue for the current industrial implementation of RAG. The RAG framework is very simple and understandable, and … Read more

Designing Agentic AI Systems: Part 4 Data Retrieval and Agent RAG

by
Designing Agentic AI Systems: Part 4 Data Retrieval and Agent RAG

So far, we have discussed the architecture of Agent systems, how to organize the system into sub-Agents, and how to build a unified mechanism to standardize communication. Today, we will turn our attention to the tool layer and one of the most important aspects you need to consider in Agent system design: data retrieval. Data … Read more

Designing Agentic AI Systems: Part One Agent Architecture

by
Designing Agentic AI Systems: Part One Agent Architecture

How to build an effective operating AI Agent system? And how to identify potential issues during development that could lead to significant trouble after deployment? To answer these questions, you need to break the Agent system down into three parts: tools, reasoning, and action. Each layer has its own challenges. An error in one layer … Read more