Data Loading and Ingestion in LlamaIndex
Data is key. Before we can operate on our data with LLM, we first need to process and load the data. This is similar to ETL (Extract, Transform, Load) in machine learning engineering. In LlamaIndex, the data ingestion pipeline typically consists of three main stages: Loading Data Transforming Data Indexing and Storing Data We will … Read more