Data Processing

Detailed Explanation of LlamaIndex Workflows: Key to Improving Data Processing Efficiency

by
Detailed Explanation of LlamaIndex Workflows: Key to Improving Data Processing Efficiency

Click the “Blue Words” to Follow Us LlamaIndex, as a powerful framework, provides a solid foundation for building data pipelines that connect with large language models (LLMs). It implements a modular approach to query execution through structured workflows, simplifying solutions to complex problems. Today, let’s discuss the workflows of LlamaIndex. 1. Basics of LlamaIndex Workflows … Read more

LlamaIndex: Awakening Your Data with AI

by
LlamaIndex: Awakening Your Data with AI

Today, let’s continue to introduce a “wheel”. In this era of information explosion, data is no longer a scarce resource; it is everywhere, like air. However, data itself does not equal wisdom. We are like boats floating in an ocean, surrounded by endless waters, and only by mastering the compass that guides our direction can … Read more

RAG 2.0 Performance Improvement: Strategies and Practices for Optimizing Indexing and Recall Mechanisms

by
RAG 2.0 Performance Improvement: Strategies and Practices for Optimizing Indexing and Recall Mechanisms

Introduction This sharing is titled “RAG 2.0 Engine Design Challenges and Implementation”. Main content includes the following parts: 1. Pain points and solutions of RAG 1.0 2. How to effectively Chunking 3. How to accurately recall 4. Advanced RAG and preprocessing 5. How RAG will develop in the future 6. Q&A Guest Speaker｜Zhang Yingfeng Founder … Read more

Enhancing Workplace Efficiency with AI Tools

by
Enhancing Workplace Efficiency with AI Tools

In the workplace, efficiency is the goal pursued by every professional. However, tasks such as creating PPTs, organizing data, and searching for information often become headaches for employees. When facing looming deadlines, do you feel overwhelmed yet still unable to keep up? Now, with the gradual maturity of AI technology, many workplace pain points are … Read more

Deep Dive Into Python Machine Learning Library LightGBM

by
Deep Dive Into Python Machine Learning Library LightGBM

Deep Dive Into Python Machine Learning Library LightGBM Xiaoming: Sister Xiaoli, I’m working on a machine learning project and I feel that model training is really difficult. Is there a useful library that can make it easier for me? 😩 Sister Xiaoli: Of course! 🙌 Today, I will tell you about LightGBM, which is a … Read more

Zhou Ming: The Technical System and Future of NLP

by
Zhou Ming: The Technical System and Future of NLP

▲Click on the top Leifeng Network to follow Since 2012, the field of Natural Language Processing (NLP) has entered the era of neural networks for 7 years. Where is the future development heading? Let’s see how Dr. Zhou Ming, the chairman of ACL 2019 and vice president of Microsoft Research Asia, interprets it~ Written by … Read more

Step-by-Step Guide to Natural Language Processing

by
Step-by-Step Guide to Natural Language Processing

Big Data Digest Work Compiled by: Xiao Fan Pen, Zhou Jiayu, Da Jieqiong, Qian Tianpei Douban Water Army Detection, “Game of Thrones” Sequel, and the Ever-More Amazing Google Translate… Recently, various applications of Natural Language Processing (NLP) have been thriving. These NLP applications seem to be incredibly cool, but the principles behind them are not … Read more

Comprehensive Collection of Common PyTorch Code Snippets

by
Comprehensive Collection of Common PyTorch Code Snippets

↑ ClickBlue Text Follow the Extreme Market Platform Author丨Jack Stark@Zhihu Source丨https://zhuanlan.zhihu.com/p/104019160 Extreme Market Guide This article is a collection of common code snippets in PyTorch, covering five aspects: basic configuration, tensor processing, model definition and operation, data processing, and model training and testing, along with several notable tips. The content is very comprehensive. Join the … Read more