LLM (Large Language Model) is a powerful new platform, but they are not always trained on data relevant to our tasks or the latest data. RAG (Retrieval Augmented Generation) is a general method that connects LLMs with external data sources (such as private or up-to-date data). It allows LLMs to use external data to generate … Read more
Machine Heart Report Editor: Rome Retrieval-Augmented Generation (RAG) and Fine-tuning are two common methods to enhance the performance of large language models. So, which method is better? Which is more efficient when building applications in specific domains? This paper from Microsoft serves as a reference for your choice. When constructing large language model applications, there … Read more
A Survey of Query Optimization in Large Language Models Paper Link:https://arxiv.org/pdf/2412.17558 Published by: Tencent Large Language Models (LLMs) are becoming increasingly popular, but they also face challenges such as “hallucination” when dealing with domain-specific tasks or those requiring specialized knowledge. Retrieval-Augmented Generation (RAG) technology has emerged as a key method for enhancing model performance, with … Read more
Hello everyone, I am Liu Cong from NLP. Just tonight, Kimi released the latest model K1.5, first, let’s take a look at the leaderboard results, it’s simply explosive. In long reasoning, K1.5 far surpasses OpenAI’s O1 model in mathematical ability, whether in pure text or visual multimodal; it is on par with Codeforces, slightly lagging … Read more
Recently, it feels like the New Year has come early. Just last night, DeepSeek and Kimi both released their version 1.0, and Kimi was the first to publish its technical report, which is quite interesting… When it comes to Kimi, everyone has the impression that it has a technological first-mover advantage, being the first to … Read more
Follow us to stay updated! Recently, the LLM community has been immersed in the shock brought by DeepSeek-V3. This model is not only open-source but also performs well. However, such a large-scale LLM is beyond our reach (the GPU memory can’t handle it). If we can’t afford that, let’s take a look at Microsoft’s open-source … Read more
Building a data analysis agent using LangChain, CrewAI, and AutoGen. Long press to follow ‘AI Technology Forum’ The data analysis agent can automatically conduct analysis tasks, execute code, and provide adaptive responses to data queries. LangChain, CrewAI, and AutoGen are the three popular frameworks for building such AI agents. This article utilizes and compares these … Read more
The Attention mechanism is a technique in deep learning, particularly widely used in Natural Language Processing (NLP) and computer vision. Its core idea is to mimic the human attention mechanism, where humans focus on certain key parts of information while ignoring less important information. In machine learning models, this can help the model better capture … Read more
Since OpenAI officially released ChatGPT in November 2022, the AI technology ecosystem has experienced rapid advancement. The public has transitioned from a state of confusion to a thrilling and exciting experience, and now to feelings of unease due to the cost-cutting and efficiency improvements brought by their respective companies. The world is changing so quickly, … Read more
Recently, the world-renowned management consulting firm Boston Consulting Group (BCG) released a highly insightful report predicting that AI Agents will spark a revolution across various industries, prompting profound reflections on future work models, business models, and even the shape of human society. As Yuval Noah Harari, author of “Sapiens: A Brief History of Humankind,” stated: … Read more