Anything LLM

Why Large Models Need Quantization and How to Quantize

by
Why Large Models Need Quantization and How to Quantize

MLNLP community is a well-known machine learning and natural language processing community, covering both domestic and international NLP master’s and doctoral students, university teachers, and corporate researchers. The Vision of the Community is to promote communication and progress between the academic and industrial sectors of natural language processing and machine learning, especially for beginners. Reproduced … Read more

TurboAttention: Efficient Attention Mechanism Optimization Reducing LLM Costs by 70%

by
TurboAttention: Efficient Attention Mechanism Optimization Reducing LLM Costs by 70%

Source: Deephub Imba This article is approximately 6500 words long and is recommended for a 10-minute read. This article will delve into how TurboAttention achieves efficiency improvements from a technical perspective and analyze its architectural innovations. As large language models (LLMs) continue to evolve in the AI application domain, their computational costs are also showing … Read more

Doubling the Efficiency of Large Language Models: A Comprehensive Optimization Guide

by
Doubling the Efficiency of Large Language Models: A Comprehensive Optimization Guide

Author: Sienna Reviewed by: Los Abstract: Large Language Models (LLMs) have demonstrated exceptional capabilities in numerous language processing tasks; however, the computational intensity and memory consumption required for their deployment have become significant challenges to improving service efficiency. Industry estimates suggest that the processing cost of a single LLM request can be as much as … Read more

Exploring Planning Capabilities in LLM-based Agents

by
Exploring Planning Capabilities in LLM-based Agents

MLNLP community is a well-known machine learning and natural language processing community, covering graduate students, university professors, and researchers in enterprises both domestically and internationally. The vision of the community is to promote communication and progress between the academic and industrial circles of natural language processing and machine learning, especially for beginners. Reprinted from | … Read more

MetaGPT Open-Source Auto-Generated Agentic Workflow

by
MetaGPT Open-Source Auto-Generated Agentic Workflow

MLNLP community is a well-known machine learning and natural language processing community both domestically and internationally, covering NLP master’s and doctoral students, university teachers, and corporate researchers. The vision of the community is to promote communication and progress between the academic and industrial circles of natural language processing and machine learning at home and abroad, … Read more

Decoding LLM Application Framework: DSPy

by
Decoding LLM Application Framework: DSPy

In the past six months, I have been continuously engaged in development work related to LLM applications. However, as many may have noticed, there haven’t been many “cognitive-refreshing” technological or application changes lately, so I haven’t had enough enthusiasm to write new articles. Model Progress From the model perspective, since the release of GPT-4 in … Read more

How Google Gemini Achieves Smart Interaction Through Language Models

by
How Google Gemini Achieves Smart Interaction Through Language Models

Introduction: This article aims to explore an innovative path by utilizing Google’s Gemini Flash instead of the widely known LangChain to achieve intelligent interaction with CSV files. We will build a simple CSV interpreter that generates code and parses data without LangChain, creating an intuitive user interface with Streamlit.©️【Deep Blue AI】 In today’s rapidly evolving … Read more

Latest ReWOO Framework Addresses Auto-GPT and LangChain Redundancy

by
Latest ReWOO Framework Addresses Auto-GPT and LangChain Redundancy

MLNLP community is a well-known machine learning and natural language processing community both domestically and internationally, covering NLP master’s and doctoral students, university professors, and corporate researchers. The vision of the community is to promote communication and progress between the academic and industrial sectors of natural language processing and machine learning, especially for beginners. With … Read more

Research on Knowledge Graph Construction Technology Based on LLM Graph Transformer

by
Research on Knowledge Graph Construction Technology Based on LLM Graph Transformer

Source: DeepHub IMBA This article is approximately 7000 words long and is recommended to be read in over 10 minutes. This article delves into the LLM Graph Transformer framework of LangChain and its dual-mode implementation mechanism for text-to-graph conversion. The conversion from text to graph is a research area with technical challenges, where the core … Read more

Getting Started with LangChain: A Beginner’s Guide to Building LLM-Powered Applications

by
Getting Started with LangChain: A Beginner's Guide to Building LLM-Powered Applications

Author: Leonie Monigatti Translation: Zhao Jiankai Proofreading: zrx This article is approximately 4800 words long and is recommended for a 7-minute read. This article introduces you to the LangChain framework. Tags: LangChain, LLM Application, OpenAI Since the release of ChatGPT, large language models (LLMs) have gained significant popularity. Even if you may not have enough … Read more