CPU Inference

Can RAG Improve LLM Inference Ability? Recent Research from Renmin University

by
Can RAG Improve LLM Inference Ability? Recent Research from Renmin University

MLNLP community is a well-known machine learning and natural language processing community both domestically and internationally, with an audience covering NLP graduate students, university teachers, and industry researchers. The Vision of the Community is to promote communication and progress between the academic and industrial circles of natural language processing and machine learning, especially for the … Read more

Fraud Text Classification Detection: LLama.cpp + CPU Inference

by
Fraud Text Classification Detection: LLama.cpp + CPU Inference

1. Introduction Previously, after training our personalized model with Lora, the first issue we faced was: how to run the model on a regular machine? After all, the model was fine-tuned on dedicated GPUs with dozens of gigabytes of memory, and switching to a regular computer with only a CPU could lead to the awkward … Read more