If you’re starting to explore how to test open source large language models (LLM) with Generative AI for the first time, the overwhelming amount of information can be daunting. There is a lot of fragmented information from various sources on the internet, making it difficult to quickly start a project. The goal of this article … Read more
LM Studio is the simplest way to support local open-source large language models. It is plug-and-play, requires no coding, is very simple, and has a beautiful interface. Today, I will introduce this application. 1. What Can LM Studio Do? 🤖 Run LLM completely offline on a laptop 👾 Use models via in-app chat UI or … Read more
I have an AI assistant named “Lao Liu”. Why? Because it sometimes speaks nonsense seriously. That’s right, this is a drawback of large models — “hallucination”. Therefore, LLMs + knowledge base is a solution to the “hallucination” problem. At the same time, for enterprises, information security must be considered; a privately owned knowledge base obviously … Read more
In the previous article, I shared how to run Google’s GemmaLLM locally using Ollama. If you haven’t seen that article, you can click the link below to review that content. Today, I’ll share how to customize your own LLM using the Modefile mechanism provided by Ollama, and I’ll demonstrate using Gemma7B again. Google’s open-source Gemma, … Read more
Previously, I introduced the NVIDIA open-source AI tool Chat With RTX that can be used on PCs: [Tool] AI tools that can be installed and used on personal computers: Chat With RTX However, when using this tool, I found that although it learned a lot of information, it could only reference information from one piece … Read more