In the previous article, I shared how to run Google’s GemmaLLM locally using Ollama. If you haven’t seen that article, you can click the link below to review that content. Today, I’ll share how to customize your own LLM using the Modefile mechanism provided by Ollama, and I’ll demonstrate using Gemma7B again. Google’s open-source Gemma, … Read more
Click 01 Muggle Society Follow our public account, never get lost in AI learning Have you ever considered running open-source LLM locally? Do you have to manually download large model files? Are you struggling to build an API for your local model? Have you tried managing multiple models locally? I guess you have thought about … Read more
1. What is Ollama Ollama is a concise and easy-to-use local framework for running large models, allowing users to quickly run large models on their local computers, with most of the code written in Golang. Project address: https://github.com/ollama/ollama Official project: https://ollama.com/ 2. Why Ollama Exists The existence of Ollama can be traced back to Llama … Read more
In 2023, the explosive development of LLMs has taken place. Closed-source large language models, represented by ChatGPT, have demonstrated astonishing capabilities. However, it is well known that when using closed-source large language models like ChatGPT, the data we communicate with AI is collected to train and improve the model. Therefore, when it comes to practical … Read more
🚀 Ollama and LM Studio In the IT industry, choosing the right tool is like selecting a Swiss Army knife that fits your hand; it requires precision and efficiency. For IT professionals, the decision between Ollama and LM Studio is a question worth pondering. Today, we will conduct an in-depth comparison of these two local … Read more
In today’s rapidly advancing field of artificial intelligence, large language models (LLMs) have become crucial tools for transforming productivity. However, using online API services often comes with high costs and privacy concerns. If we could deploy and run open-source models locally, it would be an ideal solution. Today, we will introduce Ollama, a powerful open-source … Read more
1. Introduction to Ollama Ollama is an open-source tool designed for the convenient deployment and execution of large language models (LLMs) on local machines. It provides a simple and efficient interface that allows users to easily create, execute, and manage these complex models. Additionally, Ollama comes equipped with a rich library of pre-built models, enabling … Read more
Previously, I introduced the NVIDIA open-source AI tool Chat With RTX that can be used on PCs: [Tool] AI tools that can be installed and used on personal computers: Chat With RTX However, when using this tool, I found that although it learned a lot of information, it could only reference information from one piece … Read more
To stop the Ollama service, you can follow these steps: Manually stop the service: If the Ollama service was started via the command line, you can stop it by pressing Ctrl + C. Use system tools to stop the service: If you are running the Ollama service on Windows, you can terminate the related process … Read more
The entire process requires three software: Ollama. Used to run local large models. If using the API of a closed-source large model, there is no need to install Ollama. Docker. Used to run AnythingLLM. AnythingLLM. The platform for running the knowledge base, providing functions for building and running the knowledge base. 1 Install Ollama Download … Read more