In the field of artificial intelligence, GPT (Generative Pre-trained Transformer) models are popular for their powerful text generation capabilities. However, due to resource limitations, individual users may find it difficult to run and train such large models directly. Fortunately, there are some open-source projects like Ollama and Open-WebUI that can help us set up a … Read more
1. Introduction Ollama Official Website: https://github.com/ollama/ollama Ollama is an open-source platform for artificial intelligence (AI) and machine learning (ML) tools, specifically designed to simplify the deployment and usage process of large language models (LLMs). Users can conveniently run various large language models locally, such as Llama 2 and other open-source models, using Ollama. The main … Read more
Install and Set Up Ollama https://ollama.com/ After downloading and installing, it will automatically start with the system by default. The model is installed on the default system disk, so there is no need to set it to auto-start; you can start it whenever you want; then set the default installation path for the model. Delete … Read more
Deploying DeepSeek Large Model Using Ollama Prerequisites Download CUDA drivers using NVIDIA graphics card https://developer.nvidia.com/cuda-downloads Ollama Ollama Official Version: https://ollama.com/ My graphics card is on a Windows computer, so I will install using the Windows installation method.If your graphics card is on Linux, you can install using the following command. curl -fsSL https://ollama.com/install.sh | sh … Read more
I previously installed Tsinghua University’s model directly, but today I learned about a tool called Ollama, which is said to be an essential AI tool, so I wanted to try installing it. During the actual installation process, there were quite a few pitfalls for someone without magic like me, but fortunately, I ultimately achieved local … Read more
Qwen2.5 is a large-scale language and multimodal model developed by the Tongyi Qianwen team. With its advantages in long text processing, knowledge integration, large-scale dataset pre-training, and multilingual processing, it provides users with quick and accurate responses, becoming an effective tool for enterprise intelligence transformation. Deploying the Qwen2.5 model on Function Compute FC allows users … Read more
I have an AI assistant named “Lao Liu”. Why? Because it sometimes speaks nonsense seriously. That’s right, this is a drawback of large models — “hallucination”. Therefore, LLMs + knowledge base is a solution to the “hallucination” problem. At the same time, for enterprises, information security must be considered; a privately owned knowledge base obviously … Read more
Introduction to Open WebUI Open WebUI (formerly known as Ollama WebUI) is a user-friendly web interface designed for Language Models (LLMs), supporting various LLM runners including Ollama and OpenAI compatible APIs. The project aims to provide users with an intuitive, responsive, fast, and easy-to-install chat interface. Features of Open WebUI ⭐ • 🖥️ Intuitive Interface: … Read more