Introduction Do you want to run large language models locally and create your own AI assistant? The latest Ollama 0.5.7 version makes this easier than ever. By following the steps below, you will easily complete the deployment and embark on an intelligent journey!💡 🎯 What is Ollama? Ollama is a tool designed to help users … Read more
Understanding Transformers Through Llama Model Architecture Llama Nuts and Bolts is an open-source project on GitHub that rewrites the inference process of the Llama 3.1 8B-Instruct model (80 billion parameters) from scratch using the Go language. The author is Adil Alper DALKIRAN from Turkey. If you are interested in how LLMs (Large Language Models) and … Read more
Deploying DeepSeek Large Model Using Ollama Prerequisites Download CUDA drivers using NVIDIA graphics card https://developer.nvidia.com/cuda-downloads Ollama Ollama Official Version: https://ollama.com/ My graphics card is on a Windows computer, so I will install using the Windows installation method.If your graphics card is on Linux, you can install using the following command. curl -fsSL https://ollama.com/install.sh | sh … Read more
Are you still troubled by the mixed quality of AI services in the domestic market and poor performance? Then let’s take a look at DevCat AI (3in1). This is an integrated AI assistant that combines GPT-4, Claude3, and Gemini. It covers all models of the three AI tools. Including GPT-4o and Gemini flash Now, you … Read more
Last time, I published an article titled “Building Your Own Simple Knowledge Base with Ollama,” and I found that many users encountered various issues during usage. I also faced similar problems. Particularly, after importing an article into the MaxKB knowledge base and asking questions within the application, the answers were completely off-topic and did not … Read more
I previously installed Tsinghua University’s model directly, but today I learned about a tool called Ollama, which is said to be an essential AI tool, so I wanted to try installing it. During the actual installation process, there were quite a few pitfalls for someone without magic like me, but fortunately, I ultimately achieved local … Read more
To pave the way for future workflows and local models, it is necessary to discuss the installation of the Ollama local large language model backend. 1. Ollama Before installation, it is necessary to clarify what Ollama is.. Ollama is a backend service for large language models that helps users easily deploy large language models without … Read more
Are you still troubled by the mixed quality of AI in China and poor performance? Then let’s take a look at Developer Cat AI (3in1)! This is an integrated AI assistant that combines GPT-4, Claude3, and Gemini. It covers all models of the three AI tools. Including GPT-4o and Gemini flash Now, you can own … Read more
I. Introduction A personal knowledge base is a repository of personal learning, experiences, and observations that can assist individuals in decision-making, problem-solving, and creativity. Imagine it as a personal library that stores all important books (or articles, notes, or ideas). A personal knowledge base can include: key concepts, summaries of research papers or articles, notes … Read more
DeepSeek-R1 uses reinforcement learning to significantly enhance the model’s inference capabilities. In tasks such as mathematics, coding, and natural language reasoning, its performance rivals that of OpenAI’s official version o1.The small model distilled from DeepSeek-R1 effectively inherits the reasoning patterns learned by the large model.This article primarily tests DeepSeek-R1-Distill-Llama-8B-GGUF using Llama Edge. Welcome to experiment … Read more