How to Implement Local Large Models with Ollama

How to Implement Local Large Models with Ollama

I previously installed Tsinghua University’s model directly, but today I learned about a tool called Ollama, which is said to be an essential AI tool, so I wanted to try installing it. During the actual installation process, there were quite a few pitfalls for someone without magic like me, but fortunately, I ultimately achieved local … Read more

Mastering Anthropic Claude 3 with Dify and AWS Bedrock

Mastering Anthropic Claude 3 with Dify and AWS Bedrock

This article discusses how to use Anthropic Claude 3 more stably, as well as some interesting AI native tools based on the currently well-performing models. Introduction After experiencing Anthropic Claude Pro, which went live at the beginning of the month, for more than half a month, I found that the Claude 3 series models (Opus, … Read more

MCP Server Development: Seamless Integration of LLM and Elasticsearch

MCP Server Development: Seamless Integration of LLM and Elasticsearch

It is recommended to click on the original text at the bottom of the article for a better reading experience, including displaying external links and viewing high-definition illustrations. In the article that introduces MCP (Model Context Protocol), we quickly covered the basic concepts of MCP and provided an example to give readers an initial feel … Read more

NextChat MCP Function Analysis

NextChat MCP Function Analysis

1. What is MCP? The Model Context Protocol (MCP) is an open protocol that enables seamless integration of LLM applications with external data sources and tools. Whether building an AI-based IDE, enhancing chat interfaces, or creating custom AI workflows, MCP provides a standardized way to connect LLMs with the required context. https://spec.modelcontextprotocol.io 2. Using in … Read more

Understanding the Model Context Protocol (MCP)

Understanding the Model Context Protocol (MCP)

Before reading the content below, you need to understand ollama and Function Calling. The MCP is an open protocol that standardizes how applications provide context to large language models (LLMs). It also provides a standardized way to connect AI models to various data sources and tools. This protocol was defined by Anthropic, and one of … Read more

Ollama: Run Local Large Language Models Effortlessly

Ollama: Run Local Large Language Models Effortlessly

Project Introduction Ollama is a project focused on the local deployment and running of large language models, such as Llama 2 and Mistral. This project is licensed under the MIT License and is primarily written in Go, while also integrating languages such as C, Shell, TypeScript, C++, and PowerShell. With over 33.5k stars and 2.2k … Read more

Building A Secure Personal/Enterprise Knowledge Base with Ollama and WebUI

Building A Secure Personal/Enterprise Knowledge Base with Ollama and WebUI

I have an AI assistant named “Lao Liu”. Why? Because it sometimes speaks nonsense seriously. That’s right, this is a drawback of large models — “hallucination”. Therefore, LLMs + knowledge base is a solution to the “hallucination” problem. At the same time, for enterprises, information security must be considered; a privately owned knowledge base obviously … Read more

Ollama: Your Local Large Model Running Expert

Ollama: Your Local Large Model Running Expert

In 2023, the explosive development of LLMs has taken place. Closed-source large language models, represented by ChatGPT, have demonstrated astonishing capabilities. However, it is well known that when using closed-source large language models like ChatGPT, the data we communicate with AI is collected to train and improve the model. Therefore, when it comes to practical … Read more

Building a Personal Knowledge Base Using Ollama, Docker, and Anything LLM

Building a Personal Knowledge Base Using Ollama, Docker, and Anything LLM

Previously, I introduced the NVIDIA open-source AI tool Chat With RTX that can be used on PCs: [Tool] AI tools that can be installed and used on personal computers: Chat With RTX However, when using this tool, I found that although it learned a lot of information, it could only reference information from one piece … Read more