If you’re starting to explore how to test open source large language models (LLM) with Generative AI for the first time, the overwhelming amount of information can be daunting. There is a lot of fragmented information from various sources on the internet, making it difficult to quickly start a project. The goal of this article … Read more
On April 18, 2024, Meta open-sourced the Llama 3 large models[1]. Although there are only 8B[2] and 70B[3] versions, the powerful capabilities demonstrated by Llama 3 have shocked the AI large model community. I personally tested the inference capabilities of the Llama3-70B version, which are very close to OpenAI’s GPT-4[4]. Moreover, a 400B super large … Read more
First of all, Lao Wang wants to tell everyone that I am also a layman, so I can understand the feeling of being at a loss with these new technologies. Therefore, today I am writing an article that everyone can easily get started with. The two main tools used here are: Ollama and Jan.AI. Computer … Read more
As we all know, Zuckerberg’s Meta has open-sourced Llama3 with two versions: the 8B and 70B pretrained and instruction-tuned models. There is also a larger 400B parameter version expected to be released this summer, which may be the first open-source model at the GPT-4 level! Let’s start with a preliminary understanding of Llama3. Model Architecture … Read more
Yesterday, I wrote about How OLLama Builds a Knowledge Base for Q&A Using Existing Documents? OLLama + LangChain to Assist You. There was a streamlit related to the graphical interface for the OLLama knowledge base Q&A that I didn’t write about because the code didn’t run, so today I will supplement that part. Finally, there … Read more
The author of this article is a front-end developer at 360 Qiwutuan. Introduction to Ollama Ollama is an open-source framework developed in Go that can run large models locally. Official website: https://ollama.com/ GitHub repository: https://github.com/ollama/ollama Installing Ollama Download and Install Ollama Choose the appropriate installation package based on your operating system type from the Ollama … Read more
1. Access https://ollama.com/ to download and install the Ollama application on macOS. 2. Run the corresponding model using the following command: ollama run <strong>model_name</strong> <strong>Source code link</strong> and <strong>guidelines</strong>: <strong>https://github.com/ollama/ollama</strong>
I have an AI assistant named “Lao Liu”. Why? Because it sometimes speaks nonsense seriously. That’s right, this is a drawback of large models — “hallucination”. Therefore, LLMs + knowledge base is a solution to the “hallucination” problem. At the same time, for enterprises, information security must be considered; a privately owned knowledge base obviously … Read more
Are you still troubled by the varying quality of AI in China and poor performance? Then let’s take a look at Dev Cat AI (3in1)! This is an integrated AI assistant that combines GPT-4, Claude3, and Gemini. It covers all models of the three AI tools. Including GPT-4o and Gemini flash Now you can use … Read more
In the previous article, I shared how to run Google’s GemmaLLM locally using Ollama. If you haven’t seen that article, you can click the link below to review that content. Today, I’ll share how to customize your own LLM using the Modefile mechanism provided by Ollama, and I’ll demonstrate using Gemma7B again. Google’s open-source Gemma, … Read more