Xi Xiaoyao Technology Says Original Author | Xie Nian Nian When constructing multimodal large models, there are many effective tricks, such as using cross-attention mechanisms to integrate image information into language models or directly combining image hidden state sequences with text embedding sequences as inputs to the language model. However, the reasons why these tricks … Read more
Introduction In this article, I will explore a common practice in representation learning—using the frozen states of pre-trained neural networks as feature extractors. Specifically, I am interested in comparing the performance of simple models trained using these extracted neural network features with that of fine-tuned neural networks initialized with transfer learning. The intended audience is … Read more
This Article Covers The main contents of this article include: What is Hugging Face and what does it offer Using Hugging Face models (Transformers library) Using Hugging Face datasets (Datasets library) Introduction to Hugging Face Similar to GitHub, Hugging Face is a hub (community). It can be considered the GitHub of the machine learning world. … Read more
You may have heard of the concept of word embedding, which represents semantics using numerical vectors. The closer the numerical vectors are, the more similar the corresponding statements or words are in meaning. LlamaIndex also uses embeddings to represent documents. The embedding model takes text as input and returns a long string of numbers that … Read more
Source：DeepHuhb IMBA This articleis about 4800 words and is recommended to be read in9minutes This article introduces Stable Diffusion, a latent diffusion model for text-to-image generation, along with a tutorial on its usage. Stable Diffusion is a latent diffusion model for text-to-image generation, created by researchers and engineers from CompVis, Stability AI, and LAION. It … Read more
Easy Guide to Run LLaMA2 Locally Want to play around with the famous LLaMA2 locally? No problem, this guide is just for you. I promise, it’s not one of those long-winded articles that give you a headache, but rather straightforward practical tips. Don’t worry, it’s much simpler than you think! First, you need an environment … Read more
The latest online sharing session by Machine Heart invited Song Kaitao, a researcher at Microsoft Research Asia, to share their recent open-source project JARVIS. Recently, large language models (LLMs), represented by ChatGPT, have garnered significant attention in both industry and academia. However, LLMs, which primarily handle text, still face numerous bottlenecks when addressing many complex … Read more
Since the advent of ChatGPT, various GPTs have emerged. Recently, Microsoft launched HuggingGPT and open-sourced the corresponding project on GitHub – Jarvis. Just these two points are enough to pique the public’s interest. Today’s article will simply interpret HuggingGPT, specifically the paper – HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face[1]. … Read more
(You need to download ComfyUI first, I recommend looking at the previous SVD article) What! Are there still experts? (AI Drawing: Basic Installation and Use of ComfyUI) Actually, during my previous learning of Stable Diffusion, I learned about AI video generation tools like Runway Gen2 and Pika, which, while useful, require payment. A monthly subscription … Read more
Milvus Vector Database The previous article introduced the installation and deployment of the Milvus vector database. This time, we will introduce an application example of Milvus. With the similarity search feature of Milvus, there are many applicable scenarios: • Image similarity search: Images can be searched and the most similar images can be returned immediately … Read more