Qwen 1.5 Open Source! Best Practices for Magic Adaptation!

Qwen 1.5 Open Source! Best Practices for Magic Adaptation!

In recent months, the Tongyi Qianwen team has been working hard to explore how to build a ‘good’ model while optimizing the developer experience. Just before the Chinese New Year, the Tongyi Qianwen team shared the next version of the Qwen open-source series, Qwen 1.5. Qwen 1.5 has open-sourced six sizes of foundational and chat … Read more

A Powerful Python Library: Call GPT-4 with One Line of Code!

A Powerful Python Library: Call GPT-4 with One Line of Code!

Hello everyone! Today I want to reveal an AI gem in the Python world——Hugging Face’s transformers library! This library is like having a legion of AI assistants, specifically designed to call various top AI models. Using transformers is simply the Swiss Army knife of AI development! Come on, let’s explore the magical charm of the … Read more

Cohere’s Open Source 35B Model Surpasses Mixtral in RAG and Tool Capabilities

Cohere's Open Source 35B Model Surpasses Mixtral in RAG and Tool Capabilities

https://txt.cohere.com/command-r/ https://huggingface.co/CohereForAI/c4ai-command-r-v01 1. RAG Performance On multiple datasets, it far exceeds the Mixtral MoE model. By using their own embeddings and reranking, it significantly outperforms open-source models. 2. Tool Capabilities The tool capabilities are slightly better than Mixtral and significantly outperform GPT-3.5. 3. Multilingual Capabilities Supports English, French, Spanish, Italian, German, Brazilian Portuguese, Japanese, Korean, … Read more

Introduction to Transformers in NLP

Introduction to Transformers in NLP

Recently, Hugging Face has a very popular book titled “nlp-with-transformers”, and we will be updating practical tutorials related to transformers, so let’s get hands-on learning! Original text: https://www.oreilly.com/library/view/natural-language-processing/9781098103231/ch01.html Warning ahead, there will be a strong flavor of translation, so please enjoy while it’s fresh. Hello Transformers In 2017, researchers at Google published a paper proposing … Read more

High-Speed Download of HuggingFace Models in China

High-Speed Download of HuggingFace Models in China

Author: Apathy Link: https://zhuanlan.zhihu.com/p/669120427 Note: This article has been tested and is effective, highly recommended. Users in China can use the official HuggingFace download tool huggingface-cli and hf_transfer to download models and datasets from the HuggingFace mirror site at high speed. HuggingFace-Download-Acceleratorgithub.com/LetheSec/HuggingFace-Download-Accelerator Quick Start 1. Clone the project to your local machine: git clone https://github.com/LetheSec/HuggingFace-Download-Accelerator.git … Read more

Unlocking the Magic of Natural Language Processing with HuggingFace Transformers

Unlocking the Magic of Natural Language Processing with HuggingFace Transformers

Embark on a Journey of Natural Language Magic with Python and HuggingFace Transformers, Unlocking Infinite Text Possibilities Hey there, Python newbies and enthusiasts! Today, we are going to explore a super powerful Python library in the field of natural language processing — HuggingFace Transformers. It’s like a treasure chest full of magical tools that helps … Read more

Running HuggingFace DeepSeek V2 on Single Node A800

Running HuggingFace DeepSeek V2 on Single Node A800

0x0. Background Trying to run the DeepSeek V2 released on HuggingFace, I encountered several issues. Here are the solutions. The open-source DeepSeek V2 repo link provided by HuggingFace is: https://huggingface.co/deepseek-ai/DeepSeek-V2 0x1. Error 1: KeyError: ‘sdpa’ This issue has also been reported by the community. https://huggingface.co/deepseek-ai/DeepSeek-V2/discussions/3 Insert image description here The solution is quite simple; just … Read more

Getting Started with Hugging Face

Getting Started with Hugging Face

This Article Covers The main contents of this article include: What is Hugging Face and what does it offer Using Hugging Face models (Transformers library) Using Hugging Face datasets (Datasets library) Introduction to Hugging Face Similar to GitHub, Hugging Face is a hub (community). It can be considered the GitHub of the machine learning world. … Read more

Detailed Explanation of HuggingFace BERT Source Code

Detailed Explanation of HuggingFace BERT Source Code

Follow the official account “ML_NLP“ Set as “Starred“, heavy content delivered first-hand! Reprinted from | PaperWeekly ©PaperWeekly Original · Author | Li Luoqiu School | Master’s Student at Zhejiang University Research Direction | Natural Language Processing, Knowledge Graphs This article records my understanding of the code in the HuggingFace open-source Transformers project. As we all … Read more

Understanding Transformers: A Comprehensive Guide

Understanding Transformers: A Comprehensive Guide

This article is the first in a series produced by Big Data Digest and Baidu NLP. Baidu NLP is committed to the mission of “understanding language, possessing intelligence, and changing the world”. It conducts technical research and product applications in areas including natural language processing, machine learning, and data mining, leading the development of artificial … Read more