Transforming Qwen Architecture to Deepseek and Reproducing R1 Plan

Transforming Qwen Architecture to Deepseek and Reproducing R1 Plan

MLNLP community is a well-known machine learning and natural language processing community in China and abroad, covering NLP graduate students, university teachers, and corporate researchers. The Vision of the Community is to promote communication and progress between the academic and industrial circles of natural language processing and machine learning, especially for beginners. Source | Zhihu … Read more

Summary of Contrastive Learning Papers from ACL 2021

Summary of Contrastive Learning Papers from ACL 2021

MLNLP(Machine Learning Algorithms and Natural Language Processing) community is one of the largest natural language processing communities both domestically and internationally, gathering over 500,000 subscribers, with an audience covering NLP master’s and PhD students, university teachers, and corporate researchers. The Vision of the Community is to promote communication and progress between academia, industry, and enthusiasts … Read more

The Intricate Mathematics Behind Word Vectors

The Intricate Mathematics Behind Word Vectors

Follow the WeChat public account “ML_NLP“ Set as “Starred“, heavy content delivered to you first! From | Zhihu Address | https://zhuanlan.zhihu.com/p/270210535 Author | Pan Xiaoxiao Editor | Machine Learning Algorithms and Natural Language Processing WeChat public account This article is for academic sharing only. If there is any infringement, please contact us to delete the … Read more

Application Of Large-Scale Pre-trained Models In Quantitative Investment (Part 1)

Application Of Large-Scale Pre-trained Models In Quantitative Investment (Part 1)

Application of Large-Scale Pre-trained Models in Quantitative Investment (Part 1) Research Unit: Taiping Asset Management Co., Ltd. Project Leader: Wang Zhenzhou Project Team Members: Wang Teng, Yi Chao, Zuo Wenting, Hu Qiang, Yu Hui Abstract: This project deeply explores the application of large-scale pre-trained models in the field of quantitative investment, mainly addressing several key … Read more

Economic Sentiment Analysis Based on 200 Years of News Text

Economic Sentiment Analysis Based on 200 Years of News Text

Using text from 200 million pages of 13,000 local US newspapers and machine learning methods, we constructed a measure of economic sentiment at national and state levels that spans 170 years, extending existing indicators in both time series and cross-section. Even after controlling for common predictive factors and monetary policy decisions, our measure can still … Read more

Understanding Self-Supervised Learning

Understanding Self-Supervised Learning

Self-Supervised Learning is a popular research area in recent years. It aims to extract the inherent representation features of unlabeled data by designing auxiliary tasks as supervisory signals, thereby enhancing the model’s feature extraction capabilities. Today, let’s explore what self-supervised learning is! 01 What is Self-Supervised Learning? Machine learning can be classified into supervised learning, … Read more

Comprehensive Collection of Chinese NLP Datasets, Platforms, and Tools

Comprehensive Collection of Chinese NLP Datasets, Platforms, and Tools

Follow the public account “ML_NLP“ Set as “Starred“, heavy content delivered to you first! Source: Deep Learning and NLP This resource organizes a large number of datasets for text classification, entity recognition & part-of-speech tagging, search matching, recommendation systems, coreference resolution, encyclopedia data, pre-trained word vectors or models, Chinese Cloze tests, and more. The content … Read more

NLP Language Expression Techniques: Returning to Objectivity Through Questions

NLP Language Expression Techniques: Returning to Objectivity Through Questions

Induction 1: Overgeneralization The speaker assumes that all similar situations will be the same based on one experience. This prevents the speaker from seeing the various possibilities and opportunities, and the speech conveys an “absolute” meaning. Example “He can never have a proper conversation with me.” The speaker may have drawn this sweeping negative conclusion … Read more

Notes on Papers in Natural Language Processing

Notes on Papers in Natural Language Processing

This article is reprinted with permission from the WeChat official account Paper Weekly (ID: paperweekly). Paperweekly shares interesting papers in the field of natural language processing every week. Introduction Dialogue systems are currently a hot research topic and a hotspot for venture capital. Since early 2016, countless companies have been established to create chatbots, voice … Read more

Quickly Understand What NLP Is in 3 Minutes!

Quickly Understand What NLP Is in 3 Minutes!

N Neuro refers to the nervous system, meaning how the brain influences people’s thinking processes through the nervous system. L Linguistic refers to language, which includes both verbal and non-verbal communication, indicating how people’s language and non-verbal cues influence the process from sensory signal input to meaning construction. P Programming refers to a set of … Read more