negative sampling

Word2Vec Algorithm Derivation & Implementation

by
Word2Vec Algorithm Derivation & Implementation

Author: Guo Bi Yang This article mainly summarizes the computational and programming problems from cs224n’s assignment 2. I found this assignment design to be excellent, progressing step by step, with both theory and practice, and a moderate level of difficulty. The overall structure feels more like a detailed tutorial. Therefore, I will review and reflect … Read more

In-Depth Analysis of the Word2Vec Model

by
In-Depth Analysis of the Word2Vec Model

“ This article provides a detailed explanation of the two structures in word2vec: CBOW and skip-gram, as well as the two optimization techniques: hierarchical softmax and negative sampling. Understanding these details and principles of the word2vec algorithm is very helpful!” Source: TianMin https://zhuanlan.zhihu.com/p/85998950 Word2vec is a lightweight neural network model that consists of an input … Read more