Comprehensive Explanation of Gaussian Mixture Model (GMM)

Comprehensive Explanation of Gaussian Mixture Model (GMM)

Hello everyone~ Today we are going to talk about a probabilistic model – Gaussian Mixture Model (GMM). Gaussian Mixture Model is like a complex fuzzy grouping mechanism, believing that a dataset is actually composed of multiple “small groups,” where things within each “small group” are roughly distributed according to a bell curve (Gaussian distribution). You … Read more

Introducing HyperAttention: A New Approximate Attention Mechanism

Introducing HyperAttention: A New Approximate Attention Mechanism

Original Source: Machine Heart Edited by: Big Plate Chicken This article introduces a new research on an approximate attention mechanism, HyperAttention, proposed by institutions such as Yale University and Google Research, which accelerates inference time for ChatGLM2 with a context length of 32k by 50%. Transformers have been successfully applied to various learning tasks in … Read more