Nadaraya-Watson Estimator

Using TensorFlow’s High-Level Estimator Interface (1)

by
Using TensorFlow's High-Level Estimator Interface (1)

In section 4.4 of the book “Practical Machine Learning Projects with TensorFlow”, the author used skflow. When skflow first came out, it was quite popular, but the interface changed very frequently, leading to a decline in its usage, which also resulted in the code from section 4.4 no longer running. However, in the recently released … Read more

Attention Mechanism in Deep Learning

by
Attention Mechanism in Deep Learning

Introduction Alexander J. Smola, the head of machine learning at Amazon Web Services, presented on the attention mechanism in deep learning at the ICML2019 conference, detailing the evolution from the earliest Nadaraya-Watson Estimator (NWE) to the latest Multiple Attention Heads. Authors | Alex Smola, Aston Zhang Translator | Xiaowen The report is divided into six … Read more