Time Series

Do RNN and LSTM Have Long-Term Memory?

by
Do RNN and LSTM Have Long-Term Memory?

This article introduces the ICML 2020 paper “Do RNN and LSTM have Long Memory?“. The authors of the paper are from Huawei Noah’s Ark Lab and the University of Hong Kong.. Author | Noah’s Ark Lab Editor | Cong Mo Paper link: https://arxiv.org/abs/2006.03860 1 Introduction To overcome the difficulties of Recurrent Neural Networks (RNNs) in … Read more

Understanding RNN (Recurrent Neural Networks)

by
Understanding RNN (Recurrent Neural Networks)

0. Introduction After reading many blog posts and tutorials about RNN online, I felt they were all the same, providing a vague understanding but failing to explain it clearly. RNN is the foundation of many complex models, and even in transformers, you can see the influence of RNN, so it is essential to have a … Read more