Can The Attention Mechanism Be Interpreted?
Source: Harbin Institute of Technology SCIR This article is about 9300 words, recommended reading 10+ minutes. This article will explore the interpretability of the attention mechanism. Introduction Since Bahdanau introduced Attention as soft alignment in neural machine translation in 2014, a large number of natural language processing works have regarded it as an important module … Read more