GCNet: Integrating Non-Local and SENet Attention Mechanisms

GCNet: Integrating Non-Local and SENet Attention Mechanisms

Introduction: Previously, SENet and Non-Local Neural Network (NLNet) were introduced, both of which are effective attention modules. The author found that the attention maps in NLNet respond almost consistently at different positions, and after integrating with SENet, proposed the Global Context block for global context modeling, achieving better results than SENet and NLNet in mainstream … Read more