Self Attention

https://attentionagent.github.io/ “ there is no conscious perception of the visual world without attention to it“

http://papers.nips.cc/paper/8302-stand-alone-self-attention-in-vision-models

and the difference between them and conv nets

https://openreview.net/forum?id=HJlnC1rKPB

https://github.com/epfml/attention-cnn