Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers
Paper
•
2311.10642
•
Published
•
26
Danilo Dordevic
danilodjor
AI & ML interests
Deep learning, Vision Transformers, GNNs
Organizations
None yet
authored
a
paper
about 2 years ago