Hatzky

A deep dive into the application of the transformer architecture and its self-attention operation for visionImage created by author using craiyon AIWhile self-attention is already widely adopted in NLP and significantly contributes to the performance of state-of-the-art models (e.g. , ), more and more work is being done to achieve similar results in vision.Even though, there are hybrid approaches that combine for example CNNs with attention or apply linear transformations on patches of the image , a pure attention-based…