Transformers in Vision: From Zero to Hero

Online event, register on the event website to receive the zoom joining link: https://www.aicamp.ai/event/eventdetails/W2021101110

Description:
Attention Is All You Need.
With these simple words, the Deep Learning industry was forever changed. Transformers were initially introduced in the field of Natural Language Processing to enhance language translation, but they demonstrated astonishing results even outside language processing. In particular, they recently spread in the Computer Vision community, advancing the state-of-the-art on many vision tasks. But what are Transformers? What is the mechanism of self-attention, and do we really need it? How did they revolutionize Computer Vision? Will they ever replace convolutional neural networks?
These and many other questions will be answered during the talk.
In this tech talk, we will discuss:
– A piece of history: Why did we need a new architecture?
– What is self-attention, and where does this concept come from?
– The Transformer architecture and its mechanisms
– Vision Transformers: An Image is worth 16×16 words
– Video Understanding using Transformers: the space + time approach
– The scale and data problem: Is Attention what we really need?
– The future of Computer Vision through Transformers