Why Are Vision Transformers Focusing on Boring Backgrounds?
#airesearch #visiontransformers #vits #imagerecognition #imageprocessing #explicitregisters #highnormoutliertokens #hackernoontopstory #hackernoones #hackernoonhi #hackernoonzh #hackernoonvi #hackernoonfr #hackernoonpt #hackernoonja
https://hackernoon.com/why-are-vision-transformers-focusing-on-boring-backgrounds
#airesearch #visiontransformers #vits #imagerecognition #imageprocessing #explicitregisters #highnormoutliertokens #hackernoontopstory #hackernoones #hackernoonhi #hackernoonzh #hackernoonvi #hackernoonfr #hackernoonpt #hackernoonja
https://hackernoon.com/why-are-vision-transformers-focusing-on-boring-backgrounds
Hackernoon
Why Are Vision Transformers Focusing on Boring Backgrounds? | HackerNoon
When visualizing the inner workings of vision transformers (ViTs), researchers noticed weird spikes of attention on random background patches.