To address the challenges posed by the high computational load of Vision Transformers, various lightweight methods such as pruning and quantization have been proposed. Among them, token pruning aims ...

Since Google proposed Transformer in 2017, it has made significant natural language processing (NLP) development. However, the increasing cost is a large amount of calculation and parameters. Previous ...

Introduction Swin Transformer (the name Swin stands for S hifted win dow) is initially described in arxiv, which capably serves as a general-purpose backbone for computer vision. It is basically a ...