Xian Lin

DTMFormer: Dynamic Token Merging for Boosting Transformer-Based Medical Image Segmentation

Despite the great potential in capturing long-range dependency, one rarely-explored underlying issue of transformer in medical image segmentation is attention collapse, making it often degenerate into a bypass module in CNN-Transformer hybrid architectures. This is due to the high computational comp…