4 accepted papers
The architecture of multimodal large language models (MLLMs) commonly connects a vision encoder, often based on CLIP-ViT, to a large language model. While CLIP-ViT works well for capturing global image features, it struggles to model local relationships between adjacent patches, leading to weaker vi…
Magnetically actuated medical instruments could greatly facilitate minimally invasive surgery (MIS). For example, onboard magnetic materials help catheters travel across tortuous lumens and reach difficult-to-access sites inside human bodies, guided by a controlled magnetic field (MF). However, perm
Although Vision Transformer (ViT) has achieved significant success in computer vision it does not perform well in dense prediction tasks due to the lack of inner-patch information interaction and the limited diversity of feature scale. Most existing studies are devoted to designing vision-specific t…
"Lane detection requires adequate global information due to the simplicity of lane line features and changeable road scenes. In this paper, we propose a novel lane detection Transformer based on multi-frame input to regress the parameters of lanes under a lane shape modeling. We design a Multi-frame…