Efficient Segment Anything with Depth-Aware Fusion and Limited Training Data

Yiming Zhou; Xuanjie Xie; Panfeng Li; Albrecht Kunz; Xavier Maldague

ICASSP 2026oral0 citations

Efficient Segment Anything with Depth-Aware Fusion and Limited Training Data

Yiming Zhou, Xuanjie Xie, Panfeng Li, Albrecht Kunz, Xavier Maldague

Abstract

Segment Anything Models (SAM) achieve impressive universal segmentation performance but require massive datasets (e.g., 11M images) and rely solely on RGB inputs. Recent efficient variants reduce computation but still depend on large-scale training. We propose a lightweight RGB-D fusion framework that augments EfficientViT-SAM with monocular depth priors. Depth maps are generated with a pretrained estimator and fused mid-level with RGB features through a dedicated depth encoder. Trained on only 11.2k samples (less than 0.1\% of SA-1B), our method achieves higher accuracy than EfficientViT-SAM, showing that depth cues provide strong geometric priors for segmentation.

BibTeX

@inproceedings{icassp2026_efficientsegment,
  title = {Efficient Segment Anything with Depth-Aware Fusion and Limited Training Data},
  author = {Yiming Zhou and Xuanjie Xie and Panfeng Li and Albrecht Kunz and Xavier Maldague},
  booktitle = {ICASSP 2026},
  year = {2026}
}