AAAI 2026technical0 citations
MemoVision: A Digital Catalog for Everyday Interactions
Lai Xing Ng, Keith Tien Wei Tang, Jacky Jie Wei Tan
Abstract
We present MemoVision, a digital catalog system that captures semantic, spatial, temporal and interaction information as users move around physical environments using client devices such as smart glasses. The system utilizes open-vocabulary semantic segmentation and 3D scans to store objects-of-interest with comprehensive semantic, spatial, temporal and interaction labels. Our demonstration shows multimodal information query and retrieval capabilities, supporting specific queries about object locations, temporal events and user interactions including eye gaze and hand poses, enabling more contextualized responses compared to current multimodal large language models.
BibTeX
@inproceedings{aaai2026_memovisionadigit,
title = {MemoVision: A Digital Catalog for Everyday Interactions},
author = {Lai Xing Ng and Keith Tien Wei Tang and Jacky Jie Wei Tan},
booktitle = {AAAI 2026},
year = {2026}
}