Affordance RAG: Hierarchical Multimodal Retrieval With Affordance-Aware Embodied Memory for Mobile Manipulation
In this study, we address the problem of openvocabulary mobile manipulation, where a robot is required to carry a wide range of objects to receptacles based on freeform natural language instructions. This task is challenging, as it involves understanding visual semantics and the affordance of manipu