Ming Kuang

MORE-3S:Multimodal-based Offline Reinforcement Learning with Shared Semantic Spaces

Drawing upon the intuition that aligning different modalities to the same semantic embedding space would allow models to understand states and actions more easily, we propose a new perspective to the offline reinforcement learning (RL) challenge. More concretely, we transform it into a supervised le…