Guoyu Song

Predicting What Matters: Robust Generalist Robot Policy Learning via Future Semantic Mask

World models derived from large-scale video generative pre-training have emerged as a promising paradigm for generalist robot policy learning. However, standard approaches often focus on high-fidelity RGB video prediction, but this can result in overfitting to irrelevant factors, such as dynamic bac…