The Temporal Trap: Entanglement in Pre-Trained Visual Representations for Visuomotor Policy Learning
The integration of pre-trained visual representations (PVRs) has significantly advanced visuomotor policy learning. However, effectively leveraging these models remains a challenge. We identify temporal entanglement as a critical, inherent issue when using these time-invariant models in sequential d…