2024
PredToken: Predicting Unknown Tokens and Beyond with Coarse-to-Fine Iterative Decoding
CVPR 2024poster
Predictive learning models which aim to predict future frames based on past observations are crucial to constructing world models. These models need to maintain low-level consistency and capture high-level dynamics in unannotated spatiotemporal data. Transitioning from frame-wise to token-wise predi…