Sarah Rumbley

Generative Omnimatte: Learning to Decompose Video into Layers

Given a video and a set of input object masks, an omnimatte method aims to decompose the video into semantically meaningful layers containing individual objects along with their associated effects, such as shadows and reflections.Existing omnimatte methods assume a static background or accurate pose…