Bruce McIntosh

Visual-Textual Capsule Routing for Text-Based Video Segmentation

Joint understanding of vision and natural language is a challenging problem with a wide range of applications in artificial intelligence. In this work, we focus on integration of video and text for the task of actor and action video segmentation from a sentence. We propose a capsule-based approach w…