Shreyank Jyoti

ViNet: Pushing the limits of Visual Modality for Audio-Visual Saliency Prediction

We propose the ViNet architecture for audio-visual saliency prediction. ViNet is a fully convolutional encoder-decoder architecture. The encoder uses visual features from a network trained for action recognition, and the decoder infers a saliency map via trilinear interpolation and 3D convolutions,…