← Search

Nikita Srivatsan

3 accepted papers

2024

Alt-Text with Context: Improving Accessibility for Images on Twitter

ICLR 2024poster

In this work we present an approach for generating alternative text (or alt-text) descriptions for images shared on social media, specifically Twitter. More than just a special case of image captioning, alt-text is both more literally descriptive and context-specific. Also critically, images posted…

Cited by 5SourcePDFScholar
2024

Retrieval Guided Music Captioning via Multimodal Prefixes

IJCAI 2024poster

In this paper we put forward a new approach to music captioning, the task of automatically generating natural language descriptions for songs. These descriptions are useful both for categorization and analysis, and also from an accessibility standpoint as they form an important component of closed c…

2021

Scalable Font Reconstruction with Dual Latent Manifolds

EMNLP 2021main

We propose a deep generative model that performs typography analysis and font reconstruction by learning disentangled manifolds of both font style and character shape. Our approach enables us to massively scale up the number of character types we can effectively model compared to previous methods. S…