← Search

Joseph K. J

7 accepted papers

2026

Crossing Borders: A Multimodal Challenge for Indian Poetry Translation and Image Generation

AAAI 2026technical

Indian poetry, known for its linguistic complexity and deep cultural resonance, has a rich and varied heritage spanning thousands of years. However, its layered meanings, cultural allusions, and sophisticated grammatical constructions often pose challenges for comprehension, especially for non-nativ

Cited by 0SourcePDFScholar
2026

Step-by-step Layered Design Generation

AAAI 2026technical

Design generation, in its essence, is a step-by-step process where designers progressively refine and enhance their work through careful modifications. Despite this fundamental characteristic, existing approaches mainly treat design synthesis as a single-step generation problem, significantly undere

Cited by 0SourcePDFScholar
2025

Do It Yourself (DIY): Modifying Images for Poems in a Zero-Shot Setting Using Weighted Prompt Manipulation

EMNLP 2025

Poetry is an expressive form of art that invites multiple interpretations, as readers often bring their own emotions, experiences, and cultural backgrounds into their understanding of a poem. Recognizing this, we aim to generate images for poems and improve these images in a zero-shot setting, enabl

Cited by 0SourcePDFScholar
2025

Poetry in Pixels: Prompt Tuning for Poem Image Generation via Diffusion Models

COLING 2025main

The task of text-to-image generation has encountered significant challenges when applied to literary works, especially poetry. Poems are a distinct form of literature, with meanings that frequently transcend beyond the literal words. To address this shortcoming, we propose a PoemToPixel framework de…

2024

POET: Prompt Offset Tuning for Continual Human Action Adaptation

ECCV 2024oral

"As extended reality (XR) is redefining how users interact with computing devices, research in human action recognition is gaining prominence. Typically, models deployed on immersive computing devices are static and limited to their default set of classes. The goal of our research is to provide user…