← Search

Ruofan Hu

4 accepted papers

2026

SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation

CVPR 2026

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to fine-grained spatial relationships, often producing images that appear

Cited by 0SourcecodeScholar
2025

VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words?

ICLR 2025poster

With the rapid advancement of large models, voice assistants are gradually acquiring the ability to engage in open-ended daily conversations with humans. However, current spoken dialogue systems often overlook multi-modal information in audio beyond text, such as speech rate, volume, emphasis, and b…

2024

InstructSpeech: Following Speech Editing Instructions via Large Language Models

ICML 2024poster

Instruction-guided speech editing aims to follow the user's natural language instruction to manipulate the semantic and acoustic attributes of a speech. In this work, we construct triplet paired data (instruction, input speech, output speech) to alleviate data scarcity and train a multi-task large l…

2024

Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt

NAACL 2024long

Recent singing-voice-synthesis (SVS) methods have achieved remarkable audio quality and naturalness, yet they lack the capability to control the style attributes of the synthesized singing explicitly. We propose Prompt-Singer, the first SVS method that enables attribute controlling on singer gender,…