← Search

Yao DU

4 accepted papers

2026

Injecting Distributional Awareness into MLLMs via Reinforcement Learning for Deep Imbalanced Regression

ICML 2026poster

Multimodal large language models (MLLMs) struggle with numerical regression under longtailed target distributions. Token-level supervised fine-tuning (SFT) and point-wise regression rewards bias learning toward high-density regions, leading to regression-to-the-mean behavior and poor tail performanc…

Cited by 0SourceScholar
2025

The Role of Visual Modality in Multimodal Mathematical Reasoning: Challenges and Insights

ACL 2025long

Recent research has increasingly focused on multimodal mathematical reasoning, particularly emphasizing the creation of relevant datasets and benchmarks. Despite this, the role of visual information in reasoning has been underexplored. Our findings show that existing multimodal mathematical models m…

Cited by 0SourcePDFScholar
2024

G2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Model

AAAI 2024technical

The Sign Language Production (SLP) project aims to automatically translate spoken languages into sign sequences. Our approach focuses on the transformation of sign gloss sequences into their corresponding sign pose sequences (G2P). In this paper, we present a novel solution for this task by converti…

2023

Semi-Supervised Contrastive Learning for Deep Regression with Ordinal Rankings from Spectral Seriation

NeurIPS 2023poster

Contrastive learning methods can be applied to deep regression by enforcing label distance relationships in feature space. However, these methods are limited to labeled data only unlike for classification, where unlabeled data can be used for contrastive pretraining. In this work, we extend contrast…