Lingjun Mao — accepted AI-conference papers

2024

Biomedical Visual Instruction Tuning with Clinician Preference Alignment

Hejie Cui, Lingjun Mao, Xin LIANG, Jieyu Zhang, Hui Ren, Quanzheng Li +2

NeurIPS 2024poster

Recent advancements in multimodal foundation models have showcased impressive capabilities in understanding and reasoning with visual and textual information. Adapting these foundation models trained for general usage to specialized domains like biomedicine requires large-scale domain-specific instr…

Cited by 6 Source ↗PDF ↗code ↗Scholar ↗

2024

Grounding Language in Multi-Perspective Referential Communication

Zineng Tang, Lingjun Mao, Alane Suhr

EMNLP 2024main

We introduce a task and dataset for referring expression generation and comprehension in multi-agent embodied environments.In this task, two agents in a shared scene must take into account one another’s visual perspective, which may be different from their own, to both produce and understand referen…

Cited by 2 Source ↗PDF ↗code ↗Scholar ↗