← Search

Nghiem Tuong Diep

3 accepted papers

2025

ExGra-Med: Extended Context Graph Alignment for Medical Vision-Language Models

NeurIPS 2025poster

State-of-the-art medical multi-modal LLMs (med-MLLMs), such as LLaVA-Med and BioMedGPT, primarily depend on scaling model size and data volume, with training driven largely by autoregressive objectives. However, we reveal that this approach can lead to weak vision-language alignment, making these mo…

Cited by 0SourceScholar
2025

On Zero-Initialized Attention: Optimal Prompt and Gating Factor Estimation

ICML 2025poster

LLaMA-Adapter has recently emerged as an efficient fine-tuning technique for LLaMA models, leveraging zero-initialized attention to stabilize training and enhance performance. However, despite its empirical success, the theoretical foundations of zero-initialized attention remain largely unexplored.…

Cited by 1SourcePDFScholar
2023

LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matching

NeurIPS 2023poster

Obtaining large pre-trained models that can be fine-tuned to new tasks with limited annotated samples has remained an open challenge for medical imaging data. While pre-trained networks on ImageNet and vision-language foundation models trained on web-scale data are the prevailing approaches, their e…