← Search

Junjie Shan

5 accepted papers

2026

TRivia: Self-supervised Fine-tuning of Vision-Language Models for Table Recognition

CVPR 2026

Table recognition (TR) aims to transform table images into semi-structured representations such as HTML or Markdown.As a core component of document parsing, TR has long relied on supervised learning, with recent efforts dominated by fine-tuning vision-language models (VLMs) using labeled data.While

Cited by 0SourcecodeScholar
2025

Geminio: Language-Guided Gradient Inversion Attacks in Federated Learning

ICCV 2025poster

Foundation models that bridge vision and language have made significant progress. While they have inspired many life-enriching applications, their potential for abuse in creating new threats remains largely unexplored. In this paper, we reveal that vision-language models (VLMs) can be weaponized to…

2024

SaProt: Protein Language Modeling with Structure-aware Vocabulary

ICLR 2024spotlight

Large-scale protein language models (PLMs), such as the ESM family, have achieved remarkable performance in various downstream tasks related to protein structure and function by undergoing unsupervised training on residue sequences. They have become essential tools for researchers and practitioners…

2024

StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback

ACL 2024long

The advancement of large language models (LLMs) has significantly propelled the field of code generation. Previous work integrated reinforcement learning (RL) with compiler feedback for exploring the output space of LLMs to enhance code generation quality. However, the lengthy code generated by LLMs…

2022

Decorrelate Irrelevant, Purify Relevant: Overcome Textual Spurious Correlations from a Feature Perspective

COLING 2022main

Natural language understanding (NLU) models tend to rely on spurious correlations (i.e., dataset bias) to achieve high performance on in-distribution datasets but poor performance on out-of-distribution ones. Most of the existing debiasing methods often identify and weaken these samples with biased…