← Search

Zhehao Zhang

11 accepted papers

2026

VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-use

AAAI 2026technical

While vision-language models (VLMs) have demonstrated remarkable performance across various tasks combining textual and visual information, they continue to struggle with fine-grained visual perception tasks that require detailed pixel-level analysis. Effectively eliciting comprehensive reasoning fr

Cited by 0SourcePDFScholar
2026

When Actions Go Off-Task: Detecting and Correcting Misaligned Actions in Computer-Use Agents

ICML 2026poster

Computer-use agents (CUAs) have made tremendous progress in the past year, yet they still frequently produce misaligned actions that deviate from the user's original intent. Such misaligned actions may arise from external attacks (e.g., indirect prompt injection) or from internal limitations (e.g., …

Cited by 0SourceScholar
2026

When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agents

ICML 2026poster

Although computer-use agents (CUAs) hold significant potential to automate increasingly complex OS workflows, they can demonstrate unsafe unintended behaviors that deviate from expected outcomes even under benign input contexts. However, exploration of this risk remains largely anecdotal, lacking co…

Cited by 0SourceScholar
2025

From Selection to Generation: A Survey of LLM-based Active Learning

ACL 2025long

Active Learning (AL) has been a powerful paradigm for improving model efficiency and performance by selecting the most informative data points for labeling and training. In recent active learning frameworks, Large Language Models (LLMs) have been employed not only for selection but also for generati…

Cited by 0SourcePDFScholar
2024

DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph

NeurIPS 2024poster

The current paradigm of evaluating Large Language Models (LLMs) through static benchmarks comes with significant limitations, such as vulnerability to data contamination and a lack of adaptability to the evolving capabilities of LLMs. Therefore, evaluation methods that can adapt and generate evaluat…

2024

E5: Zero-shot Hierarchical Table Analysis using Augmented LLMs via Explain, Extract, Execute, Exhibit and Extrapolate

NAACL 2024long

Analyzing large hierarchical tables with multi-level headers presents challenges due to their complex structure, implicit semantics, and calculation relationships. While recent advancements in large language models (LLMs) have shown promise in flat table analysis, their application to hierarchical t…

2024

Exploring Soft Prompt Initialization Strategy for Few-Shot Continual Text Classification

ICASSP 2024accepted

Few-shot continual learning (FSCL) is a challenging setting as it requires models to learn new knowledge with a few examples over time, and fast adapt to new tasks without forgetting previous knowledge. Prompt-tuning, as an efficient learning approach for language models, has shown competitive perfo…

Cited by 0SourceScholar
2024

Is GPT-4V (ision) All You Need for Automating Academic Data Visualization? Exploring Vision-Language Models’ Capability in Reproducing Academic Charts

EMNLP 2024finding

While effective data visualization is crucial to present complex information in academic research, its creation demands significant expertise in both data management and graphic design. We explore the potential of using Vision-Language Models (VLMs) in automating the creation of data visualizations…

Cited by 2SourcePDFScholar
2023

CRT-QA: A Dataset of Complex Reasoning Question Answering over Tabular Data

EMNLP 2023long main

Large language models (LLMs) show powerful reasoning abilities on various text-based tasks. However, their reasoning capability on structured data such as tables has not been systematically explored. In this work, we first establish a comprehensive taxonomy of reasoning and operation types for tabu…

Cited by 0SourceScholar