← Search

Tao Gong

24 accepted papers

2026

CDICS: Delving Into Fine-Grained Attribute for In-Context Segmentation via Compositional Prompts and Phased Decoupling

CVPR 2026

In-Context Learning (ICL) has shown great effectiveness in developing generalist image segmentation models. Its significant advantage over text-based descriptions is the ability to convey intricate visual appearance details through simple reference images. However, finding a perfectly matching singl

Cited by 0SourceScholar
2026

Flora: Effortless Context Construction to Arbitrary Length and Scale

AAAI 2026technical

Effectively handling long contexts is challenging for Large Language Models (LLMs) due to the rarity of long texts, high computational demands, and substantial forgetting of short-context abilities. Recent approaches have attempted to construct long contexts for instruction tuning, but these methods

Cited by 0SourcePDFScholar
2026

GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervision

CVPR 2026

Multimodal large reasoning models (MLRMs) are increasingly deployed for vision-language tasks that produce explicit intermediate rationales. However, reasoning traces can contain unsafe content even when the final answer is non-harmful, creating deployment risks. Existing multimodal safety guards pr

Cited by 0SourcecodeScholar
2026

Learning to Focus and Precise Cropping:A Reinforcement Learning Framework with Information Gaps and Grounding Loss for MLLMs

CVPR 2026

To enhance the perception and reasoning capabilities of multimodal large language models in complex visual scenes, recent research has introduced agent-based workflows. In these works, MLLMs autonomously utilize image cropping tool to analyze regions of interest for question answering. While existin

Cited by 0SourcecodeScholar
2026

MFEN: Multi-Frequency Expert Network for Visible-Infrared Person Re-ID

CVPR 2026

Visible-infrared person re-identification (VI-ReID) is challenging due to the large modality discrepancy between visible and infrared images. We contend that this discrepancy is largely related to differing lighting conditions, including differences in light wavelength and light source type. Recentl

Cited by 0SourceScholar
2026

MagicPaint: Operate Anything for Image Inpainting with Diffusion Model

AAAI 2026technical

Recent diffusion-based models have significantly improved inpainting quality. However, existing methods struggle with multi-task inpainting due to conflicting optimization objectives, and current datasets are typically limited to task-specific scenarios, hindering joint training. To address these ch

Cited by 0SourcePDFScholar
2025

FE-CLIP: Frequency Enhanced CLIP Model for Zero-Shot Anomaly Detection and Segmentation

ICCV 2025poster

Zero-shot anomaly detection (ZSAD) requires detection models trained using auxiliary data to detect anomalies without any training sample in a target dataset. It is challenging since the models need to generalize to anomalies across different domains. Recently, CLIP-based anomaly detection methods,…

Cited by 0SourcePDFScholar
2025

MARS-Bench: A Multi-turn Athletic Real-world Scenario Benchmark for Dialogue Evaluation

EMNLP 2025

Large Language Models ( LLMs ), e.g. ChatGPT, have been widely adopted in real-world dialogue applications. However, LLMs’ robustness, especially in handling long complex dialogue sessions, including frequent motivation transfer, sophisticated cross-turn dependency, is criticized all along. Neverthe

2025

Region-Aware 6D Grasping for Industrial Bin-Picking: A Sim2Real Label Self-Generation and Hybrid Evaluation Framework

IROS 2025

The integration of high-quality datasets, a generalized network model, and robust evaluation strategies sets a significant benchmark for advancing policy development in industrial bin-picking. This paper introduces the concept of region-aware grasping, a cutting-edge simulation to reality system des

Cited by 0SourceScholar
2025

Rethinking Masked Data Reconstruction Pretraining for Strong 3D Action Representation Learning

AAAI 2025technical

In 3D human action recognition, limited supervised data makes it challenging to fully tap into the modeling potential of powerful networks such as transformers. As a result, researchers have been actively investigating effective self-supervised pre-training strategies. For example, MAMP shows that i…

Cited by 0SourcePDFScholar
2025

Span Attention for Entity-Consistent Task-Oriented Dialogue Response Generation

ICASSP 2025accepted

Task-oriented dialogue systems have recently gained increasing attention due to their capability of using natural language to fulfill specific user demands, such as restaurant reservation and hotel booking. Recent works directly model task-oriented dialogue response as a text generation task. Howeve…

Cited by 0SourceScholar
2025

Towards Anytime Retrieval: A Benchmark for Anytime Person Re-Identification

IJCAI 2025

In real applications, person re-identification (ReID) expects to retrieve the target person at any time, including both daytime and nighttime, ranging from short-term to long-term. However, existing ReID tasks and datasets cannot meet this requirement, as they are constrained by available time and o

2025

Training an Anti-KD Model that Cannot Teach Students via Similarity Disruption

ICASSP 2025accepted

Knowledge Distillation (KD) aims to enhance the performance of student models by transferring knowledge from teacher models. While reaping the benefits of KD, the intellectual property risks associated with it cannot be ignored. Even if models are released without training data or provided as a serv…

Cited by 0SourceScholar
2025

Training-free Open-Vocabulary Semantic Segmentation via Diverse Prototype Construction and Sub-region Matching

AAAI 2025technical

Open-vocabulary semantic segmentation (OVSS) aims to segment images of arbitrary categories specified by class labels. While previous approaches relied on extensive image-text pairs or dense semantic annotations, recent training-free methods attempted to overcome these limitations by constructing se…

Cited by 0SourcePDFScholar
2025

UNICL-SAM: Uncertainty-Driven In-Context Segmentation with Part Prototype Discovery

CVPR 2025poster

Recent advancements in in-context segmentation generalists have demonstrated significant success in performing various image segmentation tasks using a limited number of labeled example images. However, real-world applications present challenges due to the variability of support examples, which ofte…

Cited by 0SourcePDFScholar
2025

When Allies Turn Foes: Exploring Group Characteristics of LLM-Based Multi-Agent Collaborative Systems Under Adversarial Attacks

EMNLP 2025

This paper investigates the group characteristics in multi-agent collaborative systems under adversarial attacks. Adversarial agents are tasked with generating counterfactual answers to a given collaborative problem, while collaborative agents normally interact with other agents to solve the given p

2024

Llama SLayer 8B: Shallow Layers Hold the Key to Knowledge Injection

EMNLP 2024finding

As a manner to augment pretrained large language models (LLM), knowledge injection is critical to develop vertical domain large models and has been widely studied. While most current approaches, including parameter-efficient fine-tuning (PEFT) and block expansion methods, uniformly apply knowledge a…

2024

Prior Information-Assisted Neural Network for Point Cloud Segmentation in Human-Robot Interaction Scenarios

RA-L 2024

This letter proposes a prior information-assisted (PIA) point cloud segmentation network that can be effectively applied to point cloud segmentation applications in human-robot interaction scenario. The joint angles of the robots are used as prior information, which is fed into the network as an add

Cited by 4SourceScholar
2024

Towards More Unified In-context Visual Understanding

CVPR 2024poster

The rapid advancement of large language models (LLMs) has accelerated the emergence of in-context learning (ICL) as a cutting-edge approach in the natural language processing domain. Recently ICL has been employed in visual understanding tasks such as semantic segmentation and image captioning yield…

Cited by 12SourcePDFScholar
2021

Mining Contextual Information Beyond Image for Semantic Segmentation

ICCV 2021poster

This paper studies the context aggregation problem in semantic image segmentation. The existing researches focus on improving the pixel representations by aggregating the contextual information within individual images. Though impressive, these methods neglect the significance of the representations…

Cited by 105PDFcodeScholar
2021

Seesaw Loss for Long-Tailed Instance Segmentation

CVPR 2021poster

Instance segmentation has witnessed a remarkable progress on class-balanced benchmarks. However, they fail to perform as accurately in real-world scenarios, where the category distribution of objects naturally comes with a long tail. Instances of head classes dominate a long-tailed dataset and they…

Cited by 326PDFcodeScholar
2021

Temporal ROI Align for Video Object Recognition

AAAI 2021technical

Video object detection is challenging in the presence of appearance deterioration in certain video frames. Therefore, it is a natural choice to aggregate temporal information from other frames of the same video into the current frame. However, ROI Align, as one of the most core procedures of video d…

2020

Side-Aware Boundary Localization for More Precise Object Detection

ECCV 2020poster

Current object detection frameworks mainly rely on bounding box regression to localize objects. Despite the remarkable progress in recent years, the precision of bounding box regression remains unsatisfactory, hence limiting performance in object detection. We observe that precise localization requi…