← Search

Miaojing Shi

17 accepted papers

2026

Bootstrapping MLLM for Weakly‑Supervised Class‑Agnostic Object Counting

ICLR 2026poster

Object counting is a fundamental task in computer vision, with broad applicability in many real-world scenarios. Fully-supervised counting methods require costly point-level annotations per object. Few weakly-supervised methods leverage only image-level object counts as supervision and achieve fairl…

Cited by 0SourcecodeScholar
2026

FAAR: Efficient Frequency-Aware Multi-Task Fine-Tuning via Automatic Rank Selection

CVPR 2026

Adapting models pre-trained on large-scale datasets is a proven way to reach strong performance quickly for downstream tasks. However, the growth of state-of-the-art models makes traditional full fine-tuning unsuitable and difficult, especially for multi-task learning (MTL) where cost scales with th

Cited by 0SourceScholar
2026

PDAgent: An LLM-Driven Autonomous Agent Framework Towards *In Silico* Protein Design via Directed Mutation

ICML 2026poster

Computational protein design holds immense promise across diverse domains, but existing approaches face significant challenges: traditional physics-based methods require substantial domain expertise, while emerging deep learning methods often rely on restricted functional ontologies, struggle to bri…

Cited by 0SourceScholar
2025

Enhancing Generalized Few-Shot Semantic Segmentation via Effective Knowledge Transfer

AAAI 2025technical

Generalized few-shot semantic segmentation (GFSS) aims to segment objects of both base and novel classes, using sufficient samples of base classes and few samples of novel classes. Representative GFSS approaches typically employ a two-phase training scheme, involving base class pre-training followed…

2025

Learning Flow Fields in Attention for Controllable Person Image Generation

CVPR 2025poster

Controllable person image generation aims to generate a person image conditioned on reference images, allowing precise control over the person's appearance or pose.However, prior methods often distort fine-grained textural details from the reference image, despite achieving high overall image qualit…

2024

Boosting Object Detection with Zero-Shot Day-Night Domain Adaptation

CVPR 2024poster

Detecting objects in low-light scenarios presents a persistent challenge as detectors trained on well-lit data exhibit significant performance degradation on low-light data due to low visibility. Previous methods mitigate this issue by exploring image enhancement or object detection techniques with…

2024

LoSh: Long-Short Text Joint Prediction Network for Referring Video Object Segmentation

CVPR 2024poster

Referring video object segmentation (RVOS) aims to segment the target instance referred by a given text expression in a video clip. The text expression normally contains sophisticated description of the instance's appearance action and relation with others. It is therefore rather difficult for a RVO…

2023

HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generation

ICCV 2023poster

Panoptic Scene Graph generation (PSG) is a recently proposed task in image scene understanding that aims to segment the image and extract triplets of subjects, objects and their relations to build a scene graph. This task is particularly challenging for two reasons. First, it suffers from a long-tai…

Cited by 23PDFcodeScholar
2023

Text Promptable Surgical Instrument Segmentation with Vision-Language Models

NeurIPS 2023poster

In this paper, we propose a novel text promptable surgical instrument segmentation approach to overcome challenges associated with diversity and differentiation of surgical instruments in minimally invasive surgeries. We redefine the task as text promptable, thereby enabling a more nuanced comprehen…

2022

Learning To Prompt for Open-Vocabulary Object Detection With Vision-Language Model

CVPR 2022poster

Recently, vision-language pre-training shows great potential in open-vocabulary object detection, where detectors trained on base classes are devised for detecting new classes. The class text embedding is firstly generated by feeding prompts to the text encoder of a pre-trained vision-language model…

Cited by 398PDFcodeScholar
2020

Restoring Negative Information in Few-Shot Object Detection

NeurIPS 2020poster

Few-shot learning has recently emerged as a new challenge in the deep learning field: unlike conventional methods that train the deep neural networks (DNNs) with a large number of labeled data, it asks for the generalization of DNNs on new classes with few annotated samples. Recent advances in few-s…