← Search

Pengguang Chen

9 accepted papers

2025

MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation

ICLR 2025poster

In this work, we introduce a novel evaluation paradigm for Large Language Models (LLMs) that compels them to transition from a traditional question-answering role, akin to a student, to a solution-scoring role, akin to a teacher. This paradigm, focusing on "reasoning about reasoning," termed meta-re…

Cited by 13SourcePDFScholar
2024

Defect Spectrum: A Granular Look of Large-scale Defect Datasets with Rich Semantics

ECCV 2024poster

"Defect inspection is paramount within the closed-loop manufacturing system. However, existing datasets for defect inspection often lack the precision and semantic granularity required for practical applications. In this paper, we introduce the Defect Spectrum, a comprehensive benchmark that offers…

2024

MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMs

NeurIPS 2024poster

Large language models (LLMs) have shown increasing capability in problem-solving and decision-making, largely based on the step-by-step chain-of-thought reasoning processes. However, evaluating these reasoning abilities has become increasingly challenging. Existing outcome-based benchmarks are begin…

Cited by 14SourcePDFScholar
2024

MTMamba: Enhancing Multi-Task Dense Scene Understanding by Mamba-Based Decoders

ECCV 2024poster

"Multi-task dense scene understanding, which learns a model for multiple dense prediction tasks, has a wide range of application scenarios. Modeling long-range dependency and enhancing cross-task interactions are crucial to multi-task dense prediction. In this paper, we propose MTMamba, a novel Mamb…

2023

Rethinking Out-of-Distribution (OOD) Detection: Masked Image Modeling Is All You Need

CVPR 2023poster

The core of out-of-distribution (OOD) detection is to learn the in-distribution (ID) representation, which is distinguishable from OOD samples. Previous work applied recognition-based methods to learn the ID features, which tend to learn shortcuts instead of comprehensive representations. In this wo…

2021

Deep Structured Instance Graph for Distilling Object Detectors

ICCV 2021poster

Effectively structuring deep knowledge plays a pivotal role in transfer from teacher to student, especially in semantic vision tasks. In this paper, we present a simple knowledge structure to exploit and encode information inside the detection system to facilitate detector knowledge distillation. Sp…

Cited by 18PDFcodeScholar