← Search

An Xiao

4 accepted papers

2024

CSLM: A Framework for Question Answering Dataset Generation through Collaborative Small Language Models

EMNLP 2024finding

Collecting high-quality question-answer (QA) pairs is vital for the training of large language models (LLMs), yet this process is traditionally laborious and time-intensive. With the rapid evolution of LLMs, the potential for leveraging these models to autonomously generate QA pairs has become appar…

Cited by 0SourcePDFScholar
2021

Augmented Shortcuts for Vision Transformers

NeurIPS 2021poster

Transformer models have achieved great progress on computer vision tasks recently. The rapid development of vision transformers is mainly contributed by their high representation ability for extracting informative features from input images. However, the mainstream transformer models are designed wi…

2020

Circumventing Outliers of AutoAugment with Knowledge Distillation

ECCV 2020poster

AutoAugment has been a powerful algorithm that improves the accuracy of many vision tasks, yet it is sensitive to the operator space as well as hyper-parameters, and an improper setting may degenerate network optimization. This paper delves deep into the working mechanism, and reveals that AutoAugme…

Cited by 76SourcePDFScholar