Qingshuo Guo

Does ChatGPT Know That It Does Not Know? Evaluating the Black-Box Calibration of ChatGPT

Recently, ChatGPT has demonstrated remarkable performance in various downstream tasks such as open-domain question answering, machine translation, and code generation. As a general-purpose task solver, an intriguing inquiry arises: Does ChatGPT itself know that it does not know, without any access t…