← Search

Zhang Zhiyi

3 accepted papers

2025

MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria

NAACL 2025long

Multimodal large language models (MLLMs) have broadened the scope of AI applications. Existing automatic evaluation methodologies for MLLMs are mainly limited in evaluating objective queries without considering real-world user experiences, inadequately addressing the nuances of creative and associat…

2024

CMB: A Comprehensive Medical Benchmark in Chinese

NAACL 2024long

Large Language Models (LLMs) provide a possibility to make a great breakthrough in medicine. The establishment of a standardized medical benchmark becomes a fundamental cornerstone to measure progression. However, medical environments in different regions have their local characteristics, e.g., the…

2023

HuatuoGPT, Towards Taming Language Model to Be a Doctor

EMNLP 2023long findings

In this paper, we present HuatuoGPT, a Large Language Model (LLM) for medical consultation. The core recipe of HuatuoGPT is to leverage both distilled data from **ChatGPT** and real-world data from **doctors** in the supervised fine-tuning stage. This is not only because purely using **ChatGPT**-di…

Cited by 0SourcecodeScholar