Fangzheng Xie

Meta-Router: Bridging Gold-standard and Preference-based Evaluations in LLM Routing

In language tasks requiring extensive human-model interaction, the inference cost of large language models (LLMs) can be substantial. To reduce expenses while preserving the quality of the responses, an LLM router selects among candidate models to balance between the expected response quality and t…