Wenchao Bai

Pricing Online LLM Services with Data-Calibrated Stackelberg Routing Game

The proliferation of Large Language Models (LLMs) has established LLM routing as a standard service delivery mechanism, where users select models based on cost, Quality of Service (QoS), among other things. However, optimal pricing in LLM routing platforms requires precise modeling for dynamic servi