Injae Na

Automatic Transmission for LLM Tiers: Optimizing Cost and Accuracy in Large Language Models

LLM providers typically offer multiple LLM tiers, varying in performance and price. As NLP tasks become more complex and modularized, selecting the suitable LLM tier for each subtask is a key challenge to balance between cost and performance. To address the problem, we introduce LLM Automatic Transm…