2023
Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings
ACL 2023long
Adaptive inference is a simple method for reducing inference costs. The method works by maintaining multiple classifiers of different capacities, and allocating resources to each test instance according to its difficulty. In this work, we compare the two main approaches for adaptive inference, Early…