Ruty Rinott

Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefix

Many real-world applications require making multiple predictions from the same text. Fine-tuning a large pre-trained language model for each downstream task causes computational burdens in the inference time due to several times of forward passes. To amortize the computational cost, freezing the lan…