2024
Are Bert Family Good Instruction Followers? A Study on Their Potential And Limitations
ICLR 2024poster
Language modeling at scale has proven very effective and brought unprecedented success to natural language models. Many typical representatives, especially decoder-only models, e.g., BLOOM and LLaMA, and encoder-decoder models, e.g., Flan-T5 and AlexaTM, have exhibited incredible instruction-followi…