Bosheng Liu

Improving Efficiency in Large Language Models via Extendable Block Floating Point Representation

Large language models (LLMs) have revolutionized natural language processing (NLP) tasks, yet their increasing size poses substantial challenges in terms of computational and memory resources. Block floating-point (BFP) arithmetic offers an effective solution by leveraging the strengths of both floa…