← Search

Bowen Yao

3 accepted papers

2024

NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention

NeurIPS 2024poster

Large Language Model (LLM) inference on Central Processing Units (CPU) is challenging due to the vast quantities of Multiply-Add (MAD) matrix operations in the attention computations. This paper highlights a rare gem in modern CPUs, Single-Instruction-Multiple-Data (SIMD) registers, which allows fo…

2024

SAM-Event-Adapter: Adapting Segment Anything Model for Event-RGB Semantic Segmentation

ICRA 2024poster

Semantic segmentation, a fundamental visual task ubiquitously employed in sectors ranging from transportation and robotics to healthcare, has always captivated the research community. In the wake of rapid advancements in large model research, the foundation model for semantic segmentation tasks, ter…

Cited by 11SourceScholar