← Search

Xuezhi Fang

2 accepted papers

2026

Unified Episodic and Semantic Memory via Modulating Transformer FeedForward Layers

ICML 2026poster

It is widely recognized that, after generative pre-training, Transformer FeedForward layers implicitly function as semantic memory, encoding linguistic and factual knowledge, while the contexts in key–value (KV) cache contain raw events, serving as the source of models' episodic memory. In this work…

Cited by 0SourceScholar
2025

Position-Aware Depth Decay Decoding (D3): Boosting Large Language Model Inference Efficiency

ACL 2025finding

Due to the large number of parameters, the inference phase of Large Language Models (LLMs) is resource-intensive. Unlike traditional model compression, which needs retraining, recent dynamic computation methods show that not all components are required for inference, enabling a training-free pipelin…

Cited by 0SourcePDFScholar