← Search

Ngoc Bui

9 accepted papers

2026

Cache What Lasts: Token Retention for Memory-Bounded KV Cache in LLMs

ICLR 2026poster

Memory and computation remain core bottlenecks in long-horizon LLM inference due to the quadratic cost of self-attention and the ever-growing key-value (KV) cache. Existing strategies for memory-bounded inference, such as quantization, offloading, or heuristic KV eviction, either incur high orchestr…

Cited by 0SourcecodeScholar
2026

HypRAG: Hyperbolic Dense Retrieval for Retrieval Augmented Generation

ICML 2026poster

Embedding geometry plays a fundamental role in retrieval quality, yet dense retrievers for retrieval-augmented generation (RAG) remain largely confined to Euclidean space. However, natural language exhibits hierarchical structure from broad topics to specific entities that Euclidean embeddings fail …

Cited by 0SourceScholar
2025

Learning Along the Arrow of Time: Hyperbolic Geometry for Backward-Compatible Representation Learning

ICML 2025poster

Backward compatible representation learning enables updated models to integrate seamlessly with existing ones, avoiding to reprocess stored data. Despite recent advances, existing compatibility approaches in Euclidean space neglect the uncertainty in the old embedding models and force the new model…

Cited by 0SourcePDFScholar
2025

Mixture-of-Personas Language Models for Population Simulation

ACL 2025finding

Advances in Large Language Models (LLMs) paved the way for their emerging applications in various domains, such as human behavior simulations, where LLMs could augment human-generated data in social science research and machine learning model training. However, pretrained LLMs often fail to capture…

2024

Explaining Graph Neural Networks via Structure-aware Interaction Index

ICML 2024poster

The Shapley value is a prominent tool for interpreting black-box machine learning models thanks to its strong theoretical foundation. However, for models with structured inputs, such as graph neural networks, existing Shapley-based explainability approaches either focus solely on node-wise importanc…