← Search

Wenhui Zhang

2 accepted papers

2026

STREAMING SPEECH RECOGNITION WITH DECODER-ONLY LARGE LANGUAGE MODELS AND LATENCY OPTIMIZATION

ICASSP 2026oral

Recent advances have demonstrated the potential of decoderonly large language models (LLMs) for automatic speech recognition (ASR). However, enabling streaming recognition within this framework remains a challenge. In this work, we propose a novel streaming ASR approach that integrates a read/write…

Cited by 0SourcePDFScholar
2025

Portcullis: A Scalable and Verifiable Privacy Gateway for Third-Party LLM Inference

AAAI 2025technical

Businesses using third-party LLMs face privacy risks from exposed prompts. This paper presents Portcullis, a privacy-preserving gateway that safeguards sensitive data while supporting efficient and accurate LLM responses. Portcullis functions as a mediator, anonymizing sensitive data in prompts thro…

Cited by 0SourcePDFScholar