Jiangou Zhan

Portcullis: A Scalable and Verifiable Privacy Gateway for Third-Party LLM Inference

Businesses using third-party LLMs face privacy risks from exposed prompts. This paper presents Portcullis, a privacy-preserving gateway that safeguards sensitive data while supporting efficient and accurate LLM responses. Portcullis functions as a mediator, anonymizing sensitive data in prompts thro…