← Search

Sixing Yu

3 accepted papers

2024

Federated Foundation Models: Privacy-Preserving and Collaborative Learning for Large Models

COLING 2024main

Foundation Models (FMs), such as LLaMA, BERT, GPT, ViT, and CLIP, have demonstrated remarkable success in a wide range of applications, driven by their ability to leverage vast amounts of data for pre-training. However, optimizing FMs often requires access to sensitive data, raising privacy concerns…

Cited by 59SourcePDFScholar
2022

Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learning

ICML 2022oral

Model compression is an essential technique for deploying deep neural networks (DNNs) on power and memory-constrained resources. However, existing model-compression methods often rely on human expertise and focus on parameters’ local importance, ignoring the rich topology information within DNNs. In…