← Search

David Brooks

6 accepted papers

2024

Guess & Sketch: Language Model Guided Transpilation

ICLR 2024poster

Maintaining legacy software requires many software and systems engineering hours. Assembly code programs, which demand low-level control over the computer machine state and have no variable names, are particularly difficult for humans to analyze. Existing conventional program translators guarantee c…

Cited by 9SourcePDFScholar
2023

$S^3$: Increasing GPU Utilization during Generative Inference for Higher Throughput

NeurIPS 2023poster

Generating texts with a large language model (LLM) consumes massive amounts of memory. Apart from the already-large model parameters, the key/value (KV) cache that holds information about previous tokens in a sequence can grow to be even larger than the model itself. This problem is exacerbated in o…

Cited by 68SourcePDFScholar
2023

Hardware Resilience Properties of Text-Guided Image Classifiers

NeurIPS 2023poster

This paper presents a novel method to enhance the reliability of image classification models during deployment in the face of transient hardware errors. By utilizing enriched text embeddings derived from GPT-3 with question prompts per class and CLIP pretrained text encoder, we investigate their imp…

2021

Gradient Disaggregation: Breaking Privacy in Federated Learning by Reconstructing the User Participant Matrix

ICML 2021oral

We show that aggregated model updates in federated learning may be insecure. An untrusted central server may disaggregate user updates from sums of updates across participants given repeated observations, enabling the server to recover privileged information about individual users’ private training…

2018

Weightless: Lossy Weight Encoding For Deep Neural Network Compression

ICLR 2018workshop

The large memory requirements of deep neural networks strain the capabilities of many devices, limiting their deployment and adoption. Model compression methods effectively reduce the memory requirements of these models, usually through applying transformations such as weight pruning or quantization…

Cited by 58SourceScholar
2018

Weightless: Lossy weight encoding for deep neural network compression

ICML 2018oral

The large memory requirements of deep neural networks limit their deployment and adoption on many devices. Model compression methods effectively reduce the memory requirements of these models, usually through applying transformations such as weight pruning or quantization. In this paper, we present…

Cited by 58SourcePDFScholar