← Search

Patrick Liu

4 accepted papers

2024

DiffusionSat: A Generative Foundation Model for Satellite Imagery

ICLR 2024poster

Diffusion models have achieved state-of-the-art results on many modalities including images, speech, and video. However, existing models are not tailored to support remote sensing data, which is widely used in important applications including environmental monitoring and crop-yield prediction. Satel…

2022

Enhancing Self-Consistency and Performance of Pre-Trained Language Models through Natural Language Inference

EMNLP 2022main

While large pre-trained language models are powerful, their predictions often lack logical consistency across test inputs. For example, a state-of-the-art Macaw question-answering (QA) model answers <i>Yes</i> to <i>Is a sparrow a bird?</i> and <i>Does a bird have feet?</i> but answers <i>No</i> to…

Cited by 47SourcePDFScholar
2022

SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery

NeurIPS 2022accept

Unsupervised pre-training methods for large vision models have shown to enhance performance on downstream supervised tasks. Developing similar techniques for satellite imagery presents significant opportunities as unlabelled data is plentiful and the inherent temporal and multi-spectral structure pr…

2021

SustainBench: Benchmarks for Monitoring the Sustainable Development Goals with Machine Learning

NeurIPS 2021poster

Progress toward the United Nations Sustainable Development Goals (SDGs) has been hindered by a lack of data on key environmental and socioeconomic indicators, which historically have come from ground surveys with sparse temporal and spatial coverage. Recent advances in machine learning have made it…

Cited by 74SourcecodeScholar