Single View Scene Scale Estimation Using Scale Field
Byeong-Uk Lee, Jianming Zhang, Yannick Hold-Geoffroy, In So Kweon
Abstract
In this paper, we propose a single image scale estimation method based on a novel scale field representation. A scale field defines the local pixel-to-metric conversion ratio along the gravity direction on all the ground pixels. This representation resolves the ambiguity in camera parameters, allowing us to use a simple yet effective way to collect scale annotations on arbitrary images from human annotators. By training our model on calibrated panoramic image data and the in-the-wild human annotated data, our single image scene scale estimation network generates robust scale field on a variety of image, which can be utilized in various 3D understanding and scale-aware image editing applications.
BibTeX
@inproceedings{cvpr2023_singleviewscenes,
title = {Single View Scene Scale Estimation Using Scale Field},
author = {Byeong-Uk Lee and Jianming Zhang and Yannick Hold-Geoffroy and In So Kweon},
booktitle = {CVPR 2023},
year = {2023}
}