Learning joint features for color and depth images with Convolutional Neural Networks for object classification

Eder Santana; Karl P. Dockendorf; José C. Príncipe

ICASSP 2015accepted0 citations

Learning joint features for color and depth images with Convolutional Neural Networks for object classification

Eder Santana, Karl P. Dockendorf, José C. Príncipe

Abstract

In this paper we investigate the advantages of learning representations of color plus depth images (Red-Blue-Green-Depth, RGB-D) over color only images (RGB) for computer vision. Specifically, we investigate the advantages on the task of object recognition. For this purpose, we applied the state-of-art deep convolutional neural networks (CNN) for classification of images on the RGB-D dataset published by (Bo et al., 2011). We show that this approach provides better results than those that use separate features for color and depth. Also, we probe the resulting CNN to gain intuition about how filters for depth and color channels iterate to generate useful features.

BibTeX

@inproceedings{icassp2015_learningjointfea,
  title = {Learning joint features for color and depth images with Convolutional Neural Networks for object classification},
  author = {Eder Santana and Karl P. Dockendorf and José C. Príncipe},
  booktitle = {ICASSP 2015},
  year = {2015}
}