Weighted Node Mapping and Localisation on a Pixel Processor Array
Hector Castillo-Elizalde, Yanan Liu, Laurie Bose, Walterio Mayol-Cuevas
Abstract
This paper implements and demonstrates visual route mapping and localisation upon a Pixel Processor Array (PPA). The PPA sensor comprises of an array of Processing Elements (PEs), each of which can capture and process visual information directly. This provides significant parallel processing power allowing novel ways in which information can be processed on-sensor. Our method predicts the correct node within a topological map generated from an image sequence by measuring image similarities, spatial coherence, and exploiting the parallel nature of the PPA. Our implementation runs at +300Hz on large public datasets with +2K locations requiring 2.5W at 500 GOPS/W. We compare vs traditionally implemented methods demonstrating better F-1 performance even on simulation. As far as we are aware, we present the first on-sensor mapping and localisation system running entirely on-sensor.
BibTeX
@inproceedings{icra2021_weightednodemapp,
title = {Weighted Node Mapping and Localisation on a Pixel Processor Array},
author = {Hector Castillo-Elizalde and Yanan Liu and Laurie Bose and Walterio Mayol-Cuevas},
booktitle = {ICRA 2021},
year = {2021}
}