A multi-purpose benchmark for photogrammetric urban 3D reconstruction in a controlled environment

This paper presents a novel multi-purpose benchmark for assessing the performance of the entire image-based pipeline for 3D urban reconstruction and 3D data classification. The proposed benchmark is called “3DOMcity” photogrammetric contest and is publicly available at https://3dom.fbk.eu/3domcity-benchmark. Compared to previous benchmark initiatives, the innovative aspects introduced by 3DOMcity are threefold. First, it covers the entire 3D reconstruction pipeline, including image orientation, dense image matching, point cloud classification and 3D building reconstruction. Second, the performance assessment is performed within a metrological context. Finally, the provided datasets offer 2D and 3D data collected at a very high spatial resolution. Furthermore, the benchmark is multi-purpose since it involves a multiplicity of tasks, that can be either performed independently from each other’s, or grouped together. The contributions of this paper are (i) the presentation of the novel benchmark dataset and corresponding reference data, (ii) the description of the multi-purpose benchmark tasks and evaluation procedures, and (iii) the discussion of first results of image orientation, dense image matching and classification.