Hybrid airborne imaging systems integrating oblique photogrammetric cameras and LiDAR sensors provide complementary geometric and radiometric information for high-fidelity 3D reconstruction. While LiDAR offers stable global geometric accuracy, photogrammetric reconstructions provide dense surface detail and rich fac¸ade information through oblique imaging. However, photogrammetric models often exhibit locally varying geometric drift caused by error accumulation during bundle adjustment, preventing pixel-accurate alignment between images and LiDAR data. Conventional global registration approaches are insufficient to correct such spatially varying misalignments. In this paper, we propose a view-dependent fusion framework for pixel-accurate registration between photogrammetric images and LiDAR data. The global alignment problem is decomposed into localized rigid registrations performed independently for each image. For each view, a local photogrammetric point cloud reconstructed from depth maps is rigidly aligned to a corresponding LiDAR subset using fixed-scale point-to-plane ICP. The estimated transformation is used to project LiDAR points into the image domain, where depth-consistency checks enforce visibility constraints and remove inconsistent measurements. Valid LiDAR points are colorized and fused with the photogrammetric reconstruction to generate anchored view-dependent point clouds. Finally, all view-dependent reconstructions are aggregated using voxel-grid fusion with medianbased point selection. Experiments on airborne oblique imaging datasets demonstrate improved reconstruction completeness and pixel-level consistency between images and LiDAR geometry. The proposed framework provides a practical and robust solution for high-accuracy multi-modal 3D reconstruction in complex urban environments.

Pixel-Accurate Registration of Photogrammetric Images and LiDAR in a Hybrid Airborne Oblique Imaging System

Farella, Elisa Mariarosaria;Remondino, Fabio
2026-01-01

Abstract

Hybrid airborne imaging systems integrating oblique photogrammetric cameras and LiDAR sensors provide complementary geometric and radiometric information for high-fidelity 3D reconstruction. While LiDAR offers stable global geometric accuracy, photogrammetric reconstructions provide dense surface detail and rich fac¸ade information through oblique imaging. However, photogrammetric models often exhibit locally varying geometric drift caused by error accumulation during bundle adjustment, preventing pixel-accurate alignment between images and LiDAR data. Conventional global registration approaches are insufficient to correct such spatially varying misalignments. In this paper, we propose a view-dependent fusion framework for pixel-accurate registration between photogrammetric images and LiDAR data. The global alignment problem is decomposed into localized rigid registrations performed independently for each image. For each view, a local photogrammetric point cloud reconstructed from depth maps is rigidly aligned to a corresponding LiDAR subset using fixed-scale point-to-plane ICP. The estimated transformation is used to project LiDAR points into the image domain, where depth-consistency checks enforce visibility constraints and remove inconsistent measurements. Valid LiDAR points are colorized and fused with the photogrammetric reconstruction to generate anchored view-dependent point clouds. Finally, all view-dependent reconstructions are aggregated using voxel-grid fusion with medianbased point selection. Experiments on airborne oblique imaging datasets demonstrate improved reconstruction completeness and pixel-level consistency between images and LiDAR geometry. The proposed framework provides a practical and robust solution for high-accuracy multi-modal 3D reconstruction in complex urban environments.
File in questo prodotto:
File Dimensione Formato  
isprs-archives-XLIX-B2-2026-143-2026_compressed.pdf

accesso aperto

Licenza: Creative commons
Dimensione 367.01 kB
Formato Adobe PDF
367.01 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11582/372689
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact