Revisiting Depth Image Fusion with Variational Message Passing

Diego Thomas, Ekaterina Sirazitdinova, Akihiro Sugimoto, Rin Ichsiro Taniguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution


The running average approach has long been perceived as the best choice for fusing depth measurements captured by a consumer-grade RGB-D camera into a global 3D model. This strategy, however, assumes exact correspondences between points in a 3D model and points in the captured RGB-D images. Such assumption does not hold true in many cases because of errors in motion tracking, noise, occlusions, or inconsistent surface sampling during measurements. Accordingly, reconstructed 3D models suffer unpleasant visual artifacts. In this paper, we visit the depth fusion problem from a probabilistic viewpoint and formulate it as a probabilistic optimization using variational message passing in a Bayesian network. Our formulation enables us to fuse depth images robustly, accurately, and fast for high quality RGB-D keyframe creation, even if exact point correspondences are not always available. Our formulation also allows us to smoothly combine depth and color information for further improvements without increasing computational speed. The quantitative and qualitative comparative evaluation on built keyframes of indoor scenes show that our proposed framework achieves promising results for reconstructing accurate 3D models while using low computational power and being robust against misalignment errors without post-processing.

Original languageEnglish
Title of host publicationProceedings - 2019 International Conference on 3D Vision, 3DV 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages10
ISBN (Electronic)9781728131313
Publication statusPublished - Sept 2019
Event7th International Conference on 3D Vision, 3DV 2019 - Quebec, Canada
Duration: Sept 15 2019Sept 18 2019

Publication series

NameProceedings - 2019 International Conference on 3D Vision, 3DV 2019


Conference7th International Conference on 3D Vision, 3DV 2019

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Media Technology
  • Modelling and Simulation


Dive into the research topics of 'Revisiting Depth Image Fusion with Variational Message Passing'. Together they form a unique fingerprint.

Cite this