Digital Reality Lab

 
[Progressive Refinement Imaging]

Progressive Refinement Imaging

Markus Kluge1,  Tim Weyrich2,  Andreas Kolb1

1 University of Siegen
2 University College London

Abstract

This paper presents a novel technique for progressive online integration of uncalibrated image sequences with substantial geometric and/or photometric discrepancies into a single, geometrically and photometrically consistent image. Our approach can handle large sets of images, acquired from a nearly planar or infinitely distant scene at different resolutions in object domain and under variable local or global illumination conditions. It allows for efficient user guidance as its progressive nature provides a valid and consistent reconstruction at any moment during the online refinement process. Our approach avoids global optimization techniques, as commonly used in the field of image refinement, and progressively incorporates new imagery into a dynamically extendable and memory-efficient Laplacian pyramid. Our image registration process includes a coarse homography and a local refinement stage using optical flow. Photometric consistency is achieved by retaining the photometric intensities given in a reference image, while it is being refined. Globally blurred imagery and local geometric inconsistencies due to, e.g., motion are detected and removed prior to image fusion. We demonstrate the quality and robustness of our approach using several image and video sequences, including hand-held acquisition with mobile phones and zooming sequences with consumer cameras.

Citation Style:    Publication

Progressive Refinement Imaging.
Markus Kluge, Tim Weyrich, Andreas Kolb.
Computer Graphics Forum, 39(1), pp. 360–374, Feb 2020.Markus Kluge, Tim Weyrich, and Andreas Kolb. Progressive refinement imaging. Computer Graphics Forum, 39(1):360–374, February 2020.Kluge, M., Weyrich, T., and Kolb, A. 2020. Progressive refinement imaging. Computer Graphics Forum 39, 1 (Feb.), 360–374.M. Kluge, T. Weyrich, and A. Kolb, “Progressive refinement imaging,” Computer Graphics Forum, vol. 39, no. 1, pp. 360–374, Feb. 2020.
thumbnailPDF (51 MB)
thumbnailLow-res PDF (2.7 MB)
thumbnail
External Project Page
BibTeXBibTeXBibTeX
thumbnail
DOI

Related Publication

[Progressive refinement imaging with depth-assisted disparity correction]
Progressive refinement imaging with depth-assisted disparity correction.
Markus Kluge, Tim Weyrich, Andreas Kolb.
Computers & Graphics, 115, pp. 446–460, Oct 2023.Markus Kluge, Tim Weyrich, and Andreas Kolb. Progressive refinement imaging with depth-assisted disparity correction. Computers & Graphics, 115:446–460, October 2023.Kluge, M., Weyrich, T., and Kolb, A. 2023. Progressive refinement imaging with depth-assisted disparity correction. Computers & Graphics 115 (Oct.), 446–460.M. Kluge, T. Weyrich, and A. Kolb, “Progressive refinement imaging with depth-assisted disparity correction,” Computers & Graphics, vol. 115, pp. 446–460, Oct. 2023. [Online]. Available: https: //www.sciencedirect.com/science/article/pii/S0097849323001656
[Web Page][PDF (4.9 MB)][Suppl. Material (208 MB)][Low-res Suppl. Material (9.2 MB)][External Project Page][Publisher’s Page][BibTeX][DOI]

Privacy: This page is free of cookies or any means of data collection. Copyright disclaimer: The documents contained in these pages are included to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.