[Neural Acceleration of Scattering-Aware Color 3D Printing]

Neural Acceleration of Scattering-Aware Color 3D Printing

Tobias Rittig1,  Denis Sumin2,  Vahid Babaei2,  Piotr Didyk3,  Alexey Voloboy4,  Alexander Wilkie1,  Bernd Bickel5,  Karol Myszkowski2,  Tim Weyrich6,  Jaroslav Křivánek1

1 Charles University
2 Max Planck Institute for Informatics, Saarbrücken, Germany
3 Università della Svizzera italiana
4 Keldysh Institute of Applied Mathematics RAS, Russia
5 Institute for Science and Technology Austria
6 University College London

Abstract

With the wider availability of full-color 3D printers, color-accurate 3D-print preparation has received increased attention. A key challenge lies in the inherent translucency of commonly used print materials that blurs out details of the color texture. Previous work tries to compensate for these scattering effects through strategic assignment of colored primary materials to printer voxels. To date, the highest-quality approach uses iterative optimization that relies on computationally expensive Monte Carlo light transport simulation to predict the surface appearance from subsurface scattering within a given print material distribution; that optimization, however, takes in the order of days on a single machine. In our work, we dramatically speed up the process by replacing the light transport simulation with a data-driven approach. Leveraging a deep neural network to predict the scattering within a highly heterogeneous medium, our method performs around two orders of magnitude faster than Monte Carlo rendering while yielding optimization results of similar quality level. The network is based on an established method from atmospheric cloud rendering, adapted to our domain and extended by a physically motivated weight sharing scheme that substantially reduces the network size. We analyze its performance in an end-to-end print preparation pipeline and compare quality and runtime to alternative approaches, and demonstrate its generalization to unseen geometry and material values. This for the first time enables full heterogenous material optimization for 3D-print preparation within time frames in the order of the actual printing time.

Citation Style:    Publication

Neural Acceleration of Scattering-Aware Color 3D Printing.
Tobias Rittig, Denis Sumin, Vahid Babaei, Piotr Didyk, Alexey Voloboy, Alexander Wilkie, Bernd Bickel, Karol Myszkowski, Tim Weyrich, Jaroslav Křivánek.
Computer Graphics Forum (Proc. Eurographics), 40(2), pp. 205–219, 2021.
Tobias Rittig, Denis Sumin, Vahid Babaei, Piotr Didyk, Alexey Voloboy, Alexander Wilkie, Bernd Bickel, Karol Myszkowski, Tim Weyrich, and Jaroslav Křivánek. Neural acceleration of scattering-aware color 3D printing.Computer Graphics Forum (Proc. Eurographics), 40(2):205–219, May 2021.Rittig, T., Sumin, D., Babaei, V., Didyk, P., Voloboy, A., Wilkie, A., Bickel, B., Myszkowski, K., Weyrich, T., and Křivánek, J. 2021. Neural acceleration of scattering-aware color 3D printing.Computer Graphics Forum (Proc. Eurographics) 40, 2 (May), 205–219.T. Rittig, D. Sumin, V. Babaei, P. Didyk, A. Voloboy, A. Wilkie, B. Bickel, K. Myszkowski, T. Weyrich, and J. Křivánek, “Neural acceleration of scattering-aware color 3D printing,” Computer Graphics Forum (Proc. Eurographics), vol. 40, no. 2, pp. 205–219, May 2021.

Acknowledgments

We thank Sebastian Cucerca for processing and capturing the physical printouts. This work was supported by the Charles University grant SVV-260588 and GAČR 19-07626S. This project has received funding from the European Union’s Horizon 2020 research and innovation programme, under the Marie Skłodowska-Curie grant agreements No. 642841 (DISTRO) and No. 765911 (RealVision).


Disclaimer: The documents contained in these pages are included to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.