MM-2FSK: Multimodal Frequency Shift Keying for Ultra-Efficient and Robust High-Resolution MIMO Radar Imaging

Vanessa Wirth¹, Johanna Bräunig¹, Martin Vossiek¹, Tim Weyrich^1,2, Marc Stamminger¹

¹ Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU)
² University College London

Abstract

Accurate reconstruction of static and rapidly moving targets demands three-dimensional imaging solutions with high temporal and spatial resolution. Radar sensors are a promising sensing modality because of their fast capture rates and their independence from lighting conditions. To achieve high spatial resolution, MIMO radars with large apertures are required. Yet, they are infrequently used for dynamic scenarios due to significant limitations in signal processing algorithms. These limitations impose substantial hardware constraints due to their computational intensity and reliance on large signal bandwidths, ultimately restricting the sensor&rsqo;s capture rate. One solution of previous work is to use few frequencies only, which enables faster capture and requires less computation; however, this requires coarse knowledge of the target’s position and works in a limited depth range only. To address these challenges, we extend previous work into the multimodal domain with MM-2FSK, which leverages an assistive optical depth sensing modality to obtain a depth prior, enabling high framerate capture with only few frequencies. We evaluate our method using various target objects with known ground truth geometry that is spatially registered to real millimeter-wave MIMO radar measurements. Our method demonstrates superior performance in terms of depth quality, being able to compete with the time- and resource-intensive measurements with many frequencies.

Citation Style: Display Alpha ACM SIGGRAPH IEEEtran Publication

MM-2FSK: Multimodal Frequency Shift Keying for Ultra-Efficient and Robust High-Resolution MIMO Radar Imaging.
Vanessa Wirth, Johanna Bräunig, Martin Vossiek, Tim Weyrich, Marc Stamminger.
arXiv, 2511.01405, 9 pages, 2025.Vanessa Wirth, Johanna Bräunig, Martin Vossiek, Tim Weyrich, and Marc Stamminger. MM-2FSK: Multimodal frequency shift keying for ultra-efficient and robust high-resolution MIMO radar imaging, 2025.Wirth, V., Bräunig, J., Vossiek, M., Weyrich, T., and Stamminger, M., 2025. MM-2FSK: Multimodal frequency shift keying for ultra-efficient and robust high-resolution MIMO radar imaging.V. Wirth, J. Bräunig, M. Vossiek, T. Weyrich, and M. Stamminger, “MM-2FSK: Multimodal frequency shift keying for ultra-efficient and robust high-resolution MIMO radar imaging,” 2025. [Online]. Available: https://arxiv.org/abs/2511.01405

Acknowledgments

The authors would like to express their gratitude to Paul Himmler for the insightful discussions. This work was funded by the Deutsche Forschungsgemein- schaft (DFG, German Research Foundation) – SFB 1483 – Project-ID 442419336, EmpkinS. The authors would like to thank the Rohde & Schwarz GmbH & Co. KG (Munich, Germany) for providing the radar imaging devices. The authors gratefully acknowledge the scientific support and HPC resources provided by the Erlangen National High Performance Computing Center of the Friedrich-Alexander-Universität Erlangen-Nürnberg.