Tuesday, May 2025
03:00 PM - 03:20 PM
Room: 220C
Session: AR/VR Optics
Optimizing Photon-to-Photon Latency in MR Equipment Video See-Through Display: Design Guidelines and Tuning Strategies
Description:
In the application of mixed reality (MR) devices where virtual and real environments are integrated, the Photon-to-Photon (PTP) latency in the Video See-Through (VST) segment is inevitable. This latency causes sensory discomfort and motion mismatch, reducing the immersive experience during use. Therefore, achieving stable and low PTP latency is a critical challenge in the development of MR devices. This study is based on the implementation of VST technology and analyzes the impacts of frequency and phase changes in camera shooting, image processing, and image rendering on PTP latency through simulation. The findings are validated by empirical measurements on popular MR devices such as Apple Vision Pro, Pico4, and Quest3. The results indicate that to optimize the latency performance of VST, it is essential to ensure the consistency of frequency and stability of phases across different processing stages. Furthermore, this paper proposes a set of monitoring and adaptive tuning methods and demonstrates the process of tuning PTP latency through case studies.