On-body visualization with extended reality : exploration and application

Abstract

Extended Reality (XR), which encompasses Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR), has significant potential across numerous fields by offering immersive and interactive experiences. This thesis addresses the increasing demand for effective on-body visualization technologies, particularly in the areas of biomechanical visualization, motion guidance, and feedback systems. The motivation behind this research is to leverage XR to enhance the presentation and understanding of biomechanical data and to improve performance in personal training scenarios, such as physiotherapy and exercise workouts. The thesis begins by exploring design choices for visualizing biomechanical data directly on the human body using AR, even in situations constrained by limited resources or time. It focuses on enhancing the interactivity and user comprehension of biomechanical visualizations in various everyday contexts. Through an investigation of different design options, the research identifies effective methods for presenting complex biomechanical information in an intuitive and interactive manner, making it accessible to a wide range of users, from patients undergoing physiotherapy to athletes in training. Expanding on broader applications such as physiotherapy and workouts, the research then investigates general design principles for presenting upper limb motion guidance using XR. This includes examining the impact of different perspectives, visual encoding techniques, and motion features on user performance and comprehension. The insights gathered lay a foundation for developing systems that provide clear, actionable feedback to support users in performing exercises with accuracy and efficiency. Building on these studies, the thesis applies its findings to practical deadlift training, investigating user performance and preferences for guidance visualization in this context. This study bridges the gap in previous general design implications for XR-based motion guidance systems, revealing considerations for XR systems in physically intensive exercises. Finally, the thesis presents a comprehensive review and empirical analysis of the design space for visual feedforward and corrective feedback mechanisms in XR environments. By addressing practical limitations and proposing solutions for improved system implementation, this part of the research offers a detailed framework to guide future developments in XR-based motion guidance systems. Overall, this thesis provides a thorough examination of XR-based on-body visualization for biomechanical data presentation and 3D motion guidance. It makes substantial contributions to the field, setting the stage for future advancements in XR technology for on-body visualization. The findings have broad implications for building applications in biomechanical visualization, designing effective motion guidance systems, and improving future XR-related applications and system designs.