Outpatient gynaecological procedures (such as IUD insertions, hysteroscopies, and colposcopies) are frequently associated with significant patient pain and anxiety. While non-pharmacological techniques like breathing and relaxation exercises are proven to mitigate stress, clinical constraints often prevent staff from delivering them.
This research project introduces an innovative Mixed Reality (MR) prototype featuring a virtual support character (e.g., "Anna") to guide patients through evidence-based stress-management interventions. By leveraging MR pass-through technology, the system empowers patient agency and comfort without isolating them from their physical treating clinician.
Project Website: https://gynemira.duckdns.org/
Role in the project: Software Engineer, Technical Designer
Organisation: Empathic Computing Laboratory, University of Auckland
Collaboration: University of Otago, Moana Vā – Navigators of Pacific Pride, Health New Zealand, Whānau Whanake
Platform: XREAL ONE AR Glasses, Meta Quest 3 (Standalone)
This research project introduces an innovative Mixed Reality (MR) prototype featuring a virtual support character (e.g., "Anna") to guide patients through evidence-based stress-management interventions. By leveraging MR pass-through technology, the system empowers patient agency and comfort without isolating them from their physical treating clinician.
Technical Implementation
- Cross-Platform MR Deployment:
Integrated and optimized the MR application across three distinct hardware ecosystems, tackling the unique constraints of each platform for clinical safety and comfort:
- Meta Quest 3 & 3S: Optimized high-fidelity color passthrough and UI layer rendering to blend the virtual character seamlessly into the real-world clinic, balancing the ergonomic realities of headset weight distribution.
- XREAL One AR Glasses: Implemented lightweight, non-intrusive AR visual workflows, ensuring reliable tracking and interface stability despite wired connections and a narrower Field of View (FOV).
- Interactive Virtual Avatar System: Developed the behavior and communication pipeline for the virtual avatar, translating clinical distraction tactics and guided breathing exercises into responsive 3D animations and visual cues.
- Collaborative Co-Design & Localization: Contributed to a user-centric design pipeline shaped by clinicians, consumers, and Māori and Pacific partners. Implemented feature sets that allow self-selected avatars to maximize cultural relevance and inclusive patient support.
Project Website: https://gynemira.duckdns.org/
Role in the project: Software Engineer, Technical Designer
Organisation: Empathic Computing Laboratory, University of Auckland
Collaboration: University of Otago, Moana Vā – Navigators of Pacific Pride, Health New Zealand, Whānau Whanake
Platform: XREAL ONE AR Glasses, Meta Quest 3 (Standalone)
Due to IP restrictions, we can't release the app's video publicly. However, I made a similar video to showcase the AI avatar on the XREAL One AR glasses.
Presentation at the 2026 Digital Health Festival in Melbourne:
Link
Presentation at the 2026 Health Tech Week in Auckland::
other projects: