Documentation/Labs/Augmented Reality and Virtual Reality support

The goal of this page to coordinate activities related to improving 3D Slicer's support for augmented reality and virtual reality headsets (such as Microsoft HoloLens, HTC Vive, and Oculus Rift). The scope includes all solutions that allow content created by 3D Slicer shown in an AR/VR headset. Some way of real-time interaction, data exchange is preferred, but not essential for all applications.

Current approaches

• Native VR renderer
  • Using VTK only (http://www.na-mic.org/Wiki/index.php/2014_Project_Week:ImmersiveVR) - Franklin King
  • Using OpenVR and OpenVR VTK remote module (http://www.na-mic.org/Wiki/index.php/2016_Summer_Project_Week/OpenVR_integration) - Adam Rankin
• Unity viewer
  • Load STL models exported from 3D Slicer (https://github.com/franklinwk/OpenVRUnityMedicalDemo) - Franklin King
  • Web server based communication (https://www.slicer.org/publications/item/view/2882) - Franklin King
  • OpenIGTLink base communication
• UWP (Universal Windows Platform) application for HoloLens
  • With OpenIGTLink communication - Adam Rankin
• Web viewer
  • Generate panoramic image in 3D Slicer and show it in a web browser (http://www.na-mic.org/Wiki/index.php/2015_Summer_Project_Week:Integrated_Virtual_Reality_Viewer) - Franklin King