Difference between revisions of "Documentation/Labs/Augmented Reality and Virtual Reality support"
From Slicer Wiki
| (One intermediate revision by the same user not shown) | |||
| Line 5: | Line 5: | ||
*Native VR renderer: [https://github.com/KitwareMedical/SlicerVirtualReality SlicerVirtualReality extension] | *Native VR renderer: [https://github.com/KitwareMedical/SlicerVirtualReality SlicerVirtualReality extension] | ||
*Unity viewer | *Unity viewer | ||
| − | **[https://github.com/franklinwk/OpenIGTLink-Unity Send and receive transforms via OpenIGTLink to/from Slicer or Plus] (Franklin King) | + | **[https://github.com/franklinwk/OpenIGTLink-Unity Send and receive transforms via OpenIGTLink to/from Slicer or Plus] (Franklin King - BWH) |
| − | **[http://www.spl.harvard.edu/publications/item/view/2882 Send images from Slicer via web server] (Franklin King) | + | **[https://github.com/Lyla-M/UnityOpenIGTLink Send and receive transforms and images via OpenIGTLink from Plus] (Lyla Mu - Western) |
| + | **[http://www.spl.harvard.edu/publications/item/view/2882 Send images from Slicer via web server] (Franklin King - BWH, PerkLab) | ||
**Load model files exported from 3D Slicer | **Load model files exported from 3D Slicer | ||
| − | ***[https://github.com/PerkLab/HololensQuickNav HoloLens QuickNav brain surgery] (Emily Rae, Zac Baum) | + | ***[https://github.com/PerkLab/HololensQuickNav HoloLens QuickNav brain surgery] (Emily Rae, Zac Baum - PerkLab) |
| − | ***[https://github.com/franklinwk/OpenVRUnityMedicalDemo Abdominal organs] (Franklin King) | + | ***[https://github.com/franklinwk/OpenVRUnityMedicalDemo Abdominal organs] (Franklin King - BWH) |
*UWP (Universal Windows Platform) application for HoloLens | *UWP (Universal Windows Platform) application for HoloLens | ||
| − | **[https://github.com/IGSIO/UWPOpenIGTLink OpenIGTLink communication to receive images/transforms from Plus or Slicer] (Adam Rankin) | + | **[https://github.com/IGSIO/UWPOpenIGTLink OpenIGTLink communication to receive images/transforms from Plus or Slicer] (Adam Rankin - Western) |
*Web viewer | *Web viewer | ||
| − | **[https://www.na-mic.org/wiki/2015_Summer_Project_Week:Integrated_Virtual_Reality_Viewer Generate pre-rendered panoramic image in 3D Slicer and show it in a web browser] (Franklin King) | + | **[https://www.na-mic.org/wiki/2015_Summer_Project_Week:Integrated_Virtual_Reality_Viewer Generate pre-rendered panoramic image in 3D Slicer and show it in a web browser] (Franklin King - PerkLab) |
| − | **Load models exported from 3D Slicer into https://aframe.io/ | + | **Load models exported from 3D Slicer into https://aframe.io/ (Steve Pieper - Isomics) |
| + | ==Previous efforts== | ||
| − | + | *[http://www.na-mic.org/Wiki/index.php/2014_Project_Week:ImmersiveVR Native VR renderer using VTK only] (Franklin King - PerkLab) - obsolete, since VTK has built-in OpenVR support | |
| − | + | *[http://www.na-mic.org/Wiki/index.php/2016_Summer_Project_Week/OpenVR_integration Using OpenVR and OpenVR VTK remote module] (Adam Rankin - Western) - obsolete, since Slicer has official SlicerVirtualReality extension | |
| − | *[http://www.na-mic.org/Wiki/index.php/2014_Project_Week:ImmersiveVR Native VR renderer using VTK only] (Franklin King) - obsolete, since VTK has built-in OpenVR support | ||
| − | *[http://www.na-mic.org/Wiki/index.php/2016_Summer_Project_Week/OpenVR_integration Using OpenVR and OpenVR VTK remote module] (Adam Rankin) - obsolete, since Slicer has official SlicerVirtualReality extension | ||
Latest revision as of 16:55, 8 January 2020
Home < Documentation < Labs < Augmented Reality and Virtual Reality supportThe goal of this page to coordinate activities related to improving 3D Slicer's support for augmented reality and virtual reality headsets (such as Microsoft HoloLens, HTC Vive, and Oculus Rift). The scope includes all solutions that allow content created by 3D Slicer shown in an AR/VR headset. Some way of real-time interaction, data exchange is preferred, but not essential for all applications.
Current approaches
- Native VR renderer: SlicerVirtualReality extension
- Unity viewer
- Send and receive transforms via OpenIGTLink to/from Slicer or Plus (Franklin King - BWH)
- Send and receive transforms and images via OpenIGTLink from Plus (Lyla Mu - Western)
- Send images from Slicer via web server (Franklin King - BWH, PerkLab)
- Load model files exported from 3D Slicer
- HoloLens QuickNav brain surgery (Emily Rae, Zac Baum - PerkLab)
- Abdominal organs (Franklin King - BWH)
- UWP (Universal Windows Platform) application for HoloLens
- OpenIGTLink communication to receive images/transforms from Plus or Slicer (Adam Rankin - Western)
- Web viewer
- Generate pre-rendered panoramic image in 3D Slicer and show it in a web browser (Franklin King - PerkLab)
- Load models exported from 3D Slicer into https://aframe.io/ (Steve Pieper - Isomics)
Previous efforts
- Native VR renderer using VTK only (Franklin King - PerkLab) - obsolete, since VTK has built-in OpenVR support
- Using OpenVR and OpenVR VTK remote module (Adam Rankin - Western) - obsolete, since Slicer has official SlicerVirtualReality extension
