Difference between revisions of "Documentation/Nightly/Modules/CarreraSliceInteractiveSegmenter"

From Slicer Wiki
Jump to: navigation, search
 
(3 intermediate revisions by one other user not shown)
Line 17: Line 17:
  
 
Author: Ivan Kolesov, Stony Brook University<br>
 
Author: Ivan Kolesov, Stony Brook University<br>
Author: LiangJia Zhu, Stony Brook University<br>
+
Author: Liangjia Zhu, Stony Brook University<br>
 
Author: Yi Gao, University of Alabama Birmingham<br>
 
Author: Yi Gao, University of Alabama Birmingham<br>
 
Author: Peter Karasev, Georgia Institute of Technology<br>
 
Author: Peter Karasev, Georgia Institute of Technology<br>
Line 104: Line 104:
 
[[File:FGCSeed2.png|500px]]
 
[[File:FGCSeed2.png|500px]]
  
* (c) Once finish editing on the seed image, press 'G' to run fast GrowCut again.  
+
* (c) Once finished editing on the seed image, press 'G' to run fast GrowCut again.  
 
[[File:FGCSeg2.png|500px]]
 
[[File:FGCSeg2.png|500px]]
  
The steps 6 (b) and (c) may be conducted a couple of times until satisfied
+
The steps 6 (b) and (c) may be repeated a couple of times until satisfied.
  
Step 7.) Once satisfied with the initialization, press 'M' to work with KSlice for smoothing. The energe functionals available include:
+
Step 7.) Once satisfied with the initialization, press 'M' to start KSlice interactive segmentation. The energy functionals available are:
* (a) press 'F' for local-global segmentation
+
* (a) press 'F' for local-global Chan-Vese segmentation
 
* (b) press 'U' for mean curvature smoothing
 
* (b) press 'U' for mean curvature smoothing
 
* (c) press 'E' for Chan-Vese segmentation
 
* (c) press 'E' for Chan-Vese segmentation
 
Step 8.) Select the rectangle tool(or any other painting tool).
 
 
[[File:ImplicitRectangle.png|50px]]
 
 
and initialize CarreraSlice in a 2D slice by drawing inside the structure of interest.
 
 
[[File:KSliceInitMeningioma.png|500px]]
 
 
 
Step 9.) Press the “C” key to copy the current initialization in this 2D plane, then press the left/right arrow on the keyboard to move on to an adjacent slice, press the “V” key to paste the label, thereby initializing the current slice. Once this procedure has been repeated several times, we have initialized the surface to a cube in 3D.
 
 
[[File:KSliceInit3DCube.png|500px]]
 
 
 
Step 10.) To evolve the 2D contour on a slice, hover the mouse over a 2D view plane, press “Q”.
 
 
[[File:KSlice2DEvolve.png|500px]]
 
 
 
 
Step 11.) Evolve the contour in 3D by pressing "E" to use the Chan-Vese energy.
 
  
  
Line 140: Line 118:
 
== As necessary, take steps at any time in the process ==
 
== As necessary, take steps at any time in the process ==
  
Step 12.)(Used in any order) A segmenting surface may leak into undesirable areas, based purely on image data. It is the user's job to guide the evolution process. A user can provide positive input (drawing) by selecting a paint tool, painting in areas which should be part of the object of interest but are not. Or, the user can provide negative input (erasing) by pressing "A" (toggle label value between 0 and the originally selected label). An example of a user correction is going from  
+
*(Used in any order) A segmenting surface may leak into undesirable areas, based purely on image data. It is the user's job to guide the evolution process. A user can provide positive input (drawing) by selecting a paint tool, painting in areas which should be part of the object of interest but are not. Or, the user can provide negative input (erasing) by pressing "A" (toggle label value between 0 and the originally selected label). An example of a user correction is going from  
  
 
[[File:KSliceNegativeInput.png|500px]]
 
[[File:KSliceNegativeInput.png|500px]]
Line 148: Line 126:
 
[[File:KSliceCorrectedUI.png|500px]]
 
[[File:KSliceCorrectedUI.png|500px]]
  
Step 13.) (Used in any order) Certain image regions (depending on the energy chosen and the image itself) may be highly attractive for the evolving contour despite being incorrect according to the user's expert knowledge. He has two options. First, apply repeated input several times (soft user constraints). Second, he can press "B" (toggle between soft/hard constraints) to increase the weight on his inputs, essentially making them hard constraints. Further, constraints can be provided pre-emptively, by erasing/drawing in regions before a contour has reached these areas to prevent leaks in the future or expedite the evolution process, respectively.  
+
* (Used in any order) Certain image regions (depending on the energy chosen and the image itself) may be highly attractive for the evolving contour despite being incorrect according to the user's expert knowledge. He has two options. First, apply repeated input several times (soft user constraints). Second, he can press "B" (toggle between soft/hard constraints) to increase the weight on his inputs, essentially making them hard constraints. Further, constraints can be provided pre-emptively, by erasing/drawing in regions before a contour has reached these areas to prevent leaks in the future or expedite the evolution process, respectively.  
  
  
Step 14.)(Used in any order) Press "F" to run the contour in 3D, similarly to Step.11 but using an alternative energy, the Local Global Chan-Vese. The user can switch the energy he is using at any time.
+
*(Used in any order) Press "F" to run the contour in 3D, similarly to Step.7 but using an alternative energy, the Local Global Chan-Vese. The user can switch the energy he is using at any time.
  
Step 15.) (Used in any order) Press "U" to run the contour in 3D, similarly to Step.11 but using an alternative energy, the curvature flow. The user can switch the energy he is using at any time.
+
* (Used in any order) Press "U" to run the contour in 3D, similarly to Step.7 but using an alternative energy, the curvature flow. The user can switch the energy he is using at any time.
  
  
Line 161: Line 139:
 
== Optional Visualization ==
 
== Optional Visualization ==
  
Step 16.) (Optional) Turn on “Volume Rendering” of the label image in 3D (notice the parameters set for faster interaction). This will be updated during the evolution
+
* (Optional) Turn on “Volume Rendering” of the label image in 3D (notice the parameters set for faster interaction). This will be updated during the evolution
  
 
[[File:VolumeRederingOnMeningioma.png|500px]]
 
[[File:VolumeRederingOnMeningioma.png|500px]]
Line 168: Line 146:
 
---- <!-- Horizontal  rule -->
 
---- <!-- Horizontal  rule -->
  
Step 17.) Examine the current segmentation by flipping through the 2D viewers, providing input as in Step.12 to guide the evolution.  
+
* Examine the current segmentation by flipping through the 2D viewers, providing input to guide the evolution.  
  
 
[[File:ExampleUIDuringProcess.png|500px]]  
 
[[File:ExampleUIDuringProcess.png|500px]]  
Line 174: Line 152:
  
  
Step 18.) Repeat steps 10-15 (or any subset of them) until convergence to the desired segmentation.
+
* Repeat previous steps (or any subset of them) until convergence to the desired segmentation.
  
 
[[File:KSliceFinalSegMeningioma.png|500px]]   
 
[[File:KSliceFinalSegMeningioma.png|500px]]   
  
  
Step 19.) Once satisfied with the segmentation, stop CarreraSlice by clicking "Stop Interactive Segmentor"
+
*Once satisfied with the segmentation, stop CarreraSlice by clicking "Stop Interactive Segmentor"
  
 
[[File:StopInteractiveSegmenter.png|500px]]
 
[[File:StopInteractiveSegmenter.png|500px]]
 
 
  
  

Latest revision as of 23:46, 30 January 2014

Home < Documentation < Nightly < Modules < CarreraSliceInteractiveSegmenter


For the latest Slicer documentation, visit the read-the-docs.





Introduction and Acknowledgements

This work is part of the National Alliance for Medical Image Computing (NA-MIC), funded by the National Institutes of Health through the NIH Roadmap for Medical Research, Grant U54 EB005149. Information on NA-MIC can be obtained from the NA-MIC website.

Author: Ivan Kolesov, Stony Brook University
Author: Liangjia Zhu, Stony Brook University
Author: Yi Gao, University of Alabama Birmingham
Author: Peter Karasev, Georgia Institute of Technology
Author: Patricio Vela, Georgia Institute of Technology
Author: Allen Tannenbaum, Stony Brook University
Contributor1: Steve Pieper, Isomics, Inc.
Contributor2: Karl Fritscher (BWH & MGH)





Module Description

This is the CarreraSlice interactive segmentation method. The computation is initialized using an improved GrowCut implementation and refined by an interactive, level set based segmentation algorithm, KSlice. As the automatic segmentation runs and displays the current state, a human user can influence the algorithm’s behavior to more closely align with an expected result. In the end, the user has created an excellent segmentation result with a minimal amount of time and effort. Please see the references below for more details.








Tutorials

Step 1.) Add data volume to segment

LoadMeningioma.png


Step 2.) Go to the “Editor” module, select the volume loaded in Step 1 as the “Master Volume” in the “Create and Select Label Maps” drop-down menu

StartEditorMeningioma.png


Step 3.) Select the “CarreraSlice” effect in the “Edit Selected Label Map” drop-down menu

CarreraSliceEffect.png


Step 4.) Set the “Radius” parameter, the "Number of Iterations" and press the “Start Interactive Segmentor” button ( CarreraSlice is now running in the background until the “Stop Interactive Segmentor” button is pressed)

StartBotMeningioma.png


Step 5.) Turn “On” all three slice views in the 3D Plane

TurnOnSlices3DMeningioma.png

Step 6.) Initialize the segmentation using fast GrowCut

  • (a) go to PaintEffect to draw seed regions (label 1 for foreground and 2 for background), then press 'G' to run fast GrowCut.

FGCSeed.png FGCSeg1.png

  • (b) If not satified, press 'S' to toggle between seed image and segmentation result. Edit on the seed image to reduce over/under segmentaions.

FGCSeed2.png

  • (c) Once finished editing on the seed image, press 'G' to run fast GrowCut again.

FGCSeg2.png

The steps 6 (b) and (c) may be repeated a couple of times until satisfied.

Step 7.) Once satisfied with the initialization, press 'M' to start KSlice interactive segmentation. The energy functionals available are:

  • (a) press 'F' for local-global Chan-Vese segmentation
  • (b) press 'U' for mean curvature smoothing
  • (c) press 'E' for Chan-Vese segmentation



As necessary, take steps at any time in the process

  • (Used in any order) A segmenting surface may leak into undesirable areas, based purely on image data. It is the user's job to guide the evolution process. A user can provide positive input (drawing) by selecting a paint tool, painting in areas which should be part of the object of interest but are not. Or, the user can provide negative input (erasing) by pressing "A" (toggle label value between 0 and the originally selected label). An example of a user correction is going from

KSliceNegativeInput.png

to

KSliceCorrectedUI.png

  • (Used in any order) Certain image regions (depending on the energy chosen and the image itself) may be highly attractive for the evolving contour despite being incorrect according to the user's expert knowledge. He has two options. First, apply repeated input several times (soft user constraints). Second, he can press "B" (toggle between soft/hard constraints) to increase the weight on his inputs, essentially making them hard constraints. Further, constraints can be provided pre-emptively, by erasing/drawing in regions before a contour has reached these areas to prevent leaks in the future or expedite the evolution process, respectively.


  • (Used in any order) Press "F" to run the contour in 3D, similarly to Step.7 but using an alternative energy, the Local Global Chan-Vese. The user can switch the energy he is using at any time.
  • (Used in any order) Press "U" to run the contour in 3D, similarly to Step.7 but using an alternative energy, the curvature flow. The user can switch the energy he is using at any time.




Optional Visualization

  • (Optional) Turn on “Volume Rendering” of the label image in 3D (notice the parameters set for faster interaction). This will be updated during the evolution

VolumeRederingOnMeningioma.png



  • Examine the current segmentation by flipping through the 2D viewers, providing input to guide the evolution.

ExampleUIDuringProcess.png


  • Repeat previous steps (or any subset of them) until convergence to the desired segmentation.

KSliceFinalSegMeningioma.png


  • Once satisfied with the segmentation, stop CarreraSlice by clicking "Stop Interactive Segmentor"

StopInteractiveSegmenter.png


Panels and their use

There are two parameters to set: the radius that sets the band around the current initialisation in which image data is considered (for Local-Global Chan-Vese energy) and the number of contour iterations. A large radius means data from far lying regions influences the segmentation (this increases the computational complexity). A small radius ensures that only nearby pixels influence the contour (but set too small will require a better contour initialisation from the user). The number of iterations refers to the time for which the segmenting surface is allowed to evolve before querying the user for input. A small number allows the user to catch the surface before a large error is made, reducing corrective inputs required but may be tedious/slow.









References

  • Kolesov, I., Karasev, P., Muller, G., Chudy, K., Xerogeanes, J., and Tannenbaum, A., “Human supervisory control framework for interactive medical image segmentation,” in International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) Computational Biomechanics for Medicine Workshop, Proceeding of the, 2011.
  • Karasev, P., Kolesov, I., Chudy, K., Muller, G., Xerogeanes, J., and Tannenbaum, A., “Interactive mri segmentation with controlled active vision,” in IEEE Conference on Decision and Control, Proceedings of the, IEEE, Dec. 2011.
  • Karasev, P., Kolesov, I., Fritscher, K., Vela, P., Mitchell, P., and Tannenbaum, A.. “Interactive Medical Image Segmentation using PDE Control Of Active Contours”. In: Medical Imaging, IEEE Transactions on (In Submission) (2013)
  • Xerogeanes, J., Mitchell, P. , Karasev, P., Kolesov, I. and Romine, S. . “An Anatomic and Morphologic Evaluation of the Quadriceps Tendon Using 3D MRI Reconstruction: Applications for ACL Autograft Choice and Procurement”. In: Journal of Bone and Joint Surgery (In Submission) (2013)


Information for Developers