Difference between revisions of "Slicer-3.6-QA"

From Slicer Wiki
Jump to: navigation, search
Line 60: Line 60:
 
|style="background:gold"|1Gold||style="width:33%"|my module||complete||yes and yes||yes, yes, yes||80%||0|| ||||
 
|style="background:gold"|1Gold||style="width:33%"|my module||complete||yes and yes||yes, yes, yes||80%||0|| ||||
 
|-
 
|-
|style="background:white"|  ||style="width:33%"|  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
+
|style="background:white"|  ||style="width:33%"| Simple region growing  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Create a DICOM Series  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Subtract Images  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Rigid registration  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Add Images  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Extract Skeleton  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Robust Statistics Segmentation  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Simple IO Test  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Cast Image  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  ACPC Transform  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Label Map Smoothing  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Linear registration  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Mesh Contour Segmentation  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  BRAINSROIAuto - Foreground masking tool  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Curvature Anisotropic Diffusion  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Gaussian Blur  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Otsu Threshold Segmentation  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  N4ITK MRI Bias correction  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Grayscale Grind Peak  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  CheckerBoard Filter  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  EMSegment Simple  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Register Images  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Otsu Threshold  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Register Images MultiRes (Experimental)  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Mask Image  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Resample Scalar/Vector/DWI Volume  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Transform From Fiducials  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  MRI Bias Field Correction  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Resample Scalar Volume  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Histogram Matching  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Threshold Image  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Gradient Anisotropic Diffusion  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Voting Binary Hole Filling  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Grayscale Fill Hole  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Multiply Images  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Test GridTransform registration  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Deformable BSpline registration  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Median Filter  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  PolyData To Label Map  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Orient Images  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Dicom to Nrrd Converter  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Simple DWI IO Test  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Affine registration  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Resample DTI Volume  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  BRAINSVectorDemonWarping  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Diffusion Tensor Estimation  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  EMSegment Command-line  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Labelmap Seeding  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  BRAINSResample  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Gaussian Blur BatchMake  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Diffusion Tensor Scalar Measurements  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Resample Scalar Volume BatchMake  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  BRAINSFit  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Unbiased Non Local Means filter for DWI  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  BRAINSDemonWarp  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Grayscale Model Maker  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Joint Rician LMMSE Image Filter  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  EMSegment BatchMake  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Merge Models  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Image Label Combine  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Register Images BatchMake  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Execution Model Tour  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Model Maker  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  ROISelect  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Rician LMMSE Image Filter  ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 +
|-
 +
|style="background:white"|  ||style="width:33%"|  Multiple models example   ||  || ||  ||  TBF  || TBF  ||  author |||  |n/a ||
 
|-
 
|-
 
|}
 
|}

Revision as of 23:38, 2 May 2010

Home < Slicer-3.6-QA

Return to Slicer 3.6 documentation

  • This page contains our assessment of the Slicer 3.6 modules

Testing Status

Core Modules

Slicer 3.6 Quality Assurance
Score Name Documentation Help [1] Acknowledgment [2] Current Owner
?? Camera complete yes, no link no Sebastien Barre
?? Welcome complete yes and yes yes and yes Wendy Plesniak
?? Volumes complete yes and yes yes and yes Steve Pieper
?? Diffusion Editor complete yes and yes no CF Westin
?? Models complete yes and yes yes and yes Alex Yarmarkovich
?? Measurements complete yes and yes yes and yes Nicole Aucoin
?? Fiducials complete yes and yes yes and yes Nicole Aucoin
?? Data complete yes and yes yes and yes Steve Pieper
?? Slices complete yes and yes yes and yes Jim Miller
?? Colors complete yes and yes yes and yes Nicole Aucoin
?? Interactive Editor complete no and yes yes and no Steve Pieper
?? ROI Module complete no and yes no and yes Alex Yarmarkovich
?? Volume Rendering complete yes and yes no and yes Yanling Liu
?? PET/CT Fusion complete yes and yes yes and yes Wendy Plesniak
  1. including link to website documentation
  2. including name of author and of supervisor

Application CLI Modules

Version of 04-29-2010

Slicer 3.6 QA table 2010 04 29

Version of 05-2010

Slicer 3.6 Quality Assurance
Score Name Documentation Help [1] Acknowledgment [2] Test coverage [3] valgrind errors Current Owner Comments [4] 3.6 Documentation Name [5]
1Gold my module complete yes and yes yes, yes, yes 80% 0
Simple region growing TBF TBF author |n/a
Create a DICOM Series TBF TBF author |n/a
Subtract Images TBF TBF author |n/a
Rigid registration TBF TBF author |n/a
Add Images TBF TBF author |n/a
Extract Skeleton TBF TBF author |n/a
Robust Statistics Segmentation TBF TBF author |n/a
Simple IO Test TBF TBF author |n/a
Cast Image TBF TBF author |n/a
ACPC Transform TBF TBF author |n/a
Label Map Smoothing TBF TBF author |n/a
Linear registration TBF TBF author |n/a
Mesh Contour Segmentation TBF TBF author |n/a
BRAINSROIAuto - Foreground masking tool TBF TBF author |n/a
Curvature Anisotropic Diffusion TBF TBF author |n/a
Gaussian Blur TBF TBF author |n/a
Otsu Threshold Segmentation TBF TBF author |n/a
N4ITK MRI Bias correction TBF TBF author |n/a
Grayscale Grind Peak TBF TBF author |n/a
CheckerBoard Filter TBF TBF author |n/a
EMSegment Simple TBF TBF author |n/a
Register Images TBF TBF author |n/a
Otsu Threshold TBF TBF author |n/a
Register Images MultiRes (Experimental) TBF TBF author |n/a
Mask Image TBF TBF author |n/a
Resample Scalar/Vector/DWI Volume TBF TBF author |n/a
Transform From Fiducials TBF TBF author |n/a
MRI Bias Field Correction TBF TBF author |n/a
Resample Scalar Volume TBF TBF author |n/a
Histogram Matching TBF TBF author |n/a
Threshold Image TBF TBF author |n/a
Gradient Anisotropic Diffusion TBF TBF author |n/a
Voting Binary Hole Filling TBF TBF author |n/a
Grayscale Fill Hole TBF TBF author |n/a
Multiply Images TBF TBF author |n/a
Test GridTransform registration TBF TBF author |n/a
Deformable BSpline registration TBF TBF author |n/a
Median Filter TBF TBF author |n/a
PolyData To Label Map TBF TBF author |n/a
Orient Images TBF TBF author |n/a
Dicom to Nrrd Converter TBF TBF author |n/a
Simple DWI IO Test TBF TBF author |n/a
Affine registration TBF TBF author |n/a
Resample DTI Volume TBF TBF author |n/a
BRAINSVectorDemonWarping TBF TBF author |n/a
Diffusion Tensor Estimation TBF TBF author |n/a
EMSegment Command-line TBF TBF author |n/a
Labelmap Seeding TBF TBF author |n/a
BRAINSResample TBF TBF author |n/a
Gaussian Blur BatchMake TBF TBF author |n/a
Diffusion Tensor Scalar Measurements TBF TBF author |n/a
Resample Scalar Volume BatchMake TBF TBF author |n/a
BRAINSFit TBF TBF author |n/a
Unbiased Non Local Means filter for DWI TBF TBF author |n/a
BRAINSDemonWarp TBF TBF author |n/a
Grayscale Model Maker TBF TBF author |n/a
Joint Rician LMMSE Image Filter TBF TBF author |n/a
EMSegment BatchMake TBF TBF author |n/a
Merge Models TBF TBF author |n/a
Image Label Combine TBF TBF author |n/a
Register Images BatchMake TBF TBF author |n/a
Execution Model Tour TBF TBF author |n/a
Model Maker TBF TBF author |n/a
ROISelect TBF TBF author |n/a
Rician LMMSE Image Filter TBF TBF author |n/a
Multiple models example TBF TBF author |n/a
  1. including link to website documentation
  2. including name of author and of supervisor
  3. in % for non-interactive part
  4. Test coverage percentage determined by: [# lines code covered / total # lines of code (covered and non-covered) *100] of relevant .cxx and .h files
  5. http://wiki.slicer.org/slicerWiki/index.php/Documentation-3.6

Testing Partition

Most Slicer modules have a GUI component and a Data Processing component.

Testing GUI components is still a challenge, so we will focus here on testing the Data Processing components. This can be done in most cases by partitioning the module into a GUI section and a Data Processing section, where the second one usually takes the form of a C++ class (although that is not a requirement).

The data processing section can be tested by using standard CTest/CMake mechanisms. Basically by adding ADD_TEST() entries to the CMakeLists.txt file of the module.

Luis Ibanez' scoring system

The following scoring will be applied to the data processing sections of all modules:

Slicer 3.6 Quality Assurance Scoring
Score Code Coverage Valgrind Errors Documentation Tutorial
1Gold > 80% 0 yes yes
2Silver > 70% < 10 yes yes
3Bronze > 60% < 50 yes yes
4Clay > 50% < 100 yes yes
5Coal < 50% > 100 yes yes
6Hazard unknown unknown no no

The code coverage and Valgrind error must be the ones reported on the Nightly Slicer Dashboard. Anecdotal data is not acceptable.