emsegmentation in slicer 3 b. davis, s. barre, y. yuan, w. schroeder, p. golland, k. pohl

29
EMSegmentation in EMSegmentation in Slicer 3 Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Upload: joella-hill

Post on 17-Jan-2016

217 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

EMSegmentation EMSegmentation in Slicer 3in Slicer 3

B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Page 2: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

OverviewOverview IntroductionIntroduction EM Module Step-By-StepEM Module Step-By-Step Feedback & DiscussionFeedback & Discussion Live DemoLive Demo

Page 3: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

MotivationMotivationT1-weighted MRI T2-weighted MRI

Automatic Segmentation

Cortical Spinal Fluid

White Matter SuperiorTemporal Gyrus

MiddleTemporal Gyrus

Page 4: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Hierarchical TreeHierarchical Tree

Page 5: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Applications of EM Applications of EM SegmenterSegmenter

Subcortical SegmentationPsychiatry Neuroimaging LaboratoryBWH, Harvard

White Matter LesionCenter for Neurological Imaging BWH, Harvard

Page 6: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

GoalsGoals

Slicer2

Slicer3

Design automatic segmenter thatDesign automatic segmenter that is easy to use is easy to use adapts to variety of scenariosadapts to variety of scenarios works on large data setsworks on large data sets is a research toolis a research tool

Page 7: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

OverviewOverview IntroductionIntroduction EM Module Step-By-StepEM Module Step-By-Step Feedback & DiscussionFeedback & Discussion Live DemoLive Demo

Page 8: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Wizard InterfaceWizard Interface

Separates complex tasks into a Separates complex tasks into a sequence of simpler stepssequence of simpler steps

Checks user input before each Checks user input before each transitiontransition

Provides consistent access to helpProvides consistent access to help

Page 9: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Create new Create new parameter setparameter set

Apply/modify Apply/modify existing existing parameter setparameter set

Parameter set defines segmentation Parameter set defines segmentation scenario:scenario:

Atlas, Images, Algorithm parametersAtlas, Images, Algorithm parameters

Page 10: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Defines a hierarchy of anatomical structuresDefines a hierarchy of anatomical structures

Page 11: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Assign atlas to anatomical structures Assign atlas to anatomical structures

white matter csf

grey matter background

Page 12: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Choose input channelsChoose input channels

T1

T2

Page 13: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Define intensity distribution for each structureDefine intensity distribution for each structure

Page 14: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Specify node-based segmentation parametersSpecify node-based segmentation parameters

Influence of Influence of Input channelsInput channels AtlasAtlas SmoothingSmoothing

Relative Relative weight to other weight to other structuresstructures

Stopping Stopping conditionsconditions

Page 15: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Specify atlas-to-input channel registrationSpecify atlas-to-input channel registration

white matter csf

grey matter background

T1 T2

Page 16: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Parameter Set

Atlas

Tree

Intensity

Target

Parameters

Registration

Run

Segment input channels using parametersSegment input channels using parameters

Page 17: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

PipelinePipeline

2AtlasAlignment 3EM

Segmentation1IntensityNormalization

Page 18: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Observed Data (ROI)

EM

Image Prior

Hierarchy Labelmap

EM SegmenterEM Segmenter

Page 19: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Level 1Level 1P

rior

In

form

atio

n

IMAGE

BG ICC

CSF GM WM

Page 20: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Level 2Level 2

IMAGE

ICC

Cu

rren

t P

aram

eter

CSF GM WM

ROI

Page 21: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Example TreeExample Tree

Page 22: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl
Page 23: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

OverviewOverview IntroductionIntroduction EM Module Step-By-StepEM Module Step-By-Step Feedback & DiscussionFeedback & Discussion Live DemoLive Demo

Page 24: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

ResoucesResouces Slicer3 EMSegment Wiki page:Slicer3 EMSegment Wiki page:

http://wiki.na-mic.org/Wiki/index.php/Slicer3:EMhttp://wiki.na-mic.org/Wiki/index.php/Slicer3:EM Project DescriptionProject Description Steps in EMSegment WorkflowSteps in EMSegment Workflow Future WorkFuture Work Implementation DetailsImplementation Details EMSegment TutorialEMSegment Tutorial

Slicer2 Material:Slicer2 Material: Tutorial: http://wiki.na-mic.org/Wiki/index.php/Tutorial: http://wiki.na-mic.org/Wiki/index.php/

Slicer:Workshops:User_Training_101Slicer:Workshops:User_Training_101 PublicationsPublications

K.M. Pohl , S. Bouix, R. Kikinis, W.E.L. Grimson, Anatomical K.M. Pohl , S. Bouix, R. Kikinis, W.E.L. Grimson, Anatomical Guided Segmentation with Non-Stationary Tissue Class Guided Segmentation with Non-Stationary Tissue Class Distributions in an Expectation-Maximization Framework, In Distributions in an Expectation-Maximization Framework, In Proc. ISBI 2004, pp. 81-84,2004Proc. ISBI 2004, pp. 81-84,2004

K.M. Pohl, S. Bouix, M.E. Shenton, W.E.L. Grimson, R. K.M. Pohl, S. Bouix, M.E. Shenton, W.E.L. Grimson, R. Kikinis, Automatic Segmentation Using Non-Rigid Kikinis, Automatic Segmentation Using Non-Rigid Registratio, short communications of MICCAI 2005Registratio, short communications of MICCAI 2005

Page 25: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Feedback & Feedback & DiscussionDiscussion

Priorities for future developmentPriorities for future development Class overview panelClass overview panel Graphical DisplayGraphical Display Controlled vocabularyControlled vocabulary Library of TemplatesLibrary of Templates One-Step-Segmentation One-Step-Segmentation

Page 26: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

AcknowledgementAcknowledgementss

Steve PieperSteve Pieper Alex YarmarkovichAlex Yarmarkovich Wendy PlesniakWendy Plesniak Slicer developer communitySlicer developer community Psychiatry Neuroimaging LaboratoryPsychiatry Neuroimaging Laboratory NAMIC NAMIC

Page 27: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

AcknowledgementAcknowledgementss

Kitware Developer Kitware Developer

Page 28: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

OverviewOverview IntroductionIntroduction EM Module Step-By-StepEM Module Step-By-Step Feedback & DiscussionFeedback & Discussion Live DemoLive Demo

Page 29: EMSegmentation in Slicer 3 B. Davis, S. Barre, Y. Yuan, W. Schroeder, P. Golland, K. Pohl

Editing the TreeEditing the Tree

Cortical SubcorticalLevel 3: