automatic 3-d skeleton-based segmentation of liver vessels … · 2019-03-01 · automatic 3-d...

1
Automatic 3-D Skeleton-Based Segmentation of Liver Vessels from MRI and CT for Couinaud Representation Marie-Ange Lebre 1 Antoine Vacavant 1 Manuel Grand-Brochier 1 Odyss´ ee Merveille 2 Pascal Chabrot 3 Armand Abergel 3 Benoˆ ıt Magnin 3 1 Universit´ e Clermont Auvergne, CNRS, SIGMA, Institut Pascal, F-63000 Clermont-Ferrand, France 2 ICube, UMR7357 - CNRS - Universit´ e de Strasbourg, Strasbourg, France 3 Universit´ e Clermont Auvergne, CHU, CNRS, SIGMA, Institut Pascal, F-63000 Clermont-Ferrand, France 25th IEEE ICIP, 2018 Objectives I Visualize automatically liver components on both modalities (CT and MRI). I Extract the hepatic vascular tree through 3D skeletonization process for Couinaud representation. Data used: I 20 CT from SLIVER, 20 CT from IRCAD I 40 MRI from local hospitals Figure 1: Different modalities: MRI (left) and CT (right) Methodology I. Partial skeletonization: I (a) Automatic liver segmentation: I [1] I (b) Brightest vessels detected by Sato’s filter: I s I (c-d) Largest component detection for the common trunk I (e) Main components extraction I (f) Centerlines extraction I (g-h) Centerlines extension - Connection - Validation I (i) Skeleton : S partial II. 3-D Reconstruction Figure 2: Results on MRI (left) and CT (right) I RORPO algorithm applied on the liver segmentation I, it enables multi-scale vessel extraction: I RORPO [3] I Fast marching phase used at each voxel of S partial in I RORPO (Figure 2) III. Hepatic and portal veins extraction I Erosion of the vessel segmentation obtained in step II. to retrieve largest vessels I Extraction of the two main components (hepatic and portal veins are not connected) (Figure 3) I Extraction of their centerlines (Figure 4) Centerlines extension - Connection - Validation I (1) C k with |l k | > 1: directional vectors computation b k and e k and centerlines extension I (2) C k with |l k | = 1: four closest components and directional vectors computation I Validation according to conditions on β and r j with j ∈{1, 2} defined by: r j = |E k ,l | i =1 I j s [i ] max (I j s ) ×|E k ,l | (1) E k ,l : voxels centerline between C k and the encountered component C l . I j s : results from Sato’s filter with the j th set of parameters. I j s [i ]: intensity with i ∈{1, |E k ,l |} of each voxel of E k ,l in I j s . Results Performance of vessels segmentation Table 1: Results on CT and MRI. CT Accuracy Specificity Sensitivity 0.97±0.01 0.98±0.01 0.69±0.10 Precision False Positive Rate False Negative Rate 0.61±0.07 0.01±0.01 0.32±0.09 MRI Acc Spec Sens Pre FPR FNR hepatic 0.98 0.98 0.54 0.30 0.010 0.45 portal 0.97 0.98 0.70 0.51 0.002 0.32 on 15 CT and one MRI: Figure 3: Results of hepatic vein (blue) and portal vein (green) extraction on MRI of patients with advanced cirrhosis Performance of hepatic and portal veins M 0 = |S partial | |I Ref | (2) M 0 : overlap of the detected skeleton S partial within the reference vascular segmentation image I Ref [2] Table 2: Overlap rate M 0 (%) and mean distance M d (mm) with the reference skeleton Hepatic vein M 0 (%) M d (mm) Portal vein M 0 (%) M d (mm) 95.46 8 100 7 skeletonization on one MRI: Figure 4: Results on one MRI This step is essential to construct the Couinaud scheme whose method will be presented in a future work Discussion & future works I Automatic 3D liver vessels segmentation based on partial skeletonization process I Efficient on MRI and CT even in case of advanced disease I Segmentation of enough vessels to obtain a Couinaud representation I Add comparisons with skeletonization process I Evaluate more results on MRI I Create gold MRI standard annotations for benchmarking I Evaluate the Couinaud representation on CT and MRI References [1] MA Lebre, K Arrouk, AKV V˘ an, A Leborgne, M Grand-Brochier, P Beaurepaire, A Vacavant, B Magnin, A Abergel, and P Chabrot. Medical image processing and numerical simulation for digital hepatic parenchymal blood flow. SASHIMI, MICCAI, 2017. [2] K Lidayov´ a, H Frimmel, C Wang, E Bengtsson, and O Smedby. Fast vascular skeleton extraction algorithm. Pattern Recognition Letters, 76, 2016. [3] O Merveille, H Talbot, L Najman, and N Passat. Curvilinear structure analysis by ranking the orientation responses of path operators. TPAMI, 40, 2018. http://www.institutpascal.uca.fr/index.php/fr/tgi-caviti Created with L A T E Xbeamerposter http://www-i6.informatik.rwth-aachen.de/latexbeamerposter.php [email protected]

Upload: others

Post on 21-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Automatic 3-D Skeleton-Based Segmentation of Liver Vessels … · 2019-03-01 · Automatic 3-D Skeleton-Based Segmentation of Liver Vessels from MRI and CT for Couinaud Representation

Automatic 3-D Skeleton-Based Segmentation ofLiver Vessels from MRI and CT for CouinaudRepresentationMarie-Ange Lebre 1 Antoine Vacavant1 Manuel Grand-Brochier1 Odyssee Merveille2

Pascal Chabrot3 Armand Abergel3 Benoıt Magnin3

1Universite Clermont Auvergne, CNRS, SIGMA, Institut Pascal, F-63000 Clermont-Ferrand, France2ICube, UMR7357 - CNRS - Universite de Strasbourg, Strasbourg, France3Universite Clermont Auvergne, CHU, CNRS, SIGMA, Institut Pascal, F-63000 Clermont-Ferrand, France 25th IEEE ICIP, 2018

Objectives

I Visualize automatically liver components on both modalities (CT and MRI).

I Extract the hepatic vascular tree through 3D skeletonization process for Couinaud representation.

Data used:I 20 CT from SLIVER, 20 CT from IRCAD

I 40 MRI from local hospitalsFigure 1: Different modalities: MRI (left) and CT (right)

Methodology

I. Partial skeletonization:

I (a) Automatic liver segmentation: I [1]

I (b) Brightest vessels detected by Sato’s filter: Is

I (c-d) Largest component detection for the common trunk

I (e) Main components extraction

I (f) Centerlines extraction

I (g-h) Centerlines extension - Connection - Validation

I (i) Skeleton : Spartial

II. 3-D Reconstruction

Figure 2: Results on MRI (left) and CT (right)

I RORPO algorithm applied on the liver segmentation I, it enables multi-scalevessel extraction: IRORPO [3]

I Fast marching phase used at each voxel of Spartial in IRORPO (Figure 2)

III. Hepatic and portal veins extraction

I Erosion of the vessel segmentation obtained in step II. to retrieve largest vessels

I Extraction of the two main components (hepatic and portal veins are notconnected) (Figure 3)

I Extraction of their centerlines (Figure 4)

Centerlines extension - Connection - Validation

I (1) Ck with |lk| > 1: directionalvectors computation bk and ek andcenterlines extension

I (2) Ck with |lk| = 1: four closestcomponents and directional vectorscomputation

I Validation according to conditions on β and rj with j ∈ {1, 2} defined by:

rj =

∑|Ek,l |i=1 Ijs[i ]

max(Ijs)× |Ek,l |(1)

Ek,l : voxels centerline between Ck and the encountered component Cl .Ijs: results from Sato’s filter with the jth set of parameters.Ijs[i ]: intensity with i ∈ {1, |Ek,l |} of each voxel of Ek,l in Ijs.

Results

Performance of vessels segmentation

Table 1: Results on CT and MRI.

CT Accuracy Specificity Sensitivity

0.97±0.01 0.98±0.01 0.69±0.10

Precision False Positive Rate False Negative Rate

0.61±0.07 0.01±0.01 0.32±0.09

MRI Acc Spec Sens Pre FPR FNR

hepatic 0.98 0.98 0.54 0.30 0.010 0.45

portal 0.97 0.98 0.70 0.51 0.002 0.32

on 15 CT and one MRI:

Figure 3: Results of hepatic vein (blue) andportal vein (green) extraction on MRI ofpatients with advanced cirrhosis

Performance of hepatic and portal veins

M0 =|Spartial ||IRef |

(2)

M0: overlap of the detected skeleton Spartialwithin the reference vascular segmentationimage IRef [2]

Table 2: Overlap rate M0(%) and mean distanceMd(mm) with the reference skeleton

Hepatic vein M0(%) Md(mm) Portal vein M0(%) Md(mm)

95.46 8 100 7

skeletonization on one MRI:

Figure 4: Results on one MRI

This step is essential to construct theCouinaud scheme whose method will

be presented in a future work

Discussion & future works

I Automatic 3D liver vessels segmentation based on partial skeletonization processI Efficient on MRI and CT even in case of advanced diseaseI Segmentation of enough vessels to obtain a Couinaud representation

I Add comparisons with skeletonization processI Evaluate more results on MRII Create gold MRI standard annotations for benchmarkingI Evaluate the Couinaud representation on CT and MRI

References

[1] MA Lebre, K Arrouk, AKV Van, A Leborgne, M Grand-Brochier, P Beaurepaire, A Vacavant, B Magnin,

A Abergel, and P Chabrot.

Medical image processing and numerical simulation for digital hepatic parenchymal blood flow.

SASHIMI, MICCAI, 2017.

[2] K Lidayova, H Frimmel, C Wang, E Bengtsson, and O Smedby.

Fast vascular skeleton extraction algorithm.

Pattern Recognition Letters, 76, 2016.

[3] O Merveille, H Talbot, L Najman, and N Passat.

Curvilinear structure analysis by ranking the orientation responses of path operators.

TPAMI, 40, 2018.

http://www.institutpascal.uca.fr/index.php/fr/tgi-caviti Created with LATEXbeamerposter http://www-i6.informatik.rwth-aachen.de/latexbeamerposter.php [email protected]