lecture16-medical image registration iibagci/teaching/mic16/lec16.pdf · lecture 16: medical image...

59
MEDICAL IMAGE COMPUTING (CAP 5937) LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL 32814. [email protected] or [email protected] 1 SPRING 2016

Upload: others

Post on 12-May-2020

15 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

MEDICAL IMAGE COMPUTING (CAP 5937)

LECTURE 16: Medical Image Registration II (Advanced):Deformable Registration

Dr. Ulas BagciHEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL [email protected] or [email protected]

1SPRING 2016

Page 2: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Outline

• Intensity-based deformable registration– Similarity metrics• Standard similarity measures• Probabilistic framework• Pre-processing step• Recent approaches• Linear vs. non-linear approaches

2

Page 3: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Requirements on Similarity Measure

3

Page 4: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Standard Similarity Measures

• SSD-SAD• Cross correlation• Mutual information• Derivatives

4

Page 5: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Difference Measure

5

Page 6: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

6

Credit: Itk.org

Page 7: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Limitations of SSD

7

Page 8: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Limitations of SSD

8

Read: Bagci, U., et al. The role of Intensity Standardization in Medical Image Registration, PRL 2010.

Page 9: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Normalized Cross Correlation (NCC)

9

Page 10: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

NCC-Example

10

Page 11: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Multi-modal Image Registration

11

Page 12: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Information Theoretic Approaches• Mutual Information (MI)• Normalized Mutual Information (NMI)

12

Page 13: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Preliminary: Histogram Calculation

13

Page 14: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Preliminary: Joint Histogram Calculation

14

Page 15: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Information Theoretic Approach

15

Page 16: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Joint Histogram

16

Page 17: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Joint Histogram

17

Page 18: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Joint Histogram

18

Page 19: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Information Theoretic Approach

19

Page 20: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Entropy

20

Page 21: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Mutual Information

21

Page 22: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Historical Note

22

Page 23: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Normalization of MI

23

Page 24: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Improvements to MI

24

Page 25: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Derivatives of Similarity Measures

25

Page 26: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Derivatives of Similarity Measures

26

Page 27: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Derivatives of Similarity Measures

27

Page 28: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Derivatives of Similarity Measures

28

Page 29: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Probabilistic Framework for Image Registration

• Viola, PhD Thesis, 1995• Roche et al 2000• Zollei, PhD Thesis, 2006

29

Page 30: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Probabilistic Framework

30

Page 31: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

MLE Framework for Registration

31

Page 32: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

32

Page 33: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

33

Page 34: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Intensity Relationships

34

Page 35: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Pre-Processing Steps

35

Page 36: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

36

Page 37: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

37

Page 38: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Image Gradients

38

Page 39: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Image Gradients

39

Page 40: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Image Gradients

40

Page 41: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

41

Page 42: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Entropy Images

42

Page 43: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Entropy Images

43

Page 44: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Entropy Images

44

Page 45: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Entropy Images

45

Page 46: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

46

Page 47: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Phase-based Registration

47

Page 48: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

48

Page 49: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Multi-Resolution Registration

49

Page 50: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

50

Page 51: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Attribute Vectors

51

Page 52: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Recent Approaches

52

Page 53: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Examples

53

Page 54: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Minimizing Residual Complexity

54

Page 55: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Minimizing Residual Complexity

55

Page 56: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Local and Global Statistics

56

Page 57: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Local and Global Statistics

57

Page 58: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Summary

58

Page 59: Lecture16-Medical Image Registration IIbagci/teaching/mic16/lec16.pdf · LECTURE 16: Medical Image Registration II (Advanced): Deformable Registration Dr. Ulas Bagci HEC 221, Center

Slide Credits and References• Darko Zikic’s MICCAI 2010 Tutorial• Christian Wachingher, MICCAI 2010 Tutorial

59