Download - Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC
![Page 1: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/1.jpg)
Pattern-based Pattern-based Texture Texture
MetamorphosisMetamorphosis
Z. Liu, C. Liu, and H. Z. Liu, C. Liu, and H. ShumShum
Microsoft Research AsiaMicrosoft Research Asia
Y. Y. YuYuUIUC
![Page 2: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/2.jpg)
Image Morphing vs. Image Morphing vs. Texture MorphingTexture Morphing
Specify Features and Specify Features and Correspondence *Correspondence *
Warp GenerationWarp Generation Transition ControlTransition Control
Image Morphing
* Require a lot of human intervention
![Page 3: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/3.jpg)
Textures are usually Textures are usually homogenous with homogenous with features everywhere.features everywhere. Hard to specify featuresHard to specify features Hard to build Hard to build
correspondencecorrespondence
Image Morphing vs. Image Morphing vs. Texture MorphingTexture Morphing
Texture Morphing
![Page 4: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/4.jpg)
Direct Blending Does Not Direct Blending Does Not WorkWork
Random Semi-structured Regular
source
target
![Page 5: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/5.jpg)
Interesting Problems Interesting Problems In Texture MorphingIn Texture Morphing
What pair of textures?What pair of textures? Similar and repeatable patterns.Similar and repeatable patterns. Pattern distributions are alike.Pattern distributions are alike.
What is the feature?What is the feature? User define pattern.User define pattern.
How to extract so many patterns?How to extract so many patterns? Semi-automatic approach.Semi-automatic approach.
How to build correspondence?How to build correspondence? Generate a smooth warp field.Generate a smooth warp field.
![Page 6: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/6.jpg)
Our ApproachOur Approach
1. Pattern 1. Pattern Detection and Detection and AlignmentAlignment
2. Establishing 2. Establishing Correspondence Correspondence
3. Warping and 3. Warping and BlendingBlending
Source texture Target texture
Morphing sequence
![Page 7: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/7.jpg)
Pattern RepresentationPattern Representation
Shape DistanceShape Distance
Local Feature DistanceLocal Feature Distance
Pattern Representation & Pattern Representation & Distance MeasurementDistance Measurement
mYYCU ,, 1
C
1Y2Y
mY
3Y
4Y
5Y6Y
M
iiiUUd f
1
2),( FF
M
ii
M
ii
Ti YYY
1
2
1
M
iii YYUUds
1
2min),(
![Page 8: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/8.jpg)
Pattern Detection & Pattern Detection & AlignmentAlignment
Step1: Initialization by Step1: Initialization by Generalized Hough Generalized Hough Transform (GHT).Transform (GHT).
Step2: Alignment by top-Step2: Alignment by top-down verification.down verification.
Step3: Refinement by human Step3: Refinement by human intervention.intervention.
![Page 9: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/9.jpg)
Step1: InitializationStep1: Initialization
12
3
4
56
m
Pattern Detection & Pattern Detection & AlignmentAlignment
C
1Y2Y
mY
3Y
4Y
5Y6Y
User selected patternVoting of a pixel
Intensity image Local maximum
Original texture
![Page 10: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/10.jpg)
(a) Independently update each (a) Independently update each landmarklandmark
(b) Update shape(b) Update shape
Iteratively do (a) and (b).Iteratively do (a) and (b).
Pattern Detection & Pattern Detection & AlignmentAlignment
Step2: AlignmentStep2: Alignment
![Page 11: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/11.jpg)
Alignment Process
GHT initialization alignment alignment
![Page 12: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/12.jpg)
Pattern Detection & Pattern Detection & AlignmentAlignment
Step3: RefinementStep3: Refinement
(a) False detection(a) False detection
(b) False alignment(b) False alignment
(c) More than one types of (c) More than one types of patternpattern
![Page 13: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/13.jpg)
Correspondence by Correspondence by Minimizing Morphing PathMinimizing Morphing Path
8 56 14 21 41 36
45
51
4
0
0
21
3
45
0
0
45
23
7
0
0
24
44
47
0
0
14 7
80 85
21 7
0 0 0 0 0 0
0 0
0 0
1C
1C 2C 3C 4C nC 1nC
2C
3C
4C
1nC
nC
nCC 1 nCC 1
n
iki
n
ii iCCk
1
2
1 minarg
![Page 14: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/14.jpg)
Warping and BlendingWarping and Blending
Forward, inverse and synthesized sequences acquiredbased on the warp field
blend
From S.Lee
![Page 15: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/15.jpg)
More ResultsMore Results
source
target
Pattern selected
![Page 16: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/16.jpg)
DiscussionDiscussion
About Pattern SelectionAbout Pattern Selection Can be any shapeCan be any shape User is responsibleUser is responsible
About Correspondence About Correspondence and Transition Controland Transition Control Problem of crowd patterns Problem of crowd patterns
About Warp GenerationAbout Warp Generation MFFD vs. “as rigid as possible”MFFD vs. “as rigid as possible”
![Page 17: Pattern-based Texture Metamorphosis Z. Liu, C. Liu, and H. Shum Microsoft Research Asia Y. Yu UIUC](https://reader035.vdocuments.site/reader035/viewer/2022070305/551478ab550346f06e8b4582/html5/thumbnails/17.jpg)
Thank you !Thank you !