interactive digital photomontagemisha/fall07/notes/agarwala04.pdf · interactive digital...

Interactive Digital Photomontage

Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2 Brian Curless1 David Salesin1,2 Michael Cohen2

1University of Washington 2Microsoft Research

Presented by: Gagan Bansal1

Photomontage : What does it mean

Combining parts of a set of photographs into a single composite picture ---(of course with minimum visible artifacts !!!!)

2Interactive Digital Photomontage

Presented by : Gagan Bansal

Interactive Digital Photomontage Presented by : Gagan Bansal

3

Interactive Digital Photomontage Presented by : Gagan Bansal

4

Interactive Digital Photomontage Presented by : Gagan Bansal

5

Interactive Digital Photomontage Presented by : Gagan Bansal

6

Interactive Digital Photomontage Presented by : Gagan Bansal

7

Issues Involved

• How to select the seams where to cut the images so that they merge as seamlessly as possible in the composite image ?

• How to minimize the remaining artifacts in the composite image?

Interactive Digital Photomontage Presented by : Gagan Bansal

8

Interactive Digital Photomontage Presented by : Gagan Bansal

9

Overview of the Approach

• Choosing seams– Use Graph Cut

• Minimizing the remaining artifacts– Gradient domain fusion based on Poisson equation

Interactive Digital Photomontage Presented by : Gagan Bansal

10

Image Objectives

• Designated Color• Minimum or maximum luminance• Minimum or maximum Contrast• Minimum or maximum likelihood• Eraser• Minimum or maximum difference• Designated Image

Interactive Digital Photomontage Presented by : Gagan Bansal

11

Seam Objectives

• Colors – match colors• Colors and gradients• Colors and edges – prefer seams that lie

along edges

Seam objectives are global

Interactive Digital Photomontage Presented by : Gagan Bansal

12

Graph Cut

Interactive Digital Photomontage Presented by : Gagan Bansal

13

Graph Cut

• Data Penalty– Designated Color – Euclidean distance of color to

be assigned from color in source image– Designated Image - 0 if same label– Eraser – Euclidean distance of source from current

composite ( ? )

Interactive Digital Photomontage Presented by : Gagan Bansal

14

Graph Cut

Interactive Digital Photomontage Presented by : Gagan Bansal

15

Gradient Domain Fusion

• Use labels on composite to determine the source gradient field.

• Same as in Perez et al.• Add a constraint – user chooses a pixel whose

color constrained to color in source image

Interactive Digital Photomontage Presented by : Gagan Bansal

16

Applications

• Selective Composites

Interactive Digital Photomontage Presented by : Gagan Bansal

17

Applications

• Selective Composites• Extended depth of field

Interactive Digital Photomontage Presented by : Gagan Bansal

18

Interactive Digital Photomontage Presented by : Gagan Bansal

19

Interactive Digital Photomontage Presented by : Gagan Bansal

20

Interactive Digital Photomontage Presented by : Gagan Bansal

21

Interactive Digital Photomontage Presented by : Gagan Bansal

22

Result – used maximum local contrast

Interactive Digital Photomontage Presented by : Gagan Bansal

23

Applications

• Selective Composites• Extended depth of field• Relighting

Interactive Digital Photomontage Presented by : Gagan Bansal

24

Interactive Digital Photomontage Presented by : Gagan Bansal

25

Interactive Digital Photomontage Presented by : Gagan Bansal

26

Interactive Digital Photomontage Presented by : Gagan Bansal

27

Interactive Digital Photomontage Presented by : Gagan Bansal

28

Result – using max or min luminance

Interactive Digital Photomontage Presented by : Gagan Bansal

29

Applications

• Selective Composites• Extended depth of field• Relighting• Stroboscopic visualization of movement

Interactive Digital Photomontage Presented by : Gagan Bansal

30

Applications

• Selective Composites• Extended depth of field• Relighting• Stroboscopic visualization of movement• Time lapse mosaics

Interactive Digital Photomontage Presented by : Gagan Bansal

31

Applications

• Selective Composites• Extended depth of field• Relighting• Stroboscopic visualization of movement• Time lapse mosaics• Panoramic stitching

Interactive Digital Photomontage Presented by : Gagan Bansal

32

Interactive Digital Photomontage Presented by : Gagan Bansal

33

Interactive Digital Photomontage Presented by : Gagan Bansal

34

Interactive Digital Photomontage Presented by : Gagan Bansal

35

Interactive Digital Photomontage Presented by : Gagan Bansal

36

Result

Interactive Digital Photomontage Presented by : Gagan Bansal

37

Applications

• Selective Composites• Extended depth of field• Relighting• Stroboscopic visualization of movement• Time lapse mosaics• Panoramic stitching• Clean plate production

Interactive Digital Photomontage Presented by : Gagan Bansal

38

Interactive Digital Photomontage Presented by : Gagan Bansal

39

Interactive Digital Photomontage Presented by : Gagan Bansal

40

Result – using max or min likelihood

Interactive Digital Photomontage Presented by : Gagan Bansal

41