why is photorealism the aim? people paint! what is npr? npr issues nonphotorealistic rendering
TRANSCRIPT
![Page 1: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/1.jpg)
• Why is photorealism the aim? People paint!
• What is NPR?
• NPR issues
NonPhotorealistic Rendering
![Page 2: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/2.jpg)
Why photorealism? people paint!
Why photorealism ?
• Physics provides starting point for models
• Photographs provide a foil to test against
But people paint !
• Artwork shows off important regions better
• Photography is just one depictive style amongst many
![Page 3: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/3.jpg)
What is NPR?
• NPR is a sub-branch of Computer Graphics that studies making images that do not look photographic.
• NPR is said to have started around 1990.
• Several sub-divisions exist– paint-boxes– rendering 3D models– rendering from photographs and/or video
![Page 4: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/4.jpg)
Paint boxes
from the simple… …to the complex
![Page 5: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/5.jpg)
Rendering 3D models
Breslav et al, SIGGRAPH 2007
![Page 6: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/6.jpg)
Rendering from photographs and/or video
![Page 7: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/7.jpg)
NPR issues
• NPR depends on perception and interpretation– “drawing implies seeing”– models are much more complex– interaction is common
• Mark making– What kind of mark?– Where to mark?
• No single foil to test against– there is no “correct” drawing
![Page 8: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/8.jpg)
NPR depends on Perception and Interpretation
![Page 9: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/9.jpg)
No single foil to test against
![Page 10: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/10.jpg)
Mark making: what and where?
What: Emulate real media
pencil, oil paint, chalk, …..
physical models possible
can test for quality of a given mark
What: Produce new media
Can the computer be used to make marks not made before?
Where: Should marks be made locally, globally, or both?
How to decide where to place marks?
Where: How can marks be made stable in animations?
![Page 11: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/11.jpg)
• The problems
• Some solutions
NPR from models
![Page 12: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/12.jpg)
The problems
Consider a pencil drawing, marks are used to depict:
• object boundaries and other contours
• shadows and shading
• texture
![Page 13: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/13.jpg)
Apparent ridges
Judd et al, SIGGRAPH 2007
![Page 14: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/14.jpg)
For apparent ridges we need:
• differential geometry of surfaces
• projection
The curvature at a surface point S(x,y) – how curved is the surface?
Use the Hessian, H, which is a 2x2 matrix of 2nd order partials of S.
The EVD of H = UKUT
principle directions, U = [u1 u2], principle curvature, K = [k1 k2]
Ridges and valleys where k1 is an extremum in direction u1.
Project the local surface geometry (tangents, normals ‘n all),
Look for extremum in this observed geometry.
![Page 15: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/15.jpg)
![Page 16: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/16.jpg)
Shadows and shading
Shading lines – cross hatches etc
Can be based in “image space”………or in “object space”
Again, curvature can be used, this time to direct pencil lines.
![Page 17: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/17.jpg)
Other methods use solid texture maps, that adapt to local lighting and geometry
![Page 18: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/18.jpg)
Marks make textures too…
With NPR, even the marks can be animated (look at the sea)
![Page 19: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/19.jpg)
• Where is this used?• Why is this difficult?• What has been done so far?
NPR from images
![Page 20: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/20.jpg)
Where is NPR from images used?
• Photo-booths
• Film special effects
• Adverts
is related to
• Image Based Rendering
![Page 21: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/21.jpg)
What has been done to date?
• 1990 Paint by Numbers
• 1994 Video Impressionism
• 2001 Image Analogies
• 2002 Gaze Directed Rendering
• 2003 Video Tooning
• 2007 Simpler shapes
![Page 22: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/22.jpg)
Why is NPR from images difficult?
• Painting using STROKES– WHAT is a stroke?– WHERE to place them?
• Strokes are not enough
![Page 23: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/23.jpg)
1990: Paul Haeberli “Paint by numbers”
User interaction,
place “strokes” over a photograph.
Stroke colour from pixel
Stoke direction from image gradient
Stoke look from a texture map
![Page 24: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/24.jpg)
a STROKE represents the action of a brush/pencil etc on paper/canvas etc.
![Page 25: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/25.jpg)
There is a lot of work to model strokes;
• Paint brushes
• Palette knives
• Pencil
• Copper plate
We’ll consider shaped dots
We’ll place place and shape them at edges
![Page 26: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/26.jpg)
Where to place a stroke (here a dot)
Artists draw lines at object boundaries
Edge detectors respond to object boundaries
To get edges, typically convolve with Gaussian derivatives
f(x,y)|grad(f*g)|
![Page 27: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/27.jpg)
Shaping a dot
![Page 28: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/28.jpg)
Edges are found using “local” information,
but strokes are best placed using GLOBAL information
![Page 29: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/29.jpg)
Edges do not correspond well to lines drawn by humans
![Page 30: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/30.jpg)
distinguishing between different kinds of “edges” allows differential emphasis
![Page 31: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/31.jpg)
Let’s use the “edge” mapas a kind of target.
Let’s place stokes near-randomly on one painting, but make MANY paintings.
Keep those that match the target best.
Make new painting by spawning strokes from the best fits.
Continue until happy
Detail is kept where needed
Lost where not needed
![Page 32: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/32.jpg)
The situation is worse still when the painting moves…
![Page 33: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/33.jpg)
![Page 34: Why is photorealism the aim? People paint! What is NPR? NPR issues NonPhotorealistic Rendering](https://reader036.vdocuments.site/reader036/viewer/2022062318/5515e0d9550346cf6f8b4cea/html5/thumbnails/34.jpg)
But NPR is more than strokes