depth coding using a boundary reconstruction filter for 3-d video systems kwan-jung oh, anthony...
Post on 19-Dec-2015
215 views
TRANSCRIPT
![Page 1: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/1.jpg)
Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems
Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEECSVT, MARCH 2011
![Page 2: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/2.jpg)
Outline
• Introduciotn• Analysis of Depth Coding• Depth Boundary Reconstruction Filter• Experimental Results
![Page 3: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/3.jpg)
Introduction
• Depth coding must consider the rendering quality it is capable of producing at different rates.
• 2 main groups of depth coding technique : (depending on the relation with color video coding )
– Joint coding– Independent coding
![Page 4: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/4.jpg)
Analysis of Depth Coding
Flat region : SKIP, Inter/Intra 16×16
Complex region : detail partitions
Flat regions need less rate and have less distortion
![Page 5: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/5.jpg)
Analysis of Depth Coding
• Relationship between QP and distortion/rate Mean squared error
Average coding bits
![Page 6: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/6.jpg)
Analysis of Depth Coding
• Even the complex region spends many coding bits, it incurs a large distortion and is sensitive to QP changes.
• Even small pixel changes in depth image have a notable effect on rendering quality.– Especially, the changes around the boundaries.
![Page 7: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/7.jpg)
Depth Boundary Reconstruction Filter
• Consider 3 measures : 1) Occurrence frequency
2) Similarity
3) Closeness
8 8 8 8 8
8 0 7 7 8
0 8 9 7 8
2 8 8 8 8
8 7 7 8 8
![Page 8: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/8.jpg)
Depth Boundary Reconstruction Filter
• Test various combinations of the 3 costs
• Cost function considering above measurement
![Page 9: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/9.jpg)
Depth Boundary
Reconstruction Filter
![Page 10: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/10.jpg)
Depth Boundary Reconstruction Filterbefore
after
Advantage• Robust against outliers• Filtering does not create new
unrealistic pixel values
![Page 11: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/11.jpg)
Depth Boundary Reconstruction Filter
• Some Gaussian noise still remains after filtering Apply 3×3 bilateral filter to eliminate the remaining errors.
• Use the proposed filter as an in-loop filter located right after the deblocking filter.
![Page 12: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/12.jpg)
Depth Boundary Reconstruction Filter-- determination of filter parameters
• Assume that the window size and range sigma having the best depth quality would guarantee the best rendering quality.
• Find the best parameters by considering depth quality for each slice• Encode the information into the bitstream 6 bits/slice
![Page 13: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/13.jpg)
Experimental Results
• Depth Rate & Depth Quality • Method 1 : proposed method without bilateral filter• Method 2 : proposed method with bilateral filter
Method 1 Method 2
Depth quality + 0.54 dB + 0.71 dB
![Page 14: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/14.jpg)
Experimental Results
![Page 15: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/15.jpg)
Experimental Results
• Depth Rate & Rendering Quality
Method 1 Method 2Rendering quality + 0.15 dB + 0.14 dB
![Page 16: Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems Kwan-Jung Oh, Anthony Vetro, Fellow, IEEE, Yo-Sung Ho, Senior Member, IEEE CSVT,](https://reader030.vdocuments.site/reader030/viewer/2022032800/56649d2c5503460f94a02110/html5/thumbnails/16.jpg)
JMVC 3.0 JMVC 3.0proposed proposed
left
right