motion estimation and video compression
DESCRIPTION
MOTION ESTIMATION AND VIDEO COMPRESSION. By, Jarjit Tandel Waseem Khatri Sidhesh Khapare. Outline. Introduction Motion Estimation - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/1.jpg)
MOTION ESTIMATION AND VIDEO COMPRESSION
By,
Jarjit Tandel
Waseem Khatri
Sidhesh Khapare
![Page 2: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/2.jpg)
Outline
Introduction Motion Estimation Motion Compensation Algorithm Block Estimation Algorithm Compression Results Conclusion References
![Page 3: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/3.jpg)
Introduction
Motivation Understand Motion Estimation Reconstruction of Video Using Motion
Compensation
Background A Video sequence consist of series
of frames.
![Page 4: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/4.jpg)
What is Motion Estimation
Predict current frame from previous frame Determine the displacement of an object in
the video sequence
Types of Motion Estimation: Horn and Schunck Three Step Search Block Motion Method Hierarchical Block Motion
![Page 5: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/5.jpg)
What is Motion Compensation
Reconstruction of video file Reference frame is used to predict current frame
using motion vectors.
![Page 6: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/6.jpg)
Proposed Algorithm
Extract frames ‘k’ and ‘k+1’
3-step motion
estimation
Obtain motion vectors
Forward motion
estimation
Predicted video frame
Original frame ‘k+1’
Prediction error
Quantized error
Input Color Video
Predicted video frame
Reconstructed frame ‘k+1’
-
+
++
![Page 7: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/7.jpg)
Proposed Algorithm
Extract frames ‘k’ and ‘k+1’
3-step motion
estimation
Obtain motion vectors
Forward motion
estimation
Predicted video frame
Original frame ‘k+1’
Prediction error
Quantized error
Input Color Video
Predicted video frame
Reconstructed frame ‘k+1’
-
+
++
![Page 8: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/8.jpg)
Three Step Search Method
Input RGB Video
Extract Frames
Select block With lowestMSE/MAD
Divide each Frame into Blocks of
size 16X16
Divide each block into
9 equal parts
Calculate MSE
Select block With lowestMSE/MAD
Divide the selected Block into
9 equal parts
Calculate MSE
Divide the selected
Block into 9 equal parts
Calculate MSE
Select block With lowestMSE/MAD
Draw line connecting Center of frame to this point
Video Frame
16 X 16 Block
![Page 9: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/9.jpg)
Block Representation
Extract frames ‘k’ and ‘k+1’
3-step motion
estimation
Obtain motion vectors
Forward motion
estimation
Predicted video frame
Original frame ‘k+1’
Prediction error
Quantized error
Input Color Video
Predicted video frame
Reconstructed frame ‘k+1’
-
+
++
![Page 10: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/10.jpg)
Predicting Next Frame
Frames ‘k’ and ‘k+1’ Predicted Frame ‘k+1’Motion Vectors
![Page 11: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/11.jpg)
Block Representation
Extract frames ‘k’ and ‘k+1’
3-step motion
estimation
Obtain motion vectors
Forward motion
estimation
Predicted video frame
Original frame ‘k+1’
Prediction error
Quantized error
Input Color Video
Predicted video frame
Reconstructed frame ‘k+1’
-
+
++
![Page 12: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/12.jpg)
Prediction Error Calculation
Frame 60 Frame 61
Prediction error
+
-
Predicted Frame
![Page 13: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/13.jpg)
Results
Forward motion
estimation
3-step motion
estimation
-
+
Quantized error
+
+
Color video Extracted frames ‘k’ and ‘k+1’
Motion Vectors Predicted frame
Predicted frame
Frame ‘k+1’
Prediction errorReconstructed
video frame
![Page 14: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/14.jpg)
Conclusion
Advantages:
Simplicity: Simple geometric transformation of pixel co-ordinate.
Easy to implement in hardware
Limitations:
Fails for zoom, rotational motion, and under local deformations.
![Page 15: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/15.jpg)
References
[1] H. Gharavi and M. Mills, “Block-matching motion estimation algorithms: New results,” IEEE Trans. Circ. and Syst., vol. 37, pp. 649-651, 1990.[2] V. Seferidis and M. Ghanbari, “General approach to block-matching motion estimation,” Optical Engineering, vol. 32, pp. 1464-1474, July 1993. [3] M. Bierling, “Displacement estimation by hierarchical block-matching,” Proc. Visual Comm. and Image Proc., SPIE vol. 1001, pp. 942-951, 1988.[4] B. K. P. Horn and B. G. Schunck, “Determining Optical Flow,” Artif. Intell., vol. 17, pp. 185-203, 1981. [5] S. V. Fogel, “Estimation of velocity vector fields from time varying image sequences,” CVGIP: Image Understanding, vol. 53, pp. 253-287, 1991. [6] T. S. Huang, ed., Image Sequence Analysis, Springer Verlag, 1981. [7] A. V. Oppenheim and R. W. Schafer, “Discrete - Time Signal Processing,” Prentice Hall Signal Processing Series, 1989.[8] A. M. Tekalp, “Digital Video Processing,” Prentice Hall Signal Processing Series, 1995.[9] D. E. Dudgeon, “Multidimensional Digital Signal Processing,” Prentice Hall Signal Processing Series, 1996. [10] K. Sayood, “Introduction to Data Compression,” Morgan Kaufmann Publishers, 2006.
![Page 16: MOTION ESTIMATION AND VIDEO COMPRESSION](https://reader035.vdocuments.site/reader035/viewer/2022062406/56813211550346895d986880/html5/thumbnails/16.jpg)
Thank You