![Page 1: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/1.jpg)
Disclaimer
It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature. The sole purpose of displaying these altered images is to show the seriousness of this issue and consequently the threat these manipulated images can cause to world peace .
The messages in these images don’t reflect the views of the presenters, people involved in this project or University at Albany.
![Page 2: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/2.jpg)
Hezbollah’s “Made In USA” Billboard in Southern Beirut
![Page 3: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/3.jpg)
AUTHENTIC !!
![Page 4: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/4.jpg)
Photograph showing a U.S. Marine posing with Iraqi kids holding a provocative sign, April 2004
![Page 5: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/5.jpg)
“Lcpl Boudreaux killed my Dad. Th(en) he knocked up my Sister !”
![Page 6: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/6.jpg)
Another Version: The ‘Positive’ morph
![Page 7: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/7.jpg)
“Lcpl Boudreaux saved my Dad. Th(en) he rescued my Sister !”
![Page 8: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/8.jpg)
Hero ?
Villian ?War
Peace
![Page 9: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/9.jpg)
Detecting Photo Manipulations on Signs and Billboards
Matthew Frey & Darshan ShindeDept. of Computer Science,
University At Albany, NY.
![Page 10: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/10.jpg)
Our Application is based on Research Paper of
Valentina Conotter
Hany FaridGiulia Boato
Dartmouth College, NHUniversity of Trento, Trento (Italy)
![Page 11: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/11.jpg)
Basic outline of the technique used
“When text is on a planar surface and imaged under perspective projection, the text undergoes a specific distortion. When text is manipulated, it is unlikely to precisely satisfy this geometric mapping, which can be detected.”
We exclusively concentrate on Projections
in our work.
![Page 12: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/12.jpg)
Example
![Page 13: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/13.jpg)
Example : Crude Edit Using MS-Paint
![Page 14: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/14.jpg)
Detection Techniques mentioned in the Paper
Planar Homography
Known Font
Unknown Font
Photo Composite
Future Work}
Applied}
![Page 15: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/15.jpg)
Planar Homography
A homography is an invertible transformation from a projective space to itself that maps straight lines to straight lines.
Synonyms are collineation, projective transformation, and projectivity.
![Page 16: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/16.jpg)
![Page 17: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/17.jpg)
Pla
ne o
f Te
xt
Pro
ject
ions
dra
wn to
each
poin
t
![Page 18: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/18.jpg)
Plane 1Projections 1
Projections 2
Plane 2
Projections 1 and 2 are not parallel in case of inconsistencies
![Page 19: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/19.jpg)
Welcome to Fabulous Las Vegas
![Page 20: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/20.jpg)
A ‘Refined’ edit using Photoshop (Scaled, Rotated)
![Page 21: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/21.jpg)
Attempt to bypass Planar Homography in Photoshop
![Page 22: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/22.jpg)
Known Font
Assuming that the font style is known, the string in its world coordinate system can easily be determined. From the pair of images, we automatically extract the image and world coordinates required for the planar homography estimation
![Page 23: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/23.jpg)
A feature vector consisting of local gradients is measured at each keypoint position. Keypoints are matched between two images using a variant of nearest neighbor matching on the feature vectors. This association accounts for a geometric transformation between the images by matching keypoints up
to a planar homography.
![Page 24: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/24.jpg)
Unknown Font
When the font of the text in question cannot be easily determined by visual inspection, we adopt the following technique for automatically identifying the font style.
The font style that returns the largest number of matched keypoints is taken to be the correct font.
![Page 25: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/25.jpg)
Photo Composite
![Page 26: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/26.jpg)
Conclusions
Since no forgery is perfect, the inconsistencies in alignment and fonts often creep in.
With that said, it is quite easy to detect the forgeries in the signs using the mentioned techniques – for not all would know how to do a ‘Perfect murder’ of a billboard.
A determined forger could circumvent this technique by applying the correct homography to the inserted text. Taking this in account, relevant techniques like CFA interpolation, noise levels, can be considered.
![Page 27: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/27.jpg)
ManipulationDetector® : Our MATLAB Application to detect text forgery
Term Project for CSI 660, Digital Image Forensics, Prof. Sewei Lyu
Important features:
Compact, just around 30 Lines of code.
Written completely in MATLAB
The system is able to detect inconsistencies in Planar Homography and Font.
We exclusively use Planar Homography techniques for this.
![Page 28: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/28.jpg)
Demo Of Current Work
![Page 29: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/29.jpg)
Planar Homography: Airport Sign
![Page 30: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/30.jpg)
Homography: Airport Sign Original Picture
![Page 31: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/31.jpg)
![Page 32: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/32.jpg)
![Page 33: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/33.jpg)
Our Technique For Known Font
Select two points on a letter in text area.
Repeat this procedure by selecting similar points for same letter which may be located in forged text area.
Program draws the lines. If the length of the lines is found to be same, the font is same.
The distances have to be in proportion if the plane is inclined
![Page 34: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/34.jpg)
Incorrect Font in Fabulous Las Vegas
![Page 35: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/35.jpg)
Comparison of ‘S’ (Proportional resize implemented here)
x y
Since x ≠ y, fonts are inconsistent
![Page 36: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/36.jpg)
Angled Surfaces : Proportions of Font Lengths remain Constant
x y x1
y1
For Consistent Fonts,
x / y = x1 / y1
![Page 37: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/37.jpg)
Steps Software Takes For Detection
![Page 38: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/38.jpg)
Text Area Selection
![Page 39: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/39.jpg)
Selected text image saved as JPEG for MATLAB parsing
![Page 40: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/40.jpg)
Points selected for linear comparison
![Page 41: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/41.jpg)
Lines are drawn based on point profile
The slopes of these lines can then be compared to determine the homography of the text
![Page 42: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/42.jpg)
How does it work ?
Works by testing the principle of Planar Homography.
Tests if the text in the supposedly edited area is in same plane or not.
For considering this, we select points on the font.
Lines are drawn showing consistency of the plane in which the text is placed
![Page 43: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/43.jpg)
Limitations
Works only if the edited text has been placed in inconsistent projection.
Cannot work if individual letters are placed in different planes .
Example: ‘Hollywood’ Meets ‘Bollywood’
![Page 44: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/44.jpg)
Complicated Scenario: Multiple Planes, Different ‘Depth’
![Page 45: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/45.jpg)
?
![Page 46: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/46.jpg)
Limitations (Continued)
Works only if the edited text has been placed in inconsistent projection.
Cannot work if individual letters are placed in different planes .
Example: ‘Hollywood’ Meets ‘Bollywood’
May not work precisely for fonts that are closely related (i.e. Calibri and Cambria)
![Page 47: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/47.jpg)
Calibri & Cambria
![Page 48: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/48.jpg)
Limitations (Continued)
Works only if the edited text has been placed in inconsistent projection.
Cannot work if individual letters are placed in different planes .
Example: ‘Hollywood’ Meets ‘Bollywood’
May not work precisely for fonts that are closely related (i.e. Calibri and Cambria)
The results are largely altered if points are not correctly selected.
![Page 49: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/49.jpg)
Future Work
Automate the selection process for Text Area.
Automated procedure for selecting the points for drawing lines for Planar Homography.
Complete detection mechanism for Font Inconsistencies by Font comparison automaton.
A detecting mechanism for CFA Interpolation & Noise Variations for better results.
![Page 50: It is not uncommon to see the uproar that manipulated images cause in media. Some slides have images containing messages that may be controversial in nature](https://reader038.vdocuments.site/reader038/viewer/2022103111/551a2cf9550346545e8b48b6/html5/thumbnails/50.jpg)
Questions ??