android app for identifying digital signage...

21
Introduction Collecting data Pixel analysis Training data Results conclusion Questions/live demo Android App for Identifying Digital Signage Viewer Dane Hylton Kennesaw State University April 27, 2017 Dane Hylton Android App for Identifying Digital Signage Viewer

Upload: others

Post on 10-Aug-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Android App for Identifying Digital Signage Viewer

Dane Hylton

Kennesaw State University

April 27, 2017

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 2: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Race detection

E-Tech software predicts ethnicity based on person’s last name

Kairos: http://kairos.com/diversity-recognition

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 3: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Ethnicities used:

African/black

Asian

Indian

Hispanice/Latino

Midille Esastern

White/Caucasian

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 4: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Data collection

The data was comprised of face pictures taken from theinternet.

20 data sets of each race were collected.

Each data set included 10 male and female.

Each picture were then editted to get as close to the face aspossible (this was done to avoid background pixel data).

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 5: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Samples

Original Image Edited image

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 6: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Finding the most frequent pixels

Objective: find the most frequent pixels (frequency pixels)

Finding the most occuring pixles for each race gives and ideaof what pixel values to look for when detecting race.

Images were processed in Matlab and stored in their originaldimensions.

A matrix was formed for each race with their frequency pixels.

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 7: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Converting from RGB to HSV

HSV color

Named for 3 values: hue, saturation, and value. Why useHSV?

To analyze the pixels and sort them interms of their tone.

Will be easier to find specific range of colors.

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 8: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Sorting HSV colors

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 9: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Intervals of HSV colors for detecting race

For the 20 frequent pixels of each race the average of thebottom half (abh) and the top half was (ath).

A detected face would need to be in this range to detectsomeone’s race.

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 10: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Sample data with intervals: abh tbh

For the 20 frequent pixels of each race the average of thebottom half (abh) and the top half was (ath).

A detected face would need to be in this range to detectsomeone’s race.

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 11: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Sample

Sorted HSV pixels for Africanimage data

Upper and lower bound forafrican data

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 12: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Sample data with intervals: abh tbh

For the 20 frequent pixels of each race the average of thebottom half (abh) and the top half was (ath).

A detected face would need to be in this range to detectsomeone’s race.

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 13: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Neural network architecture

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 14: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Weight training

Error term for ouput

δOk = Ok(E )(1 − ok(E ))(tk(E ) − Ok(E ))

where Ok(E ) is the ouput, and (tk is for categorization.

Error term for hidden unit.

δhk = hk(E )(1 − hk(E )) ·∑

i∈outputs(wkiδOi

)

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 15: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Calculating new weights

For each weight wij .

Between input unit i and and hidden unit j . The learning raten = 0.7.

∆ij = nδhj xi

Between hidden unit i and output unit j.

∆ij = nδOjhi (E )

where hi (E ) is the output from the hidden unit i for E.

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 16: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Weights obtained

w1 = 0.8108w2 = 0.0121w3 = 0.0730w4 = 0.3268w5 = 0.0613w6 = -0.9008w7 = 0.5139w8 = 1.0427w9 = 0.4881w10 = 1.0745w11 = -0.1855w12 = 0.6990w13 = 0.6308w14 = -0.3979w15 = 0.4430w16 = 0.5668w17 = 0.9113w18 = 1.0292

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 17: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Results

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 18: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Results

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 19: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Results

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 20: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Conclusion

Race detection is very hard!

A lot of variable to take into consideration.

Neural networks are hard to train especially for novices.

No known data/algorithm for detecting race/ethnicity is opensource.

Dane Hylton Android App for Identifying Digital Signage Viewer

Page 21: Android App for Identifying Digital Signage Viewerksuweb.kennesaw.edu/~mkang9/teaching/CS7455/548553-1051953 … · Introduction Collecting data Pixel analysis Training data Results

IntroductionCollecting dataPixel analysisTraining data

Resultsconclusion

Questions/live demo

Live DEMO

Questions?

Live Demo

Dane Hylton Android App for Identifying Digital Signage Viewer