Extending Google Goggles to Identify services offered by

objects

CMSC 601-Basic Research SkillsMay 11, 2011

Presented by,

Anurag Korde

Mobile technology- access information from anywhere at anytime

Cloud computing-does computations on shared resources and provides storage, security and infrastructure as a service[3]

Semantic computing-stores, analyzes and find correlation between data[4]

Introduction

Mobile devices have limited power and processing capabilities

Increase in applications requiring high computation

Small display- difficult to type search queries

Google Goggles[1] do not give services offered by objects

Large computation required for image analysis and comparison

Problems

SolutionReduce volume of processing on mobileOffload the computation on cloudSend only results to mobileUse visual search along with geo-location

information

ImportanceUsing Cloud computing increases scalability and

efficiency, low cost, high performanceReduces mobile power consumptionIncrease in number of applications and its useReduces image comparison with large image

dataset

Solution and its Impact

Google Goggles[1]Allows visual searchNo need to type or say queryGoogle has a dataset of 1 billion images

Related Work-I

Images:[1]

Google Sky Map[2]Point your mobile towards skyShows planets, stars, constellationsUses mobile geo-location and compass angle

Related Work-II

Images:[2]

StrengthsUser friendlyWorks on books, landmarks, logos, business

cards, etcSolves Sudoku!!

WeaknessesCannot identify common objects: animals,

plants, foodCannot solve complex AI gamesGives only the information associated with

objectSearches over a large image dataset

Related Work-III

Proposed Architecture

Image search and service mapping

Take a snap

Image

Results(Information / Services)

Images:[1] and www.google.com/images

Approach-IImage based Search and compare image with large datasetFilter the search based on contextExtract service information

Approach-IIUses geographic location of mobileExtract information using GPS, accelerometer

and compassFind the intersection between the data and

mapExtract service and other information

Implementation/Methodology

Images: www.google.com/images

Develop and deploy a working prototype

Run application in:Various scenariosWith different test objects

Calculate error rate

Improve dataset if necessary

Evaluation

Improve and expand the image dataset

Identify common objects: animals, plants, food

Play difficult AI games like chess

Face recognition using social profile

Future Work

Google Goggles[1]-provides visual search on limited objects, needs one extension i.e. give services by object

New approach for visual searching-location and context based

Added new functionality i.e. retrieval of services offered by the captured object

Conclusion

[1] www.google.com/mobile/goggles

[2] http://www.google.com/mobile/skymap

[3] Srinivasa Rao V, Nageswara Rao N K, and E Kusuma Kumari. Cloud computing: An overview. Journal of Theoretical and Applied Information Technology.

[4] Sonal Anand, Sarvesh Gupta, Shweta Fatnani, Varsha Sharma, and Deepti Jain. Semantic cloud for mobile technology. International Journal of Computer Applications

References

Thank You….!!!