6th sense plus in vpm

13
1.0ABSTRACT - Starting from ‘6 TH SENSE TECHNOLOGY’ (SST) is a wearable gestral interfa!e t"at agments t"e #"$si!al worl% aron% s wit" %igital information an% lets s s "an% gestres to intera!t wit" t"at information& '$ sing a !amera an% a tin$ monte% in a #en%ant li e wearable %e*i!e+ , SST , sees w"at $o see an% *is SIXTH SENSE PLUS TECHNOLOGY NAME OF AUTHORS: 1. GAURESH D. VANJARE 2. HARSHIL A. SHETH NAME OF INSTITUTE: VIVEKANAND EDUCATION SOCIETY POLYTECHNIC. CONTACT DETAILS- 1. GAURESH D.VANJARE. EMAIL: [email protected] Con!" n#$%&'-(()*1+0++( 2. HARSHIL A. SHETH. EMAIL: [email protected] Con!" n#$%&'- ..//06.01 COURSE : ELECTRONICS AND COMMUNICATION. YEAR : THIRD YEAR DIPLOMA

Upload: bhavin

Post on 07-Oct-2015

224 views

Category:

Documents


0 download

DESCRIPTION

sixth sense

TRANSCRIPT

FUTURE DETACHABLE ORGAN

SIXTH SENSE PLUS TECHNOLOGYNAME OF AUTHORS:GAURESH D. VANJAREHARSHIL A. SHETHNAME OF INSTITUTE: VIVEKANAND EDUCATION SOCIETY POLYTECHNIC.CONTACT DETAILS- 1. GAURESH D.VANJARE.EMAIL: [email protected] Contact number-9987140449 2. HARSHIL A. SHETH. EMAIL: [email protected] Contact number- 9773326721COURSE : ELECTRONICS AND COMMUNICATION.YEAR : THIRD YEAR DIPLOMA

1.0ABSTRACT-Starting from 6TH SENSE TECHNOLOGY (SST) is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. By using a camera and a tiny projector mounted in a pendant like wearable device, ' SST ' sees what you see and visually augments any surfaces or objects we are interacting with. It projects information onto surfaces, walls, and physical objects around us, and lets us interact with the projected information through natural hand gestures, arm movements, or our interaction with the object itself. 'SST' attempts to free information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.1.1 INTRODUCTION-When we encounter something, someone or some place, we use our five natural senses which include eye, ear, nose, tongue mind and body to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our Digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. fig1.2.11.3 WHAT IS SIXTH SENSE TECHNOLOGY?SST in scientific terms is defined as Extra Sensory Perception or in short ESP. It involves the reception of information not gained through any of the five senses. Nor is it taken from any experiences from the past or known. Sixth Sense aims to more seamlessly integrate online information and tech into everyday life.

1.4 COMPONENTS-

Fig1.4.1 fig1.4.21 Camera

Fig1.4.3

The camera captures and recognises an object in view and tracks the users hand gestures using computer-vision based techniques. 2 Projector

Fig1.4.4A projector opens up interaction and sharing. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces.3 MirrorThe usage of the mirror is significant as the projector dangles pointing downwards from the neck.4 Peripheral Connectors And Wireless MediumMicro USB is used as main connector to connect this technology to pc. This port is also used for charging the device. Also micro HDMI is provided to view FULL HD recorded video on the big TV. Also a 3.5mm jack to connect your earphones is provided.On the contrary ,with the wireless medium go, we can integrate WIFI DIRECT with blazing fast speed for sharing of files, also Bluetooth 3.0 providing faster file transfer and connectivity ,and WIFI to connect to internet and browse the internet at faster speed , also there is DLNA SHARING and NFC sharing.5 Memory Unit, Sim Slot And Processor.It is packed with 1GB RAM, 16GB user memory .It also accepts any sim card for its networks, and processor used here can be Intels atom or cortex processor.6 Colour Markers

Fig1.4.5It is at the tip of the users fingers. Marking the users fingers with red, yellow, green, and blue tape helps the camera recognize gestures. 1.5 HOW DOES IT WORK?

Fig1.5.11. The hardware that makes SST work is a pendant like mobile wearableInterface.2. It has a camera, a mirror and a projector and is connected wirelessly to a Bluetooth or 3G or wifi smart phone that can slip comfortably into ones pocket.3. The camera recognizes individuals, images, pictures, gestures one makes with their hands.4. Information is sent for processing.5. The downward-facing projector projects the output image on to the mirror.6. Mirror reflects image on to the desired surface.7. Thus, digital information is freed from its confines and placed in the physical world.The idea is that SST tries to determine not only what someone is interacting with, but also how he or she is interacting with it. The software searches the internet for information that is potentially relevant to that situation, and then the projector takes over.

1.6 GESTURES"The system is constantly trying to figure out what's around you, and what you're trying to do. It has to recognize the images you see, track your gestures, and then relate it all to relevant information at the same time."The software recognizes 3 kinds of gestures:- Multitouch gestures, make the map move by pinching and dragging.- Freehand gestures, like when you take a picture. -Iconic gestures, drawing an icon in the air. You might want to use other gestures that you use in everyday life. This system is very customizable.-Pantomimic gestures:It means mimicking the actions of doing something.

Fig1.6 GesturesTo give our device an Indian touch we have programmed the gesture of NAMASTE to turn on the device.1.7 OPERATING SYSTEMWe can integrate Linux, android, windows OS etc.

1.8 THE PLUS TECHNOLOGYThe 6th sense plus technology comes with a bionic lens which completely changes the vision for 6th sense. It can do all things that SST can but in much integrated manner.1.8.1 Construction of bionic lens. Fig1.9.1 fig1.9.2 A contact lens display comprising a multipixel light emitting diode (LED) chip (1) power-harvesting/control circuitry (2), antenna (3), and interconnects (4). These subsystems are encapsulated in a transparent polymer (5), creating a system to project virtual images (6) perceivable by the eye of the wearer. (b) LED chip with 100 pixels. LED active layers can be grown a top a transparent substrate. Emitted light travels through the substrate and is reimaged using planar Fresnel lenses. (c) Magnified view with one pixel activated, showing Fresnel lenses opposite each LED pixel.1.8.2 How does it work

Fig1.8.1Here mobile phone can be replaced by 6th sense hardware.1.8.3 A new vision from plus technologyAugmented realitySixth sense technology which uses Augmented Reality concept to super imposes digital information on the physical world. With the help of advanced AR technology (e.g. adding computer vision and object recognition) the information about the surrounding real world of the user becomes interactive and digitally usable. Artificial information about the environment and the objects in it can be stored and retrieved as an information layer on top of the real world viewSee the world like never before. Fig 1.8.3a

Fig 1.8.3c 1.9 GENERAL APPLICATIONS OF 6TH SENSE TECHNOLOGY.1. Viewing Map: With the help of a map application the user can call upon any map of his/her choice and navigate through them by projecting the map on to any surface.

Fig1.9.12 Taking Pictures: Another application of sixth sense devices is the implementation of a gestural camera. This camera takes the photo of the location user is looking at by detecting the framing gesture. Fig1.9.2 3. Drawing Application: The drawing application allows the user you to draw on any surface by tracking the fingertip movements of the users index finger.

Fig1.9.34.Making Calls: We can make calls with help of sixth sense device .The sixth sense device is used to project the keypad onto your palm and then using that virtual keypad we can make call anyone.

Fig1.9.45. Check the time: Draw a circle on your wrist to get a watch that gives you the correct time

Fig1.9.56. Create multimedia reading experiences Sixth Sense can be programmed to project related videos onto the latest newspaper articles you are reading. This ensures that we are connected with the world all the time.

Fig1.9.67. Get product and book information: Sixth Sense uses image recognition or marker technology to recognize products we pick up, and then gives us information on those products. Fig1.9.78. Feed information on people: The system will project relevant information about a person such as what they do, where they work etc.

Fig1.9.89. Wireless sharingWith wifi direct file sharing of about 400mb/min wirelessly can be made possible. This is one of the fastest technologies that have changed the world.And Bluetooth can be used to connect another supported peripheral to it. Also NFC tap sharing and tap to pay technology is integrated to it.10. Voice based technologyLike siri in Iphone 4s we can just speak to do any activity using a voice module.

1.10 SPECIFIC APPLICATIONS1. Sixth sense technology ensures 100 % security from hackers and thefts, as only the one wearing the lens can decode the information.2. This technology can work as a fifth sense for the physically challenged people. Using earphones this device can instruct the blind to move forward or avoid an obstacle.3. Sixth sense technology ensures that all special moments of your life are captured in your camera. Like if your baby takes its first step you can fail to click it using an ordinary camera but just a little gesture and the picture is taken using our device.4. This technology can be used in the medical field such that patients heartbeat and other parameters can be displayed as soon as the camera detects the patient.5. This technology can be used in industries to monitor the performances of machines and send reports of the state of site wirelessly to the control room.6. Can be used by students to submit their assignments, make presentations etc.7. This plus technology can be used by soldier to track the movement of enemy.And many more... 1.11 WHAT CAN PLUS TECHNOLOGY DO?Check mails can be used in office Fig1.11.1 fig1.11.2To check the automation process in security Fig1.11.3 fig1.11.4For navigation for calling a person

Fig1.11.5 fig1.11.6Reading news paper with Augmented reality Getting plant information Fig1.11.7 fig1.11.8And many more with plus technology.1.12 ADVANTAGES-SST is a user friendly interface which integrates digital information into the physical world and its objects, making the entire world your computer.- SST does not change human habits but causes computer and other machines to adapt to human needs.- It uses hand gestures to interact with digital information.- Supports multi-touch and multi-user interaction- Data access directly from machine in real time- It is an open source and cost effective and we can mind map the idea anywhere 1.13 FUTURE ENHANCEMENT-To get rid of colour markers-To incorporate camera and projector inside mobile computing device.- Whenever we place pendant- style wearable device on table, it should allow us to use the table as multi touch user interface.- To have 3D gesture tracking.-To display images holographically.

Fig1.13-To add new toolkit facility for upgradation.1.14 A NEW CONCEPT FOR BLIND TO LET THEM SEE THE WORLD :Let there be light: A microchip packed with 1,500 sensors is implanted in the back of the eye. This then stimulates nerves in the retina which pass signals down the optic nerve to the brain to create an image

Fig1.14.1Sixth Sense Washing MachineThe New Generation 6th Sense appliances from Whirlpool are helping to protect theEnvironment and to reduce your energy bills1.13 CONCLUSIONSixth Sense recognizes the objects around us, displaying information automatically and letting us access it in the way we need. This prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system, allowing us to interact with this information via natural hand gestures. This became the ultimate transparent user interface for accessing information about everything around us. This technology is surely the next big thing in the techno world1.14 REFERENCES1. www.blendernation.com/sixth-sense-technology/2. http://boingboing.net/2009/11/12/sixth-sense-technolo.html3..http://lucasrichter.wordpress.com/2009/03/13/pattie-maes-sixth-sensetechnology-whats-stopping-this/

10.