microcontroll er based gesture vocalizer
DESCRIPTION
TRANSCRIPT
![Page 1: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/1.jpg)
MICROCONTROLL-ER BASED
GESTURE VOCALIZER
![Page 2: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/2.jpg)
COMMUNICATIONActivity of conveying
Information
Speech and Gestures
![Page 3: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/3.jpg)
MICROCONTROLLER
SENSORIts a converter that measures a
physical quantity and converts it into a signal which can be read by an observer or by an instrument
A microprocessor with inbuilt memory and timers
![Page 4: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/4.jpg)
Large Scale Multi-Microcontroller based system being designed to facilitate the communication among the deaf, dumb and blind.
GESTURE VOCALIZER
![Page 5: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/5.jpg)
MODULES
1.DATA GLOVE
2.TILT DETECTOR
3.GESTURE DETECTOR
4.SPEECH SYNTHESIZER
5.LCD DISPLAY
![Page 6: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/6.jpg)
BEND SENSOR
TILT SENSOR
DATA GLOVE
![Page 7: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/7.jpg)
Data glove has five bend sensors one for each finger
Detects the static movements of finger
BEND SENSOR
![Page 8: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/8.jpg)
BEND SENSOR
![Page 9: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/9.jpg)
Made by using IC-555 timer(In astable mode) along with photo transistor
It has a square wave output
Frequency of this square wave varies with bending of bend sensor
BEND SENSOR
![Page 10: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/10.jpg)
Accelerometer ADXL103, used as tilt detector which detects tilting of hand
Has an analog output varying from 1.5 volts to 3.5 volts
The output of accelerometer is provided to tilt detection module
TILT SENSOR
![Page 11: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/11.jpg)
To decrease the sensitivity of the system , output of accelerometer is amplified using
additional circuitry
TILT SENSOR
![Page 12: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/12.jpg)
TILT DETECTORChecks the output of accelerometer.
sends the binary data against some meaningful gesture to gesture detection module.
Gesture vocalizer system is a dual axis system which can detect tilt of hand in two axes.
Pipelined structure of two ADC 0804 ICs are used to digitize the outputs of two accelerometers.
![Page 13: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/13.jpg)
TILT DETECTOR
Two ADCs have 8-bit output , common data bus and control lines
Pipelining of ADCs is done by using chip select pin
At a given time only one ADC is active
![Page 14: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/14.jpg)
TILT DETECTOR
The microcontroller receives the data from two ADCs one by one and saves them
Now the microcontroller compares these values with predefined values in its memory to represent it’s a meaningful gesture or not
If it is a meaningful gesture, then microcontroller sends the data to gesture detection module
![Page 15: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/15.jpg)
GESTURE DETECTORMost Important and core part
Microcontroller controlled circuitry
Three ports are in use(two input and one output)
• Port 0 • Port 1 • Port 2
![Page 16: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/16.jpg)
GESTURE DETECTOR• Port 0 (Input port)
Microcontroller checks the output of first bend sensor , calculates its pulse width, stores this output and moves on
The bends are quantized into ten levels and the finger must be at any of these ten levels and the system knows how much each finger is bent.
Now the system reads the movements of all the fingers as a whole and moves on to next step , if the bend is a meaningful one.
![Page 17: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/17.jpg)
GESTURE DETECTOR
• Port 1• Receives 8-bit data from tilt detector and if that is a
meaningful tilt, then the gesture as a whole (bend+tilt) is considered as a meaningful one and generates a 8-bit data
This 8-bit data can represent 256 (28 = 256) different gestures
![Page 18: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/18.jpg)
Consists of a microcontroller, a speech synthesizer ( IC SP0256) and a speaker
The microcontroller receives the 8-bit data from gesture detector and determines what gesture has been made
The speech synthesizer IC SP0256 has some allophones
SPEECH SYNTHESIZER
![Page 19: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/19.jpg)
Allophones-Sounds that are merely phonetic variants of the same phoneme are allophonesEg: ’s’ of sing and the ’r ’ of ring
Each allophone has a particular address location
The microcontroller’s 8-bit address corresponds to a particular allophone and same can be heard on speaker
SPEECH SYNTHESIZER
![Page 20: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/20.jpg)
It is useful for the deaf
Voice is represented in text form
LCD
![Page 21: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/21.jpg)
LCD
The 8-bit data given by gesture detection module is given to LCD module.
The LCD display module checks each word and compares it with previously stored values
Based on this comparison, the microcontroller decides what must be displayed on LCD
![Page 22: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/22.jpg)
Two Accelerometers
OVERALL VIEW
![Page 23: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/23.jpg)
Designing of wireless transceiver system for "Microcontroller and Sensors Based Gesture Vocalizer"
FUTURE ENHANCEMENTS
![Page 24: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/24.jpg)
FUTURE ENHANCEMENTSPerfection in monitoring and sensing of
the dynamic movements involved in "Microcontroller and Sensors Based Gesture Vocalizer“
![Page 25: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/25.jpg)
FUTURE ENHANCEMENTSThe Robot control system to regulate machine
activity at remote sensitive sites
![Page 26: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/26.jpg)
Basis for communication for the disabled
Conveys sign language into voice for the blind and as text for the deaf
CONCLUSION
![Page 27: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/27.jpg)
CONCLUSION
India’s population 121 million , 2.1% of population is disabled
Blind - 15 millionDeaf – 10 millionDumb – 2.7 million
Thus if proper light is thrown on R and D for this device , every person with the above three disabilities can communicate easily withanyone
![Page 28: Microcontroll er based gesture vocalizer](https://reader035.vdocuments.site/reader035/viewer/2022062618/54c8e67d4a79595e2f8b45e5/html5/thumbnails/28.jpg)
THANK YOU