VISVESVARAYA TECHNOLOGICAL UNIVERSITY

“JnanaSangama”, Machhe, Belagavi, Karnataka-590018

A Synopsis On

“Obstacle Detection And Identification Using A Single Camera For

The Visually Impaired”

Sponsored by

Karnataka State Council for Science and Technology [KSCST]

Indian Institute of Science Campus, Bangalore

Submitted in partial fulfillment of the requirements for the award of the degree of

Bachelor of Engineering in

Information Science and Engineering

Submitted by Hamsaveena M M 4GW14IS016

Kavyashree M J 4GW14IS024

Nayana N 4GW14IS028

Vidyashree D 4GW14IS063

Under the Guidance of Tanuja K Amaresha A M

Assistant Professor Assistant Professor, GSSSIETW, Mysuru GSSSIETW, Mysuru

Department of Information Science and Engineering

(Accredited by NBA, New Delhi (Validity 01.07.2017-30.06.2020) Geetha Shishu Shikshana Sangha (R)

GSSS INSTITUTE OF ENGINEERING AND TECHNOLOGY FOR WOMEN (Affiliated to VTU, Belagavi, Approved by AICTE, New Delhi & Govt. of Karnataka)

KRS Road, Metagalli, Mysuru570 016, Karnataka, India

2018

Geetha Shishu Shikshana Sangha (R) GSSS INSTITUTE OF ENGINEERING AND TECHNOLOGY FOR

WOMEN (Affiliated to VTU, Belagavi, Approved by AICTE, New Delhi & Govt. of Karnataka)

KRS Road, Metagalli, Mysuru 570 016, Karnataka, India

Department of Information Science and Engineering Accredited by NBA, New Delhi, (Validity: 01.07.2017 - 30.06.2020)

Project Title: Obstacle Detection and Identification Using

a Single Camera for the Visually Impaired

Project proposal reference number: 4IS_BE_0790

Name(s) of project guide(s): Tanuja K ( Email id: tanujak@gsss.edu.in, Mobile No. 9482088606)

Amaresh A M ( Email id: amaresham@gsss.edu.in, Mobile No.8105051753)

Names of Students:

1. Ms. Vidyashree D ( Email id : shreevidya634@gmail.com, Mobile No. 9945291997 )

2. Ms. Hamsaveena M M ( Email id : hamsaveena24@gmail.com, Mobile No.

9449651872 )

3. Ms. Kavyashree M J ( Email id : mjkavyashree@gmail.com, Mobile No.

8867724185 )

4. Ms. Nayana N ( Email id : nayanagpet@gmail.com, Mobile No. 7022214844)

Keywords Used In The Synopsis

Visually Impaired, Crutch, Renesas RL 78 microcontroller, Ultrasonic Sensor, GPS, LDR,

LED Lamp, Buzzer, Switch, Android Smartphone with camera.

INTRODUCTION

According to the survey of World Health Organization [WHO], there are about 285 million people suffer from lack of vision. It is estimated worldwide: 39 million are blind and 246 million have less vision. Around 90% of the visually impaired live in low income conditions. 82% of people living with blindness are around 50 years of age and above. Globally, uncorrected refractive errors are the main cause of moderate and severe visual impairment; cataract is the leading cause of blindness in middle- and low-income countries.

The number of people visually impaired from infectious diseases has reduced in the last

20years according to global estimates work. 80% of the visual impairments can be prevented

or cured.

In today’s lifestyle, technology has become dependable in many ways thereby

simplifying day-to-day life. As age of human beings increase most of the people lose their

eye sight nowadays, they face more problems in their daily routine life. Aged peoples with

blindness find problem while walking, such as unable to view obstacle at a close distance in

front of them which may inflict injuries to one-self.

In this competitive world the basic problem which every blind person faces is

navigation. The most basic tools for them are walking cane and guide dogs and also on

kindness of fellow commuters. The most commonly used tool is still the blind stick. It suffers

from drawbacks like lots of practice, range of motion, less reliability in terms of dynamic

hurdles and also range detection. Hence, the effort is to try to modify this cane with electronic

components, android application and sensors.

The existing system consists of the blind navigation system which is very less and is

not efficient. The blind traveller is dependent on other guide like white cane, information

given by the people, trained dogs etc. Many visually impaired people use walking sticks or

guide dogs to move from place to place. A guide dog is trained for guiding its users to avoid

the accidents from objects and barriers over a fixed path or in a fixed area. When a visually

impaired person uses a walking stick, he waves his stick and finds the obstacle by striking the

obstacles in his way. The usage of such old devices might be dangerous in some situations

which cannot be relied on. Some new technologies which uses electronic travelling aid and

sensors to develop a smart cane, work efficiently but even they are having disadvantages

wherein they use all the recent technology which is of high cost which cannot be affordable

by common people and such new devices are not user friendly as they are not been taught to

the needy.

The proposed system consists of a system concept to provide a smart electronic aid for

blind people. We propose to design an intelligent device which alerts the person on occurrence of

obstacles. Here, this intelligent device not only alerts but also traces the location of the person

and informs the current position of the person to their care taker through the use of GSM & GPS.

The proposed system also glows LED Lamp with the help of LDR, when the intensity of light

decreases. The proposed system also helps to recognize the obstacles by capturing the picture of

the obstacle through an android smart phone’s camera and send the image to the care taker via

mail. The main advantage of this project is to help visually impaired as well as aged people

to navigate from one place to another. This system can be used for both indoor and outdoor

navigation.

OBJECTIVES

Improving the mobility of the visually challenged.

Incorporating GSM module for the transformation of message.

Comprising of two way transmission through GPS system.

Illuminating LED lamps in dark places to avoid accidents.

Recognize the obstacle detected using android smart phone’s camera.

METHODOLOGY

The system can be represented using algorithms and algorithms are designed using

flowcharts.

Fig 1: Flowchart of the system

The logics of the algorithm help to identify whether there is any obstacle detected in front

of the user by transmitting the ultrasonic waves through ultrasonic sensor. If any obstacle is

detected it calculates the distance if it is less than 70cm it outputs the beep sound then the phone

with the user automatically captures the picture and sends to their care taker through a mail. In

case of emergency if the user presses the switch which is mounted on the obstacle detection unit

then the GPS tracker tracks the user location and send their latitude and longitudinal coordinates

to their care taker as a messages. If any message with this format from user is sent to the care

taker then the application opens with already placed coordinates in it then if the care taker press

the map button in the application they can easily track the user. Even if the care taker want to

track the user they can do by using track back key.

Fig 2: System Architecture

Renesas RL 78 – Control the system by programming.

ALCD – Display message to know the status of the system.

Ultrasonic Sensors – Detect the obstacles.

LDR – Variable resistance that changes with the light intensity.

LED Lamp – Turns on when intensity of LDR is less than 40%.

Buzzer – Starts buzzing when any Obstacle is detected.

Switch – User activates the switch in emergency cases.

GSM – Sends the alert message to the care taker.

GPS – 2 way location tracking system.

Android Smartphone – Contains application to track the user & to capture the

picture to recognize obstacles.

Required components

GSM (Global System for Mobile communication)

Fig 3: SIM800c GSM

Here we have used SIM800C GSM module. The SIM800C is a Quad-band

GSM/GPRS Module which can be embedded easily by customer or hobbyist the

SIM800 delivers GSM/GPRS 850/900/1800/1900MHz performance for voice, SMS,

Data with low power consumption.

Ultrasonic Sensor

Fig 4: Ultrasonic sensor(HC-SR04)

An Ultrasonic sensor is a device that can measure the distance to an object by using

sound waves. It measures distance by sending out a sound wave at a specific

frequency and listening for that sound wave to bounce back. By recording the elapsed

time between the sound wave being generated and the sound wave bouncing back, it

is possible to calculate the distance between the sonar sensor and the object.

Here we have used the HC-SR04 ultrasonic sensor to determine distance to an object

in front of the user. It offers excellent range accuracy and stable readings in an easy-

to-use package. It operation is not affected by sunlight or black material like Sharp

rangefinders are (although acoustically soft materials like cloth can be difficult to

detect).

Global Positioning System (GPS)

Fig 5: GPS Module

The GPS QUESTER TTL is a compact all-in-one GPS module solution intended for a

broad range of Original Equipment Manufacturer (OEM) products, where fast and

easy system integration. The receiver continuously tracks all satellites in view and

provides accurate satellite positioning data. The GPS QUESTER TTL is optimized for

applications requiring good performance, low cost and maximum flexibility, suitable

for wide range of OEM configurations including sensors, asset tracking, PDA- centric

personal navigation system, and vehicle navigation products.

Renesas Microcontroller

Fig 6: Renesas RL78 microcontroller

Renesas RL78 microcontroller is a general purpose register which is 8*32 bits

register. It has a ROM of 512KB, RAM of 32KB and a single chip power supply,

flash memory with a prohibition of block, arrays or writing function the data flash

memory is of 8KB, it has a on chip debug function and watch box timer and has 8 or

10 bit resolution AD convertor. It has totally 11 ports with 58 idle pins. The minimum

instruction time can be changed from ultra low speed to high speed. This

Microcontroller is used because it is less prone to damage due to electrostatic charge

and the controller operates with 5 volt power supply.

LED LAMP

When the Intensity of LDR sensor is less than 40% LED driver drives the relay and

intern LED lamp turns ON in dark places to avoid accidents..

Fig 7: LDR sensor

Android

Android is open source in Linux based operating system for mobile devices such as

smart phones and tablet computers. Android applications are developed in JAVA

programming language using android software development kit. Linux kernel is a

bottom of the layer which provides a level of abstraction between the device hardware

and contains all the essential hardware devices like camera and display etc.

Smartphone

Fig 8: Smartphone

A smart phone is a handheld personal computer with a mobile operating system with

an integrated mobile broadband cellular network connection for voice, SMS, and

Internet data communication etc,. If not many smart phones also support Wi-Fi.

Smartphone's are typically pocket-sized. They are able to run a variety of software

components known as apps. Most basic applications will be pre-installed in the

system, while others are available for download from official sources like the Google

Play Store or Apple App Store.

User holds obstacle

detection model with the

smart phone the camera

captures the image and

end to their care taker

Send the captured

obstacle and a

locations of the user

to their care taker

RESULTS AND CONCLUSION

The results of the system is as shown below

Fig 9: Final Prototype of Obstacle Detection Unit at User Site

In this project, a solution is proposed and implemented to help blind to move safely

and detect obstacles in their path. Solution was composed of a stick with an ultrasonic sensor

and an emergency switch mounted on it along with android smart phone. The proposed

system contains single ultrasonic sensor through which the obstacles are detected and android

smart phone to capture the obstacle and send it to their care taker.

Fig 10: How the operation takes place

It also includes a two way transmission of location through GPS and it also have LEP

lamp incorporated in case of emergency to protect the user. This paper can be concluded in a

single sentence that is it gives an alert to the user about the obstacle using ultrasonic sensor

and sends the location and obstacle ahead of the user to the care taker during emergency

conditions.

user to

smart

phone

USER

Smartphone Obstacle captured by

smart phone

Obstacle detected sent

to the caretaker as a

mail

Fig 11: Snapshots of care taker module

FUTURE WORK

With the ongoing changes taking place in today’s technology the entire unit can be

made into a simple and compact device. Flexible solar power developed on a plastic strip can

be attached to the unit as the source of power supply. It can provissde audio cues in their

native language through Google Language Assistance.

Geetha Shishu Shikshana Sangha (R)

GSSS INSTITUTE OF ENGINEERING AND TECHNOLOGY FOR WOMEN (Affiliated to VTU, Belagavi, Approved by AICTE, New Delhi & Govt. of Karnataka)

KRS Road, Metagalli, Mysuru 570 016, Karnataka, India

Department of Information Science and Engineering

Accredited by NBA, New Delhi, (Validity: 01.07.2017 - 30.06.2020)

"Obstacle Detection and Identification using Single Camera

for the Visually Impaired"

Hamsaveena M M*, Kavyashree M J*, Nayana N*, Vidyashree D*, Tanuja K#

Student*, Assistant Professor#

Department of Information Science and Engineering,

GSSS Institute of Engineering and Technology for Women, Mysuru, India

Affiliated to Visvesvaraya Tecnological University, Belagavi, India

The aim of this project is to develop application specific program to detect the

obstacle in the path of the visually impaired utilizing the camera of a smart phone. If any

obstacle is employed in their path the camera root out the hindrance and provides

information to them in order to avoid the detected obstacle.

According to estimates from the World Health Organization (WHO) prevention of

blindness program, there are about 285 million people are visually impaired worldwide and

39 million are blind and 246 million have low vision. About 90% of the world's visually

impaired people live in developing countries. 65% of visually impaired and 82% of blind

people is over 50 years of age.

Visually impaired faces trouble while travelling outside. As they are unaware of the

surroundings they don’t have information about their relative localization with the

surrounding objects. In order to tackle this problem, this project focuses on developing a

system to detect object within the line of vision of the visually impaired. The information

about the detected objects will be conveyed in the form of audio cues to the user and mail to

their care taker.

The main objectives of the project is to develop obstacle detection model and a

specific application in order to detect the obstacle and intimate the same to the user. The

project aims to improve the mobility of the visually challenged as it is one the biggest

factors that affects their quality of life. Smartphone have become ubiquitous, with good

quality cameras at an affordable price. So, this project aims to detect objects and identify

them in real time, and provide audio cues to the visually challenged, so this helps them to

identify their surroundings, ultimately helping them in navigation. By incorporating GSM

module for the transformation of message the obstacle detection model helps the visually

impaired to share their location to their care taker. The android application Comprises of

two way transmission through GPS system. Obstacle detection model illuminates the LED

lamps in dark places to avoid accidents.

Geetha Shishu Shikshana Sangha(R) GSSS INSTITUTE OF ENGINEERING AND TECHNOLOGY FOR WOMEN

(Affiliated to VTU and approved by AICTE, New Delhi & Govt. Of Karnataka) K.R.S. Road, Metagalli, Mysuru -570 016

Department of Information Science and Engineering Accredited by NBA, New Delhi (Validity: 01.07.2017 - 30.06.2020)

“Obstacle Detection and Identification using Single Camera for the Visually Impaired”

According to the survey of World Health Organization (WHO) there are about 285 million people are visually impaired worldwide and 39 million are blind and 246 million have low vision. About 90% of the world's visually impaired people live in developing countries. 65% of visually impaired and 82% of blind people is over 50 years of age. Hence to overcome the difficulty faced by visually impaired and old age people, this project aims to develop application specific program to detect the obstacle in the path of the visually impaired utilizing the camera of a smart phone. If any obstacle is employed in their path the camera root out the hindrance and provides information to them in order to avoid the detected obstacle. Visually impaired faces trouble while travelling outside. As they are unaware of the surroundings they don’t have information about their relative localization with the surrounding objects. In order to tackle this problem, this project focuses on developing a system to detect object within the line of vision of the visually impaired. The information about the detected objects will be conveyed in the form of audio cues or message.

Team Members: Hamsaveena M M, Kavyashree M J, Nayana N, Vidyashree D

Guided By: Tanuja K, Assistant Professor of Dept. of ISE