sample thesis
Post on 17-Feb-2016
19 Views
Preview:
DESCRIPTION
TRANSCRIPT
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
TOUCH ENABLED SURFACE USING A PROJECTED DISPLAY
A Title Submitted to the Faculty of the College of Engineering, Computer Studies and Architecture
Lyceum of the Philippines University – Cavite
In partial Fulfillment of the Requirements of the Degree Bachelor of Science in Electronics Engineering
Baterbonia, Christine B.Castillo, Sarah Jane T.
Castro, Jennalyn N.Costacio, Lean Joy P.
September 24, 2015
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
CHAPTER 1
INTRODUCTION
A projected display is a computer output surface that are fed from the desktop and
displayed by a projecting mechanism that shows text and graphic content to the user. It
usually displays the current interface of the desktop and would continue to display the
changes made by the user in real time. As we advanced to a more technological age
different mechanisms have been developed to offer wide varieties of features to be
integrated with the simple display. Projectors have been made with Bluetooth and more
advanced firmwares. Interactive projector and board however introduced another aspect
into just displaying graphics intended by the user for his/her presentation. These
mechanism introduced touch control onto the actual projection/display. This means that
this device allows the user to control the desktop/presentation that is shown onto the
display. Interactive whiteboards allows controlling the desktop through a special pen and
even enables them to write to the display surface. However these whiteboards are not put
into common use. Although they provide a great advantage to the professionals who are
in need of a presentation media, they also require a great amount of money to have them
installed. Interactive projectors however are just basically composed of a camera, a pc
and software to translate the camera feed as the substitute to a mouse input.
This study however would replace a desktop with a much less complicated
version of itself, the raspberry pi. A camera would be connected into the raspberry pi
which would load a program to interpret the pen’s motion that would control the cursor.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
The provided software would track the pen through the camera. The pen however would
have an infrared led into its tip for tracking purposes. Using software that used advanced
image processing the infrared light emitted by the pen would be converted into blobs that
would be tracked and processed either as a mouse click or just a simple mouse track.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
BACKGROUND OF THE STUDY
The first revolutionary teaching tool—the humble blackboard—found its way into
classrooms back in 1801 and had a profound impact on the nature of teaching over the
next 200 years. The blackboard became synonymous with the traditional classroom and is
still seen as a stereotypical symbol of education. The interactive whiteboard—or IWB—
has the potential to be the second revolutionary teaching tool. Just as the blackboard was
seen as a key part of nineteenth- and twentieth century classrooms, the Interactive White
Board has the capability to become synonymous with the new digital classrooms of the
twenty-first century. In the same way that the old-style blackboards were a technology
that could be used in traditional schools every day by all teachers, interactive whiteboards
are already displaying their facility to be used in this ‘every-day-by every-teacher’ way in
our emerging digital schools.
An interactive whiteboard is an instructional tool that allows computer images to
be displayed onto a board using a digital projector. The instructor can then manipulate the
elements on the board by using his finger as a mouse, directly on the screen. Items can be
dragged, clicked and copied and the lecturer can handwrite notes, which can be
transformed into text and saved.
Every interactive whiteboard system requires three basic components: a computer,
projector and the interactive whiteboard. To use it, the projector is connected to both the
computer and interactive white board so that the document or media opened on the
computer is displayed for the audience on the screen. In contrast to previous conventional
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
computer and projector setups, the user controls the interactive white board directly from
the surface of the screen either by using the special pens accompanied with the board or
with the touch of a finger. In this way, the user can interact with the interactive white
board so as to more readily engage the audience. While most interactive white board only
allow for one input or finger/pen to be used at a time, the new models recently released in
2012 can allow up to four users to simultaneously select, write or draw on the board
(“SMART Tech, 2012).
The use of IWBs in schools around the world is growing; according to a June 2011
report by Future source Consulting, a research firm that specializes in education
technology. It found that the IWB market grew in 2010 by 15percent, which translates
into more than 3.6 million globally installed IWBs. No matter the type of lesson or
subject area, the interactive whiteboard can prove to be a valuable tool to help ensure all
areas of the curriculum are presented in an engaging and motivating way (MacIntyre cites
Starkman, 2006, pg. 2). The positive impact of the interactive whiteboard does not end
at the student level. Teachers found that instruction delivered using the interactive
whiteboard was interesting, relevant, appealing and involving (Beeland, 2007). Students
were focused on the lesson 84% of the time, contributed to classroom discussions 78% of
the time, and enjoyed learning (by self-report) 100% of the time when the SMARTBoard
was used (Amolo & Dees, 2007), causing less time spent on classroom management. By
the using the IWB technology, students has the ability to increase their interactivity with
the curriculum within the classroom thus participating in a learner-centered curriculum
with the focus on the needs and concerns of the individual (Schiro, 2008).
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
Development of Hardware/Prototype
Design of an Interfacing circuit for Hardware/Prototype
Software Development
Testing Validation
Touch Enabled Surface using a
Projected Display
HARDWARE Raspberry Pi Infrared Camera Infrared Pen Projector
SOFTWARE Visual Studio
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
CONCEPTUAL FRAMEWORK
INPUT PROCESS OUTPUT
Figure 1.
Conceptual Framework.
The development of the research was dependent on the different elements used for the
study. The said elements are:
Raspberry Pi that acted as the main processing unit of the system
Infrared Camera which detected the movement and path created by the pen
Infrared pen that acted as the main input device of the system
Projector that was the main display hardware
Visual Studio to create a program that would process the video feed and interpret
it into a series of commands and computer actions.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
OBJECTIVES OF THE STUDY
The Touch Enabled Surface through a projected display is a
sophisticated replacement of the traditional whiteboard. The
researchers aim to develop a device that:
Can create an interactive panel with the help of the projected
display to make discussion not time consuming.
Can manipulate what is displayed on the board through a
special pen directed on the surface.
Will serve as an educational aid where you can write additional
notes or solutions providing an application for a note/lecture
editor.
Can save notes which are on the panel for future use.
The IR pen can act as clicker (next/previous) if away from the display.
Has a toolbar icon that is always displayed.
Has an application that will act as calculator which has the ability to solve
trigonometric function in degree/radians and complex numbers.
.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
SIGNIFICANCE OF THE STUDY
The proposed project has many benefits to individuals, groups and communities.
Below are the target beneficiaries of the project:
LPU Electronics Engineering Educator Sector. It gives an interactive tools and
application for the professors and instructors to make some complex concepts easy to
understand and improve their teaching practices.
LPU Electronics Engineering Society. It gives people the opportunity to absorb
information in multiple formats, and also the project will educate them to the field of
image processing, object tracking and IR filtering.
Future Researchers. It gives ideas, techniques and strategies for future designs and
projects. It also feeds advanced knowledge on our existing electronic devices which can
be integrated for better creation and invention.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
SCOPE AND DELIMITATIONS
The proposed project fills in the effectivity use of a human interface device that is
designed to allow you to activate icons and other features of the software running on your
machine. You can turn the wall or other surface into your computer's touchscreen
immediately. It can capture and save notes written on that surface to the connected
minicomputer and also can manipulate using click and drag which annotates
a program or a presentation. The normal webcam has 45degree view angle and need to
place a bit far away from the screen to see the full view of the surface. The Infrared pen
can act as a controller, clicker or remote. Also, has built in calculator application.
The system can’t operate if there is a power failure. It can only be manipulated by
using single infrared pen; can’t be multi touch. This device is only a prototype and cannot
create files in Microsoft Office, Open Office and other.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
DEFINITION OF TERMS
Bluetooth. Wireless technology standard for exchanging data over short distances (using
short-wavelength UHF radio waves in the ISM band from 2.4 to 2.485 GHz) from fixed
and mobile devices, and building personal area
( http://www.webopedia.com/TERM/B/bluetooth.html ).
C++ . A general-purpose programming language. It has imperative, object-oriented
and generic programming features, while also providing facilities for low-level memory
manipulation (https://msdn.microsoft.com/en-us/library/teas0593.aspx).
Image Processing. Processing of images using mathematical operations by using any
form of signal processing for which the input is an image, such as a photograph or video
frame; the output of image processing may be either an image or a set of characteristics
or parameters related to the image
(http://www.pcmag.com/encyclopedia/term/44796/image-processing).
Infrared (IR). Invisible radiant energy, electromagnetic radiation with
longer wavelengths than those of visible light, extending from the nominal red edge of
the visible spectrum at 700 nanometers (frequency 430 THz) to 1 mm (300 GHz).
(http://www.merriam-webster.com/dictionary/infrared).
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
Infrared Tracking. Refers to a passive missile guidance system, which uses
the emission from a target of electromagnetic radiation in the infrared part of
the spectrum to track it. Missiles that use infrared seeking are often referred to as "heat-
seekers", since infrared is just below the visible spectrum of light in frequency and is
radiated strongly by hot bodies (http://www.webopedia.com/infrared/tracking.html).
Interactive Whiteboard. Large interactive display that connects to a computer wherein
a projector projects the computer's desktop onto the board's surface where users
control the computer using a pen, finger, stylus, or other device
(http://www.pcmag.com/encyclopedia/interactive-whiteboard).
OpenCV (Open Source Computer Vision). Library of programming functions mainly
aimed at real-time computer vision originally developed by Intel. It is free for
commercial and research use under a BSD license
(http://encyclopedia2.thefreedictionary.com/OpenCV).
Projector or Image Projector. Optical device that projects an image or moving
images)onto a surface, commonly a projection screen
(http://whatis.techtarget.com/definition/digital-projector-digital-projection-display
system).
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
Raspberry Pi. Series of credit card–sized single-board computers developed in
the UK by the Raspberry Pi Foundation with the intention of promoting the teaching of
basic computer science in schools (https://www.raspberrypi.org/help/what-is-a-raspberry-
pi/).
Software. Any set of machine-readable instructions that directs a computer's processor
to perform specific operations (http://searchsoa.techtarget.com/definition/software).
Thermographic Camera. Also called an infrared camera or thermal imaging camera. A
device that forms an image using infrared radiation, similar to a common camera that
forms an image using visible light
(http://dictionary.reference.com/browse/thermal+imaging).
Toolbox. Graphical control element on which on-screen buttons, icons, menus, or other
input or output elements are placed
(http://www.oxforddictionaries.com/us/definition/american_english/toolbox).
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
CHAPTER 2
REVIEW OF RELATED LITERATURE
CONCEPTUAL LITERATURE
Videos are actually sequences of images, each of which called a frame, displayed
in fast enough frequency so that human eyes can percept the continuity of its content. It is
obvious that all image processing techniques can be applied to individual frames.
Besides, the contents of two consecutive frames are usually closely related.
Visual content can be modeled as a hierarchy of abstractions. At the first level are the raw
pixels with color or brightness information. Further processing yields features such as
edges, corners, lines, curves, and color regions. A higher abstraction layer may combine
and interpret these features as objects and their attributes. At the highest level are the
human level concepts involving one or more objects and relationships among them.
Object detection in videos involves verifying the presence of an object in image
sequences and possibly locating it precisely for recognition. Object tracking is to monitor
objects spatial and temporal changes during a video sequence, including its presence,
position, size, shape, etc. This is done by solving the temporal correspondence
problem, the problem of matching the target region in successive frames of a sequence of
images taken at closely-spaced time intervals. These two processes are closely related
because tracking usually starts with detecting objects, while detecting an object
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
repeatedly in subsequent image sequence is often necessary to help and verify tracking
(Guo, 2001).
Object Tracking can be defined as the problem of finding the location of an object
in the image plane when it moves its position from frame to frame. In other words a
tracker assigns appropriate labels to the tracked objects in different frames associated
with the video that we captured. While considering a single image it provides a snapshot
of a scene, where as in video that we capture over certain time represents the dynamics in
the scene. Tracking objects can be complex due to variation in object structures, loss of
information caused by projection of the 3D world on a 2D image, real-time processing
requirements, complex object motion etc. There are mainly three steps associated with
tracking and they are, detecting the moving objects, tracking the detected objects from
frame to frame and analyze the behavior of tracked object. In tracking almost all
algorithms assume that the object motion is smooth with no abrupt changes we need a
prior knowledge about the number and size of object, shape and appearance of the object.
In a tracking scenario, whatever may be an object it can be a boat on a sea, vehicle on a
road, plane in an air or people walking on a road. Generally, there is a strong relationship
between the object representations and the tracking algorithms [1]. Object representation
can be chosen on the basis of application and object can be represented on the basis of
shape and appearance. In object tracking selecting the right feature plays a critical role.
The most desirable property of a visual feature is its uniqueness that the objects can be
easily distinguished in the feature space. There is a close relationship between object
representation and tracking. For example, in the case of contour-based representation we
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
choose object edges as a feature and for histogram based representation we consider
colour as a feature. In most of the cases the tracking algorithm considers a combination of
features (Cherian & Singh).
In the website http://www.ar-tracking.com/ an article was made with the subject
of a constant object that is being detected.
“The object whose position shall be tracked is equipped with markers. Markers can be
light reflectors or light emitters. To also measure the orientation of a body, several of
these markers have to be arranged at a known geometry. Tracking cameras scan a
certain volume and detect the light that comes from the markers. Their images are
processed to identify and calculate potential marker positions (in image coordinates)
with high accuracy; a mean accuracy of 0.04 pixels is standard in ART tracking systems.
These 2DOF data are combined to calculate 3DOF positions of single markers or 6DOF
poses of rigid arrangements of several markers. Some additional information about the
tracking system is necessary for this, which has to be collected in calibration processes
beforehand: position and orientation of the tracking cameras, as well as the geometry of
rigid bodies. The result of each measurement are coordinates that describes the position
of the markers, and hence the position and orientation of the body carrying the markers.”
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
RELATED STUDIES
In the article “Using Kinect to emulate an Interactive Whiteboard” a low-cost
solution to emulate an IWB is propose base on the introduction of the Kinect as a
concrete tool to support teaching and learning activities. The Kinect can be defined a
Natural Interaction (NI) device, which operates in the context of Natural User Interface
(NUI), a new emerging metaphysical paradigm in Human Computer Interaction (HCI).
NI refers to a concept whereby the interaction with devices is based on human senses.
The main goal of the NI paradigm is to transform the legacy interfaces and devices used
during the last years of technology evolution in a more intuitive and naturally interaction
without the need to wear particular devices or learn complicated instructions to use them.
The Kinect can perfectly play this role in the process of transformation. The researcher
take advantage from the technology offered by this kind of device, we can see how the
depth camera of the Kinect can be used to perform a skeleton recognition mapping the
mouse position. We project the computer desktop on a surface and the mouse is
positioned exactly where the user puts his or her index finger, controlling in this way the
computer involved in the tracking. Kinect recognise and detect skeleton information,
gestures and vocal commands using the different components is equipped. This kind of
technology uses specially designed light patterns projected onto objects to collect 3D data
about objects and people present in the environment. Hence, we can claim the fact Kinect
is to all intents and purposes a depth camera. To better understand how the device can
detect objects and people, we make a comparison with normal cameras. They build and
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
image transforming the light bounces on objects in the colours that you see. A depth
camera uses IR light to build the same image but in this case each the colour of the pixels
identifies how far is this part of the image from the camera itself. We can define the
image built from the camera a depth image, the information contained are more accurate
and precise with respect to a conventional color image, hence more sophisticated data
analysis can be conducted offering the possibility to track the body of individual people
(Avancini,2012).
In the article, “Low-cost Multitouch Whiteboard Using the Wii mote”, the project
use infrared (IR) light pens and the Wii remote to create a very cheap multipoint
interactive whiteboards and multipoint tablet display. The infrared camera is built into the
front of controller that only sense infrared light which is pointed on the screen to see the
whole area with a field of view of 45 degrees. The infrared pen is composing of infrared
LED, a push button switch and a connection to a power supply or a battery that when the
button is press the LED turns on. Additionally, because the Wii remote controller can
track up to four points simultaneously, two pens can be used to have a multi-touch
interactive system. Without the help of the projector, the same technique can be used by
mounting the Wii remote on the Liquid Crystal Display (LCD) and essentially turn the
LCD into a multi-touch tablet display.
Any surface that can be projected basically can be turn into an interactive
whiteboard. In truth, the tracking resolution can get in the camera cannot be as good as
one in the commercial project, but it’s pretty good and much much cheaper (Chong Lee,
2007).
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
In the article “Personal projected displays”, the researcher present a system called
the Escritoire that uses a novel configuration of overlapping projectors to create a large
desk display that fills the area of a conventional desk and also has a high resolution
region in front of the user for precise work. The projectors need not be positioned exactly
—the projected imagery is warped using standard 3D video hardware to compensate for
rough projector positioning and oblique projection. Calibration involves computing
planar homographies between the 2D co-ordinate spaces of the warped textures, projector
frame buffers, desk, and input devices. The video hardware can easily perform the
necessary warping and achieves 30 frames per second for the dual-projector display.
Oblique projection has proved to be a solution to the problem of occlusion common to
front-projection systems. The combination of an electromagnetic digitizer and an
ultrasonic pen allows simultaneous input with two hands. The pen for the non-dominant
hand is simpler and coarser than that for the dominant hand, reflecting the differing roles
of the hands in bimanual manipulation. A new algorithm is given for calibrating a pen,
that uses piecewise linear interpolation between control points and an algorithm to
calibrate a wall display at distance using a device whose position and orientation are
tracked in three dimensions.
The Escritoire software is divided into a client that exploits the video hardware
and handles the input devices, and a server that processes events and stores all of the
system state. Multiple clients can connect to a single server to support collaboration.
Sheets of virtual paper on the Escritoire can be put in piles which can be browsed and
reordered. As with physical paper this allows items to be arranged quickly and
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
informally, avoiding the premature work required to add an item to a hierarchical file
system. Another interface feature is pen traces, which allow remote users to gesture to
each other. Collaborating participants found an audio channel and the shared desk surface
much more useful than a video channel showing their faces. The Escritoire is constructed
from commodity components, and unlike multi-projector display walls its cost is feasible
for an individual user and it fits into a normal office setting. It demonstrates a hardware
configuration, calibration algorithm, graphics warping process, set of interface features,
and distributed architecture that can make personal projected displays a reality
(Ashdown, 2004).
Stephen Regenold's article "E-Chalk Talk" provides the most succinct discussion
of the elements of an electronic whiteboard. Regenold states:
Although electronic whiteboards come in several sizes and shapes, their main
function is the same - to capture written annotations, notes and drawings and store them
for future reference. This is accomplished with infrared sensors, radio-signal emitting
pens, plasma overlays and other technologies. The end product is a file of digitally stored
notes that can be emailed, posted online, or printed and handed out to an audience
immediately after a presentation or training session. Beyond these basic features, some
electronic whiteboards are interactive - letting you connect a computer and projector to
the whiteboard to combine its features with common software programs.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
Using an electronic whiteboard, a document can be projected onto the screen
where it can be marked up with colored pens to highlight important information or
concepts. "Or, using an interactive whiteboard's touchscreen feature, a presenter can
navigate the Web using a finger to move the cursor and double-clicking with taps on the
screen. Even videoconferencing functions have been integrated into electronic
whiteboards in the past year".
Presenters can also toggle between a PowerPoint-like presentation and the Web
Browser, write some notes on the board, or bring in other electronic sources, including
moving video. The SMART Board even has some software for converting written notes
to text.
The article “The Wonders of Interactive Whiteboards: No Cutting-Edge
Classroom Is Complete without One”, Smart Technologies developed the Smart Board
which is one of several interactive whiteboards on the market today. For starters, you can
write, erase, and perform mouse functions with your finger, a pen, or anything with a
maneuverable, firm surface. You can write in digital ink over applications, Web sites, and
videos. You can capture your work or save your notes directly into different software
applications. In the latest version, 9.5, you can even download the software onto a PC.
That means teachers can create and prepare lessons at home, and students can review
lessons and do work at home.
Another good thing is that Smart Boards--interactive whiteboards in general--are
relatively easy to use. Testament to that is found in Kellie Gaffney's classroom at Liberty
Elementary School in Flower Mound, TX. Gaffney taught her students--kindergarteners--
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
how to calibrate the board. Gaffney uses her Smart Board every day, for literature, for
phonics, even for tutoring. Her assessment scores are continually rising. And her students
are now so savvy; they pretend they're the teacher. "They can use it on their own," she
says. "They want to go do it."
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
SYNTHESIS
In the previous articles, you will notice that this system involves the drawings and
writings on the surface of the whiteboard screen to be printed or saved to the mini
computer or distributed over a network system.
For this project to work, it consists of four major components: projector, raspberry
pi, software and the screen display. It also consists of a receiver and a radio-wave
emitting pen. This is a device that connects to a computer, which in turn is connected to a
projector. Calibration also matters; this is the first thing you need to do for you to know
that the system is ready to use. It must be oriented so that where the user presses on the
board, is accurately represented on the screen. Then the operating software will appear
and is used to manipulate the projected images and reflect the changes in the data stored
in the minicomputer. The movement of the user's infrared pen over the image projected
on the screen is captured by its interference with infrared light at the surface of the
whiteboard. With the use of this project, user also doesn’t need to stay in front for
manipulation since the infrared pen has a built in clicker that is connected via Bluetooth
to the minicomputer. Moreover, this project has two modes: computer control mode and
writing mode. It is in computer control mode when the radio-wave emitting pen acts as
the mouse, and a tap as a mouse click. In writing mode, radio-wave emitting pen act as an
actual writing implement, with the computer producing digital ink on the projected
image.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
CHAPTER 3
RESEARCH METHODOLOGY AND PROCEDURE
RESEARCH DESIGN
Conceptual Diagram
Figure 3.1. Conceptual Diagram
The conceptual diagram of the system is shown in the figure above having four
components namely user, raspberry noir camera, develop software, and raspberry pi
interface. Instead of using the mouse, a special pen will be provided where the raspberry
noir camera will translate the given data using the develop software. It will send an
equivalent command for the user to manipulate what is on the display. Furthermore, the
notes will then be saved in the device in PDF form for future used.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
USER
RASPBERRY PI INTERFACE
DEVELOP SOFTWARE
RASPBERRY NOIR CAMERA
MOTION USING A SPECIAL PEN
MOTION DETECTOR
MANIPULATE THE DISPLAY
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
RESEARCH PROCEDURE
The proponents gathered the data through the following procedure:
Browsing the internet for the appropriate materials that we are going to use
Reading some thesis papers to serve as guidelines in our paper
Reading some dissertations in other Foreign Schools for additional knowledge
INSTRUMENTATION:
The following are lists of components use in the project:
Raspberry Pi 2
Figure 3.2.
Raspberry Pi 2
Raspberry Pi 2 will serve as a perfect single-board computer of the project.
Raspberry pi 2 has the following features:
SoC: Broadcom 2836
CPU: Quad-core ARM7 800MHz
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
GPU: Videocore IV 250MHz
Memory: 1GB
Storage: microSDHC slot
GPIO: 40pin
Ports: 4x USB 2.0, 100BaseT Ethernet, HDMI, MicroSD card
Size: 85.60 × 56.5mm (about 3.2 x 2.1-inch)
Raspberry Pi NoIR Camera Board
Figure 3.3. Raspberry Pi NoIR Camera Board
The Raspberry Pi NoIR Camera Board has no Infrared filter, which makes it
perfect for only sensing infrared light coming from the infrared pen. The camera plugs
directly into the CSI connector on the Raspberry Pi. Like many camera modules it is
fitted with an infrared (IR) filter which is there to improve overall image quality.
The Raspberry Pi NoIR Camera Board Features:
No IR filter - Great for Low Light Conditions
5MP Omnivision 5647 Camera Module
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
1.4 µm X 1.4 µm pixel with OmniBSI technology for high performance (high
sensitivity,
low crosstalk, low noise)
Still Picture Resolution: 2592 x 1944
Video: Supports 1080p @ 30fps, 720p @ 60fps and 640x480p 60/90 Recording
15-pin MIPI Camera Serial Interface - Plugs Directly into the Raspberry Pi Board
32 bytes of Embedded one-time programmable (OTP) memory
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
VALIDATION OF INSTRUMENT
The testing and evaluation composed of tests as follows to ensure that the Infrared
Camera is functional.
Functionality Test – This is used to validate the behavior of each application in
the system, which covers all the functionality in terms of its use.
Reliability Test – This is to verify if the system is stable enough and has the
overall performance collated during an extended period of time under various
specific sets of test conditions.
Accuracy Test – This is used for verifying the execution of the infrared pen when
in used is in conformity with its input.
Usability Test – This identifies issues regarding ease-of-use, learnability, visual
appeal, and effectiveness. It also gives insights into how users think and behave.
The instruments used in designing this project were validated by the College of
Engineering, Computer Studies and Architecture of Lyceum of the Philippines University
Cavite Campus.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
DATA FLOWCHART
Figure 3.4 Design Flowchart
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
START
End
Planning the development of the proposed software and
hardware
Finalization
Testing and Debugging
Development Of the software(s) required
Assembly of the camera module and the raspberry
pi
Evaluation
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
DATA ANALYSIS
Figure 3.5 Data Analysis Flowchart
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
START
End
Assembly of the Interactive WhiteBoard prototype with
raspberry pi
Data Interpretation
Data Capturing and Algorithm Calculations
Infrared light detection and tracking
Calibration of the Infrared Camera
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
Assembly of the Interactive Whiteboard Prototype with Raspberry Pi
In building the prototype the researchers have designed a solution that utilized an
infrared pen for detection purposes, a projector for the display, Raspberry Pi for the main
logic control and its camera module for capturing the pen’s position. One of the many
factors the researchers have considered was the camera’s positioning for capturing the
whole projective plane. The plane and the visual output coordinate system must be
translated from one system to another. The camera captures the surrounding space around
the projective plane. There is an angle between the camera view and the projective plane.
Therefore the result images cannot be directly used in the coordinate of the raspberry
interface. To do such translation, calibration and correction algorithm was utilized.
Calibration of the Infrared Camera
One of the most crucial points in the study was to make sure that the camera
would capture the pen’s tip to be able for the software to track and interpret the pen’s
position in the plane. To be able to do this the module was calibrated using the four point
test. This was done by clicking the four corner points provided by a calibration software.
This is to translate the 4 point (in the projective plane) to the coordinate system of the
raspberry interface.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
LYCEUM OF THE PHILIPPINES UNIVERSITY - CAVITE
Infrared Light Detection and Tracking
The pen’s tip is equipped with infrared light which would be tracked by the
Raspberry’s NOIR camera module. The camera does not employ an infrared filter which
allows the camera to capture infrared light as well as visible light. To maximize the
tracking resolution, a visible light filter was added. Another way to optimize the tracking
feature is to make sure that the camera is situated at a distance not too far and not to near
on the projective plane. The camera should always capture the pen’s tip otherwise the
software would not be able to interpret the motion and the events made by the pen. Left-
handed people should be on the right side of the projector while right-handed on the left,
this is to avoid shadowing the camera.
Data Interpretation
Interpreting the position of the pen’s tip is the most important part of the
system. The software provided would transform the images/video fed by the camera into
blobs according to the position of the infrared led light detected. This blob would then
plotted into the translated coordinate system of the projective plane. After the correction
algorithm was performed the data would be interpreted as a point the raspberry pi’s
interface and would then indicate the precise position of the cursor.
The weakness of the project was discovered with the help of the gathered data.
The data also help the researcher to give information about the hardware’s limitation so
that the project will be more reliable and accurate. This informations will serve as the
basis of the project to attain the desired output.
COLLEGE OF ENGINEERING, COMPUTER STUDIES AND ARCHITECTURE
top related