wizardhand - simon fraser university
TRANSCRIPT
![Page 1: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/1.jpg)
WizardHand
1
ENSC440W/305W Instructor: Andrew Rawicz
Steve Whitmore Simon Fraser University
April 18th, 2016
Team members: Alex Chen - CEO Albert Xu - CFO Current Zeng -CTO Scott Zhu - CMO
![Page 2: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/2.jpg)
Outline
2
• Introduc,on • Hardware • So2ware • Business Case • Finance • Schedule
• Conclusion • Ques,on
![Page 3: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/3.jpg)
Introduction
3
![Page 4: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/4.jpg)
Aimbot’s Staffs
4
Name Position Main Responsibility
Alex Chen CEO Hardware, Arrange meeting, Purchasing
Current Zeng CTO Software, hardware
Albert Xu CFO Hardware, Purchasing
Scott Zhu CMO Software, Documentation and Research
![Page 5: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/5.jpg)
Work Break Down Table High Level Tasks Current Zeng Albert Xu Sco: Zhu Alex Chen
Component Determina,on xx x
Circuit Design x xx x
Circuit Build x xx x x
Packaging x xx
Data Transfer xx x
Windows Form Design xx x
Virtual Events xx x x x
IMU Research xx x
IMU Data Processing xx
Quaternion Research x x xx x
Market Research x xx
Administra,ve Tasks x x xx
5 Where xx = Primary Responsibility; x = Some Responsibility
![Page 6: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/6.jpg)
Background and Motivation
• Mo,va,on • We are trying to built a product that is portable and make human being’s life easier
• Our staffs are op,mis,c about the wearable device in the future • Background
• Help people to achieve wireless cursor control • Wide range of using: PCs, projectors, smartphones, etc. • There is no such product in the world
6
![Page 7: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/7.jpg)
Hardware and Circuit
7
![Page 8: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/8.jpg)
Demo Recording for basic function
8
![Page 9: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/9.jpg)
Overview of Components
• 4 x So2 poten,ometers
• 1 x Arduino Pro-‐mini
• 1 x Iner,a Measurement Unit
• 1 x Charging unit
9
• 1 x Bluetooth Module
• 1 x 850mAh Li-‐ion ba_ery
• 1 x Programmer
• 1 x Li-‐ion ba_ery
![Page 10: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/10.jpg)
Soft Potentiometers
• 4 of them are applied on index finger to li_le
finger
• By bending the strip, the resistance linearly
changes from 100Ohms to 10,000Ohms.
Thus, it provides different signals reflec,ng
the fingers’ posi,on.
10
![Page 11: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/11.jpg)
Arduino Pro-mini
Compact size -‐ 18mm x 33mm Weight less than 2 grams Enough pin to handle our inputs
11
![Page 12: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/12.jpg)
Programmer
• Required by Arduino Pro-‐mini • Only for loading embedded so2ware • Not presented on user’s system
12
![Page 13: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/13.jpg)
Inertia Measurement Unit
• Including three measurements: 1. Accelera,on 2. Angular difference 3. Magne,c field
• This component controls the loca,on of cursor
13
![Page 14: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/14.jpg)
Bluetooth Mate Silver
• Good signal transfer range – 10m • Support of various baud rates • Achieving wireless communica,on with PC
14
![Page 15: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/15.jpg)
Li-ion Battery 850mAh
• 850mAh Li-‐ion ba_ery • Rechargeable • Compact
15
![Page 16: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/16.jpg)
Charging Unit
• Bring up Li-‐ion ba_ery voltage to 5V • Charge the ba_ery using micro USB connector
16
![Page 17: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/17.jpg)
The Integrated Circuit
17
![Page 18: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/18.jpg)
Project Assembly
18
![Page 19: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/19.jpg)
Software
19
![Page 20: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/20.jpg)
Software Part 1. What You Can See
2. What You Cannot See
20
![Page 21: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/21.jpg)
User Form - General
• User Interface Layout • Simple and Easy
• Three Tabs in One Window
• Connec,on Op,on Tab
• Monitoring Tab
• Debugging Tab
21
![Page 22: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/22.jpg)
User Form – Connection Tab
1. Choose Port Name and Connec,on
Method Before Using the Device
2. The Switches is to Enable/Disable Mouse Control/Hand Gesture
Func,ons
3. Open/Close Bu_on are Used to
Enable/Disable the Device
22
![Page 23: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/23.jpg)
User Form – Monitoring Tab
1. Fingers Monitor is Monitoring the
Status of the Hand Gestures
2. Mouse Func,on and Hot-‐Keys
Monitor Is to Show what Func,ons
are being used
3. The Scroll Bar Is Used to Adjust
Mouse Sensi,vity
23
![Page 24: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/24.jpg)
User Form – Debugging Tab
This Tab is for Debugging Propose Only
24
![Page 25: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/25.jpg)
C++ Structure – General
There Three Parts in This Project:
1. Header Files
2. Resource Files
3. Source Files
The Parts that Enrolled Most of Our
Algorithm are IMU_SP.h and
IMU_SP.cpp
25
![Page 26: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/26.jpg)
IMU to Cursor Position
• IMU is Iner,a Measurement Unit • We are using Accelerometer and Gyroscope only
• Gyroscope Measures Angular Velocity • Integrate Angular Velocity into Angle Which Represent Orienta,on of User’s Hand
• Accelerometer Measures Accelera,on • The accelera,ons it picks up are projec,ons of gravity on X, Y and Z axis's of the Accelerometer
• Based on the projec,ons, the angles of the accelerometer’s coordinate can be calculated
26
![Page 27: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/27.jpg)
IMU to Cursor Position
• Gyroscope is integra,ng its measurement over ,me • It accumulate errors – long term error
• It can only be rely on short term applica,ons
• Accelerometer’s readings do not depends on ,me • Its reading has unwanted noise • It can provide accurate long term results
• It is good to use it in a long term applica,on
27
![Page 28: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/28.jpg)
IMU to Cursor Position
• Complementary
• When Device is s,ll (Accelerometer readings are not changing)
• Rely on Accelerometer more
• Use Gyroscope to stabilize Accelerometer Reading
• When Device is being moved
• Rely on Gyroscope more
• Use Accelerometer to correct the final reading of Gyroscope(when device is s,ll)
28
![Page 29: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/29.jpg)
IMU to Cursor Position • The Orienta,on is represented in form of Quaternion in programming
• Use the orienta,on to es,mate rota,on of the device
• The device is treated as a vector during the rota,on
• The projec,on, of the vector, on Y and Z axis is used as X and –Y coordinate of the cursor
29
![Page 30: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/30.jpg)
Business Case
30
![Page 31: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/31.jpg)
Market Target People: • Everyone • Disabled People • People interested in new electronic device
• Retailers (e.g. NCIX, Amazon)
31
Apply Area: • No flat surface around (e.g. Sofa, Bed) • Far away from PC • No Wi-‐Fi environment Actual Cost $691.5
Expect Cost for Mass Production
$100
Selling Price $200
Profit $100
Expected Time for Reproduing
12 Hours
![Page 32: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/32.jpg)
Competition • There are some people already built the similar device (e.g. Razer), but the products are s,ll not sold on market.
• The reason may be is the cost is too high. • Most people is s,ll using normal mouse, they cannot use mouse in some situa,ons.
• But the cost of nomal mouse is cheap.
32
![Page 33: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/33.jpg)
Finance
33
![Page 34: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/34.jpg)
Schedule
34
![Page 35: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/35.jpg)
Conclusion
35
![Page 36: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/36.jpg)
Learning Experiences • Hardware
• Arduino usage • Electrical circuit designing and building • Arrangement of components
• So2ware • Visual Studio experiences • Virtual mouse/keyboard event • Serial communica,on
• Others • Design and manufacture process • Teamwork
36
![Page 37: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/37.jpg)
Future Plans
• Improve the system • Poten,ometer could be smaller and so2er
• Bluetooth can be faster ( 115200) • Closure and packaging can be be_er
• Reduce the cost • Buy components from China
• Manufacture our own board by designing the PCB board
37
![Page 38: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/38.jpg)
Acknowledgement
Dr. Andrew Rawicz
Prof. Steve Whitmore
TA: Hsiu-‐Yang Tseng
Jamal Bahari
Mahssa Abdolahi
Mona Rahbar
Soroush Haeri
38
![Page 39: WizardHand - Simon Fraser University](https://reader033.vdocuments.site/reader033/viewer/2022050207/626dcf1334049b2b662780b8/html5/thumbnails/39.jpg)
Question?
39