content-centric embedded
DESCRIPTION
A product world is trying to change focusing on "Content-Centric". Then, it is necessary to design our products by "Content-Centric". For that purpose, it is necessary to perform a trial production and a products design quickly flexibly. Therefore we created one robot based on the soul of "DIwO(Do It with Others)" used as basic concepts, such as Make:, in order to realize it. And I created an ALL in ONE developing environment, it's called "ofxDroidLinaro", It is created by: -Application Framework --Android --openFrameworks(http://www.openframeworks.cc/) -Library&Driver --Linaro(http://www.linaro.org/) --Ubuntu(http://www.ubuntu.com/) -Device --ARM based Computers Therefore I can make the my product easily & quckly by using ofxDroidLinaro! -Application Framework --Make Program easily&quickly by Android --Make Cool UI by openFrameworks -Library&Driver --Use a lot of Libraries&Drivers for Linux -Device --Mobile & Connect to sensors (Ex,Kinect) by ARMTRANSCRIPT
©SIProp Project, 2006-2008 1
Content-Centric Embedded~ Treasure Hunting Robot ~
Noritsuna Imamura
©SIProp Project, 2006-2008 2
Agenda
1st
About meToday’s goal
2nd
Auto Chasing TurtleTreasure Hunting Robot
Little how to make
©SIProp Project, 2006-2008 3
My Bio
SpecialNetworking technology (P2P)
Community (OSS)SIProp.orgJapan Android GroupLinaro
CompanyNPO OESF (Open Embedded Software Foundation)
©SIProp Project, 2006-2008 4
Current work
WorkIndustrial Technology Research Institute.Making a testing center for Android Devices.
©SIProp Project, 2006-2008 5
Japan Android Group : 2008-
Prof.Maruyama & I started up this community.
At Apr/2008
DetailThe most famous & largest Community in JapanURL: http://www.android-group.jp/Since: Sep/2008Members: over 20,000Branch: over 20
©SIProp Project, 2006-2008 6
Linaro: 2010-
http://linaro.org/
MissionOptimize for each SoC & Platform
Contributor for community!
©SIProp Project, 2006-2008 7
Android’s tools
NyARToolkit for AndroidI made a based-program for this OSS community
http://en.sourceforge.jp/projects/nyartoolkit-and/
OpenCV for Android NDKThis program is included in Android 4.0.1 .
http://tools.oesf.biz/android-4.0.1_r1.0/search?q=SIProp
©SIProp Project, 2006-2008 8
Today’s Topic
Noritsuna Imamura
©SIProp Project, 2006-2008 9
What do you want to make?
©SIProp Project, 2006-2008 10
Need a lot of money…
How to get?Make a Startup CompanyGet a Sponsor
Kinds of SponsorsProduct Sponsors
Sale their products
Service SponsorsExpand their service
PatronSupport a cool guy (Ex. Kickstarter)
©SIProp Project, 2006-2008 11
Treasure Hunting Robot
AiRscouter
MindWave
Pandaboard
Xtion
©SIProp Project, 2006-2008 12
Hardwares & Softwares
HardwaresBase computer
PandaboardTI
Brain Wave SensorMindWave
Depth SensorXtion pro live
DisplayAiRscoter
Brother Industries
Walking RobotKHR-3WL
Kondo science
SoftwaresUbuntu & Android
Linaro11.11Linaro
Depth SensorOpenNI
Bone skeleton tracker
NITE for ARM
UI FrameworkopenFrameworksAndroid
OESF
©SIProp Project, 2006-2008 13
Important point
Quick making a prototype!Almost people can NOT image a new product without a real device.
Do It Yourself ⇒Do It With Others!
! Reinventing the wheel.MAKE:style
Hardwarebeagleboard-xMArduinoKinect
SoftwareLinux KernelAndroid
©SIProp Project, 2006-2008 14
Content-Centric Embedded
Content-Centric NetworkingIt was pioneered by Ted Nelson in 1979 and later by Brent Baccala in 2002.
The old internet finds servers by IP-Address.
This philosophy finds them by Contents.
Content-Centric EmbeddedWhen make products, it thinks from hardware.
This philosophy thinks them from Contents.
Ex: Kindle
http://en.wikipedia.org/wiki/Content-centric_networking
©SIProp Project, 2006-2008 15
What do you want to make?
©SIProp Project, 2006-2008 16
Auto Chasing Turtle
Noritsuna Imamura
©SIProp Project, 2006-2008 17
Summary
This product is an "Auto Chasing Turtle".By autonomous control, this robot recognizes people's face and approaches to the detected human.
©SIProp Project, 2006-2008 18
YouTubehttp://www.youtube.com/watch?v=8EgfAk5RBVo
Source Code & detail explanationhttp://www.siprop.org/ja/2.0/index.php?product%2FAutoChasingTurtle
KeywordAutoChasingTurtle
Movie
©SIProp Project, 2006-2008 19
Hardwares & Softwares
HardwaresBase computer
Beagleboard-xMTI
Depth SensorKinect
RobotKONDO Animal
Kondo science
SoftwaresUbuntu & Android
Linaro10.03Linaro
Depth SensorofxKinect
UI FrameworkopenFrameworksAndroid
OESF
©SIProp Project, 2006-2008 20
How to make
©SIProp Project, 2006-2008 21
3 Points for Developing
Detect the Face
Calculate the course
Calculate the distance
1. detect
2. course
3. distance
©SIProp Project, 2006-2008 22
Detect the face
How to recognize a human’s face?Using KINECT RGB Camera as Sensor
KINECT Image
©SIProp Project, 2006-2008 23
How to recognizing a human’s face
FaceDetector detector = new FaceDetector(w, h, faces.length);int numFaces = detector.findFaces(bitmap, faces);
Android’s APIs.
60-80% Product!
©SIProp Project, 2006-2008 24
3 Points for Developing
Detect the Face
Calculate the course
Calculate the distance
1. detect
2. course
3. distance
©SIProp Project, 2006-2008 25
Calculate the course
1. Calculate a center position of face.2. Calculate a position of the face from 4-
sections separation KINECT’s image.640px
160px
©SIProp Project, 2006-2008 26
Calculate the course
faces[0].getMidPoint(midPoint); //get center position of faceint pointX = (int)midPoint.x;
if (pointX > 0 && pointX < w/4) { DroidBot.getInstance().turnRight(); // right position} else if (pointX >= w/4 && pointX <= 3*w/4) { ; // center position} else if (pointX > 3*w/4 && pointX <= w) { DroidBot.getInstance().turnLeft(); // left position}
©SIProp Project, 2006-2008 27
3 Points for Developing
Detect the Face
Calculate the course
Calculate the distance
1. detect
2. course
3. distance
©SIProp Project, 2006-2008 28
Calculate the distance
Distance of from Robot to detected human
Can be gotten by KINECT.
©SIProp Project, 2006-2008 29
Calculate the distance
Depth camera’s range is 0~65565.
int dist = OFAndroid.getDistance(pointX, pointY); // Use depth camera
if (dist < 100) DroidBot.getInstance().walkBack4();else if (dist >= 100 && dist < 150) DroidBot.getInstance().walkToward4();else if (dist >= 150 && dist < 200) DroidBot.getInstance().walkToward8();else if (dist >= 200 && dist < 300) DroidBot.getInstance().walkToward16();else if (dist >= 300) DroidBot.getInstance().walkToward32();
©SIProp Project, 2006-2008 30
Treasure Hunting Robot
Noritsuna Imamura
©SIProp Project, 2006-2008 31
Summary
This is an "AR(augmented reality) Treasure Hunting Game“
You get virtual treasures by controlling real robot!
©SIProp Project, 2006-2008 32
Manual
Look at radar window like dragon radar.Show the treasure on radar as red star.Center is a place in which a robot is present.
The Blue arrow is direction of robot..
Look at line graph. This is brain wave line graph.
You control the robot to the treasure point by your brain wave.
Exciting -> Turn leftNormal -> Go towardRelax -> Turn right
©SIProp Project, 2006-2008 33
Hardwares & Softwares
HardwaresBase computer
PandaboardTI
Brain Wave SensorMindWave
Depth SensorXtion pro live
DisplayAiRscoter
Brother Industries
Walking RobotKHR-3WL
Kondo science
SoftwaresUbuntu & Android
Linaro11.11Linaro
Depth SensorOpenNI
Bone skeleton tracker
NITE for ARM
UI FrameworkopenFrameworksAndroid
OESF
©SIProp Project, 2006-2008 34
Hardwares’ photo
AiRscouter
MindWave
Pandaboard
Xtion
©SIProp Project, 2006-2008 35
Softwares’ photo
Brain WaveLine
GraphBone skeleton
Tracking Window
©SIProp Project, 2006-2008 36
Some Problems ・・・
Cool UILibraryMobileConnect Sensors
©SIProp Project, 2006-2008 37
Made by ofxDroidLinaro 1/2
An ALL in ONE developing environment.
Made by 3 Layers
Device :
Library&Driver :
App Framework :
©SIProp Project, 2006-2008 38
Made by ofxDroidLinaro 2/2
Make Program easily&quickly by AndroidMake Cool UI by openFrameworks
Use a lot of Libraries&Drivers for Linux
Mobile & Connect to sensors (Ex,Kinect) by ARM
App Framework :
Library&Driver :
Device :
©SIProp Project, 2006-2008 39
Download source code
We release all source code on our site.http://www.siprop.org/en/2.0/index.php?product%2FTreasureHuntingRobot
Do It Yourself ⇒Do It With Others!
If you want to try it, please ask me!You can experience like Google Glass!
©SIProp Project, 2006-2008 40
Events & Conferences~ Show Demonstration &
Speech ~
©SIProp Project, 2006-2008 41
China
©SIProp Project, 2006-2008 42
Mini Maker Faire 2012 ShenZhen
The first Maker Faire in ChinaTarget
DIY(DIwO) Engineer
About Maker FaireThe most famous DIwO
conference
©SIProp Project, 2006-2008 43
Ma An Shan Univ.
TargetChinese StudentsEducation
©SIProp Project, 2006-2008 44
Taiwan
©SIProp Project, 2006-2008 45
OSDC.tw 2012 (Apr/2012)
One of the largest OSS conference in Taiwan
TargetTaiwanese Engineer
©SIProp Project, 2006-2008 46
COSCUP 2011&2012 (Aug)
One of the largest OSS conference in Taiwan
TargetTaiwanese Engineer
©SIProp Project, 2006-2008 47
Computex 2011&2012 (June)
The largest hardware business show.Target
Hardware Engineer & Company
©SIProp Project, 2006-2008 48
Yuan Pei Univ.
TargetTaiwanese StudentsEducation
©SIProp Project, 2006-2008 49
Singapore
©SIProp Project, 2006-2008 50
Mini Maker Faire 2012 Singapore
The first Maker Faire in SingaporeTarget
DIY(DIwO) Engineer
About Maker FaireThe most famous DIwO
conference
©SIProp Project, 2006-2008 51
Hong Kong
©SIProp Project, 2006-2008 52
Mini Maker Faire 2012 Hong Kong
The first Maker Faire in Hong KongTarget
DIY(DIwO) Engineer
About Maker FaireThe most famous DIwO
conference
©SIProp Project, 2006-2008 53
USA
©SIProp Project, 2006-2008 54
Linaro Demo Friday 2012.Q2
The Making Linux Kernel for ARM ProjectTarget
ARM Embedded Engineer
©SIProp Project, 2006-2008 55
Embedded Linux Con 2012
TargetLinux Embedded Engineer
©SIProp Project, 2006-2008 56
Maker Faire 2012 BayArea
The biggest Maker FaireTarget
DIY(DIwO) Engineer
About Maker FaireThe most famous DIwO
conference
©SIProp Project, 2006-2008 57
Japan
©SIProp Project, 2006-2008 58
ABC 2012 Spring
The largest Android User Community in JapanTarget
Japanese Android Engineer
©SIProp Project, 2006-2008 59
NicoNico Gakkai
The largest Otaku conference in Japan.
TargetJapanese DIY(DIwO)
Engineer
©SIProp Project, 2006-2008 60
LinuxCon Japan 2012
TargetLinux Embedded Engineer
©SIProp Project, 2006-2008 61
One more thing
©SIProp Project, 2006-2008 62
Why do you work?
For money?
©SIProp Project, 2006-2008 63
No money economy
The money economy is made by single value.
One thing has one priceNo physical thing has no price
True???
©SIProp Project, 2006-2008 64
Ex: Simeji 1/2
One of Android applicationMade by 2 Japanese guys.
As hobby work.
Taken over by 百度2-3M UDS
.
©SIProp Project, 2006-2008 65
Ex: Simeji 2/2
Why did 百度 take over it?A technology for input method?
Developers don’t have a technology for input method.
Because base is OpenIME as engine.
Installing user base?Only used by developers. No used by normal people.
Their strong pointOne of most famous developer in Japanese Android Community.
百度 wants to get respect in Japanese community.
©SIProp Project, 2006-2008 66
This was predicted in 2006
IBM Global Innovation Outlook 2.0 (06’)
http://domino.research.ibm.com/comm/www_innovate.nsf/pages/world.gio2004.html
The "one man company" will appear billions.
Collaboration environment based on a contribution.
The role of a company is supporting to an individual creator and group.
A new product is made by them.
©SIProp Project, 2006-2008 67
Why are they free?
MAKE:style (Do It With Others Style)
Hardwarebeagleboard-xMArduinoKinect
Do It Yourself ⇒Do It With Others!
SoftwareofxDroidKinect
Linaro KernelAndroid
©SIProp Project, 2006-2008 68
Thank you!