practical in humanoid robotics - mit esp...millennium challenge for advanced robotics,” advanced...
TRANSCRIPT
![Page 1: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/1.jpg)
![Page 2: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/2.jpg)
Practical in Humanoid Robotics
Marcelo dos Anjos
University National of Asuncion
![Page 3: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/3.jpg)
About Me
Maker for hobby
Electronic Engineer Software and Computer Engineer Finishing my PHD in Computer Sciences
![Page 5: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/5.jpg)
Humanoid Robot
•
Humanoid refers to any being whose body structure resembles that of a human: head, torso, legs,arms, hands.
But it is also a robot made to resemble a human both in appearance and behavior
![Page 7: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/7.jpg)
Why do we need a motion specification?
Difficulties for researchers in robotics: Industrial copyright Programs are not re-usable in
different robot families, even different versions of same robot families
Have to choose OS based on the drivers provided
Not easy to share a robot remotely with other collaborators in different locations
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
Motion Commands
Windows? Linux? Mac OS?
Embedded OS?
![Page 8: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/8.jpg)
Project goals OpenSource OpenHardware
Whatever: (cross-model) Provide a network-enabled interface for independent of the
controller libraries Access to other robots & simulators.
Whoever: (cross-platform) User interface must be cross-platform: support Linux, Mac OS X
and Windows. Wherever: (cross-network)
Good quality of service across the Internet.
![Page 10: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/10.jpg)
Architecture
Control Algorithm
Command Queue
Unit Control
Interface Hardware
Read
Write
Input sensors
Feedbackactuators
3D Choreography Programs
Artificial Intelligence
Robot Movement
![Page 14: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/14.jpg)
Prices for Human Sizes Robots
Poppy Child Kit +- 9.000 u$$
Big Size Servo Motor 20 x 2.000 U$$ = 40.000 u$$.
![Page 19: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/19.jpg)
Servo Motor
Board
Board
Servo
Servo
Servo
M Servo M Servo M Servo
Digital or AnalogicServo Motors
Micro controlled Servo Motors
![Page 20: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/20.jpg)
Micro controlled Servo Motor with PID
PID is the most commonly used servo control algorithm:
– Proportional
– Integral
– Derivative
PID systems can be understood by way of analogous physical models.
![Page 28: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/28.jpg)
Artificial Intelligence
•
Artificial intelligence (AI) is a branch of science, which deals with helping machines find solutions to complex problem in a more human like fashion.
Borrowing characteristics from human intelligence, and applying them as algorithm in a computer friendly way.
![Page 29: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/29.jpg)
Recognition Technology
1. Recognition of moving objects2. Posture/gesture recognition3. Environment recognition4. Sound recognition5. Face recognition.
![Page 30: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/30.jpg)
Sound Recognition
Many Robots can distinguish between voices and other sounds.
He can respond to his name, face peoplewhen being spoken to, and recognizesudden, unusual sounds such as that of afalling object or a collision, and face in thatdirection.
![Page 31: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/31.jpg)
Facial Recognition
Many Robots has the ability torecognize faces, or the human being ismoving.
It can individually recognizefaces. Once they are registeredit can address them by name.
![Page 32: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/32.jpg)
Architecture - Specification Standard
Configuration Spec
Command Spec
Communication Spec
Abstraction
![Page 33: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/33.jpg)
Architecture - System Overview
Client/Server
...
Client
Client
Server
Asimo Library
Pioneer Library
Simulator
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
Configuration Spec
Command Spec
Communication Spec
![Page 34: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/34.jpg)
Architecture - Robotalk Server
Server Daemon
Robot Daemon
Read and Write TCP/IP sockets
Issue Robot Driver Calls
CClientConnection
CClientConnection
Provide: Buffering, Scheduling, Panic, etc.
Class Interface
.
.
.
CRobotDriver
![Page 35: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/35.jpg)
Architecture - CClientConnection
CClientConnection
Command Queue
Return Queue
Playback Queue
Read
Write
Input commands
Feedback
Priority Queues
Server Daemon
Robot Daemon
![Page 36: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/36.jpg)
Architecture - CClient
Read Daemon
Return cache
CClient Class
Class Interface
Commands to the server.(Blocking/Nonblocking)
Feedback
(Nonblocking)
Broadcastcache
Function calls
![Page 37: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/37.jpg)
Architecture - Communication Modes
Direct mode: blocking & instantaneous, for debug purposes
Delay mode: nonblocking, instantaneous or delay
Playback mode: nonblocking, adaptive caching based on channel quality
Broadcast mode: periodic query feedback
![Page 38: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/38.jpg)
Direct Mode
Client Server Sync system clock
Clock
Command Cache
RobotDaemon
Client
Function call
Cache Return Cachereturn
![Page 39: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/39.jpg)
Delay Mode
Client Server Sync system clock
RobotDaemon
Client
Cache
Function call
return
Delay
Command Cache
Clock +
Return Cacheerror signal
![Page 40: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/40.jpg)
Playback Mode
Client
Cache
Function call
return
Return Cacheerror signal
Clock
Playback Cache
Command Cache
Delay
RobotDaemon
Client Server
Length of the sequence
![Page 41: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/41.jpg)
Broadcast Mode
Client
Cache
Broadcast
call
return
Command Cache
RobotDaemon
Return Cachedata
Delay
![Page 42: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/42.jpg)
Conclusions
Motivations System Structure Four Network Command Modes Future Extensions
Exclusive control Data channels Controlling multiple humanoid robots Virtual humanoid robots
![Page 43: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/43.jpg)
Virtual Humanoid
Server
Pioneer Library
Camera Library
Puma Library
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.
Site A
Site B
Virtual Humanoid
![Page 47: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped](https://reader036.vdocuments.site/reader036/viewer/2022081601/612528f5af2c520c3e1dd3df/html5/thumbnails/47.jpg)
References
== H. Kitano and H. Asada, “The RoboCup humanoid challenge as the millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736.
== C. Zhou and Q. Meng, “Dynamic balance of a biped robot using fuzzy reinforcement learning agents,” Fuzzy Sets and Systems 134(1) (2003) 169-187.
== http://www.davidgeer.com/artificial-intelligence-humanoids-david-geer.pdf
== http://plen.jp/playground/wiki/about
== www.airspacedefense.org
== All CODES in
https://github.com/splash2018