Robots and Intelligent Robots and Intelligent ToysToys

Mark GreenMark Green

School of Creative MediaSchool of Creative Media

IntroductionIntroduction

We all like toys, not just kidsWe all like toys, not just kids Toys are used for a variety of reasons:Toys are used for a variety of reasons:

RecreationRecreation Pass the timePass the time CuriosityCuriosity EducationEducation ChallengeChallenge

As we grow older our toys changeAs we grow older our toys change

IntroductionIntroduction

Toys change with the times, they reflect Toys change with the times, they reflect the current culturethe current culture

Children want to imitate their parents, so Children want to imitate their parents, so their toys will resemble their parents’ worktheir toys will resemble their parents’ work

Children imitate what they see adults Children imitate what they see adults doingdoing

Play is practice for growing older, how we Play is practice for growing older, how we learn to be an adultlearn to be an adult

IntroductionIntroduction

Over the past decade electronics has Over the past decade electronics has become an important part of toysbecome an important part of toys

This has ranged from computer like toys This has ranged from computer like toys and other electronic gadgets to electronics and other electronic gadgets to electronics in traditional toysin traditional toys

Illustrates two approaches:Illustrates two approaches: Toys that emulate technologyToys that emulate technology Toys that include technologyToys that include technology

Emulate TechnologyEmulate Technology

Toys that look like the real thing, or at Toys that look like the real thing, or at least motivated by itleast motivated by it

Computers and laptops are quite common, Computers and laptops are quite common, combine with simple educational softwarecombine with simple educational software

Some can now access the InternetSome can now access the Internet Mobile phones are quite common as wellMobile phones are quite common as well Many aim to be educationalMany aim to be educational

VTechVTech

Local company, probably the world leader Local company, probably the world leader in this type of toyin this type of toy

Have produced electronic toys for many Have produced electronic toys for many years, many with educational sideyears, many with educational side

One of the most innovative companies in One of the most innovative companies in this area, produce some excellent designsthis area, produce some excellent designs

Go take a look at their toys, see what can Go take a look at their toys, see what can be done with creativity and electronicsbe done with creativity and electronics

VTech Electronic ToysVTech Electronic Toys

VTech Electronic ToysVTech Electronic Toys

Include TechnologyInclude Technology

Other toys include technology, but it’s not Other toys include technology, but it’s not an obvious part of the toyan obvious part of the toy

Microsoft Barney and similar toys are good Microsoft Barney and similar toys are good examples - ActiMatesexamples - ActiMates

Sophisticated use of robotics and Sophisticated use of robotics and computer technologycomputer technology

Could connect to computer and TV to Could connect to computer and TV to interact with the childinteract with the child

MicrosoftMicrosoft

The ActiMates line appeared in 1997 and The ActiMates line appeared in 1997 and has since been discontinuedhas since been discontinued

They were too expensive, with a starting They were too expensive, with a starting price of over $100USprice of over $100US

Problems developing software for licensed Problems developing software for licensed characters, had to agree with the TV characters, had to agree with the TV charactercharacter

Think carefully about using licensed Think carefully about using licensed characters characters

FurbyFurby

Probably the most successful toy in this Probably the most successful toy in this categorycategory

Developed in 1997 and became one of the Developed in 1997 and became one of the most popular toys in 1998 and 1999most popular toys in 1998 and 1999

Had the right price point, around $30US Had the right price point, around $30US and was cuteand was cute

Main feature was ability to interact with Main feature was ability to interact with Furby and train itFurby and train it

FurbyFurby

FurbyFurby

Furby is basically a very simple robot with Furby is basically a very simple robot with a microcontrollera microcontroller

A motor was used to move its arms and A motor was used to move its arms and mouth, very simple motions and mouth, very simple motions and expressionsexpressions

Furbys tried to learn, started with some Furbys tried to learn, started with some speech capabilities (could not understand speech capabilities (could not understand them) which could be improvedthem) which could be improved

FurbyFurby

FurbyFurby

Did a few things right:Did a few things right: Small size with big eyes, triggers baby Small size with big eyes, triggers baby

response in peopleresponse in people Gave impression of interaction and emotions, Gave impression of interaction and emotions,

acted intelligentacted intelligent Speech was very important, its trying to Speech was very important, its trying to

communicatecommunicate Developed over time, acted like it was Developed over time, acted like it was

learning, like a real creaturelearning, like a real creature

FurbyFurby

Things it did wrong:Things it did wrong: Not very robust, ours broke after a few daysNot very robust, ours broke after a few days Could easily reach its limit, Furby could Could easily reach its limit, Furby could

develop for a while, but after that it was staticdevelop for a while, but after that it was static No way to turn it off, could become very No way to turn it off, could become very

annoyingannoying Developed over a very short period of Developed over a very short period of

time, didn’t have chance to make it robust time, didn’t have chance to make it robust enoughenough

RobotsRobots

People are fascinated by robots, a People are fascinated by robots, a machine that you can interact withmachine that you can interact with

Robots for play and entertainment aren’t a Robots for play and entertainment aren’t a new idea, have appeared in fiction for a new idea, have appeared in fiction for a long timelong time

Industrial uses of robots started in the Industrial uses of robots started in the 1960s, and have grown rapidly over the 1960s, and have grown rapidly over the past 20 yearspast 20 years

RobotsRobots

Domestic robots: robots that appear in the Domestic robots: robots that appear in the home or work with peoplehome or work with people

These are now beginning to appear:These are now beginning to appear: Robots for house cleaning, a robot vacuum Robots for house cleaning, a robot vacuum

cleaner, commercially available around cleaner, commercially available around $200US$200US

Mail delivery in office buildings, robots that Mail delivery in office buildings, robots that have a standard route for delivering mail and have a standard route for delivering mail and packagespackages

RobotsRobots

Entertainment robots have been available Entertainment robots have been available for several yearsfor several years

Sony is the leader in this area, but other Sony is the leader in this area, but other Japanese companies are also activeJapanese companies are also active

The first Sony entertainment robot was The first Sony entertainment robot was Aibo, far more successful than they ever Aibo, far more successful than they ever thought it would bethought it would be

Based on a general robot platform – Based on a general robot platform – OPEN-ROPEN-R

AiboAibo

Originally produced by Sony as an Originally produced by Sony as an experiment, did a small production run to experiment, did a small production run to see if it would sellsee if it would sell

Only available on webOnly available on web In Japan sold out in 20 minutes, in the US In Japan sold out in 20 minutes, in the US

it took a full 4 days to sell outit took a full 4 days to sell out Initial price was over $2000US, not a Initial price was over $2000US, not a

random purchase!random purchase!

AiboAibo

AiboAibo

Current version in the $1500US range, still Current version in the $1500US range, still quite priceyquite pricey

Main features:Main features: Wide range of sensors, including cameraWide range of sensors, including camera Reasonably fast processor and 32 MByte of Reasonably fast processor and 32 MByte of

memorymemory Can use memory cards for programmingCan use memory cards for programming Wireless network connectionWireless network connection

A PC with legs!A PC with legs!

AiboAibo

Aibo starts as a puppy and over a six Aibo starts as a puppy and over a six week period grows into a mature dogweek period grows into a mature dog

Aibo can recognize its owner’s face, and Aibo can recognize its owner’s face, and respond to voice commandsrespond to voice commands

Can teach Aibo tricks and train itCan teach Aibo tricks and train it If you aren’t happy with Aibo’s behavior If you aren’t happy with Aibo’s behavior

can reset it to puppy stage and start over can reset it to puppy stage and start over againagain

AiboAibo

AiboAibo

AiboAibo

Several ways of programming Aibo:Several ways of programming Aibo: High level scripting language for simple High level scripting language for simple

behaviorsbehaviors Low level C++ interface for more complex Low level C++ interface for more complex

behaviorsbehaviors GUI interface to customize AiboGUI interface to customize Aibo

Sony lets users develop their own Sony lets users develop their own software and share with others, but no software and share with others, but no commercial software productioncommercial software production

AiboAibo

Does a lot of things right:Does a lot of things right: Sophisticated behaviorsSophisticated behaviors Can be trained, develops over timeCan be trained, develops over time Ability to customize and program, can grow Ability to customize and program, can grow

with Aibowith Aibo Complex enough to express emotions and be Complex enough to express emotions and be

interestinginteresting Still very expensive, not a standard “toy”Still very expensive, not a standard “toy”

Humanoid RobotsHumanoid Robots

Several Japanese companies are working Several Japanese companies are working on thison this

More difficult problem:More difficult problem: Balance: must be able to walk on two feetBalance: must be able to walk on two feet Must be more sophisticated to fool peopleMust be more sophisticated to fool people Cannot be threatening or scare peopleCannot be threatening or scare people

Nothing commercial yet, likely to be very Nothing commercial yet, likely to be very expensive, over $10,000USexpensive, over $10,000US

Construction SetsConstruction Sets

Construction sets allow us to build our own Construction sets allow us to build our own robots, previous ones provided a ready robots, previous ones provided a ready built robotbuilt robot

Far more flexible, have control over the Far more flexible, have control over the physical form of the robotphysical form of the robot

Take a lot more time to build:Take a lot more time to build: Need to have building skill, know how to put Need to have building skill, know how to put

things togetherthings together Large projects, lots of work and testingLarge projects, lots of work and testing

Construction SetsConstruction Sets

Many different types of sets, depends Many different types of sets, depends upon the audience and their aimsupon the audience and their aims

Simplest are the single function setsSimplest are the single function sets Given the parts and can then build a single Given the parts and can then build a single

robot, or robot platformrobot, or robot platform Many of these robots are expandable, but Many of these robots are expandable, but

they have a fixed structurethey have a fixed structure Example: my small wheeled robotExample: my small wheeled robot

Construction SetsConstruction Sets

You can get a wide range of these setsYou can get a wide range of these sets Most of them concentrate on wheeled Most of them concentrate on wheeled

vehicles, but there are some other typesvehicles, but there are some other types Tend to be relatively cheap, around Tend to be relatively cheap, around

$50US for a set$50US for a set They can lead to much more complex They can lead to much more complex

custom robot systems, where you design it custom robot systems, where you design it yourself from basic partsyourself from basic parts

Simple Robot KitsSimple Robot Kits

LegoLego

Probably the best known of the Probably the best known of the construction kitsconstruction kits

Based on plastic blocks that fit togetherBased on plastic blocks that fit together Pixels for the real 3D world, can build Pixels for the real 3D world, can build

about anything, but it will always look like it about anything, but it will always look like it is made out of blocksis made out of blocks

Very flexible, a wide range of parts that Very flexible, a wide range of parts that can be used to build many thingscan be used to build many things

LegoLego

Mindstorms started as a research project Mindstorms started as a research project at MIT, add computation to Legoat MIT, add computation to Lego

Add simple sensors and motors to Lego Add simple sensors and motors to Lego under computer controlunder computer control

Original system was large, computer brick Original system was large, computer brick was tethered to PC, so robots couldn’t go was tethered to PC, so robots couldn’t go very farvery far

Initial work with Schools, teach science, Initial work with Schools, teach science, math and programmingmath and programming

LegoLego

Next version was portable, and used as Next version was portable, and used as the basis for Lego Mindstormsthe basis for Lego Mindstorms

Based on a logic brick called an RCX, a Based on a logic brick called an RCX, a microcontroller that is programmed from a microcontroller that is programmed from a PCPC

There have been three versions of the There have been three versions of the RCX, versions 1, 1.5 and 2.0, we will be RCX, versions 1, 1.5 and 2.0, we will be using version 2.0using version 2.0

LegoLego

Lego uses a simple visual language for Lego uses a simple visual language for programming the RCXprogramming the RCX

Extend the Lego block metaphor to Extend the Lego block metaphor to programmingprogramming

Users drag various shapes to a work area Users drag various shapes to a work area and assemble them to produce a programand assemble them to produce a program

Designed to be easy for 12 year olds, but Designed to be easy for 12 year olds, but is somewhat limitedis somewhat limited

Visual ProgrammingVisual Programming

LegoLego

Since the RCX uses a well known Since the RCX uses a well known microcontroller a number of other microcontroller a number of other techniques have been developed for techniques have been developed for programmingprogramming

A number of standard languages, like C, A number of standard languages, like C, Java and Basic can be used for Java and Basic can be used for programmingprogramming

Fairly open system for programming and Fairly open system for programming and hardwarehardware

MindstormsMindstorms

MindstormsMindstorms

MindstormsMindstorms

fischertechnikfischertechnik

The next level up from LegoThe next level up from Lego Produced by an engineering company that Produced by an engineering company that

also produces industrial modelsalso produces industrial models More flexible and better looking models, More flexible and better looking models,

but it is also more expensive and not as but it is also more expensive and not as widely usedwidely used

Controller is more sophisticated and can Controller is more sophisticated and can support more sensors and motorssupport more sensors and motors

fischertechnikfischertechnik

High EndHigh End

Build it yourself out of individual Build it yourself out of individual componentscomponents

Design it all yourself and assemble the Design it all yourself and assemble the components required to produce your components required to produce your robotrobot

Several companies specialize in parts for Several companies specialize in parts for this, including one in HK:this, including one in HK:

http://www.robotstorehk.com/http://www.robotstorehk.com/

High EndHigh End

These stores carry various kinds of motors These stores carry various kinds of motors and sensors, can select what you needand sensors, can select what you need

Mobile platforms that can be used as the Mobile platforms that can be used as the basis for a wheeled robotbasis for a wheeled robot

Also have various types of controllers and Also have various types of controllers and single board computerssingle board computers

Need to know what you are doing, but the Need to know what you are doing, but the most flexible approachmost flexible approach

HandyBotHandyBot

HandyBot – Robot DanceHandyBot – Robot Dance

Artistic RobotsArtistic Robots

Artists have been fascinated with robots Artists have been fascinated with robots for a long timefor a long time

Robots have been produced to dance, Robots have been produced to dance, draw and play musical instrumentsdraw and play musical instruments

Basically mimicking what people doBasically mimicking what people do Is this what we really want?Is this what we really want? What is the robot adding to the What is the robot adding to the

performance?performance?

Artistic RobotsArtistic Robots

What types of artistic statements do robots What types of artistic statements do robots make?make?

They are modern industrial inventions, They are modern industrial inventions, they should reflect our modern worldthey should reflect our modern world

Installation art with robots as themes, live Installation art with robots as themes, live out science fictionout science fiction

Influenced by violence and rapid pace of Influenced by violence and rapid pace of technologytechnology

Survival Research LabSurvival Research Lab

The first and probably best known of the The first and probably best known of the artistic groupsartistic groups

Put together robots out of old scrap and Put together robots out of old scrap and cast off technologycast off technology

Often have a violent theme, machines that Often have a violent theme, machines that fight with each otherfight with each other

Produce a spectacle as well as a Produce a spectacle as well as a performanceperformance

SRLSRL

Robots tend to be quite large and Robots tend to be quite large and potentially quite dangerouspotentially quite dangerous

Early show would have robots battle to the Early show would have robots battle to the death, often staged randomly wherever death, often staged randomly wherever there was an empty parking lotthere was an empty parking lot

Now have legal and insurance problems Now have legal and insurance problems with their shows, fear that someone could with their shows, fear that someone could get killedget killed

SRLSRL

SRLSRL

http://www.srl.org/yard/kcop/kcoptvhi.ram

SRLSRL

SeemenSeemen

Another group with a slightly different take Another group with a slightly different take on robotson robots

Machines are similar to SRL:Machines are similar to SRL: Made of old industrial partsMade of old industrial parts Tend to be largeTend to be large Tend to be violentTend to be violent Lots of fireLots of fire

But, they like to have audience But, they like to have audience participationparticipation

SeemanSeeman

SRL tends to be chaotic, while Seemen is SRL tends to be chaotic, while Seemen is more staged, like a performancemore staged, like a performance

SRL will destroy their machines during a SRL will destroy their machines during a performance, but Seemen uses them to performance, but Seemen uses them to express their opinionsexpress their opinions

Don’t always use violence as a theme, Don’t always use violence as a theme, sometimes use lovesometimes use love

Want the audience to experience the Want the audience to experience the robots, control them directlyrobots, control them directly