Tablet PCs InTablet PCs InSocially Relevant ProjectsSocially Relevant Projects

Michael BuckleyMichael BuckleyUniversity of BuffaloUniversity of Buffalo

Here’s The Problem...Here’s The Problem...

We needed an experience for We needed an experience for undergraduate projects teams that wasundergraduate projects teams that was

Un-simulatedUn-simulated

IntenseIntense

MeaningfulMeaningful

ReflectiveReflective

The Target PopulationThe Target Population

Those who could benefit from the Those who could benefit from the intelligence, creativity, hard workintelligence, creativity, hard workof studentsof students

Those who could not command the Those who could not command the technology themselvestechnology themselves

Those whose quality of life would benefitThose whose quality of life would benefit

The Tablet PCThe Tablet PC

Reduced the cost of touch-activated Reduced the cost of touch-activated control from $6,000 to $1000control from $6,000 to $1000

Reduced the cost of programmable touch-Reduced the cost of programmable touch-activated control from $10,000 to $1000activated control from $10,000 to $1000

Made touch activated control available to Made touch activated control available to an army of studentsan army of students

Our Clients And CustomersOur Clients And Customers

Our First Client:Our First Client:ElderWood Senior Care At ElderWood Senior Care At Oakwood, Williamsville, NYOakwood, Williamsville, NYMotivation Motivation

David, a 43-year old stroke patient who has been speech impaired David, a 43-year old stroke patient who has been speech impaired for over 20 years for over 20 years

Previously communicated using a letter boardPreviously communicated using a letter board

Commercial technology solutions were not adequate for DavidCommercial technology solutions were not adequate for David

Result Result The UB Talker was developed for David by studentsThe UB Talker was developed for David by students

VESID (Vocational and Educational Services for Individuals with VESID (Vocational and Educational Services for Individuals with Disabilities) has purchased a tablet PC for David Disabilities) has purchased a tablet PC for David

David will be working with our research group as a consultantDavid will be working with our research group as a consultant

UB TalkerUB Talker

Goal – Give those peopleGoal – Give those peoplewithout the ability to speak, a voice without the ability to speak, a voice

Target Population – Handicapped/disabledTarget Population – Handicapped/disabledwho have limited motor skills and havewho have limited motor skills and havedifficulty with voice communicationdifficulty with voice communication

Phase I – Adult TalkerPhase I – Adult Talker

Phase II – Child TalkerPhase II – Child Talker

Phase III – For the visually impaired, andPhase III – For the visually impaired, andfor the severely handicapped (no motor skills)for the severely handicapped (no motor skills)

UB TalkerUB Talker

Allows for the creation of sentences, Allows for the creation of sentences, phrases and speeches that can bephrases and speeches that can bespoken with the push of a buttonspoken with the push of a button

Phrase and Word Completion –Phrase and Word Completion –Based on frequency of use, last-usedBased on frequency of use, last-used

Content Prediction – Time andContent Prediction – Time andContext – Based on time of day,Context – Based on time of day,day of week, seasonday of week, season

Auto-ScanAuto-Scan

An Alternative DesignAn Alternative Design

UB TalkerUB Talker

The Center For Handicapped The Center For Handicapped Children, Williamsville, NYChildren, Williamsville, NY

Center Based ProgramCenter Based ProgramCHC LEARNING CENTER provides educational and therapeutic CHC LEARNING CENTER provides educational and therapeutic programming for pre-school and school age children (infant to 21 yearsprogramming for pre-school and school age children (infant to 21 yearsof age) who are medically frail and technologically dependentof age) who are medically frail and technologically dependent

Home Based ProgramHome Based ProgramCertified special teachers and licensed therapists provide serviceCertified special teachers and licensed therapists provide servicein the home for infants and young children unable to attend thein the home for infants and young children unable to attend thecenter based program center based program

Support ServicesSupport ServicesOccupational, Speech and Language, and Physical Therapies areOccupational, Speech and Language, and Physical Therapies areavailable to all students at CHC LEARNING CENTER          available to all students at CHC LEARNING CENTER         

PhilosophyPhilosophyCHC LEARNING CENTER recognizes the need for support for theCHC LEARNING CENTER recognizes the need for support for thefamilies of children with disabilities and the benefits to child and family families of children with disabilities and the benefits to child and family when services are truly comprehensive and integratedwhen services are truly comprehensive and integrated

DISCODISCO

Interface multiple inputs (switches) toInterface multiple inputs (switches) toyield multiple outputs (lights and sound) yield multiple outputs (lights and sound) through the use of a computer to createthrough the use of a computer to createa cost-effective learning tool for disabled a cost-effective learning tool for disabled and handicapped students and handicapped students

This tool accommodates a variety of This tool accommodates a variety of needs beyond the hand and eye needs beyond the hand and eye

The use of lights, fog, music, video, etc. The use of lights, fog, music, video, etc. to create soothing and entertaining stimulito create soothing and entertaining stimuli

DISCODISCO

Simple choice-making and the realization of Simple choice-making and the realization of cause-and-effect are a central goal of early cause-and-effect are a central goal of early education for the physically handicapped and education for the physically handicapped and developmentally delayed, especially children developmentally delayed, especially children

The relationship between physical actionThe relationship between physical actionand ultimate effect is not necessarily naturaland ultimate effect is not necessarily natural

The ability to select between alternativesThe ability to select between alternativesof increasing number is part of a student’s of increasing number is part of a student’s Individual Education Program (IEP) from early-onIndividual Education Program (IEP) from early-on

DISCODISCO

The mechanism used usually presentsThe mechanism used usually presentslarge colored switches which respondlarge colored switches which respondwith different noises or spoken words: with different noises or spoken words:

First a single switchFirst a single switch

Then two, then four Then two, then four

Until sufficient cause-and-effect isUntil sufficient cause-and-effect isestablished to graduate the student to aestablished to graduate the student to amore powerful augmentative communications more powerful augmentative communications device such as a touch-screen talkerdevice such as a touch-screen talker

Hardware SetupHardware Setup

Interfacing HardwareInterfacing HardwareTo A Tablet PCTo A Tablet PC

From Measurement ComputingFrom Measurement Computing

……To AC PowerTo AC Power

From StarMagicFrom StarMagic

……To Lights and SoundTo Lights and Sound

OthersOthers

Unrestricted internet navigation usingUnrestricted internet navigation usinga single switch (e.g., head switch)a single switch (e.g., head switch)

Motorized wheelchair controlled from a Motorized wheelchair controlled from a remote laptop (with cameras and safety remote laptop (with cameras and safety sensors, etc.) to teach mobilitysensors, etc.) to teach mobility

© 2006 Microsoft Corporation. All rights reserved.Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation.Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft,

and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.