a character based communication system as a universal design, especially for the visually and the...

A Character Based A Character Based CommunicationCommunication System as a Universal Design, System as a Universal Design,

Especially for Especially for the the VisuallyVisually and the and the HearingHearing Impaired Impaired

Hiroki MinagawaHiroki Minagawa, , Makoto KobayashiMakoto KobayashiTomoyuki Nishioka, Shigeki MiyoshiTomoyuki Nishioka, Shigeki Miyoshi

Tsukuba College of TechnologyTsukuba College of TechnologyJapanJapan

19 July 200019 July 2000 ICCHP 2000 - Hiroki MinagawaICCHP 2000 - Hiroki Minagawa 22

PurposePurpose

Equivalent communication environmentEquivalent communication environment for any personsfor any personsespecially for the especially for the visuallyvisually and the and the hearinghearing

impairedimpaired


ApproachApproach

Analysis of human communication on Analysis of human communication on computer networkcomputer networkInformation flowInformation flowHuman interactionHuman interaction

SIRCC (Speaking IRC Client)SIRCC (Speaking IRC Client)Makoto KobayashiMakoto Kobayashi


Communication ExperimentCommunication Experiment

AimAimAnalysis of network communication

MethodMethodChatChat

Division for visually impairedDivision for visually impairedDivision for hearing impairedDivision for hearing impaired


Subject Client software

Totally blind SIRCCVisuallyimpaired Weak eyesight SIRCC

SIRCCMicrosoft Chat

(Character mode)Hearing impairedMicrosoft Chat(Comic mode)

Subjects and Client SoftwareSubjects and Client Software


Results 1: AccessibilityResults 1: AccessibilityThree Three hearing impairedhearing impaired subjects: subjects:

Accessible via any Accessible via any visual interfacevisual interfaceA A totally blindtotally blind subject: subject:

Accessible by means of Accessible by means of hearing synthetic hearing synthetic voicevoice and and typing keyboardtyping keyboard

A A weak-sightedweak-sighted subject: subject:Accessible by means of Accessible by means of adjusting the color of adjusting the color of

characters, the contrast and the sizecharacters, the contrast and the size, and , and hearing synthetic voicehearing synthetic voice


Results 2: ErrorsResults 2: ErrorsHuman errorsHuman errors

Key typingKey typing error errorSystem operationSystem operation error error

System errorsSystem errorsCharacter codingCharacter coding error error

IME ( Input Method Editor )IME ( Input Method Editor )Voice synthesizingVoice synthesizing error error

Screen readerScreen reader


Results 3: Time lagResults 3: Time lagThree Three hearing impairedhearing impaired subjects: subjects:

ShortShortNo division among No division among threethree hearing impairedhearing impaired

subjectssubjectsTwo Two visually impairedvisually impaired subjects: subjects:

Long (because of Long (because of system operationsystem operation))Some division between Some division between visually impairedvisually impaired

and and hearing impairedhearing impaired subjects subjects


Result 4: System collisionResult 4: System collision

Collision of Collision of voice synthesizervoice synthesizer control controlVoice feedbackVoice feedback for for system operationsystem operation of of

blind userblind userVoiceVoice of of other users’ messageother users’ message


ConsiderationConsideration

Data flow modelData flow model of of human communicationhuman communication on computer networkon computer network


Case 1Case 1Windows user - Windows userWindows user - Windows user

Windowsuser

hands

eye

Windowsuser

eye

hands


Windowsuser

hands

eye

Windowsuser

eye

hands

WindowsPC


putputputput



Windowsuser

hands

eye

Windowsuser

eye

hands

WindowsPC

WindowsPC

send receive



Windowsuser

hands

eye

Windowsuser

eye

hands

WindowsPC

WindowsPC

get



put

Windowsuser

hands

eye

Windowsuser

eye

hands

WindowsPC

WindowsPC

put


Windowsuser

hands

eye

Windowsuser

eye

hands

WindowsPC

WindowsPC


sendreceive



get

Windowsuser

hands

eye

Windowsuser

eye

hands

WindowsPC

WindowsPC



Windowsuser

hands

eye

Windowsuser

eye

hands

WindowsPC

WindowsPC


Case 2Case 2Screen reader user - Windows userScreen reader user - Windows user

screen readeruser

hands

ear

Windowsuser

eye

hands


put

screen readeruser

hands

ear

Windowsuser

eye

hands

WindowsPC


putputput

screenreader


screen readeruser

hands

ear

Windowsuser

eye

hands

WindowsPC

WindowsPC

screenreader


send receive



get

screen readeruser

hands

ear

Windowsuser

eye

hands

WindowsPC

WindowsPC

screenreader


screen readeruser

hands

ear

Windowsuser

eye

hands

WindowsPC

WindowsPC

screenreader


putput


screen readeruser

hands

ear

Windowsuser

eye

hands

WindowsPC

WindowsPC

screenreader


sendreceive



get

screen readeruser

hands

ear

Windowsuser

eye

hands

WindowsPC

WindowsPC

screenreader

get



screen readeruser

hands

ear

Windowsuser

eye

hands

WindowsPC

WindowsPC

screenreader

system error(IME)

human error(operation)

system error(screen reader)human error

(hearing)human error(operation)

human error(reading)

time lag (long) time lag (short)



screen readeruser

hands

ear

Windowsuser

eye

hands

WindowsPC

WindowsPC

screenreader

collision of system resource

collision of human hearing resource


ConclusionConclusion

CommunicationCommunication experiment among experiment among the the visuallyvisually and the and the hearinghearing impaired impaired on on computer networkcomputer network

Data flow modelData flow model of human of human communication on computer networkcommunication on computer network


Future research subjectsFuture research subjects

Computational modelsComputational models of network of network communicationcommunicationSpecifying the Specifying the parametersparameters

Error ratesError rates at each step at each stepTime lagTime lag at each operation at each operation

Influence Influence of such parameters on of such parameters on human human behaviorbehavior

Computational models of Computational models of other other communication communication (e.g. sign language)(e.g. sign language)

a character based communication system as a universal design, especially for the visually and the...

Documents