enabling abilites with smart systems - madelaine sayko

Enabling Abilities with Smart Support

Systems Madelaine Sayko, CEO

Patrice Tremoulet, PhD

Meira Josephy

What Is Cognition

● Cognition: the process by which sensory inputs are transformed,

reduced, elaborated, stored, recovered, and used. (APA, 2013)

● Includes; the mental processes of attention, memory,

comprehending and producing language, monitoring mental and

physiological states, calculating, reasoning, planning, problem

solving, sequencing, wayfinding and decision making. (from ICF cognitive

functions)

● Cognition is not necessarily the same as intelligence

© Cognitive Compass

2015

What Is A Cognitive Disability?

● Standard Definition: Because of a physical, mental, or emotional condition, this

individual has more difficulty than the average person with concentrating,

remembering, or making decisions

● Additional features include:

Deficits in initiation, problem solving, abstract reasoning insight, judgement,

planning, information processing, interpreting social cues, and organization.

(NIH Consensus Development Panel of Rehabilitation of Persons with

Traumatic Brain Injury)

Cognitive disabilities range from significant to mild.

They occur across a broad spectrum (Armstrong – continuum of

competence)

Cognitive disabilities are not always apparent (invisible)

Many individuals can perform at very high levels but may have a problem

with a specific function such as attention or social skills

Cognitive disabilities may include physical attributes such as vision or balance

Many cognitive disabilities improve throughout a lifetime, no matter when

they occurred or how (Chapman 2015)


2015

Why Cognitive Assistants for

Disability

• Almost ½ of all disabilities are cognitive (43%)

• 25% of the workforce are baby boomers who will experience mild cognitive impairments even as they continue to work

• First generation of students graduating from school under ADA are now in the workforce

• 95% of clinicians report that people with brain injury need technology to support organization and memory

• Over 1/3 of employers have difficulty filling positions; persons with cognitive disabilities may be able to meet these needs with Assistive Technology for Cognition (ATC)


2015

What Is Assistive Technology

For Cognition

• Technologies Are Human Created Artifacts that

Extend Human Capabilities (Kapp 1877, Lawson

2010)

• Assistive Technology for Cognition are human

created artifacts that enable, enhance or extend

cognitive function (Gillespie and Zittoun, 2010)


2015

Evolution of Cognitive Model

Technology Type/ User Group/ Rehab Goals

Modular/ Neuropsychological View/Functional Specificity/ ICF

Neuro-Socio-Technical /ATC as a circuit

• Similar deficits arise in different user groups.

• Single technology can support multiple cognitive functions

DESIGN FOR ALL

Cognition as an interactive process – Cognition and Behavior linked (Bateson)


2015

Executive Function (Norman and Shallice)

Environmental Triggers

Mobilize Scripts

Action in the Environment

Regulating and Monitoring

Supervisory Attentional System


2015

Socio-Neuro-Technical Model

• A full understanding of human cognition must consider the elements

beyond the brain itself; including interaction with environmental

factors

• Environmental factors include

o Psycho-social

o Physical Space

o Task

o Resources

• Seamless Interaction with the world – Zero effort technology

• Neural structure of individual adapts to the tools in the environment

and the modes of social interaction – supports compensation


2015

What Are The Challenges Of Addressing Cognitive Disability

● Very individualized needs – wide spectrum

● Challenges with initiation may impact ability to enter or actively use

tools

● Memory issues may make it harder to learn tools

● Lack of self- awareness

● Socio-Neuro-Technical model is needed – must address

Context

Task

Ability

Personality

Supports

Environment


2015

Examples

• Neuropage

• PEAT (Brain Aid)

• Memex

• Bionic Brain

• Smart Calendaring

• SIRI et al

• Remembrance Agent

• Word processing tools – spell check

• CALO


2015

New Product Development


2015

A New Solution Set for a Cognitive Assistant

• Based on Semantic Knowledge

• Start with one function built into a service system

• Based on organizational norms

• Utilize built in decision making, cuing and custom

prompts for minimal effort and to mitigate initiation

problems

• Creates a status for documents, email and contacts

for projects


2015

Key Features • Service System

• Zero Effort Technology (approximates)

• Smart System – learns the users

• Cognitively Friendly UI - NLP

• Assessment and Recommender Component

• Captures User Data

• Mobile

• Focus on Function & Task Interaction NOT a given disability

• Integrates task functions into one system

• Uses external prompts and aids to ‘scaffold’ the user


2015

Functions

• Set of Assistive Tools that are “aware” of accepted social norms in

work organizations

• Monitor work patterns

• Offer assistance and appropriate reminders and cues

• Offloads some task management to technology

• Provide insight in cognitive disability in the workplace

• ‘Canary in the coal mine’ for understanding cognition overall


2015

Learning Models

• Guide the User – high level of system feedback, instructs user when

mistakes are made, encourages when right path is chosen (think

video games)

• Understand the User – responds to user needs and preferences,

response speed, accuracy etc. shape system presentation (think

cognitive games)

• Support the User- present information in ways that are easy to follow,

step by step (highly structured)


2015

AN INTELLIGENT TASK STATUS MANAGER

Task Status Management Functionality

Knowledge of Social / Org norms and practices related to tasks statuses

Monitoring Cues & Advise Adjustments

*1) Supplier X hasn’t responded to inquiry for a week, follow up with him *2) email requests from Manager needs respond within 24 hours, *3) monthly work status report pre-warning 5 days in advance of deadline


2015

Future Vision For A Cognitive Support Service System

Private Data Store

Behavioral Physiological & Environmental

Models

Recommender & Integrated Work Assist Environment

Smart Assessor

Individualized cuing and aids to ‘scaffold’ the user for task needs – Cognitive Assistant

Task & Status Management

Attention / Initiation

Planning & Organization

Communication/ Behavior

Time Management/

Cognitive Budget

Usage Patterns

Biometric Devices

Image Collection

Dialogue Module

User Preferences


2015

Contact Information

• Madelaine Sayko • [email protected] • (610) 715-2057

mailto:[email protected]