Download - SenseCam & memory rehabilitation
Memex Summit, July 2006
SenseCam & memory SenseCam & memory rehabilitationrehabilitationGeorgina Browne, Emma Berry, Narinder KapurGeorgina Browne, Emma Berry, Narinder Kapur
Steve Hodges, Lyndsay Williams, Gavin Smyth, James Srinivasan, Steve Hodges, Lyndsay Williams, Gavin Smyth, James Srinivasan, Alex Butler, Alban Rrustemi, Ken WoodAlex Butler, Alban Rrustemi, Ken Wood
2 Memex Summit, July 2006
BackgroundBackground
• Cambridge Memory Clinic, Cambridge Memory Clinic, Addenbrooke’s Hospital Addenbrooke’s Hospital
3 Memex Summit, July 2006
Causes and treatment of memory lossCauses and treatment of memory loss
• Neurodegenerative disease Neurodegenerative disease – Alzheimer’s disease and Lewy Body dementia Alzheimer’s disease and Lewy Body dementia
can be treated with medication – with limited can be treated with medication – with limited successsuccess
– No medical treatment for other dementiasNo medical treatment for other dementias
– External memory aids (in theory)External memory aids (in theory)
• Acquired brain injury (traumatic and non-Acquired brain injury (traumatic and non-traumatic) traumatic) – External memory aids (in theory)External memory aids (in theory)
4 Memex Summit, July 2006
Improving memory with SenseCam Improving memory with SenseCam
• Different types of memory:Different types of memory:– Episodic – things you have done (personal Episodic – things you have done (personal
experiences)experiences)
– Semantic – facts and conceptsSemantic – facts and concepts
– Prospective – things you intend to do (go Prospective – things you intend to do (go shopping, visit friends, make and keep shopping, visit friends, make and keep appointments)appointments)
• Almost all memory aids treat prospective Almost all memory aids treat prospective memorymemory
5 Memex Summit, July 2006
Improving memory with SenseCamImproving memory with SenseCam
• Episodic memory critical to quality of lifeEpisodic memory critical to quality of life– Forms basis for semantic memoriesForms basis for semantic memories– Guides actions, creates bonds, builds self-concept Guides actions, creates bonds, builds self-concept
• SenseCam records experiencesSenseCam records experiences– Captures events from patient’s point of view Captures events from patient’s point of view – Without conscious thought or intrusionWithout conscious thought or intrusion– Plays back quickly in simple-to-use, easy-to-view ‘movie’Plays back quickly in simple-to-use, easy-to-view ‘movie’
• Subsequent viewing of image sequencesSubsequent viewing of image sequences– Cues recall & so consolidates storage of memoriesCues recall & so consolidates storage of memories
6 Memex Summit, July 2006
Improving memory with SenseCamImproving memory with SenseCam
• Cambridge Memory Clinic, Cambridge Memory Clinic, Addenbrooke’s Hospital Addenbrooke’s Hospital
• 63 year old, well-educated, 63 year old, well-educated, married woman ‘Mrs B’married woman ‘Mrs B’
• Diagnosed with limbic Diagnosed with limbic encephalitis in 2002encephalitis in 2002
• Now has marked amnesiaNow has marked amnesia– usually no memory a couple of days after eventusually no memory a couple of days after event
7 Memex Summit, July 2006
Improving memory with SenseCamImproving memory with SenseCam
• Goals of patient and husbandGoals of patient and husband
– To improve Mrs B’s episodic memoryTo improve Mrs B’s episodic memory
– To share experiences with each otherTo share experiences with each other
– To improve Mrs B’s self-esteem and To improve Mrs B’s self-esteem and confidenceconfidence
8 Memex Summit, July 2006
Improving memory with SenseCamImproving memory with SenseCam
• Study ProtocolStudy Protocol
– Experimental condition: SenseCam used to record Experimental condition: SenseCam used to record ‘special’ days (N=9) ‘special’ days (N=9)
– Control condition: written diary used to record ‘special’ Control condition: written diary used to record ‘special’ days (N=3)days (N=3)
– Baseline condition: no memory aid used to help recall Baseline condition: no memory aid used to help recall ‘special’ days (N=2)‘special’ days (N=2)
– Information reviewed every 2 days for 2 weeksInformation reviewed every 2 days for 2 weeks
– Memory evaluated before each reviewMemory evaluated before each review
9 Memex Summit, July 2006
Results Results
0.0
0.5
1.0
1.5
2.0
2.5
x
ResultsResults
Pro
port
ion
of e
vent
re
mem
bere
d
Memory of an event over time
Baseline
Days elapsed following event
10 Memex Summit, July 2006
0.0
0.5
1.0
1.5
2.0
2.5
x
Results Results ResultsResults
Memory of an event over time
Days elapsed following event
Diary
Baseline
Pro
port
ion
of e
vent
re
mem
bere
d
11 Memex Summit, July 2006
0.0
0.5
1.0
1.5
2.0
2.5
x
Results Results ResultsResults
Memory of an event over time
Days elapsed following event
Diary
SenseCam
Baseline
Pro
port
ion
of e
vent
re
mem
bere
d
12 Memex Summit, July 2006
0.0
0.5
1.0
1.5
2.0
2.5
x
Results Results ResultsResults
Memory of an event over time
Days elapsed following event
Diary
SenseCam
Baseline
Pro
port
ion
of e
vent
re
mem
bere
d
13 Memex Summit, July 2006
Results: SenseCam feedbackResults: SenseCam feedback
• Results from patient’s point of view:Results from patient’s point of view:
– More relaxed socially and less anxiousMore relaxed socially and less anxious
– Sharing experiences again was a ‘sheer Sharing experiences again was a ‘sheer pleasure’pleasure’
– Seeing images brings memories ‘flooding back’Seeing images brings memories ‘flooding back’
– ‘‘It has enormous potential as a memory aid It has enormous potential as a memory aid and has been a great success for us personally’and has been a great success for us personally’
14 Memex Summit, July 2006
Results: SenseCam feedbackResults: SenseCam feedback
• PublicationsPublications
– Berry, E., Kapur, N., Watson, P., Smith, R., Williams, L., & Wilson, B. (in Berry, E., Kapur, N., Watson, P., Smith, R., Williams, L., & Wilson, B. (in press). The use of SenseCam as a pictorial diary to improve press). The use of SenseCam as a pictorial diary to improve autobiographical memory in a patient with limbic encephalitis: A autobiographical memory in a patient with limbic encephalitis: A preliminary report. preliminary report. Neuropsychological RehabilitationNeuropsychological Rehabilitation. .
– Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N., & Wood, K. SenseCam: A retropsective memory Smyth, G., Kapur, N., & Wood, K. SenseCam: A retropsective memory aid. To appear in aid. To appear in UbiComp 2006, 8UbiComp 2006, 8thth International Conference on International Conference on Ubiquitous Computing, September 17-21, 2006Ubiquitous Computing, September 17-21, 2006..
– Tan, D., Berry, E., Czerwinski, M., Sellen, A., Bell, G., Gemmell, J., Tan, D., Berry, E., Czerwinski, M., Sellen, A., Bell, G., Gemmell, J., Hodges, S., Kapur, N., Meyers, B., Oliver, N., Robertson, G., & Wood, K. Hodges, S., Kapur, N., Meyers, B., Oliver, N., Robertson, G., & Wood, K. (in press). Supporting human memory with a personal digital lifetime (in press). Supporting human memory with a personal digital lifetime store. To appear in J. Teevan & W. Jones (Eds.), store. To appear in J. Teevan & W. Jones (Eds.), Readings in Personal Readings in Personal Information ManagementInformation Management. Seattle: University of Washington Press. . Seattle: University of Washington Press.
15 Memex Summit, July 2006
Ongoing research: MSRCOngoing research: MSRC
• SenseCam as an episodic memory aid in SenseCam as an episodic memory aid in patients with early Alzheimer’s diseasepatients with early Alzheimer’s disease
• SenseCam as an episodic memory aid in SenseCam as an episodic memory aid in other patients with memory lossother patients with memory loss
• SenseCam factors facilitating consolidationSenseCam factors facilitating consolidation– Image-reviewing schedulesImage-reviewing schedules
16 Memex Summit, July 2006
Ongoing research: collaborative workOngoing research: collaborative work• Collaborations agreed/underway with:Collaborations agreed/underway with:
– Professor Narinder Kapur, Head Professor Narinder Kapur, Head of Neuropsychology, of Neuropsychology, Addenbrookes Hospital, Addenbrookes Hospital, CambridgeCambridge
– Professor Adam Zeman, Professor Professor Adam Zeman, Professor of Cognitive and Behavioural of Cognitive and Behavioural Neurology, Peninsula Medical Neurology, Peninsula Medical School, ExeterSchool, Exeter
– Professor Jon Evans, Professor of Professor Jon Evans, Professor of Applied Neuropsychology, Applied Neuropsychology, University of Glasgow University of Glasgow
– Dr Chris Butler, Clinical Research Dr Chris Butler, Clinical Research Fellow, Department of Neurology, Fellow, Department of Neurology, University of EdinburghUniversity of Edinburgh
– Dr Nick Alderman, Consultant Dr Nick Alderman, Consultant Neuropsychologist, St Andrews Neuropsychologist, St Andrews Hospital, NorthamptonHospital, Northampton
– Professor Barbara Wilson, Senior Professor Barbara Wilson, Senior Scientist, MRC Cognition and Brain Scientist, MRC Cognition and Brain Sciences Unit, CambridgeSciences Unit, Cambridge
– Professor John Hodges, Professor Professor John Hodges, Professor of Behavioural Neurology, of Behavioural Neurology, University of CambridgeUniversity of Cambridge
– Professor Phillip Barnard, Research Professor Phillip Barnard, Research Scientist, MRC Cognition and Brain Scientist, MRC Cognition and Brain Sciences Unit, CambridgeSciences Unit, Cambridge
– Professor Martin Conway, Director Professor Martin Conway, Director of Research & ESRC Professorial of Research & ESRC Professorial Fellow, Leeds Memory Group, Fellow, Leeds Memory Group, University of LeedsUniversity of Leeds
– Dr Andrew Bateman, Clinical Dr Andrew Bateman, Clinical Director, Oliver Zangwill Centre of Director, Oliver Zangwill Centre of Neuropsychological Rehabilitation, Neuropsychological Rehabilitation, ElyEly
17 Memex Summit, July 2006
Ongoing research: collaborative workOngoing research: collaborative work
• John Hodges, Professor of Behavioural Neurology, John Hodges, Professor of Behavioural Neurology, Addenbrooke’s HospitalAddenbrooke’s Hospital
– Mild Cognitive ImpairmentMild Cognitive Impairment– Early Alzheimer’s Disease Early Alzheimer’s Disease
• Adam Zeman, Professor of Cognitive & Adam Zeman, Professor of Cognitive & Behavioural Neurology, ExeterBehavioural Neurology, Exeter
– Epileptic amnesiaEpileptic amnesia– Semantic dementiaSemantic dementia
• Oliver Zangwill Centre, CambridgeOliver Zangwill Centre, Cambridge– Brain Injury RehabilitationBrain Injury Rehabilitation– TherapyTherapy
18 Memex Summit, July 2006
Ongoing research: collaborative workOngoing research: collaborative work
• Collaboration with Martin Conway, Collaboration with Martin Conway, Professor of Cognitive Psychology, Professor of Cognitive Psychology, Leeds Memory Group, Editor of the Leeds Memory Group, Editor of the journal journal MemoryMemory
SenseCam is potentially SenseCam is potentially ‘the first truly powerful ‘the first truly powerful 21st century memory stimulant’21st century memory stimulant’ which could which could generally improve and strengthen memory in generally improve and strengthen memory in normal aging populations and in those with normal aging populations and in those with brain diseasebrain disease
19 Memex Summit, July 2006
Ongoing research: collaborative workOngoing research: collaborative work
• Undertaking SenseCam memory studies based on Undertaking SenseCam memory studies based on two hypotheses:two hypotheses:
1.1. SenseCam movies mimic episodic memorySenseCam movies mimic episodic memory• VisualVisual• From ‘egocentric’ point of viewFrom ‘egocentric’ point of view• Temporally orderedTemporally ordered• Formed outside awarenessFormed outside awareness• Time compressedTime compressed• Correspond to changes in goal-directed behaviourCorrespond to changes in goal-directed behaviour
Using SenseCam in experimental studiesUsing SenseCam in experimental studies• Investigating extent to which SenseCam stimulates recall and Investigating extent to which SenseCam stimulates recall and
strengthens learningstrengthens learning• Asking ‘How do we forget over time?’ and ‘How do our memories Asking ‘How do we forget over time?’ and ‘How do our memories
decline with age?’decline with age?’
20 Memex Summit, July 2006
Ongoing research: collaborative workOngoing research: collaborative work
• Professor Conway’s hypotheses cont’d…Professor Conway’s hypotheses cont’d…
2.2. SenseCam movies stimulate brain regions important for SenseCam movies stimulate brain regions important for memory consolidationmemory consolidation
• Hippocampus and related memory structures Hippocampus and related memory structures
• Neural networks not easily activated otherwiseNeural networks not easily activated otherwise
Using SenseCam in neuroimaging studiesUsing SenseCam in neuroimaging studies• Investigating the functional neuroanatomy of episodic memory in Investigating the functional neuroanatomy of episodic memory in
the normal population and in patientsthe normal population and in patients
21 Memex Summit, July 2006
Final wordsFinal words
• SenseCam may be an extremely powerful aid for SenseCam may be an extremely powerful aid for people with memory disorderspeople with memory disorders
• SenseCam may be a potential ‘innoculation’ SenseCam may be a potential ‘innoculation’ against memory decline in the normal ageing against memory decline in the normal ageing populationpopulation