christopher buckingham, computer science, aston university
DESCRIPTION
www.egrist.org. Improving care of people with mental health problems using the Galatean Risk and Safety Tool ( GRiST ). The potential for IAPT services. LUFC. Elland Road. April 10 th , 2013. Christopher Buckingham, Computer Science, Aston University - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/1.jpg)
Improving care of people with mental health problems using the Galatean Risk and Safety Tool
(GRiST)
Christopher Buckingham, Computer Science, Aston University
Ann Adams, Medical School, University of Warwick
April 10th, 2013
The potential for IAPT services
www.egrist.org
LUFC Elland Road
![Page 2: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/2.jpg)
Risks associated with mental health problems• Suicide
• Self harm• Harm to others and damage to property• Self neglect• Vulnerability• Risk to dependents
Our research is about better understanding, detection, and management
It is aimed at both clinicians and service usersIt feeds into the GRiST clinical tool and improved
services
![Page 3: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/3.jpg)
Some of the Research Team
Ann Adams,& Christopher MaceUniversity of Warwick
Christopher Buckingham,Ashish Kumar, Abu AhmedUniversity of Aston
![Page 4: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/4.jpg)
Evidence about mental-health risksRisk
independent cues
Risk
cue clusters
Risk
cue interactions
specific cue valuesoccurring together
particular cuecombinations
We know quite a lot We know a little
We hardly know anything
![Page 5: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/5.jpg)
No explicit integration
RISKASSESSMENT
Risk tool
Clinical judgement
![Page 6: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/6.jpg)
Need to connect the information sources
RISKASSESSMENT
Risk tool
Clinical judgement
HOLISTIC
![Page 7: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/7.jpg)
Data hard to extract
![Page 8: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/8.jpg)
Electronic documents: little structure, information buried
Yes, this really is an NHS decision support document
![Page 9: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/9.jpg)
Data not shared
RISKASSESSMENT
RISKASSESSMENT
Mon
Tue
Fri
RISKASSESSMENT
or exploitthe semanticweb
![Page 10: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/10.jpg)
The solution: GRiST• Explicitly models structured clinical judgements• Underpinned by a database with sophisticated statistical
and pattern recognition tools.– linked with empirical evidence
• Developed from the start to exploit the semantic web– universally available– ordinary web browsers
• Designed as an interactive tool with sophisticated interface functionality
• Provides a common risk language with multiple interfaces
– collecting information– providing advice
• Supports shared decision making and self-assessment
![Page 11: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/11.jpg)
The solution: GRiST• Versions for different populations
– older, working age, child and adolescent– specialist services (e.g. learning disability, forensic)
• A whole (health and social care) system approach to risk assessment
![Page 12: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/12.jpg)
www.egrist.org
![Page 13: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/13.jpg)
Eliciting expertiseKnowledge bottleneck
– Extracting expertise– Representational language experts understand– Gain agreement between multiple experts– Lowest common denominator ……
![Page 14: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/14.jpg)
Unstructured Interview
• What factors would you consider important to evaluate in an assessment of someone presenting with mental health difficulties?– prompts or probes to explore further
• 46 multidisciplinary mental-health practitioners
![Page 15: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/15.jpg)
![Page 16: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/16.jpg)
![Page 17: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/17.jpg)
![Page 18: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/18.jpg)
Mind map with total numbers of expertsresults of integrating interview data
12 experts
• identifies relevant service-user data• “tree” relates data to risk concepts and top-level risks• information profile for service user
![Page 19: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/19.jpg)
Interview transcripts
Qs & layers
XSLT
Different riskscreeningtools for varying circumstancesand assessors
Coding
Lisp
Lisp or XSLT
Mind map
Tree for pruning
Pruned tree
Data gathering treeData gathering treewith questions and layers
that organise question priority
Fully annotatedpruned tree
mark up
XS
LT
All trees are implemented as XML
![Page 20: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/20.jpg)
Multiple populations handled by instructions in the tree
• Work on specifying different models done by XML attributes
• End-users access their own simple tree
• What is XML?<family>
<brother “john”/><sister “mary”/><daddy “long legs”/>
</family>
![Page 21: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/21.jpg)
Arboreal sculpture
![Page 22: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/22.jpg)
Complete “universal” tree: multiple overlays
working age
![Page 23: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/23.jpg)
Complete “universal” tree: multiple overlays
CAMHS
![Page 24: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/24.jpg)
Complete “universal” tree: multiple overlays
OlderAdults
![Page 25: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/25.jpg)
Complete “universal” tree: multiple overlays
Service users
![Page 26: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/26.jpg)
Complete “universal” tree: multiple overlays
Carers
![Page 27: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/27.jpg)
Complete “universal” tree: multiple overlays
Friends
![Page 28: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/28.jpg)
Multiple services
• Same idea as populations• Customise service requirements• Difference is that they cover all populations• Services so far:
– IAPT– Primary Care– Forensic
![Page 29: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/29.jpg)
How not to design and develop• Must be able to meet end-user’s changing and
varied requirements
![Page 30: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/30.jpg)
Iterative development for implementing research results into evolving GRiST and
myGRiST
Agile software engineering
![Page 31: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/31.jpg)
![Page 32: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/32.jpg)
![Page 33: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/33.jpg)
IAPT demoIf the person says yes
IAPT versionof Gristjust 6 screeningquestions
![Page 34: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/34.jpg)
Opens up four subsidiary questions for IAPT
If the person says yes
![Page 35: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/35.jpg)
Two more IAPT questions are asked.
![Page 36: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/36.jpg)
Comments and management information can be added to any
questions
![Page 37: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/37.jpg)
An overall risk judgement is made along with supporting comments
and risk management information
![Page 38: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/38.jpg)
Risk reports are generated immediately and can be downloaded
as a pdf.This shows a summary
just for suicide
![Page 39: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/39.jpg)
Each risk has a detailed information profile that explains where the risk judgement came
from.
![Page 40: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/40.jpg)
commentaction/intervention
gold padlock
silver padlock
red means filled
Interface functionality
![Page 41: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/41.jpg)
Manage patient assessments
![Page 42: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/42.jpg)
Service audit data (i)
![Page 43: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/43.jpg)
Service audit data (ii)
![Page 44: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/44.jpg)
myGRiST
![Page 45: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/45.jpg)
myGRiST
![Page 46: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/46.jpg)
Communication
• GRiST Cloud– common data
PHQ-9 et alGAD-7
GPs
IAPT myGRiST MH trusts
Private hospitals
Non-health orgs:education, work,
community
Data sharingData exchangeData integration
social services
![Page 47: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/47.jpg)
Patient-centric web of care
clin
ical
per
spec
tive
Riskcl
inic
al/s
ervi
ce u
ser
Safety se
rvic
e us
erWell-being
![Page 48: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/48.jpg)
Current GRiST database (now twice as big)
• 96,040 cases of patient data linked to clinical risk judgements
• Different risks• Different age ranges• Precise quantitative input linked with
qualitative free text
![Page 49: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/49.jpg)
Wisdom
Expertise
Dissemination
![Page 50: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/50.jpg)
f(data)
c
kkk ztztwJ
1
22
21)(
21)(
How we do itTransparentKnowledge and reasoning can be understood
• Black box• Can’t see how
answer derived
input data
Risk data
output judgement
Risk evaluation
![Page 51: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/51.jpg)
input
data
judgement
input data
GRiST cognitive modelClear explanation for risk judgementIdentifies important risk conceptsInforms interventions
judgemen
t
Mathematical modelsOptimal prediction of judgementValidation of cognitive modelEvidence base for cues and relationship with risks
RBFNBBNneural netPCA
securetrusted
risks
![Page 52: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/52.jpg)
GRiST captures consensus• Preliminary (crude analysis) results for clinical tool
– Correlation > 0.8, R2 = 0.69– 87% of 4000 predictions within 1 of the expert on 11-point scale– No difference if inputs are raw values or membership grades
• So we can model evaluations for different types of user
![Page 53: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/53.jpg)
Clinical Decision Support for Mental Healthwww.eGRiST.org
Galatean Risk Screening ToolResults
Absolute Error in Predicting Judgement
87% of predictions have an error of < +/- 1eg If judgement = 3, 2 < prediction < 4Less than 3% have an error of greater than +/- 2 less than 2
87%
>+/- 113%
less than 2More than 2
No Risk Low Risk Medium Risk High Risk Max Risk
0 to 2 2 to 4 4 to 6 6 to 8 8 to 10
![Page 54: Christopher Buckingham, Computer Science, Aston University](https://reader036.vdocuments.site/reader036/viewer/2022062520/56816387550346895dd472e6/html5/thumbnails/54.jpg)
www.egrist.org