big data solutions omics and ehr · • bristol-meyers squibb (paid to institution) • orion...

46
Anthony Gordon Professor of Anaesthesia and Critical Care Imperial College London NIHR Research Professor Big data solutions Omics and EHR

Upload: others

Post on 17-Mar-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Anthony GordonProfessor of Anaesthesia and Critical Care

Imperial College London

NIHR Research Professor

Big data solutions – Omics and EHR

Page 2: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Disclosures / Acknowledgements

Grant funding / support

• NIHR

• Tenax Therapeutics

• Orion Pharma

• HCA International

Consulting / speaker fees

• Ferring Pharmaceuticals (paid to institution)

• Tenax Therapeutics (paid to institution)

• GSK (paid to institution)

• Bristol-Meyers Squibb (paid to institution)

• Orion Pharma

• Amomed Pharma

The views expressed are those of the author(s) and not necessarily those of the NHS, the

NIHR or the Department of Health.

Page 3: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Lessons learnt

1. Need to work with real experts

Page 4: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

4

Environment

Proteomics

Metabonomics

Transcriptomics

Pathogen

Host

Genomics

Page 5: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Community acquired pneumonia

Page 6: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Consistent signal across validation cohorts

Page 7: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

-lo

g1

0 p

-va

lue

8

6

4

2

Combined cohort

Page 8: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Lessons learnt

1. Need to work with real experts

2. Genomics

– (generally) need large numbers

– pathogen may be important

Page 9: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Metabonomics

Chemical shift Mass to charge ratio

NMR Mass Spec

Page 10: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Benefits

• Large data set

• Very sensitive

• Final downstream marker

Metabonomics

Disadvantages

• Large data set

• Very sensitive

• Final downstream marker

10

Page 11: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily
Page 12: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Serum - NMR

R2Y = 0.91, Q2Y = 0.28, p = 0.02

Page 13: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Ventilator associated pneumonia

VAP

Brain injury

R2Y = 0.94, Q2Y = 0.27, p = 0.05

AUROC = 0.91

Page 14: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Lessons learnt

1. Need to work with real experts

2. Genomics

– (generally) need large numbers

– pathogen may be important

3. Metabonomics

– promising but challenging

Page 15: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Unsupervised hierarchical cluster analysis Principal component analysis

41%

59%

Page 16: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Derivation cohort Validation cohortSRS1

SRS2

7 genes could predict SRS group membership - 3.8% misclassification

Page 17: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Unsupervised hierarchical cluster analysis Principal component analysis

Page 18: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily
Page 19: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily
Page 20: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Interaction p = 0.02

Page 21: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

SRS1 SRS2

HC Placebo HC Placebo P-value

interaction

Time to shock

reversal (hrs)

30.6

(18.1 – 77.7)

43·8

(21·5 - 91·5)

58·9

(36·1 - 82·3)

89·5

(31·5 - 122·0)0.60

Possible explanation? – downregulation of MHC II by steroids

Page 22: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Lessons learnt

1. Need to work with real experts

2. Genomics

– (generally) need large numbers

– pathogen may be important

3. Metabonomics

– promising but challenging

4. Transcriptomics

– ready for use in RCTs?

Page 23: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Using clinical data - EHR

Page 24: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily
Page 25: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Reinforcement learning

Category of artificial intelligence

A virtual agent learns from trial and error an optimized set of rules – a

policy - that maximises a return / reward

Similar to a clinician?

But

Doesn’t suffer from recall bias

Can learn from huge numbers

We can select a delayed reward

Page 26: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Markov Decision Process

A general framework used for modelling sequential decision

making.

Most useful in problems involving complex, stochastic and

dynamic decisions, for which they can find optimal

solutions.

Page 27: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Environment

Agent

Markov Decision Process

Clinicianpolicy π

Patient

action, astate, s reward, r

= prescription= patient condition = mortality risk

Q(s,a): the state-action

value function: value

action a taken in patient

state s

1. Evaluate clinicians’ policy

2. Learn optimal policy

Page 28: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Markov Decision Process

• Defined by 𝑆, 𝐴, 𝑇, 𝑅• 𝑆: a finite set of states

• 𝐴: a finite set of actions

• 𝑇 𝑠𝑡+1, 𝑠𝑡 , 𝑎𝑡 : the transition matrix

• 𝑅: the immediate reward = {-100, +100}

Page 29: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Medical Information Mart for Intensive Care version III (MIMIC-III)

openly available dataset

developed by the MIT Lab for Computational Physiology

deidentified health data

~60,000 critical care patients (2001-2012, 6 ICUs Beth Israel Deaconess Medical

Center)

Includes

– demographics

– vital signs

– laboratory tests

– medications

– outcomes (Social Security Administration Death Master File)

Page 30: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Suspected Sepsis-3 criteria

Antibiotic + micro sample

Increase SOFA >2

Page 31: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

States – 48 variables

Category Items Type

Demographics Age

Gender

Weight

Readmission to ICU

Elixhauser score

(premorbid status)

Cont

Binary

Cont.

Binary

Cont.

Vital signs Modified SOFA*

SIRS

GCS

Heart rate,

systolic, mean and

diastolic BP,

shock index

Respiratory rate, SpO2

Temperature

Cont.

Cont.

Cont.

Cont.

Cont.

Cont.

Cont.

Cont.

Category Items Type

Lab values Potassium, sodium, chloride

Glucose, BUN, creatinine

Magnesium, calcium, ionized calcium,

carbon dioxide

SGOT, SGPT, total bilirubin, albumin

Hemoglobin

White blood cells count, platelets

count, PTT, PT, INR

pH, PaO2, PaCO2, base excess,

bicarbonate, lactate, PaO2/FiO2 ratio

Cont.

Cont.

Cont.

Cont.

Cont.

Cont.

Cont.

Cont.

Cont.

Cont.

Ventilation

parameters

Mechanical ventilation

FiO2

Binary

Cont.

Medications

and fluid

balance

Current IV fluid intake over 4h

Max dose of vasopressor over 4h

Urine output over 4h

Cumulated fluid balance since

admission (includes preadmission

data when available)

Cont.

Cont.

Cont.

Cont.

Outcome Hospital mortality

90-day mortality

Binary

Binary

Page 32: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

States

4 hour windows

K-means clustering

750 + 2 states

(death, successful discharge)

Page 33: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Actions (treatments)

Vasopressors

norepinephrine equivalents (Brown et al, Chest 2013)

Fluids

boluses & background infusions

crystalloids, colloids and blood products,

normalised by tonicity (Waechter et al. CCM, 2014)

5 possible dose ranges for each,

zero drug given

Four quartiles of actual doses given

Page 34: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Actions (treatments)

Discretized

action

IV fluids (mL in 4 hours) Vasopressors (µg/kg/min)

Range Median dose Range Median dose

1 0 0 0 0

2 ]0-50] 30 ]0-0.08] 0.045

3 ]50-180] 86 ]0.08-0.22] 0.135

4 ]180-530] 324 ]0.22-0.45] 0.30

5 >530 974 >0.45 0.90

Page 35: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Trajectories

Page 36: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Reinforcement Learning algorithms

1.Clinicians’ policy evaluation

2.Optimal policy estimation

Page 37: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Is the AI policy better?

Internal validation in MIMIC-III – 20%

Off-policy policy evaluation

Clinicians’ policy value Model-based AI policy value

90-day mortality 53.7 (53.0-55.2) 82.3 (81.8-82.7)

Clinicians’ policy value IS-based AI policy value

90-day mortality 51.9 (50.7-53.1) 87.7 (85.2-88.9)

Page 38: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Independent external validation

Philips Research Institute - eICU database

20,000 patients publicly available

3.3M in total!!

459 ICUs in USA

2008 – 2016

Similar data to MIMIC-III but data quality “variable”

Page 39: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily
Page 40: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Independent validation

Clinicians’ policy value IS-based AI policy value

Hospital mortality 56.9 (54.7 – 58.8) 84.5 (84.3 – 87.7)

Page 41: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Independent validation

Page 42: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Comparing policies

Page 43: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

17% of patients actually received vasopressors

AI recommended vasopressors for 30%

When doses differed

Equal proportion given too much / too little fluid

– On average too much fluid (~80ml/h)

75% given too low vasopressor dose

– median dose deficit 0.13 µg/kg/min

Comparing policies

Page 44: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

Next steps

Real-time analysis – as decision support system

Prospective testing

• “hidden”

• RCT

Further AI policy development

Page 45: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

[email protected]

@agordonICU

Page 46: Big data solutions Omics and EHR · • Bristol-Meyers Squibb (paid to institution) • Orion Pharma • Amomed Pharma The views expressed are those of the author(s) and not necessarily

What determined the policies?