slides sandra zwakhalen [read-only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j...
TRANSCRIPT
![Page 1: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/1.jpg)
Evaluation of effects
Sandra Zwakhalen
June 2018, EDCNS
![Page 2: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/2.jpg)
Health Services Research, Maastricht University
• Research program Ageing and Long-Term care
• Disciplines (>100 employees)- Physicians, Health Economy, Health Policy, Nursing Science,
Care Thechnology, Social Gerontology, Health Technology Assessment etc….
![Page 3: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/3.jpg)
Ageing and Long-Term Careaims to:
1. Develop of knowledge on psychosocial and environmental determinants of health problems, need of care, social participation, independency and quality of life
2. Evaluate of innovative health care programs and interventions for older persons to slow down processes of disablement
3. Implement health care programs and interventions
![Page 4: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/4.jpg)
Major themes
• Effectiveness of care (health care problems), e.g.:- Pain in dementia, Incontinence, Malnutrition, Falls and
injuries, Fear of falling, Mobility, Heart failure, Pressure ulcers, Physical restraints, Disability
• Organisation of care, e.g.:- Patient centered care, Quality of care, Care for frail older
people, Redesigning health care, Small scale nursing homes, Geriatric rehabilitation
![Page 5: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/5.jpg)
![Page 6: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/6.jpg)
Living lab, how
Staff working at both; university and LTC organization
Interdisciplinary; nursing, medicine, psychology…. etc.
![Page 7: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/7.jpg)
Assessing effectiveness
• Research designs• Feasibility to apply designs in
evaluation of complex interventions• Bias• Examples en group work
![Page 8: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/8.jpg)
Assessing effectiveness …. (10 minutes brainstorm ABC exercise to start)
• Thinking about effectiveness, - Brainstorm ABC………
![Page 9: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/9.jpg)
• How can we assess the effectiveness of an intervention?- What research design is viewed as the
‘gold standard’?- Experimental – randomized controlled trials
![Page 10: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/10.jpg)
![Page 11: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/11.jpg)
![Page 12: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/12.jpg)
![Page 13: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/13.jpg)
![Page 14: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/14.jpg)
![Page 15: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/15.jpg)
![Page 16: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/16.jpg)
![Page 17: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/17.jpg)
(Quasi)-Experimental Designs
RANDOMIZED DESIGNS1. Individual-patient randomized controlled trials2. Cluster randomized trials3. Factorial design4. Repeated measures design
SEMI or NON-RANDOMIZED DESIGNS e.g1. Preference trial2. Stepped Wedge Design (Wait-list design)3. Other designs e.g. Time Series Design, Before and After
Design (case control)
![Page 18: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/18.jpg)
Randomized Controlled Trial (RCT)
1. Randomization2. Control3. Manipulation
Key idea of a randomized controlled trial is that we compare groups of participants who differ only with respect to their intervention.
![Page 19: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/19.jpg)
RCT• Example: Effectiveness of morphine following
adenotonsillectomies (T&A) in children
- Randomization- Children admitted for T&A
- Two groups- Experimental/intervention group- Control group
- Intervention- Paracetamol + morphine
In sum:1. Paracetamol + morphine2. Paracetamol + placebo
![Page 20: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/20.jpg)
Why experimental design?
• Internal validity- The extent to which the observed effects
are true for the people in a study- The degree to which a result (of a
measurement or study) is likely to be true and free of bias (systematic errors)
![Page 21: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/21.jpg)
SELECTION BIAS(systematic differences in comparison groups)
PERFORMANCE BIAS(systematic differences in care provided apart from intervention under evaluation)
ATTRITION BIAS(systematic differences in withdrawals)
DETECTION BIAS(systematic differences in outcome assessment)
SOURCES OF BIAS
Target Population (baseline)
Allocation
Intervention Group Control Group
Exposed to intervention Not exposed
Follow up Follow up
OUTCOMES OUTCOMES
![Page 22: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/22.jpg)
Critisism experimental design
• External validity- The extent to which the effects observed in a
study truly reflect what can be expected in a target population beyond the people included in the study
- Generalizability
• Explanatory versus pragmatical RCT’s- Efficacy (does it work in most favourable
circumstances?) versus effectiveness (does it work in everyday practice?)
![Page 23: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/23.jpg)
Why are RCT’s not always suitable
![Page 24: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/24.jpg)
Why are RCT’s not always suitable
• Experimentation may be unnecessary- Efficacy of parachutes, anaesthesia for surgical
operations
• Experimentation may be inappropriate- To measure infrequent adverse events, to prevent rare
events, or measure outcomes in far future
• Experimentation may be impossible- Refusal of clinicians to participate or ethical objections
• Experimentation may be inadequate- Patients in trial are atypical, professionals are
unrepresentative or treatment is atypical
![Page 25: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/25.jpg)
Cluster RCT
• Randomization not on individual level, but on organizational level- E.g., midwife, hospital wards, nursing
homes
• Data collection on individual level- E.g., age, gender, pain, quality of life
![Page 26: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/26.jpg)
Disadvantages?
• Complex (multi-level) analyses, less power
• Complex organisation, time consuming • Large sample needed• Contamination
![Page 27: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/27.jpg)
Factorial design
In which two active treatments A and B, are simultaneously compared to each other and to a control.
Participants are randomized into four groups, who receive either A only, B only, both A and B, or neither.
![Page 28: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/28.jpg)
Factorial design
• Effectiveness morphine and nurses’ systematic pain assessments (SPA)
1. Paracetamol + morphine + SPA2. Paracetamol + placebo+ SPA3. Paracetamol + morphine + no SPA4. Paracetamol + placebo+ no SPA
![Page 29: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/29.jpg)
Repeated measurement designor within subject
• Instead of having one score per subjectmultiple scores are generated for eachcase
• Every subject is his own control
![Page 30: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/30.jpg)
![Page 31: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/31.jpg)
(Quasi)-Experimental Designs
RANDOMIZED DESIGNS1. Individual-patient randomized controlled trials2. Cluster randomized trials3. Factorial design4. Repeated measures design
SEMI or NON-RANDOMIZED DESIGNS e.g1. Preference trial2. Stepped Wedge Design (Wait-list design)3. Other designs e.g. Time Series Design, Before and After
Design (case control)
![Page 32: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/32.jpg)
Preference trial
AssessOutcomes
Receive A
Prefer A
AssessOutcomes
Receive A
AssessOutcomes
Receive B
IndifferentRandomised
AssessOutcomes
Receive B
Prefer B
![Page 33: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/33.jpg)
Stepped Wedge Design
![Page 34: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/34.jpg)
Group task
• Use an example of an intervention study of one of participants.
• CreateResearch question(s)……
(Alternative) design: …..Define participants:……Sampling method: …..Methods of data collection: …..Outcomes and meaures:
Advantages and disadvantages (think of possible bias):…….
![Page 35: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/35.jpg)
Reporting statements
CONSORT for randomised controlled trials STARD for diagnostic accuracy studies STROBE for observational studies PRISMA for systematic reviews of trialsMOOSE for meta-analyses of observational studies
EQUATOR networkhttp://www.equator-network.org/library/translations-of-
reporting-guidelines/
![Page 36: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/36.jpg)
General conclusion
• Experimental designs as the ‘golden standard’
• Not always feasible to use for assessing effectiveness of complex interventions
• Look for the best alternative- Explanatory versus pragmatic trials- Non randomized designs controlling for attrition,
performance and detection bias
• Complex nursing interventions can be evaluated adequately
![Page 38: Slides Sandra Zwakhalen [Read-Only] · 0dmru wkhphv (iihfwlyhqhvv ri fduh khdowk fduhsureohpv h j 3dlq lq ghphqwld ,qfrqwlqhqfh 0doqxwulwlrq )doov dqg lqmxulhv )hdu ri idoolqj 0relolw\](https://reader033.vdocuments.site/reader033/viewer/2022052000/6012fe250024fe27667026bb/html5/thumbnails/38.jpg)
Partners: