guidelines - what difference do they make? a dutch perspective
DESCRIPTION
This lecture was given by Dr Raymond Ostelo of the EMGO Institute, VU University Medical Center, Amsterdam, to the North British Pain Association Spring Scientific Meeting in Edinburgh on Friday 18th May, 2007. His lecture forms part of a conference "Blurring the Boundaries - Managing Pain in Primary Care and Secondary Care".TRANSCRIPT
![Page 1: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/1.jpg)
www.wspg.org.ukWest of Scotland Pain Group
www.nbpa.org.ukNorth British Pain
Association
![Page 2: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/2.jpg)
GuidelinesWhat difference do they make?
a Dutch perspective
Raymond Ostelo, PhD, PT
EMGO Institute, VU University Medical CentreInstitute for Health Sciences, VU University
Acknowledgement: Maurits van Tulder, Arno Engers
![Page 3: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/3.jpg)
Content
• Development of evidence based guidelines
• Implementing evidence based guidelines
• Some food for thought /challenges for the future
![Page 4: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/4.jpg)
Why (on earth) do we need guidelines?
![Page 5: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/5.jpg)
Many myths
![Page 6: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/6.jpg)
Evidence based practice
Sackett et al. EBM, Churchill Livingstone, 1997
Conscientious, explicit and judicious use of
current best evidence in making decisions
about care of individual patients
![Page 7: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/7.jpg)
Problem
• The evidence explosion• No individual care provider can be up to date
anymore
![Page 8: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/8.jpg)
![Page 9: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/9.jpg)
Need for systematic reviews
• Systematic
• Transparent
• Reproducible state-of-the-art summaries
![Page 10: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/10.jpg)
Clinical guidelines
• Systematically developed statements to assist
practitioner and patient decisions about
appropriate health care
• Recommendations
• No protocols, no ‘law’
![Page 11: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/11.jpg)
Development and Implementation Cycle
of
Guidelines
![Page 12: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/12.jpg)
ImplementingEvidence
Building Evidence
SystematicalLiterature studies
Clinical guidelines
study the optimal implementation strategies
Audit / monitoring
Study the effect ofimplementation
define health care problem
Experimental studies Observational studiesEconomical evaluation
![Page 13: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/13.jpg)
ImplementingEvidence
Building Evidence
SystematicalLiterature studies
Clinical guidelines
study the optimal implementation strategies
Audit / monitoring
Study the effect ofimplementation
Low Back Problem
Experimental studies Observational studiesEconomical evaluation
![Page 14: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/14.jpg)
ImplementingEvidence
Building Evidence
SystematicalLiterature studies
Clinical guidelines
study the optimal implementation strategies
Audit / monitoring
Study the effect ofimplementation
Low Back Problem
RCTs on effectiveness & Cost effectiveness
![Page 15: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/15.jpg)
ImplementingEvidence
Building Evidence
Sufficient number of systematic (or structured) reviews
Clinical guidelines
study the optimal implementation strategies
Audit / monitoring
Study the effect ofimplementation
Low Back Problem
RCTs on effectiveness & Cost effectiveness
![Page 16: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/16.jpg)
ImplementingEvidence
Sufficient number of systematic (or structured) reviews
Clinical guidelines in the Netherlands:- GP (NHG) guidelines (updated 2004)- Physiotherapy (KNGF) (2001)- Occupational Physicians (NVAB) (1999)- Manual Therapy (NVMT) (2003)- DI Healthcare Imp. (CBO) (2003)- Dutch Health Council (2007)
study the optimal implementation strategies
Audit / monitoring
Study the effect ofimplementation
Low Back Problem
RCTs on effectiveness & Cost effectiveness
![Page 17: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/17.jpg)
Some features of Dutch guidelines
• Mono disciplinary– GP (NHG) guidelines (updated 2004)– Physiotherapy (KNGF) (2001)– Occupational Physicians (NVAB) (1999)– Manual Therapy (NVMT) (2003)
• Multidisciplinary– Dutch Institute Healthcare Improvement (CBO) (2003)– Dutch Health Council (2007)
![Page 18: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/18.jpg)
Some features of Dutch guidelines
• Different methodologies for development– Advisory committee and writing panel – Subcommittees who are responsible for different parts
• Different methodologies for grading the evidence– Strict criteria (e.g. at least 1 good quality systematic
review: ‘level 1’, use phrase ‘it has been shown’ for recommendation
– quality criteria and formulations more loosely used
![Page 19: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/19.jpg)
One feature in common
• All are ‘evidence based’
![Page 20: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/20.jpg)
An intermezzo
![Page 21: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/21.jpg)
Jacob (1785-1863) & Wilhelm (1786-1859) Grimm
![Page 22: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/22.jpg)
An evidence based fairy tale• Once there was… a guideline committee and they defined
the health care problem & searched for the evidence
• then summarized the evidence…
• Then the orthopedists, anesthesiologists & the neurosurgeons did not like the evidence that was not in favor of surgery
• They redefined the health care problem so that they could omit the unfavorable evidence
• They sponsored the guideline so the guideline committee (grudgingly) ‘agreed’
![Page 23: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/23.jpg)
Clinical guidelines for the management of low back pain in primary care:an international comparison
Bart Koes, Maurits van Tulder, Raymond Ostelo,
Kim Burton, Gordon Waddell
Spine 2001; 26: 2504-13.
![Page 24: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/24.jpg)
Sources for differences in recommendations
• health care systems (organisation / financial)
• target population (e.g., GPs, physiotherapists)
![Page 25: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/25.jpg)
Sources for differences in recommendations
• health care systems (organisation / financial)
• target population (e.g., GPs, physiotherapists)
• magnitude of effects
• (in)completeness of evidence
• methods of grading the evidence
• membership of guidelines committees
Clinical Judgment
![Page 26: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/26.jpg)
Evidence based guidelines
Or
Evidence biased guided lies
![Page 27: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/27.jpg)
Implementation
of guidelines
![Page 28: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/28.jpg)
![Page 29: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/29.jpg)
BackgroundRoom for improvement in adhering to the GP guideline
• Referral to physiotherapy for acute LBP pain• Time contingent approach
– medication– bed rest
• Medication– First choice: paracetamol – Second choice: NSAID’s
![Page 30: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/30.jpg)
A multifaceted implementation strategy: aims
• Enhance patient education skills
• Improve referral practices for MT and PT
• Increase the use of written information (pamphlets)
• Increased knowledge of the guideline & relevant
scientific evidence
![Page 31: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/31.jpg)
Why a multifaceted implementation strategy?
• Effective– Educational outreach visits – Multi professional collaboration– Financial interventions– Combined interventions
• Mostly effective– Interactive small group meetings– Mass media campaigns– Reminders– Computerized decision support
(Grol & Grimshaw. Lancet 2003; 362: 1225-30)
![Page 32: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/32.jpg)
• 2 hour Workshop– Discussing relevant issues – Role playing with actor
• Providing pamphlets• Reminder with guidelines of Occup Phys and 2 articles
A multifaceted implementation strategy: training
![Page 33: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/33.jpg)
![Page 34: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/34.jpg)
![Page 35: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/35.jpg)
![Page 36: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/36.jpg)
Results
• A multifaceted intervention slightly modified the management behaviour of GPs in terms of fewer referrals to therapists during follow-up consultations
• It did not lead to more adequate provision of information to patients
![Page 37: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/37.jpg)
Discussion
• GPs in control group also performed well– Is further improvement called for?
• Perhaps focus on situations where adherence to the clinical guidelines is known to be limited
![Page 38: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/38.jpg)
![Page 39: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/39.jpg)
113 PTs 113 PTs randomisrandomiseded
61 61 StandardStandard
DisseminatiDisseminationon
2 drop 2 drop outs outs
11 no 11 no data data
4 drop 4 drop outs outs
11 no 11 no data data
--
--
52 Active52 Active
ImplementaImplementationtion
N=3N=377
N=4N=488
PhysiotherapistsSame as Engers
![Page 40: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/40.jpg)
Inclusion of patients
• New referral for non-specific low back pain
• Exclusion:– Specific low back pain– Pregnancy– Unable to complete questionnaires– No informed consent
![Page 41: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/41.jpg)
Process-oriented outcome measures
• Blinded evaluation of registration forms by 2
researchers using algorithm for 4 key
recommendations:
– Limited number of sessions normal course– Goals focussing on activity and participation– Using active interventions– Giving adequate advise and information
![Page 42: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/42.jpg)
Results process outcomes:% agreement with guidelines
26
79 77
96
42
12
7160
87
30
0
20
40
60
80
100
1 2 3 4 5
implementation
dissemination
1: ≤ 3 sessions 4: adequate information2: adequate goals 5: all recommendations3: active interventions
![Page 43: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/43.jpg)
Results patient-centered outcomes
52 w eken12 w ekenbaseline
Lic
ha
me
lijk
fun
ctio
ne
ren
100
90
80
70
60
50
40
30
20
10
0
interventie
controle
Functional status (QBPDS)
Pain intensity (NRS)
52 w eken12 w ekenbaselineP
ijn
10
9
8
7
6
5
4
3
2
1
0
interventie
controle
Work absenteeism, coping, beliefs similar results
ll l l l l l
![Page 44: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/44.jpg)
Conclusion• The implementation strategy
– slightly improved adherence to the guideline– did not result in additional beneficial effects on patient
outcomes
• Possible explanation: contrast in adherence between the two groups too small
![Page 45: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/45.jpg)
Discussion
• Active strategies for implementing seem (not only from these studies) not beneficial on patient outcomes
• Still there might be other good reasons for using an active strategy to implement guidelines
• In case of similar outcomes, a more transparent health care process or reduction in costs can be reasons to recommend this strategy broadly
![Page 46: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/46.jpg)
Food for thought
• Development
– Think before you leap: www.agreecollaboration.org
– Clinical guidelines are based on systematic reviews
(and/or individual studies) plus clinical expertise
– Saying an guideline is evidence based doesn’t make it
evidence based by itself
– Do weed need mono- or multidisciplinary guidelines?
![Page 47: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/47.jpg)
More food for thought
• Should we adapt existing guidelines or develop
them all over again?
• Implementation of guidelines challenge for the
near future especially for practitioners not
participating in trials
![Page 48: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/48.jpg)
Key messages
Development:
Adhere to guidelines for development
Dissemination should be planned, targeted and evaluated & needs to be supplemented by active implementation strategies
![Page 49: Guidelines - what difference do they make? A Dutch perspective](https://reader036.vdocuments.site/reader036/viewer/2022062511/54b91a184a7959877c8b4589/html5/thumbnails/49.jpg)
Raymond Ostelo
EMGO Institute, VU University Medical Centre
Institute for Health Sciences, VU University