introduction to critical appraisal
DESCRIPTION
Introduction to Critical Appraisal. Yulia Lin, MD, FRCPC Transfusion Medicine & Hematology Sunnybrook Health Sciences Centre University of Toronto TMR Journal Club, September 21, 2010. Why is Critical Appraisal important?. Vast amount of literature. New Studies in Transfusion. - PowerPoint PPT PresentationTRANSCRIPT
11
Introduction to Introduction to Critical AppraisalCritical Appraisal
Yulia Lin, MD, FRCPCYulia Lin, MD, FRCPC
Transfusion Medicine & Hematology Transfusion Medicine & Hematology
Sunnybrook Health Sciences CentreSunnybrook Health Sciences Centre
University of TorontoUniversity of Toronto
TMR Journal Club, September 21, 2010TMR Journal Club, September 21, 2010
22
Why is Critical Appraisal Why is Critical Appraisal important?important?
33
Vast amount of literatureVast amount of literature
44
New Studies inTransfusion
55
New Studies inTransfusion
Past Studies in Transfusion
66
New Studies inTransfusion
Past Studies in TransfusionStudies in other Sub-specialties
77
Why critical appraisal is important?Why critical appraisal is important?
Impossible to keep up with all of the Impossible to keep up with all of the literatureliterature
Enables us to distinguish stronger Enables us to distinguish stronger evidence from weaker evidenceevidence from weaker evidence
Allows us to appropriately incorporate the Allows us to appropriately incorporate the evidence into our practice so as to evidence into our practice so as to improve patient careimprove patient care
88
ScholarScholar 2 - Evaluate medical information and its sources 2 - Evaluate medical information and its sources
critically, and apply this appropriately to practice critically, and apply this appropriately to practice decisionsdecisions• Describe the principles of critical appraisalDescribe the principles of critical appraisal• Critically appraise retrieved evidence in order to address Critically appraise retrieved evidence in order to address
a clinical questiona clinical question• Integrate critical appraisal conclusions into clinical careIntegrate critical appraisal conclusions into clinical care• Critically review published literature and apply Critically review published literature and apply
appropriate utilization principles/practices /guidelinesappropriate utilization principles/practices /guidelines
99
Purpose of TMR Journal ClubPurpose of TMR Journal Club
1.1. To present a recent article in the To present a recent article in the transfusion literaturetransfusion literature
2.2. To learn how to critically appraise the To learn how to critically appraise the medical literature medical literature
1010
Steps to a successful JCSteps to a successful JC
1.1. Choosing the articleChoosing the article
2.2. Presenting the articlePresenting the article
3.3. Critically appraising the articleCritically appraising the article
1111
Choosing an article…Choosing an article…
Where to find an article?Where to find an article?• Recent table of contents Recent table of contents
NEJM, Lancet, JAMANEJM, Lancet, JAMA Transfusion, Vox Sanguinis, Blood, etc.Transfusion, Vox Sanguinis, Blood, etc.
• Transfusion Medicine Reviews – Journal ClubTransfusion Medicine Reviews – Journal Club• Transfusion Medicine CommunityTransfusion Medicine Community• List of interesting articlesList of interesting articles
1212
Choosing the article…Choosing the article…
Which article?Which article?• RelevantRelevant• Interesting to youInteresting to you
What type of article?What type of article?• Any articleAny article• But some are easier than others…But some are easier than others…
1313
Type of articlesType of articles
Randomized controlled trials – TherapyRandomized controlled trials – Therapy Observational studies – HarmObservational studies – Harm Systematic ReviewsSystematic Reviews GuidelinesGuidelines
DiagnosisDiagnosis PrognosisPrognosis
1414
First, a review…First, a review…
1515
Randomized Controlled TrialRandomized Controlled Trial
Population Randomization
Intervention A
Intervention B
Outcomesmeasured
1616
Randomized Controlled TrialRandomized Controlled Trial
Population Randomization
Intervention A
Intervention B
Outcomesmeasured
Effects of tranexamic acid on death, vascular occlusiveevents, and blood transfusion in trauma patients with
significant haemorrhage (CRASH-2): a randomised,placebo-controlled trial. CRASH-2 trial collaborators.
Lancet. Published online June 15, 2010.
1717
Randomized Controlled TrialRandomized Controlled Trial
Trauma ptswith
Hemorrhage
Randomization
Placebo
Tranexamic acid
Death in hospital within 4 wks
Effects of tranexamic acid on death, vascular occlusiveevents, and blood transfusion in trauma patients with
significant haemorrhage (CRASH-2): a randomised,placebo-controlled trial. CRASH-2 trial collaborators.
Lancet. Published online June 15, 2010.
1818
Observational Case-ControlObservational Case-Control
Population
Cases(+Disease)
Control(No disease)
Exposure to Risk Factor
Exposed
Yes
No
Yes
No
1919
Observational Case-ControlObservational Case-Control
Population
Cases(+Disease)
Control(No disease)
Exposure to Risk Factor
Exposed
Yes
No
Yes
No
Retrospective
2020
Observational Case-ControlObservational Case-Control
Population
Cases(+Disease)
Control(No disease)
Exposure to Risk Factor
Exposed
Yes
No
Yes
No
Prevalence of xenotropic murine leukaemia virus-relatedvirus in patients with chronic fatigue syndrome in the
Netherlands: retrospective analysis of samples from anestablished cohort. Van Kuppeveld et al. BMJ 2010;340:c1018.
2121
Observational Case-ControlObservational Case-Control
Population
CFS(+Disease)
Controls(No disease)
Exposure to XMRV
Exposed
Yes
No
Yes
No
Prevalence of xenotropic murine leukaemia virus-relatedvirus in patients with chronic fatigue syndrome in the
Netherlands: retrospective analysis of samples from anestablished cohort. Van Kuppeveld et al. BMJ 2010;340:c1018.
2222
Observational CohortObservational Cohort
Cohort
Cohort without Disease
Exposure to Risk Factor
Population
Exposed
Not exposed
Disease
Yes
No
Yes
No
2323
Cohort StudiesCohort StudiesPast Present Future
Follow-upCohort assembled
RetrospectiveCohort Study
2424
Cohort StudiesCohort StudiesPast Present Future
Follow-upCohort assembled
RetrospectiveCohort Study
Effect of duration of red blood cell storage on early and late mortality after CABG.
van Straten et al. J Thor CV Surg 2010; published online.
2525
Cohort StudiesCohort StudiesPast Present Future
Mortality before 30 daysMortality after 30 days
CABG1998-2007
Exposure to blood of differentstorage age
Effect of duration of red blood cell storage on early and late mortality after CABG.
van Straten et al. J Thor CV Surg 2010; published online.
2626
Cohort StudiesCohort StudiesPast Present Future
In-hospital mortality
Trauma2000-2005Nonmassive transfusion Plasma
transfusion
Effect of duration of red blood cell storage on early and late mortality after CABG.
van Straten et al. J Thor CV Surg 2010; published online.
Impact of plasma transfusion in trauma patients who do not require massive transfusion.
Inaba et al. J Am Coll Surg June 2010;210:957-65.
2727
Cohort StudiesCohort StudiesPast Present Future
Follow-upCohort assembled
RetrospectiveCohort Study
Follow-upCohort assembled
ProspectiveCohort Study
2828
Cohort StudiesCohort StudiesPast Present Future
Follow-upCohort assembled
RetrospectiveCohort Study
Follow-upCohort assembled
ProspectiveCohort Study
Transfusion practice and guidelines in Australian and New Zealand intensive care units
Intensive Care Med 2010;36:1138-46.
2929
Cohort StudiesCohort StudiesPast Present Future
Follow-upCohort assembled
RetrospectiveCohort Study
Adherence toguidelines
Patients receivingtransfusion Transfusion
Indications &triggers
Transfusion practice and guidelines in Australian and New Zealand intensive care units
Intensive Care Med 2010;36:1138-46.
3030
Systematic ReviewSystematic Review
OverviewOverview• Summary of the medical literature that Summary of the medical literature that
attempts to address a focused clinical questionattempts to address a focused clinical question Systematic reviewSystematic review
• Using methods designed to reduce the Using methods designed to reduce the likelihood of biaslikelihood of bias
Meta-analysisMeta-analysis• Review that uses quantitative methods to Review that uses quantitative methods to
summarize the resultssummarize the results
3131
Systematic ReviewSystematic Review
Systematic reviewSystematic review• Using methods designed to reduce the Using methods designed to reduce the
likelihood of biaslikelihood of bias Meta-analysisMeta-analysis
• Review that uses quantitative methods to Review that uses quantitative methods to summarize the resultssummarize the results
Intravenous immunoglobulin for Guillain-Barre Syndrome.Hughes et al. Cochrane Database Syst Rev 2010 Jun 16;6:CD002063.
3232
GuidelinesGuidelines
““Systematically developed statements to Systematically developed statements to assist practitioner and patient decisions assist practitioner and patient decisions about appropriate health care for specific about appropriate health care for specific clinical circumstances”clinical circumstances”• Attempt to address all issues and values relevant Attempt to address all issues and values relevant
to a clinical decisionto a clinical decision• Attempt to distill a large body of medical Attempt to distill a large body of medical
expertise into a convenient, readily usable formatexpertise into a convenient, readily usable format• Make explicit recommendations with definite Make explicit recommendations with definite
intent to influence what clinicians dointent to influence what clinicians do
Field MJ. Clinical practice guidelines. 1990Hayward et al. JAMA 1995;274:570-4
Cook et al. Ann Int Med 1997;127:210-6
3333
GuidelinesGuidelines
““Systematically developed statements to Systematically developed statements to assist practitioner and patient decisions assist practitioner and patient decisions about appropriate health care for specific about appropriate health care for specific clinical circumstances”clinical circumstances”
Perioperative blood transfusion and blood conservation in cardiac surgery: the Society of Thoracic Surgeons and
The Society of Cardiovascular Anesthesiologists clinical practice guideline.
Ann Thorac Surg 2007 May;83(5Suppl):S27-86.
Guidelines on the use of irradiated blood components.BCSH 2010.
http://www.bcshguidelines.com/pdf/draft_irrad_0710.pdf
3434
How to do a critical appraisal?How to do a critical appraisal?
3535
Critical appraisal methodsCritical appraisal methods
Most are based on Users’ Guides to the Most are based on Users’ Guides to the Medical Literature Medical Literature • Available in a textbook form (2Available in a textbook form (2ndnd ed) ed) • Brief version Brief version
http://www.ebem.org/usersguide.htmlhttp://www.ebem.org/usersguide.html For guidelines, different instrumentsFor guidelines, different instruments
• AGREE instrument: AGREE instrument: http://www.agreetrust.org/resource-centre/agrehttp://www.agreetrust.org/resource-centre/agree-ii/e-ii/
3636
3737
Steps to Critical AppraisalSteps to Critical Appraisal
1.1. Are the results valid?Are the results valid?• Have the results been influenced in a Have the results been influenced in a
systematic fashion so as to lead to a false systematic fashion so as to lead to a false conclusion?conclusion?
2.2. What are the results?What are the results?
3.3. How can I apply the results to patient How can I apply the results to patient care? care?
3838
3939
4040
RCTRCT
Population Randomization
Intervention A
Intervention B
Outcomesmeasured
4141
RCT - Are the results valid?RCT - Are the results valid?
Population Randomization
Intervention A
Intervention B
Outcomesmeasured
Was the assignment of patients to treatment randomized?Were all patients who entered the trial accounted for and attributed at its conclusion?Were patients, clinicians and study personnel kept "blind" to treatment received?Were the groups similar at the start of the trial?Aside from the experimental intervention were the groups treated equally?
4242
RCT - What were the results?RCT - What were the results?
Population Randomization
Intervention A
Intervention B
Outcomesmeasured
How large was the treatment effect?How precise was the estimate of the treatment effect?
4343
RCT - How can I apply the RCT - How can I apply the results to patient care?results to patient care?
Population Randomization
Intervention A
Intervention B
Outcomesmeasured
Can the results be applied to my patients?
4444
RCT - How can I apply the RCT - How can I apply the results to patient care?results to patient care?
Population Randomization
Intervention A
Intervention B
Outcomesmeasured
Can the results be applied to my patients?Were all clinically important outcomes considered?Are the likely treatment benefits worth the potential harm and costs?
4545
Observational CohortObservational Cohort
Cohort
Cohort without Disease
Exposure to Risk Factor
Population
Exposed
Not exposed
Disease
Yes
No
Yes
No
4646
Cohort - Are the results valid?Cohort - Are the results valid?
Cohort
Cohort without Disease
Exposure to Risk Factor
Population
Exposed
Not exposed
Disease
Yes
No
Yes
No
Except for the exposure under study, were the compared groups similar to each other?Were the outcomes and exposures measured in the same ways in both groups?Was the follow-up of patients sufficiently long and complete?Is the temporal relationship correct?Is there a dose-response gradient?
4747
Cohort - What are the results?Cohort - What are the results?
Cohort
Cohort without Disease
Exposure to Risk Factor
Population
Exposed
Not exposed
Disease
Yes
No
Yes
No
How strong is the association between exposure and outcome? Consider magnitude and dose response?How precise is the estimate of the risk?
4848
Cohort - How can I apply the results?Cohort - How can I apply the results?
Cohort
Cohort without Disease
Exposure to Risk Factor
Population
Exposed
Not exposed
Disease
Yes
No
Yes
No
Are the results applicable to my patients?
4949
Cohort - How can I apply the results?Cohort - How can I apply the results?
Cohort
Cohort without Disease
Exposure to Risk Factor
Population
Exposed
Not exposed
Disease
Yes
No
Yes
No
Are the results applicable to my patients?What is the magnitude of the risk?Should I attempt to stop the exposure?
5050
Putting it all together…Putting it all together…
5151
Tips for TMR Journal ClubTips for TMR Journal Club
Choose the article carefully Choose the article carefully Include brief background for contextInclude brief background for context Present the article briefly (10 slides)Present the article briefly (10 slides) The main objective is the critical appraisalThe main objective is the critical appraisal
• Internal validity: Internal validity: Focus on 1-2 key pointsFocus on 1-2 key points Try explaining a new concept (bias, Try explaining a new concept (bias,
statistical concept)statistical concept)• External validity: Take a standExternal validity: Take a stand
Allow 20-30 minutes for discussionAllow 20-30 minutes for discussion