nccmt webinar - applicaibilty and transferability of evidence (a&t) tool

Follow us @nccmt Suivez-nous @ccnmo

Funded by the Public Health Agency of Canada | Affiliated with McMaster University Production of this presentation has been made possible through a financial contribution from the Public Health Agency of Canada. The

views expressed here do not necessarily reflect the views of the Public Health Agency of Canada..

The Applicability & Transferability

(A&T) Tool Presenters:

Stephanie Bale

Donna Ciliska

Melanie Hood

Shannon Dowdall-Smith

December 9, 2015

1:00 – 2:30 PM ET


Use Q&A to post comments / questions

during the webinar

• ‘Send’ questions to All (not

privately to ‘Host’)

Connection issues

• Recommend using a wired

Internet connection (vs. wireless),

• WebEx 24/7 help line

• 1-866-229-3239

Housekeeping

2

Q&A

Participant Side

Panel in WebEx


After Today

The PowerPoint presentation (in English and French)

and English audio recording will be made available.

These resources are available at:

PowerPoint: http://www.slideshare.net/NCCMT/

Audio Recording:

https://www.youtube.com/user/nccmt/videos

3

http://www.slideshare.net/NCCMT/







Poll Question #1

How many people are watching today’s session with you?

1. Just me 2. 2 to 3 3.4 to 5 4. More than 5

4


Your profession? Put a √ on your answer (or RSVP via email)

/

Epidemiologist Management (director,

supervisor, etc.)

Allied health

professionals (nurse,

dietician, dental

hygenist, etc.)

Librarian

Physician / Dentist Other

5


The Applicability & Transferability Tool http://www.nccmt.ca/resources/search/24

Episode 21

6

http://www.nccmt.ca/resources/search/24

Poll Question #2

Where are you from?

1. BC

2. AB

3. SK

4. MB

5. ON

6. QC

7. NB

8. NS

9. PEI

10. NL

11. YK

11. NWT

12. NU

13. Outside Canada

7

NCC

Infectious

Diseases Winnipeg, MB NCC

Methods

and Tools Hamilton, ON

NCC Healthy

Public Policy Montreal, QC

NCC

Determinants

of Health Antigonish, NS

NCC

Aboriginal

Health Prince George, BC

NCC

Environmental

Health Vancouver, BC

8

http://www.nccid.ca/en/home

http://www.nccmt.ca/

http://www.healthypublicpolicy.ca/2/Home.htm

http://www.nccdh.ca/

http://www.nccah-ccnsa.ca/

http://www.ncceh.ca/


National Collaborating Centre for

Methods and Tools

• dedicated to improving access to, and use of,

methods and tools that support moving

research evidence into decisions related to

public health practice, programs, and policy in

Canada.

9

Poll Question #3

What sector are you from?

1. Public Health Practitioner 2. Health Practitioner (Other) 3. Education 4. Research 5. Provincial/Territorial/Government/Ministry 6. Municipality 7. Policy Analyst (NGO, etc.) 8. Other

10


Donna Ciliska, RN, PhD Senior Knowledge Translation Advisor National Collaborating Centre for Methods and Tools McMaster University

Presenters

11


Melanie Hood, MsC R. Kin Health Promoter Health Promotion Division Sudbury & District Health Unit at the Sudbury & District Health Unit

Presenters

12


Stephanie Bale, MPH Health Promoter Health Promotion Division at the Sudbury & District Health Unit

Presenters

13


Shannon Dowdall-Smith, RN, PhD Manager, Control of Infectious Diseases/Vaccine Preventable Disease/Tuberculosis Clinical & Family Services Division at the Sudbury & District Health Unit

Presenters

14


What is the A&T Tool

The tool provides a systematic process and

criteria to assess the applicability and

transferability of research evidence to practice

decisions in your local setting

15


Poll Question #4

How familiar are you with the A&T Tool?

A. I am not familiar with the A&T Tool B. I have heard of the A&T Tool C. I have used the A&T Tool

16


Why was the A&T Tool developed?

• To help public health professionals use

evidence to better channel scarce public health

resources into the best available programs and

services for local delivery

• To support the Adapt step in process of

Evidence-Informed Public Health (EIPH)

17

Follow us @nccmt Suivez-nous @ccnmo 18

Steps in the process of Evidence-

Informed Public Health


Model for Evidence-Informed

Public Health


How was the A&T Tool developed?

• Literature review (1996-2006; updated 2007) identified criteria for deciding if/how evidence can be transferred to local setting

• Buffett, C., Ciliska, D., & Thomas, H. (2007). Can I use this evidence in

my program decision? Assessing applicability and transferability of evidence. Hamilton, ON: National Collaborating Centre for Methods

and Tools (NCCMT).

• Relevant work was synthesized into a list of 21 questions to assess applicability (feasibility) and transferability (generalizability) of evidence

20


• In 2011, original tool was updated based on

user feedback

• Two new versions created

• A. Starting a new intervention

• B. Stopping an existing intervention

21


Applicability

• “Can the intervention we found work for us?”

• Other terms

• feasibility, plausibility, acceptability

• Looks at how the intervention process could be

implemented in the local setting

22


Applicability: Factors

Applicability considers:

• Political acceptability

• Social acceptability

• Resources

• Organizational capacity

23


Transferability

• “Will it work for us? Can we expect similar

results?”

• Other terms

• generalizability, external validity

• Examines whether the intervention can achieve

similar outcomes in the local setting

24


Transferability: Factors

Transferability considers:

• Magnitude of health issue in local setting

• Magnitude of the reach and cost effectiveness

of the intervention

• Characteristics of target population

25


How do I use the A&T Tool?

Prior to using the tool:

• Defined a question/issue

• Searched for, found and appraised research

evidence relevant to your question

• Synthesized the evidence to form

recommendation(s)

26


• Select stakeholders who will be involved in the decision. Collaborate on the remaining steps.

• Orient group members to the process; establish timelines

• Choose assessment criteria from the tool that are most important/relevant to your issue and context

• Decide if/how final scoring will be done (e.g.,1-5 rating for each question; sum individual ratings; discussion and consensus on each criteria)

• Document the process you use

27

Applicability & Transferability of Evidence

Tool (A&T Tool) Presented by: Stephanie Bale, Melanie Hood, and Shannon

Dowdall-Smith

Sudbury & District Health Unit

Background: How the review came about

• SDHU’s Evidence-Informed Practice Working Group (EIPWG)

• Practice-based questions • Academic Detailing

• Postnatal Support

Practice-Based Question: Postnatal Support

Research question: Are postnatal classes an effective method of promoting child and family health, and if so, how can they be effectively implemented?

Rapid Review: Postnatal Support

Supportive Evidence

• Evidence supported the benefit of postnatal classes

• Evidence offered suggestions on successful implementation

Recommendations

• Further investigation is required prior to implementation

Practice-Based Question: Academic Detailing

Research Question:

What types of clinician practice behaviour does academic detailing/educational outreach visits effectively influence and what is required for effective implementation in a public health setting?

Rapid Review: Academic Detailing

• Evidence from the rapid review suggested that academic detailing could be a useful communication tool – but key success factors would need to be considered

• Should the SDHU use Academic Detailing as a strategy to influence clinician practice behaviour?

Use of NCCMT’s A&T Tool

• Applicability and transferability was explored through discussions with key management and staff at the health unit, guided by NCCMT’s A&T Tool

• Adapted the tool to fit with the specific topic/question at hand

• Selected questions that were relevant to the research question

• Re-worded the questions to be specific to the subject matter

Use of NCCMT’s A&T Tool

Benefits • Ensured consistency between meetings with

different groups of staff • Focused the discussion and kept it on-track • Ensured all important aspects were considered and

discussed • Practical and easy to use

Discussions were summarized into a final report, including recommendations to assist with decision-making

Rapid Review: Outcomes

• An academic detailing program is under development, taking into consideration the findings and recommendations from the rapid review and A&T process

• A pilot program of postnatal classes was attempted for approximately 6 months in partnership with a local Best Start Hub, unfortunately they were cancelled due to lack of uptake

Copyright

Copyright for this document belongs to the Sudbury & District Health Unit. This document should not be reproduced, in part, or in whole, without written permission.

Written requests to reproduce this document, in part, or in whole, should be directed to the Sudbury & District Health Unit.

When permission to reproduce this document is granted, please ensure that the Sudbury & District Health Unit is credited.

©Sudbury & District Health Unit, 2015

Poll Question #5

What are your next steps? I plan to …

A. access the A&T Tool. B. read the NCCMT summary of the A&T Tool. C. consider using the A&T Tool. D. tell a colleague about the A&T Tool.

38

39

Supporting awareness and uptake of

cancer prevention knowledge in practice Funded by the Canadian Institutes of Health Research

Announcing: Implementation of a research project to build capacity among Canadian public health professionals to use research evidence in program planning decisions.

Timeline: 18 months (Fall’15 to Spring’17)

Intervention: Receive concise actionable messages based on high-quality systematic review evidence via: Twitter, webinars, and/or tailored email messages. Participants will be surveyed at baseline and follow-up.

Now recruiting: Individual public health professionals across Canada working in the areas of:

- Tobacco/Alcohol use - Sun safety

- Healthy eating - Physical activity

More info: Click here http://kt.healthevidence.org to access the Participant Information Form (Consent). If you decide to participate, you will have the option to continue to a 20 min online survey to begin your participation.

Complete the survey for a chance to win an iPad Air 2 64GB!

For more information, contact Research Coordinator, Olivia Marquez at [email protected] or 905-525-9140 ext. 20464

http://kt.healthevidence.org/







mailto:[email protected]




• Use Q&A to post comments

and/or questions

• ‘Send’ questions to All (not

privately to ‘Host’)

Q&A

Participant Side

Panel in WebEx Your Comments/Questions

40

Your Feedback is Important

Please take a few minutes to share your thoughts

on today’s webinar.

Your comments and suggestions help to improve

the resources we offer and plan future webinars.

The short survey is available at:

https://nccmt.co1.qualtrics.com/SE/?SID=SV_8kcNZREDtwRFq0R

41




Funded by the Public Health Agency of Canada | Affiliated with McMaster University The views expressed here do not necessarily reflect the views of the Public Health Agency of Canada.

For more information about the

National Collaborating Centre

for Methods and Tools:

NCCMT website www.nccmt.ca

Contact: [email protected]

http://www.nccmt.ca/


nccmt webinar - applicaibilty and transferability of evidence (a&t) tool

Healthcare