Overcoming Barriers to Evidence-Informed Decision Making: Online Learning for Public Health Practitioners Maureen Dobbins, RN, PhD Pamela Forsyth, MHSc, RD Donna Ciliska, RN, PhD Ramona Kyabaggu, MSc Jeannie Mackintosh, Cert (PR) Kate Tulloch, MPH Jennifer Yost, RN, PhD CHNC conference Ottawa, June 2 4, 2014 Funded by the Public Health Agency of Canada Affiliated with McMaster University
NCC Aboriginal Health Prince George, BC NCC Determinants of Health Antigonish, NS NCC Environmental Health Vancouver, BC NCC Infectious Diseases Winnipeg, MB NCC Methods and Tools Hamilton, ON NCC Healthy Public Policy Montreal and Quebec City, QC 2
NCCMT Products and Services Registry of Methods and Tools Networking and Outreach Online Learning Opportunities Multimedia Workshops Public Health+ 3
Online Learning with NCCMT What resources are available: Learning Centre Online modules o Suite of modules to support Evidence-Informed Public Health Search Pyramids o Free online tools to support and structure your search for research evidence Videos Understanding Research Evidence Webinar companions Short summaries of key points (English, French) 4
Online Learning Modules: Intro to Evidence-Informed Decision Making Quantitative Research Designs 101 Searching for Research Evidence in Public Health Critical Appraisal of Intervention Studies Critical Appraisal of Systematic Reviews Critical Appraisal of Qualitative Studies (new!) Assessing Applicability and Transferability of Evidence (new!) 5
Evaluating the modules Pre- and post-assessment questionnaires Demographics User knowledge Self-efficacy User experience 6
How many people use the modules? Between 1 April 2013 and 31 March 2014: 2350 modules were started by 1308 unique users 21.1% of users started more than one module 7
Where do module users work? Users worked in 52 countries across the world 59.4% worked in Canada: Ontario (n = 423, 59.4%) British Columbia (n = 86, 12.1%) Alberta (n = 73, 10.3%) Nova Scotia (n= 49, 6.9% Manitoba (n = 23, 3.2%) Quebec (n - 15, 2.1%) Newfoundland and Labrador (n = 14, 2.0%) New Brunswick (n = 11, 1.5%) Saskatchewan (n = 8, 1.1%) Northwest Territories (n = 5, 0.7%) Nunavet (n = 4, 0.6%) Prince Edward Island (n = 1, 0.1%) 8
Public health roles of module users Librarian Inforation Specialist Physician Epidemiologist Manager Academic Professor Research Research Analyst Health Promote Educator Other Student Public Health Nurse 0 20 40 60 80 100 120 140 160 9
Level of education College education Bachelor's degree Master's degree Doctorate Other Medical Doctor 10
Users learning outcomes: Knowledge 1.2 Changes in Knowledge from Pre- to Post- Module Completion 1.0 0.8 0.6 85.3% 88.0% 86.8% 63.5% 62.1% 64.0% 90.3% 73.3% 73.3% 95.6% Pre Post 0.4 0.2 0.0 CAIS* (n = 169) RD* (n = 280) *Significant change P < 0.0001 Search* (n = 123) CASR* (n = 53) CAQS* (n = 15) 11
Users learning outcomes: Self-efficacy 5 Changes in Self-Efficacy from Pre- to Post-module (completion) 4.5 4 Pre 3.5 3 2.5 2 1.5 2.96 3.17 2.3 2.54 1.62 1.86 1.35 1.51 Post 1 0.5 0 EIDM (n = 157) CAIS* (n = 237) Search (n = 163) CAQS* (n = 19) *Significant change P < 0.05 Likert Scale: 0 = don't know/no answer; 1 = strongly disagree; 2 = disagree; 3 = neither agree/disagree; 4 = agree; 5 = strongly agree 12
Supporting Learner Needs 70.0% 60.0% 50.0% 40.0% Module was easy for me to access Module was easy for me to navigate 30.0% Module was easy for me to understand 20.0% Online format was an effective learning method 10.0% 0.0% Do Not Know Strongly Disagree Disagree Neither Agree or Disagree Agree Strongly Agree 13
Learner Intentions After Module Completion 60.0% 50.0% 40.0% 30.0% I intend to complete other modules offered by NCCMT I will recommend this series of NCCMT online modules to a colleague 20.0% 10.0% 0.0% Yes No Undecided 14
Summary of findings Effective strategy to build KT capacity Increase learner knowledge Increase learner self-efficacy 15
Key features of NCCMT learning modules free accessible self paced support professional development colour-coded to match EIPH wheel (new!) 16
Group registration Register with colleagues Invite class or study group Share notes, questions Earn your own certificate 17
How to access online modules Register or log in to NCCMT s Learning Centre: www.nccmt.ca/learningcentre It s free! 18
Other online learning opportunities available from NCCMT Search Pyramids Understanding Research Evidence videos Webinars, webinar companions 19
For more information about the National Collaborating Centre for Methods and Tools: NCCMT website www.nccmt.ca Contact: nccmt@mcmaster.ca 2020