The Ontario Perception of Care Tool for Mental Health and Addictions (OPOC-MHA): How does this impact programs and clients?

Transcription

1 EENet presents the second webinar in the Health Canada DTFP-ON series: The Ontario Perception of Care Tool for Mental Health and Addictions (OPOC-MHA): How does this impact programs and clients? Friday January 29, pm 2:30pm (EST)

2 OPOC-MHA: How does this impact agencies and clients? HOUSEKEEPING The audio is being stream via your computers. For optimal sound, please use external speakers or earphones. If you are still having trouble hearing our presenters, you can dial into Participant PIN: # This webinar will be recorded and posted on the EENet following the presentation. Please also let us know via the chat box if someone is watching the webinar with you! Some collected data from the webinar might be used for reporting. We would appreciate having your feedback on today s knowledge exchange webinar. An online survey will be sent to you after the webinar. Thanks in advance for the 5 minutes of your time to complete our online feedback survey.

3 OPOC-MHA: How does this impact agencies and clients? Before we begin, we would like to know a little about YOU! EENet would like to know WHICH SECTORS are participating in today s webinar. Please answer the poll: What sector do you work in? Addictions only Mental health only Addictions and mental health Other (please specify which sector in the chat box)

4 OPOC-MHA: How does this impact agencies and clients? Before we begin, we would like to know a little about YOU! EENet would like to know WHO is participating in today s webinar. Please answer the poll: What is your main role in relation to the addictions and/or mental health sectors? Agency Leadership Direct Service Provider Knowledge Broker/Implementation staff Person with Lived Experience and/or Family Member Policy Maker/Decision Maker System Planner Researcher/Research staff Other (please specify in chat-box) Not in the addictions and/or mental health sectors

5 OPOC-MHA: How does this impact agencies and clients? Now we would like to know a little more about YOU! EENet would like to know WHERE everyone is participating from. Please answer the poll: Which Local Health Integration Network (LHIN) area are you participating from? 1. Erie St. Clair 2. South West 3. Waterloo Wellington 4. Hamilton Niagara Haldimand Brant 5. Central West 6. Mississauga Halton 7. Toronto Central 8. Central 9. Central East 10. South East 11. Champlain 12. North Simcoe Muskoka 13. North East 14. North West I am participating from outside of Ontario Not sure

6 Health Canada s Drug Treatment Funding Program (DTFP) Ontario DTFP Drug Treatment Funding Program Ontario Systems Projects Through consultations with provincial and territorial governments and non-governmental organizations, Health Canada developed the Drug Treatment Funding Program (DTFP) in 2008 as part of the Treatment Action Plan under the National Anti-Drug Strategy. The DTFP is a federal contribution program designed to support provinces and territories in their efforts to strengthen evidence-informed substance use treatment systems; and address critical gaps in substance abuse treatment services, particularly for at-risk youth. 6

7 Health Canada s Drug Treatment Funding Program (DTFP) Ontario DTFP Drug Treatment Funding Program Ontario Systems Projects The DTFP supports sustainable improvement in the quality and organization of substance use treatment systems through investments in the following areas: IMPLEMENTATION OF EVIDENCE INFORMED PRACTICE STRENGTHENING PERFORMANCE MEASUREMENT & EVALUATION LINKAGE & KNOWLEDGE EXCHANGE 7

8 DTFP-ON Projects for FY2015- December 2016 Project IMPLEMENTATION OF EVIDENCE INFORMED PRACTICE The Implementation of the Ontario Perception of Care Tool for Mental Health and Addictions (OPOC-MHA) Implementation of a new staged screening and assessment process for addictions Best practices in Peer Support Services Developing and testing Internet-based interventions (IBI) for substance use in youth (NEW INITIATIVE) Trauma-informed substance use screening and assessment tools for First Nations and Inuit peoples (NEW INITIATIVE) STRENGTHENING EVALUATION & PERFORMANCE MEASUREMENT Development and standardization of cost-based performance indicators Project Lead Kim Baker, CAMH Kim Baker, CAMH Janis Cramp, AMHO Karen Urbanoski, Joanna Henderson, Gloria Chaim, CAMH Renee Linklater, CAMH Kim Baker, CAMH Strengthening performance measurement for mental health and addictions in Ontario (NEW INITIATIVE) Improving reporting compliance and data quality among Ontario s addiction treatment agencies Evaluating Residential Support Services Evaluation Plan for Youth Care (NEW INITIATIVE) LINKAGE & EXCHANGE Karen Urbanoski, CAMH Claudio Rocca, CAMH Janis Cramp, AMHO Laura Mills, Pine River Institute Evidence Exchange Network (EENet) Nandini Saxena, CAMH 8

9 PSSP Supports Ontario s 10 year Comprehensive Mental Health and Addictions Strategy Offices across Ontario, five regional teams (150+ staff) Capacity and expertise in knowledge exchange and implementation, information management, equity and engagement, coaching, and evaluation

10 OPOC-MHA: How does this impact agencies and clients? Today s presenters: Renée Behrooz, is an Implementation Coordinator for both the OPOC and the new Staged Screening and Assessment process for addictions. She has an Honours BA in psychology and a Master of Science degree in Addiction Studies. Prior to her current role, she worked in the Research Department here at CAMH for 12 years on various projects related to addictions, concurrent disorders, and health systems research. She is excited to actually be implementing some of this important work now with the Provincial System Support Program at CAMH, and enjoys working out in the community. Kevin Acuna, is a research analyst working on the OPOC- MHA project. His main role on the project is to code all the mental health and addictions programs across the province and to create the OPOC database that holds this information. He is also the bridge between the DATIS team and our implementation team to ensure that the OPOC website is working as needed.

11 Enhancing Quality of Care: The Ontario Perception of Care Tool for Mental Health and Addictions (OPOC-MHA)

12 AGENDA Overview of the Ontario Perception of Care tool Description of the online database and brief demo How OPOC data can be used for quality improvement Update on the implementation status and plans Information about impacts to the system, agencies, and clients

13 DTFP Previous and current work funded through Health Canada s Anti-Drug Strategy Initiatives program Drug Treatment Funding Program Overall objective to enhance quality of care within the addictions sector Ontario DTFP administered through the Ministry of Health and Long- Term Care IMPLEMENTATION OF EVIDENCE INFORMED PRACTICE STRENGTHENING PERFORMANCE MEASUREMENT & EVALUATION LINKAGE & KNOWLEDGE EXCHANGE

14 WHAT IS THE ONTARIO PERCEPTION OF CARE TOOL?

15 Client/Patient Voice Enhancing Quality of Care A standardized, validated tool to gather client perception of care feedback Perception of care asks about the care experience in relation to what is expected as standard practice Tool copyrighted by CAMH; endorsed by Accreditation Canada

16 Empowers service users by providing a standardized way to provide feedback OPOC contributes to quality improvement, program evaluation and performance monitoring Recognized as an important indicator of the quality of care as it is a direct measure of whether a client received services that met expectations and needs Why OPOC-MHA?

17 Last Round of DTFP OPOC Development

18 Literature review completed Research & Development Environmental scan most agencies using something, many tools developed in-house Decision to develop a new tool that could be used in addictions, mental health, and concurrent disorder settings and also with family members/supporters Extensive stakeholder consultation through Advisory Structure, Project Working Group, and Persons with Lived Experience Panel

19 Pilot & Validation Piloted in 23 mental health and addiction agencies (82 unique programs and 1,772 participants) Pilot sites represented a diversity of clients and services across Ontario (i.e. inpatient/community, genderspecific, youth, ethno-racial etc.) Overall feedback from staff, clients, and management about the OPOC-MHA was positive Tool demonstrated strong psychometrics with stable subscales

20 CLOSER LOOK AT THE TOOL

21 REGISTERED CLIENTS (38 items) Registered clients of the program OPOC-MHA Versions Clients receiving services for their own treatment/support Family members/significant others/supporters who are receiving services for their own support 6 items specific to inpatient/residential treatment services FAMILY/SUPPORTERS (17 items) Family members/significant others/supporters Supporters who are not registered clients but who are also receiving services/support from the program (such as parent who has a child in the program)

22 OPOC-MHA asks about Access/Entry Additional questions about age, gender, ethnicity, sexual orientation Stage in treatment process Open ended questions about least/most helpful aspects of service Services Provided Participation/Rights Therapists/Support Workers/Staff Environment Discharge/Leaving the Program Overall Experience

23 OPOC-MHA Scoring Analysis and interpretation of OPOC-MHA data may involve individual or grouped items Responses to each item may be reported as % OR averages In addition to an Overall Perception of Care score, subscale scores may also be calculated for Accessing Services & Within Services Scales Overall Perception of Care # of Items 23 Accessing Services Within Services 17 Items 1-8, 12-15, 17-18, 20-25, , 12-15, 17-18, 20-25, Scoring Average score of the 23 items Average score of the 6 items Average score of the 17 items

24 Administration Essentials Available in both English and French Validated for clients 12 years of age or older Appropriate for a literacy level of grade-six or higher Provide the entire questionnaire Provide facilitation as needed 4 Key Requirements Ensure anonymity/protect client privacy Completion is voluntary

25 Data Collection Variety of ways the OPOC-MHA can be administered. No prescribed way, as this depends on the practices of each agency and/or program Clients can complete the tool electronically or pen to paper Can be distributed in many ways, i.e. group setting, individually, in person at the agency or by mail Agencies/programs may decide to do a blitz, collect data at specified times or employ OPOC ongoing/continuously

26 Data System Info Data collected and analyzed centrally Built by DATIS but in separate data platform No connection to PHI Accessible to all agencies:

27 HOW DOES THE DATABASE WORK?

28 OPOC Coding Details Each organization and program will be coded in the OPOC database in a way that makes sense for QI An agency OPOC administrator will be able to generate new OPOC questionnaires each survey will have a unique key that will link it to the appropriate program in the database The survey key will allow respondents to access the website and respond electronically, or could be stapled to the paper OPOC for data entry

29 OPOC Reports Standardized reports for each program will be available from the website Cell sizes less than 5 will not be reported All providers will also have immediate access to their own raw data, including open-ended comments Providers need to ensure open-ended comments are not analyzed or reported such that they identify respondents Program specific data is used for quality improvement

30 OPOC Reports Aggregated reports: programs will be able to compare their results to collated data from like services Other organization/program names not identified MOHLTC and the LHINs will have access to all of the quantitative data Identified by the name of the organization and program Standardized data enables quality improvement across the system, LHIN, and province

31 Data must be linked to quality improvement efforts OPOC enables this by capturing information on quality improvement indicators For example safety, accessibility, client OPOC-MHA & QI centeredness, environment, etc. Actionable items make it possible to develop strategies to address specific issues

32 WHAT DOES THIS MEAN FOR AGENCIES?

33 Agency Action Planning Each organization develops an implementation plan that Takes into account agency context and client population Looks at programs distinctly to support using the data for quality improvement Protects client privacy Honours administration essentials Maximizes client/patient input

34 Implementation Support Implementation Team within the Provincial System Support Program at CAMH Using Implementation Science: an evidence-based approach to implement new practices Coordinators support LHIN level implementation plan Implementation Coach supports agency level planning Research Analyst develops program codes Each implementing agency identifies an OPOC lead contact for implementation

35 Selecting an Agency Lead Who can best support decisions regarding OPOC implementation within your organization? Will work with Implementation Coach and may confer with other OPOC leads to develop agency/program level implementation plans (with connection to LHIN implementation plan) Staff involved in OPOC implementation to complete a 2 hour web-based orientation

36 OPOC Web-based orientation: Introduction to the tool Administration details Protecting privacy Data gathering and website demo Using the data quality improvement implications

37 Privacy Impact Assessment conducted by external/independent party Recommendations guided development of MOU and client information sheet MOU articulates key roles & responsibilities Information sheet (consent form) will be generated with each new OPOC key Protecting Client Privacy

38 Where is it being implemented? Tasked by Ontario s Ministry of Health and Long-term Care (MOHLTC) to implement in all MOHLTC/Local Health Integration Network (LHIN) funded addiction, mental health and concurrent disorder programs Approximately 500 organizations in scope for supported implementation

39 Implementation Update Implementation planning underway in 6 LHINS at present, further LHIN engagement in 2016 Agency level action plan development underway Early OPOC adopters identified Will provide orientation/training on administration, data collection as well as implementation guide Database ready for beta testing Building reports

40 Contributing to quality healthcare Data is the cornerstone of quality improvement (Health Quality Ontario) Some quotes from Service Users about OPOC: An amazing step in the right direction. It s important we know our voices are heard. This treats our experience as a form of evidence. Various Members; CAMH Persons with Lived Experience

41 The point.. Client voice informs service change to enhance quality of care

42 Questions? Comments?

43 Renée Behrooz DTFP Implementation Coordinator

44 OPOC-MHA: How does this impact agencies and clients? Thanks to all participants for joining today s webinar. EENet would also like to give a special THANKS to Renée and Kevin for today s presentation! Please take a few minutes to answer our survey on today s webinar: The recording of today s webinar will also be posted the project web page shortly.

45 Next webinar in Health Canada DTFP-ON series: Evaluation Plan for Youth Care (EPYC): Exploring a user-friendly tool to benefit clients and agencies February 18, pm 2pm EST Register here: For additional updates about the Ontario DTFP projects, sign up for our newsletter at: d7768&id=c75fdbe945