Information Technology Health Informatics Assessment Report

Transcription

1 Information Technology Health Informatics Assessment Report I. Program History History The field of Health Informatics is the result of the convergence of information management and information technologies. Health informatics professionals work in operational and management positions throughout the health care industry in such locales as hospitals, clinics, managed care organizations, software vendors and government agencies. This degree option was first offered in Klamath Falls and Portland in fall 2008 and is now offered as a fully online option. Current enrollment (from Spring 2013 Banner Report) is 52 students, 13 students are enrolled at the Klamath Falls campus, 34 are in Wilsonville and five are online enrollees. Three students graduated with an Information Technology Health Informatics degree in June Eleven students graduated in June Based on current knowledge, employment rate is 100%. Median salary rate is approximately $60K. Employers include Huron Consulting, Oregon State Department of Health and OCHIN. In addition to providing in-class didactic education, the Health Informatics degree option at Oregon Tech provides hands-on experiential learning through the application of numerous information systems and technologies delivered in instructional labs. Recent acquisition of instructional lab equipment for Health Informatics includes, hardware and software applications, such as servers, electronic health record updates, HL7 interface engines, business intelligence and analytical tools. II. Program Purpose The Management faculty reviewed the program purpose, objectives, and learning outcomes during the fall faculty meeting in September The faculty reaffirmed the statements below: Learning Opportunities: The Information Technology Health Informatics Option degree supports students in numerous way by facilitating opportunities to enhance their knowledge outside the classroom. These opportunities include but are not limited to the follow: professional meetings, conferences, internships, service learning, experiential learning, participation in professional societies, and industry tours. 1

2 Information Technology Health Informatics Mission Statement: The Information Technology Health Informatics Option degree provides students with the foundation necessary to enable them to effectively design, develop, implement, evaluate and manage health care information systems and resources. Educational Objectives: (1) The Information Technology Health Informatics degree program prepares students to contribute to the improvement of health care delivery systems. (2) The Information Technology Health Informatics degree program prepares students to adapt to ever-changing industry trends. (3) The Information Technology Health Informatics degree program prepares students to succeed in broad industry applications such as mid-level managers or as IT professionals. The Educational Objectives will be assessed and evaluated every three years through the use of a survey distributed to graduates and key employers. The resulting data will be analyzed and used to validate the Educational Objectives. Student Learning Outcomes: The Information Technology Health Informatics program consists of the eight core Management Department student learning outcomes as well as four student learning outcomes specific to this program. Upon completion of this program, Information- Technology Health Informatics graduates will be able to: 1. Demonstrate an understanding of the functional areas of accounting, marketing, finance, management, and economics. 2. Demonstrate an understanding of the legal and social environment of business. 3. Demonstrate an understanding of the global environment of business. 4. Demonstrate an understanding of the ethical obligations and responsibilities of business. 5. Demonstrate the ability to use business tools. 6. Demonstrate the ability to communicate effectively. 7. Demonstrate the ability to apply knowledge of business concepts and functions in an integrated manner. 8. Demonstrate the ability to work effectively in teams and/or groups. 9. Demonstrate ability to analyze, design, implement, and support Relational Database Management Systems (RDMS) 10. Analyze business needs with the view to design and implement data networks. 11. Perform the general planning and analysis of business systems that will support the development of modern business information systems (IS). 12. Demonstrate an understanding of the design and use of computerized information systems for use in health care. 2

3 Advisory Board: The Management Department is in the process of forming and meeting with an Industry Advisory Board which will provide input to the department and its programs. III. Assessment Cycle Assessment schedule IACBE requires all accredited institutions to complete a full assessment cycle for all IACBE core student learning outcomes (SLOs 1-8) on an annual basis. Programspecific learning outcomes (PSLOs 9-12) will be assessed as follows: Program-Specific Learning Outcomes (PSLO) 9. Demonstrate ability to analyze, design, implement, and support RDMS. 10. Analyze business needs with the view to design and implement data networks. 11. Perform the planning and analysis of business systems to support IS. 12. Demonstrate an understanding of the design and use of computerized information systems for use in health care. a. Analyze health care information technology system adoption & optimization b. Configure Utilize electronic health records X X X X X Table 1: Assessment Cycle for Information Technology Health Informatics PSLOs IV Assessment Activities Assessment results for the eight core student learning outcomes are reported separately and can be found on the Oregon Tech website under IACBE Public Disclosure of Student Learning. This report covers PSLO 11 and 12a only per the 3

4 assessment cycle above. These outcomes have been mapped to the curriculum as shown in the Appendix. In addition assessment of professionalism, ethics and teamwork was begun. The results for Health Informatics students are presented. PSLO #11: Perform the general planning and analysis of business systems that will support the development of modern business information systems (IS). Direct Assessment: Direct Assessment (KF): This outcome was assessed using the final project for MIS 312 Systems Analysis I. Scored using a rubric. There were 6 HI Students out of 10 students in the course. The below results are those HI students. Direct Assessment (WLV): This Outcome was measured but not reported by the instructor on record for both MIS 312 and MIS 322. Direct Assessment (WEB): This outcome was assessed using the final project for MIS 312 Systems Analysis I scored using a rubric. There were 6 HI Health Informatics Students out of 24 students in the course. MIS 322 was not offered during the academic year. The results of this assessment including the performance criteria are shown in the table below. Performance Criteria Assessment Method Measurement Minimum Acceptable Performance (KF) n=5 (WLV) (WEB) n=6 1. Employ SDLC to plan and design IS to meet business needs. 2. Design an IS that incorporates industry standards and best practices. 3. Generate system specifications and project plan. Rating of final project Rating of final project Rating of final project 1-4 Proficiency 1-4 Proficiency 1-4 Proficiency 80% achieve 3 or 4 rating 80% achieve 3 or 4 rating Table 2: Assessment for PSLO #12 in MIS 312 and MIS 322 4/5=80% (322) NA* 4/5=80% (322) NA* 80% achieve 3 or 4 rating 5/6=100 % (322) NA* 5/6=83 % (312) NA (322) 5/6=83 % (312) NA (322) 5/6=83 %(312) NA (322) *Note: 1) Wilsonville data was unattainable for this report, see weaknesses. 4

5 Strengths: 1) HI Student performance demonstrates a high rate of learning for PSLO #11 2) The department has begun to re-hire full time faculty to increase continuity and program outcomes. Weaknesses: 1) Not having Wilsonville data available by the instructors on record has created a report that is difficult to analyze. 2) Low enrollment cancelled MIS 322 this academic year through distance education. Actions: In the IT program will pursue better coordination between campuses to increase the sample size for results, specifically in Wilsonville. Currently and into 2014 the IT program will evaluate ways to consolidate program extension to entice program growth and improve quality outcomes. This process will require possible consolidation of options and developing new assessment criteria. Indirect Assessment: Performance Criteria (PC): 1. Employ SDLC to plan and design IS to meet business needs. 2. Design an IS that incorporates industry standards and best practices. 3. Generate system specifications and project plan. Survey Question PC Assessment Method 1. I can complete SLO 9 2. I can complete SLO 11 1 Student rating Student rating Measurement 1-4 Proficiency 1-4 Proficiency Table 3: Assessment for PSLO #11 from Senior Survey Minimum Acceptable Performance 80% achieve 3 or 4 rating 80% achieve 3 or 4 rating (KF) n=2 2/2=100 % 2/2=100 % (WLV) n=6 5/6=83% NA 5/6=83% NA (DE)* n=-0 *Note: 0 HI DE students completed the exit survey Indirect Assessment Summary Upon review of the results of the Spring 2012 and Spring 2013 senior survey for the questions that correspond to PSLO #11, faculty observed that student s perception of their ability is congruent with their performance as found in the MIS 312 Business Systems Analysis I. However, open comments from the senior survey and student responses from the focus group seem to indicate some suggested program improvements in the following areas: 5

6 More hands-on and practical application in IT courses. Greater emphasis on current software. Greater selection of IT electives. Better connection and sequencing between courses in the IT curriculum. Better connection between IT curriculum and industry demands. Allow option of an internship in lieu of the senior project. PSLO #12a: Demonstrate an understanding of the design and use of computerized information systems for use in health care. (a) Analyze health care information technology system adoption and optimization. Direct Assessment: The faculty assessed this outcome in MIS 345 Health Care information Systems Management. The results of these assessments including the performance criteria are shown in the table below. Performance Criteria 1. Analyze health care IT system adoption. Assessment Method Rating of lab assignment Measurement 1-4 Proficiency Minimum Acceptable Performance 75% achieve 3 or 4 rating Wilsonville (W 2013) N=9 Klamath Falls n=3 8/9=89% 3/3=100% Distance Ed ( Sp 2013) n=6 5/6=83% 2. Analyze health care IT system optimization. Rating of lab assignment 1-4 Proficiency 75% achieve 3 or 4 rating 8/9=89% 3/3=100% 5/6=83% Table 4: Assessment for PSLO #12(a) in MIS 345 Strengths: 1) Student performance as rated by faculty is well above the minimum acceptable performance. No further action required. Weaknesses: 1) Increased hands on applied learning to be incorporated into course content. Actions: In the IT program will pursue better coordination between campuses to increase the sample size for results, specifically in Wilsonville. 6

7 Currently and into 2014 the IT program will evaluate ways to consolidate program extension to entice program growth and improve quality outcomes. This process will require possible consolidation of options and developing new assessment criteria. Increasing and improving applied learning will be a focus for course content and curriculum development for IT and HI. Indirect Assessment: Performance Criteria (PC): 1. The ability to analyze health care information technology system adoption and optimization. Program-specific learning outcomes (Exit Survey Question) The ability to analyze health care information technology system adoption and optimization Assessment Method Student rating Measurement Minimum Acceptable Performance % of graduates indicate a 3 or 4 rating Table 5: Assessment for IT-Health Informatics PSLOs from 2013 Senior Exit Survey (W)n=6 (KF) n=2 6/6=100% 2/2=100% Indirect Assessment Summary In general students rated their preparedness very high in regards to the Information Technology Health Informatics PSLOs. Upon review of the results of the Spring 2012 and Spring 2013 senior survey for the questions that correspond to PSLO #12a, faculty observed that student s perception of their ability is congruent with their performance as found in the MIS 345 Health Care information Systems Management. However, open comments from the senior survey and student responses from the focus group seem to indicate some suggested program improvements in the following areas: More hands-on and practical application in IT and HI courses. Greater emphasis on current software. Greater selection of IT electives. Better connection and sequencing between courses in the IT curriculum. Deeper knowledge of applied health IT software and systems Better connection between IT curriculum and industry demands. Allow option of an internship in lieu of the senior project. Greater technical expertise by faculty 7

8 Professionalism Six graduating Health Informatics students from the Wilsonville campus were evaluated on the following twelve criteria. Mean scores are given. Criteria Mean Score Percentage Met or Exceeded Faculty Expectations 1) Timeliness 2 100% 2) Quality-content 2 100% 3) Quality-delivery 2 100% 4) Attitude toward feedback 2 100% 5) Attitude toward tasks 2 100% 6) Punctuality 2 100% 7) Attendance 2 100% 8) Academic integrity 2 100% 9) Interpersonal skills 2 100% 10) Policies and procedures 2 100% 11) Work ethic 1 100% 12) Appearance Table 6: Professionalism Criteria and Scores 2 100% Definitions: 1) Timeliness of work: Student performs tasks in a timely manner. 2) Quality-content: Student performs assigned tasks according to course expectations. 3) Quality-delivery: Student work product is done in a professional manner. 4) Attitude toward feedback: Student accepts feedback appropriately. 5) Attitude toward assigned tasks: Student accepts & carries out tasks with positive attitude. 6) Punctuality: Student arrives on time or gives appropriate notification. 7) Attendance: Student regularly attends classes/meetings or gives appropriate notification. 8) Academic integrity: Student follows OIT Student Conduct Code. 9) Interpersonal skills: Student interacts appropriately with others. 10) Knowledge of classroom policies & procedures: Student is aware of and follows classroom policies & procedures. 11) Work ethic: Student demonstrates effort and hard work. 12) Appearance: When required, student demonstrates appropriate professional appearance. : Blank = Not able to assess 0 = Does not meet faculty expectations 1 = Meets faculty expectations 2 = Exceeds faculty expectations 8

9 Professionalism Summary As is demonstrated by the mean scores, Health Informatics students display a high degree of professionalism, ethics and team work skills and competencies. These characteristics will serve these students well in their chosen careers. 9

10 Information Technology Health Informatics PSLO-Curriculum Map PSLO #9: The student will demonstrate ability to analyze, design, implement, and support Relational Database Management Systems (RDMS). Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall PSY 201 MATH 361 ACC 201 BUS 356 SPE 111 MIS 115 MIS 312 R MIS 273 WRI 121 MIS 217 MIS 345 MIS 496 R Hum Elective MIS 255 MIS 341 E Tech Elective MSSS Elective MIS 311 Win BIO 200 MATH 371 MIS 322 R BUS 316 ECO 201N MIS 215 E MIS 342 E BUS 337/223 MATH 111 MIS 256 MIS 357 MIS 445 MIS 102 Hum Elective WRI 327 MIS 497 R WRI 122 Tech Elective Spr BIO 103 BUS 317 BUS 456 BUS 478 ECO 202N PSY 347 MIS 344 Tech Elective MIS 275 I SPE 321 ACC 203 MIS 498 R MSSS Elective WRI 227 MIS 272 MSSS Elective Hum Elective MSSS Elective 10

11 Information Technology Health Informatics SLO-Curriculum Map PSLO #10: Analyze business needs with the view to design and implement data networks. Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall PSY 201 MATH 361 ACC 201 BUS 356 SPE 111 MIS 115 MIS 312 I MIS 273 E WRI 121 MIS 217 MIS 345 MIS 496 E Hum Elective MIS 255 MIS 341 Tech Elective Elective MIS 311 Win BIO 200 MATH 371 MIS 322 R BUS 316 ECO 201N MIS 215 MIS 342 ACC 203 MATH 111 MIS 256 MIS 357 MIS 445 MIS 102 Hum Elective WRI 327 MIS 497 WRI 122 Tech Elective Spr BIO 103 BUS 317 BUS 456 BUS 478 R ECO 202N PSY 347 MIS 344 Tech Elective MIS 275 SPE 321 ACC 203 MIS 498 Elective WRI 227 MIS 272 I Elective Hum Elective Elective Elective 11

12 Information Technology Health Informatics SLO-Curriculum Map Map correct SLO/PSLO for IT & HI as noted above PSLO #11: The student will perform the general planning and analysis of business systems that will support the development of modern business information systems. Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall PSY 201 MATH 361 ACC 201 BUS 356 SPE 111 MIS 115 MIS 312 E MIS 273 R WRI 121 MIS 217 MIS 345 MIS 496 E Hum Elective MIS 255 MIS 341 Tech Elective MSSS Elective MIS 311 I Win BIO 200 MATH 371 MIS 322 E BUS 316 ECO 201N MIS 215 R MIS 342 R BUS 337/223 MATH 111 MIS 256 MIS 357 MIS 445 MIS 102 Hum Elective WRI 327 MIS 497 R WRI 122 Tech Elective Spr BIO 103 BUS 317 BUS 456 BUS 478 ECO 202N PSY 347 MIS 344 Tech Elective MIS 275 R SPE 321 ACC 203 MIS 498 R MSSS Elective WRI 227 MIS 272 MSSS Elective Hum Elective MSSS Elective 12

13 Information Technology Health Informatics SLO-Curriculum Map PSLO #12: The student will demonstrate an understanding of the design and use of computerized information systems for use in health care. a. Analyze health care information technology system adoption & optimization Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall PSY 201 MATH 361 ACC 201 BUS 356 SPE 111 MIS 115 MIS 312 MIS 351 WRI 121 MIS 217 MIS 345 E MIS 496 Hum Elective MIS 255 I MIS 341 WRI 327 MSSS Elective MIS 311 Win BIO 200 MATH 371 BUS 328 BUS 316 ECO 201N MIS 215 MIS 322 BUS 337 MATH 111 MIS 256 MIS 342 MIS 445 MIS 102 Hum Elective MIS 357 R MIS 497 WRI 122 Tech Elective Tech Elective Spr BIO 103 BUS 317 BUS 456 BUS 478 ECO 202N PSY 347 MIS 272 MIS 479 MIS 275 SPE 321 MIS 344 MIS 498 MSSS Elective WRI 227 MIS 375 MSSS Elective Hum Elective MSSS Elective 13

14 Information Technology Health Informatics SLO-Curriculum Map PSLO #12: The student will demonstrate an understanding of the design and use of computerized information systems for use in health care. b. Configure and utilize electronic health records. Courses that are shaded below indicate that the SLO above is taught in the course, students demonstrate skills or knowledge in the SLO, and students receive feedback on their performance on the SLO. I = Introduced R = Reinforced E = Emphasized Fr. Soph. Jr. Sr. Fall PSY 201 MATH 361 ACC 201 BUS 356 SPE 111 MIS 115 MIS 312 MIS 351 WRI 121 MIS 217 I MIS 345 R MIS 496 Hum Elective MIS 255 I MIS 341 WRI 327 MSSS Elective MIS 311 Win BIO 200 MATH 371 BUS 328 BUS 316 ECO 201N MIS 215 MIS 322 BUS 337 MATH 111 MIS 256 MIS 342 MIS 445 MIS 102 Hum Elective MIS 357 E MIS 497 WRI 122 Tech Elective Tech Elective Spr BIO 103 BUS 317 BUS 456 BUS 478 ECO 202N PSY 347 MIS 272 MIS 479 MIS 275 SPE 321 MIS 344 MIS 498 MSSS Elective WRI 227 MIS 375 MSSS Elective Hum Elective MSSS Elective 14