SCIENCE PROGRAMS (Engineering, Health & Nursing, and Natural Resources Units) Plan for Assessment of Student Academic Achievement

Transcription

1 SCIENCE PROGRAMS (Engineering, Health & Nursing, and Natural Resources Units) Plan for Assessment of Student Academic Achievement From the Mission of Hocking College To prepare learners for technical careers or for transfer to other institutions of higher learning. Mission of Academic Affairs Unit To promote learning and learner success. Mission of Science Program To provide an innovative, experience-based education that prepares students with knowledge, skills, and attitudes to be successful in applications of scientific concepts related to their technical careers or transfer to other institutions; and, to provide multiple ways for students to achieve success in science. Central Objective To provide the students with scientific knowledge and skills necessary to succeed in technical programs, to transfer to fouryear educational institutions, or entry-level employment. IP0304Science/1

2 Success Skills The following general outcomes are life and work skills cultivated in all students seeking the Associate Degree. 1. Communicates effectively. 2. Demonstrates math skills. 3. Demonstrates learning and critical thinking skills. 4. Maintains professional skills and attitudes. 5. Practices human relations skills. 6. Demonstrates knowledge of science and the environment. 7. Demonstrates community, cultural, and global awareness. 8. Maintains a code of ethics. Program Outcomes The following outcomes express additional, particular skills, behaviors, and attitudes cultivated in students taking science courses. 1. Demonstrates knowledge and skills required by Hocking College Success Skill, "Demonstrates knowledge of science and the environment." 2. Demonstrates scientific knowledge and skills necessary for success in the students technology. 3. Demonstrates ability to succeed in science at four-year institutions by those who are university bound. 4. Demonstrates the scientific knowledge and skills necessary for success in entry-level positions. The Success Skills and Program Outcomes combine to form a single set of skills, behaviors, and attitudes determined desirable for entry-level practitioners, for graduates transferring to four-year institutions, and for educated citizens. IP0304Science/2

3 Criteria for Assessing Student Academic Achievement 1. The aggregate score for the Success Skill Demonstrates Knowledge of Science and the Environment evaluated by graduates of Hocking College on a survey will be 3.5 or higher (on a 5-point scale) indicating the graduates satisfaction with their preparedness in math at Hocking College. Data gathered for *: Note: Numbers in parentheses are those recorded for and can be used for comparison. Technology Aggregates for "Demonstrates Knowledge of Science and the Environment" Number of Respondents Number of Graduates Accounting 4.17 (3.67) 6 (3) 24 (22) Archaeology (3) Associate Individ. Studies (3) Associate Tech. Studies 6 (32) Audio/Video Productions (9) Backcountry Horse 5.00 (4.33) 2 (3) 10 (17) Business Management 3.33 (3.67) 9 (3) 43 (40) Compressed Air & Gas 2 (3) Computer Electronics (6) Computer Programming (12) Culinary Arts 4.50 (4.00) 4 (2) 31 (18) Drafting & Design (5.00) (1) (2) E-Commerce & Web De (7) Ecotour. & Adv. Travel 3.75 (5.00) 4 (2) 14 (20) Environmental Rest (3.40) 3 (5) 15 (19) Fire/EMS (5.00) (1) (1) Fish Mgt. & Aquaculture 4.00 (5.00) 1 (2) 6 (4) Forest Management 4.25 (4.00) 4 (1) 14 (11) GIS/GPS 3.00 (3.64) 2 (11) 8 (21) Hotel/Restaurant 4.00 (2.00) 2 (1) 92 (59) Human Serv. & Correct (3.82) 10 (11) 47 (50) Industrial Ceramics 7 (3) Interactive Multimedia 2 Juvenile Services 3.25 (4.50) 4 (4) 18 (13) Massage Therapy (5) Materials Engineering 4.00 (3.00) 1 (1) 4 (7) Medical Assistant 4.25 (4.00) 4 (1) 13 (6) Medical Records-HIM 3.00 (3.50) 2 (2) 10 (13) Nat. & Hist. Interpret (5.00) 4 (2) 14 (10) Natural Resource Mgt (4.71) 2 (7) 24 (44) Network Systems 4.00 (4.50) 2 (2) 15 (18) Nursing, Level I 3.93 (4.07) 28 (15) 164 (144) Nursing, Level II 3.95 (3.92) 38 (25) 139 (157) Nutrition & Dietetics 1 (6) Office Management 4.00 (3.50) 1 (2) 8 (11) Opticianry (4.00) (1) (5) Physical Therapy Asst (4.00) 2 (2) 9 (10) Police Science 3.00 (3.00) 3 (1) 16 (10) Ranger Services 4.17 (4.00) 6 (4) 11 (17) Timber Harvesting 1 (4) Travel & Tourism Wildlife Management 4.50 (4.57) 12 (7) 47 (45) Overall 3.98 (4.03) 168 (130) IP0304Science/3

4 Criterion 1 continued Analysis of data: The overall aggregate for "Demonstrates Knowledge of Science and the Environment" as rated by the graduates met the goal. One hundred sixty-eight graduates (168) rated this skill at 3.98 (on a 5-point scale). Compared to the previous year, the overall aggregate decreased, but the number of graduates returning the surveys increased. For , one hundred thirty graduates(130) rated this skill at 4.03 on a 5-point scale (see Hocking College Graduate Survey Report, September 2003).. For , two hundred thirty graduates rated this skill at 3.93 on a 5-point scale (see Hocking College Graduate Survey Report, June 2002). The graduates from seven programs rated this skill below goal. They are as follows: Associate of Individual Studies (3.00 by one respondent), Business Management (3.33 by 9 respondents), E- Commerce & Web Design (3.00 by 1 respondent), GIS/GPS (3.00 by 2 respondents), Juvenile Services (3.25 by 4 respondents), Medical Records-HIM (3.00 by 2 respondents), and Police Science (3.00 by 3 respondents). Compared to the information recorded the previous reporting year, the number of programs rating the skill below goal has increased by three programs. Those reporting below goal scores then were Environmental Restoration, Hotel/Restaurant Management, Materials Engineering, and Police Science. Only the Police Science program remained below goal from this group. Graduates from Medical Records have rated this Success Skill below goal for three of the past four reporting years. Last reporting year, these graduates rated the skill at the goal of 3.50 (0n a 5-point scale). The Health Science Coordinator will meet with the Medical Records Coordinator to discuss the graduate responses for this Success Skill. Those students enrolled in Medical Records who struggle in Health Sciences are generally not well prepared. The Health Science faculty members and the Medical Records coordinator continually seek solutions to this problem. Some of these students do not buy all of the materials even though requested to do so by the Program Coordinator. They do not take advantage of opportunities such as study groups, which would help them to succeed or schedule classes according to the Medical Records block schedule. Some Medical Records students question why they need to take Human Organism and Anatomy & Physiology I and II; however, those courses are deemed necessary for the AHIMA National Certification exam. Does this analysis support conclusions drawn from other assessment data analyzed for ? Please elaborate. During the same time period, twenty employers rated this skill at 3.65 (on a 5-point scale). Overall, the employers rated two programs (Ecotourism & Adventure Travel and Ranger Services) below goal and only one employer had responded for each of those programs (see page 5, this report) During this same time period, practicum supervisors rated Hocking College students from thirteen programs at 4.37(on a 5-point scale) for this skill (see page 7, this report). * Graduate and employer survey results for are reported with data for ; survey results are not available until 15 months following June graduation. IP0304Science/4

5 2. The aggregate score for the Success Skill Demonstrates Knowledge of Science and the Environment evaluated by employers on a survey will be 3.5 or higher (on a 5-point scale) indicating the employers satisfaction with the preparedness in math of the Hocking College graduate. Data gathered for *: Note: Numbers in parentheses are those recorded for and can be used for comparison. Technology Aggregates for "Demonstrates Knowledge of Science and the Environment" Number of Respondents Accounting Archaeology Associate Individ. Studies Associate Tech. Studies Audio/Video Productions Backcountry Horse Business Management (4.0) (1) Compressed Air & Gas Computer Electronics Computer Programming Culinary Arts (3.0) (1) Drafting & Design (4.0) (1) Ecotour. & Adv. Travel Environmental Rest Fire/EMS Fish Mgt. & Aquaculture (4.0) (1) Forest Management GIS/GPS (3.5) (2) Hotel/Restaurant Mgt. Human Serv. & Correct. (4.7) (3) Industrial Ceramics Juvenile Services (4.0) (1) Materials Engineering Medical Assistant Medical Records - HIM (4.0) (1) Nat. & Hist. Interprt Natural Resources Mgt. Network Systems Nursing, Level I 3.67 (3.4) 6 (5) Nursing, Level II 3.67 (3.6) 9 (15) Nutrition & Dietetics Office Management (5.0) (1) Opticianry Physical Therapy Asst. Police Science Ranger Services 3.00 (3.0) 1 (1) Timber Harvesting Wildlife Management Overall 3.65 (3.7) 20 (33) Criterion 2 continued on next page. IP0304Science/5

6 Criterion 2 continued Analysis of data: The overall aggregate of 3.65 exceeded the goal of 3.5 (on a 5-point scale). The employers rated two technologies below goal as follows: Ecotourism & Adventure Travel and Ranger Services. The overall aggregate of 3.7 exceeded the goal of 3.5 (on a 5-point scale). Out of those two programs, Ranger Services was rated below goal the two previous reporting years. The overall aggregate rating by employers of Hocking College graduates has remained consistent over several years. For Health Sciences, employers for both Nursing Levels I and II. Both were rated above goal at 3.67 (on a 5-point scale). Additionally, the rating for Nursing Level I improved as it was rated below goal the previous reporting year. The rating for Nursing Level II remained about the same. Although responses from employers were few in number, the students seem to be considered to be prepared in science. Does this analysis support conclusions drawn from other assessment data analyzed for ? Please elaborate. During the same time period, Hocking College graduates rated this skill at 3.98 (on a 5-point scale) and seven programs were rated below goal (see pages 3 & 4, this report). During this same time period, practicum supervisors rated Hocking College students from thirteen programs at 4.37(on a 5-point scale) for this skill (see page 7, this report). * Graduate and employer survey results for are reported with data for ; survey results are not available until 15 months following June graduation. IP0304Science/6

7 3. The aggregate score for science skills as evaluated by on-site practicum supervisors will be 3.5 or higher (on a 5-point scale) indicating above average or better performance. Data gathered The information was collected by reviewing the program/technology assessment reports submitted for Note: Numbers in parentheses are those recorded for and can be used for comparison. Technology Aggregate for "Demonstrates Knowledge of Science and the Environment" Number of Evaluations Backcountry Horse 4.70 (4.33) 10 (12) Business Mgt 3.75 (4.22) 16 (9) Computer Programming 4.00 (5.00) 1 (1) Ecotourism & Adv 4.45 (4.80) 12 (35) Fire/EMS Fish Mgt. & Aquaculture (4.46) (3) Forrest Mgt (4.73) 7 (15) GIS/GPS (4.56) (9) Hotel/Restaurant Mgt to 45 Human Serv & Cor* 4.50 (4.50) 46 (46) Medical Records - HIM 4.33 (4.69) 11 (17) Nat. & Hist. Interpret (4.64) 14 (14) Natural Resource Mgt (4.50) 18 (23) Ranger Services 4.30 (4.60) 14 (17) Wildlife Management 4.36 (4.60) 17 to 28 (41) Aggregate 4.37 (4.59) 13 programs (242) *Data extracted from measure using on-site practicum supervisor input. Analysis of data: The overall aggregate of 4.37 for Demonstrates Knowledge of Science & the Environment exceeded the goal of 3.5 (on a 5-point scale). This rating is a little lower than the 4.59 reported the previous year (see each program s report). Not every technology/program requests evaluation of this skill by on-site practicum supervisors. Thus the information is somewhat limited for each science unit. For Health Sciences, data was available for only two programs, Fire/EMS and HIM, and the responding practicum supervisors rated both programs above goal. Does this analysis support conclusions drawn from other assessment data analyzed for ? Please elaborate. During the same time period, Hocking College graduates rated this skill at 3.98 (on a 5-point scale) and seven programs were rated below goal (see this report, pages 3 & 4). During the same time period, twenty employers rated this skill at 3.65 (on a 5-point scale). Overall, the employers rated two programs (Ecotourism & Adventure Travel and Ranger Services) below goal and only one employer had responded for each of those programs (see this report, page 5). IP0304Science/7

8 4. Student enrolled in Anatomy and Physiology I (BIOS 113) will score 3.5 or higher (on a 5-point scale) for each area evaluated on an in-class essay question The areas evaluated include content, grammar, punctuation, and spelling. (Note: This criterion measures Success Skill #1 and # 6, and Program Outcomes # 1 and # 2.) Data gathered for : Sample Size Content Grammar Punctuation Spelling SU FA WN SP Year Analysis of data: Students enrolled in Anatomy and Physiology I who completed the essay question Describe the flow of blood through the heart and explain the functional differences for the right and left sides of the heart scored above goal in each of the four areas evaluated. The data was further reviewed based upon student performance by technology. While the course is required for most of the programs in the School of Health & Nursing (Massage Therapy is the exception), it can also be an elective for students seeking an associated degree in independent studies or technical studies as well as those seeking transfer to other institutions. A limited sample using data from Winter and Spring Quarters was utilized. Program Sample Size Content Grammar Punctuation Spelling AIS Dietetics Fire/EMT Fitness General HIM MA NSG PTA Rad Tech Surg Tech Transfer This analysis revealed that students in each program were evaluated well above the minimum goal during the two quarters for which the data was available by technology. Program change planned for as a result of this analysis: The program will not be changed based upon this analysis. Changes to the rubric were made during Fall Quarter 2003 and implemented during Winter Quarter It is premature to make further changes at this time. We will continue to use the revised rubric for academic year This Criterion will be changed to read as follows in our Plan: This criterion will remain the same. IP0304Science/8