North Dakota State College of Science Annual Review of Assessment Activities Department Reporting Form Academic Year

Transcription

1 North Dakota State College of Science Annual Review of Assessment Activities Department Reporting Form Academic Year Department: Diesel Technology Date: 10/15/2010 Briefly describe the actions that were taken from the recommendations of the Assessment Committee on last year s report: The Diesel Department has revised the COOP evaluation information sheets. The student s time and tasks are more closely evaluated. The information gathered will more accurately account for quality of work in each curriculum area. See - Doc A1 & A2 In the space below, provide the student outcome, the data collected, the conclusions reached and changes or revisions made as a result. This should be a summary of strengths and opportunities for improvement in student learning. STUDENT OUTCOME # 2 : Electrical Students will demonstrate an understanding of electrical principles, component and test equipment operations, as well as troubleshooting and testing of electrical/electronic circuits. What data was collected? Revised Diesel Technology COOP Surveys CAT Think Big Skills & Knowledge Application JD Tech Dealer/Student Evaluations JD Electrical Certification DTEC 155 Pre-test & Post-test Scores What conclusions were reached based on the data collected? Due to the results from previous data collected, improved training aids were placed into the electrical course which has increased the overall electrical scores by 16% in the CAT Dealer Service Program. The trend over the last three years in the John Deere Tech Program has shown a 4% increase in overall class average. 100% of the students exceeded the national average of 80% as set by John Deere. (Doc B1, B2, B3, B4) At this time the Diesel department does not have a means of comparing to a national average score. What changes or revisions are being made based on the data collected? We are currently waiting for a national exit exam from AED (Associated Equipment Distributors) to compare NDSCS Diesel Tech with other Diesel programs in the nation. We have been told that this test is 2-3 years from completion. Are there budget implications that affect curriculum, professional development, equipment, etc.? Not at this time.

2 STUDENT OUTCOME # 5 : Air Conditioning Students will demonstrate an understanding of the operation, service and repair of air conditioning systems. What data was collected? Diesel Technology COOP Survey Results CAT Think Big Skills & Knowledge Application JD Tech Dealer/Student Evaluations Diesel, JD, CAT Air Conditioning Certification TECH 109 Pre-test & Post-test Scores What conclusions were reached based on the data collected? Due to the results from previous data collected, improved training aids were placed into the air conditioning course which has increased the overall A/C scores by 17% in the CAT Dealer Service Program. TECH 109 (Diesel & JD Tech students) pre-test to post-test scores show a 41% increase in student knowledge in the area of air conditioning. What changes or revisions are being made based on the data collected? We are currently waiting for a national exit exam from AED (Associated Equipment Distributors) to compare NDSCS Diesel Tech with other Diesel programs in the nation. We have been told that this test is 2-3 years from completion. Are there budget implications that affect curriculum, professional development, equipment, etc.? None at this time.

3 STUDENT OUTCOME # 7 : Safety Students will demonstrate an understanding of safety as it relates to the Diesel Technology industry. What data was collected? Diesel Technology COOP Survey Results CAT Think Big Skills & Knowledge Application JD Tech Dealer/Student Evaluations Annual Safety Day Forklift Safety Near Miss/Injury Reports What conclusions were reached based on the data collected? The Diesel Department has had no major safety related injury. Minor cuts and scrapes are documented and students are seen in the Health Services. Safety can never be overlooked. We will continue to enhance our safety training at every opportunity. Industry representatives provide on campus training to the students as it relates to the diesel industry. What changes or revisions are being made based on the data collected? We will continue to provide students with ongoing safety training as it relates to our industry. Are there budget implications that affect curriculum, professional development, equipment, etc.? Not at this time.

4 Moving from specific outcomes to examining trends in your program assessment plan as a whole, please answer the following questions: Qualities: 1. What one thing have you learned from this report that will most improve student learning in your program? Trending is much easier with national comparisons. We have identified this in our JD Tech and CAT programs. 2. What is a strength of student learning in your program identified from this review? An increase in our electrical and air conditioning scores. 3. What overall improvement in your program has resulted from assessment efforts? COOP surveys have been revised to provide better assessment information. 4. Describe how students are involved in assessment activities in your department, how they are made aware of the learning outcomes and given feedback on their progress. Students are made aware of the expectations of the program including outcomes upon enrollment and these outcomes are reinforced with the specific performance objectives on each course syllabus. Feedback is given to students on a continuous basis through progress charts and labs. Assessment results are also shared with the students. (Skills USA, CAT ThinkBig, pre-test, post-test, certification results JDAT etc.) Improvement: 5. What, if any, concerns in relationship to student learning did you identify from your review? Not all students were assigned tasks that involved the electrical and air conditioning outcomes. More effort will be placed on collecting graduate survey results. The department recognizes we are currently not a member of an organization that has a means of tracking academic achievement of the Diesel Technology students. 6. What specific steps will you take to address identified concerns or make further improvements? We are researching the possibilities of having the program NATEF certified. (National Automotive Technician Education Foundation) 7. In order to make these improvements, will there be a financial impact? If so, explain. Yes, funds will be needed to reimburse staff for extended COOP visits to collect graduate information. ASE certification will need to be obtained by all staff in the Diesel Department to participate in the NATEF organization. Certification tests have fees associated. These costs will have to be addressed in some manner Change: 8. Based on this year s report, what changes or revisions are you making in your Assessment Plan for next year? (Are outcomes being revised, using different ways to measure, etc.) None at this time.

5 Diesel Technology Assessment: Outcome # 2 Doc A1 Please circle Yes or No and include any comments you may have. Electrical/Electronic Assessment: 1. Does the student demonstrate the ability to test electrical components? Yes or No 2. Does the student demonstrate the ability to test electrical and electronic systems? Yes or No 3. Does the student demonstrate the ability to understand and follow electrical schematics? Yes or No 4. Does the student demonstrate the ability to properly connect and operate the required test equipment? Yes or No 5. Does the student demonstrate an adequate knowledge of electrical and electronic principles necessary for him/her to perform the job? Yes or No _

6 Diesel Technology Assessment: Outcome # 2 Doc A2 Please circle Yes or No and include any comments you may have. Electrical/Electronic Assessment: 1. What is the percentage of time the student/graduate spent working on Electrical/Electronic systems? 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 2. How important is it that the student/graduate knows electrical/electronic systems? Not important somewhat important very important 3. Does the student demonstrate the ability to test electrical components? Yes or No 4. Does the student demonstrate the ability to test electrical and electronic systems? Yes or No 5. Does the student demonstrate the ability to understand and follow electrical schematics? Yes or No

7 6. Does the student demonstrate the ability to properly connect and operate the required test equipment? Yes or No 7. Does the student demonstrate an adequate knowledge of electrical and electronic principles necessary for him/her to perform the job? Yes or No _

8 Individual Student Scores Class Average Certification set by JD JD Tech Electrical/Electronic Certification Scores 2007 Doc B Individual Student Scores Class Average John Deere Average Score 86.26

9 Individual Student Scores Average Class Score Certification score set by JD JD Tech Electrical/Electronic Certification Scores 2008 Doc B Individual Student Scores Average Class Score John Deere Average Score 88.23

10 Individual Student Scores Class Average Score Certification by JD Electrical/Electronic Certification Scores Doc B3 Series1 Series2 Series Average Score 92.16

11 JD Tech JDAT Electrical/Electronic Average Certification Scores Doc B JD Tech JDAT Average Scores Average