Presented by: Kimberly Tynes, Ph.D.

Transcription

1 Presented by: Kimberly Tynes, Ph.D.

2 Prep Course Execution CTE 2001 CPAS Prep This course will focus on four major areas: Reading Strategies, Understanding Key Testing Terms, Reading diagrams and an extensive review of the CPAS course blueprint. Began course in Spring 2012 Three ways of conducting the CTE 2001 CPAS Prep Course: 1. In-person class utilizing ExamView LAN testing software 2. Online class utilizing CANVAS 3. In-person class utilizing CANVAS CD will be provided at the end of this presentation. Contents of the CD will be discussed and instructions are outlined within this presentation.

3 Course SUCCESS Fall 2012 Stats 24 out of 29 of our students successfully passed the CPAS assessment 8 out of 9 of our CTE programs passed CPAS 6 of our programs had a 100% passage rate Fall 2013 Stats 15 out of 20 students successfully passed the CPAS assessment 14 out of the 15 students scored 70% or above 3 programs had a 100% passage rate

4 Course SUCCESS Continued Spring 2013 Stats Highest individual CPAS score on record for SMCC 98% (2012 highest score was 93%) 18 students scored 80% or higher (13 in 2012) 7 students scored 90% or higher (1 in 2012) 7 programs had a mean average 60% (6 programs in 2012) 2 programs had a 100% passage rate (1 program in 2012) 58% of the total students passed the CPAS in Spring 2013 with a 60% or higher (48% in 2012and only 36% in 2010) The mean average of all tested programs combined was 61.4%

5 Course SUCCESS Continued Spring 2014 Stats Highest individual score is a 100% (Early Childhood Education Technology student). This is the highest individual CPAS score on record for SMCC. 47 students (59%) of the total students passed the CPAS this Spring with a 60% or higher 32 students made a 70% or higher 10 students made an 80% or higher 4 students made a 90% or higher Early Childhood Education Technology--100% passage rate two years in a row Heating and Air Conditioning Highest individual score on record: 90% Electrical Technology Highest individual score on record: 90% 7 programs have a mean average of 60% or higher The mean average of all tested programs combined is a passing 61.92%

6 Survey Results Fall 2012 Student survey results (N=29) Fall % completed surveys, N=29 69% agreed that the Prep Course were related to material covered in program area, 24% neutral. 59% agreed that the CPAS assessment was related to material covered in program area, 34% neutral. 62% agreed that the Prep Course made them feel more comfortable and relaxed during CPAS assessment, 24% neutral. 79% agreed that the Prep Course helped improve overall performance on CPAS assessment, 17% neutral. 97% agreed that they would recommend future students to take the CPAS Prep Course, 3% neutral. Comments included: The only improvements I would like to see is more time on practice test such as two days a week if possible. But everything else works great. and my personal favorite free food and drinks

7 Survey Results Continued Spring 2013 only 68% completed surveys, N=73 67% agreed that the Prep Course were related to material covered in program area, 22% neutral. 63% agreed that the CPAS assessment was related to material covered in program area, 29% neutral. 53% agreed that the Prep Course made them feel more comfortable and relaxed during CPAS assessment, 33% neutral. 53% agreed that the Prep Course helped improve overall performance on CPAS assessment, 29% neutral. 67% agreed that they would recommend future students to take the CPAS Prep Course, 21% neutral. Comments included: I think they should use more pictures on the test, study guide information, and my personal favorite, I hope me and my class done very well on it

8 Survey Results Continued Fall 2013 Student survey results (N=29) Fall % completed surveys, N=22 73% agreed that the Prep Course were related to material covered in program area, 9% neutral. 59% agreed that the CPAS assessment was related to material covered in program area, 9% neutral. 55% agreed that the Prep Course made them feel more comfortable and relaxed during CPAS assessment, 23% neutral. 55% agreed that the Prep Course helped improve overall performance on CPAS assessment, 18% neutral. 64% agreed that they would recommend future students to take the CPAS Prep Course, 18% neutral. NEW Question 32% stated they have taken remedial course(s) and 57% agreed that the remedial course(s) helped them succeed in their program of study, 43% neutral. Comments included: I think a big improvement for the cpas test will be to get a hands on study guide so that we can actually study it off campus. I believe that this will improve alot of test scores., Print outs of the practice test so student may go home and study.

9 Survey Results Continued ONLINE course started in Spring 2013 ONLINE Student results for Spring 2013/Fall % completed survey, N=4 (3 students Spring 2013, 1 Fall 2013) 50% agreed that the Online Prep Course were related to material covered in program area, 0% neutral. 50% agreed that the CPAS assessment was related to material covered in program area, 0% neutral. 50% agreed that the Online Prep Course made them feel more comfortable and relaxed during CPAS assessment, 0% neutral. 25% agreed that the Online Prep Course helped improve overall performance on CPAS assessment, 25% neutral. 0% agreed that they would recommend future students to take the Online CPAS Prep Course, 50% neutral. 2 students passed with scores greater than 70% No comments were left by online students Spring 2014 Results total students that will be tested=103, including 6 online students.

10 Survey Results Continued Spring 2014 Student survey results (N=82) Spring % completed surveys, N=82 63% agreed that the Prep Course were related to material covered in program area, 23% neutral. 65% agreed that the CPAS assessment was related to material covered in program area, 28% neutral. 61% agreed that the Prep Course made them feel more comfortable and relaxed during CPAS assessment, 27% neutral. 63% agreed that the Prep Course helped improve overall performance on CPAS assessment, 33% neutral. 73% agreed that they would recommend future students to take the CPAS Prep Course, 21% neutral. NEW Question 9% stated they have taken remedial course(s) and 40% agreed that the remedial course(s) helped them succeed in their program of study, 27% neutral. Comments included: To be able to print out to the CPAS questions to be able to look over them before taking the overall test, Study the code book more.

11 Survey Results Continued Spring 2014 ONLINE Student results ONLINE Student results (much more positive than last group of online students) 67% completed survey. N=4 75% agreed that the Online Prep Course were related to material covered in program area, 25% neutral. 75% agreed that the CPAS assessment was related to material covered in program area, 25% neutral. 75% agreed that the Online Prep Course made them feel more comfortable and relaxed during CPAS assessment, 0% neutral. 75% agreed that the Online Prep Course helped improve overall performance on CPAS assessment, 25% neutral. 75% agreed that they would recommend future students to take the Online CPAS Prep Course, 0% neutral. No comments were left by online students

12 Soldier Comments We are very proud of the hard work that each of our faculty have put into preparation of this assessment. It is a true indication of the commitment and dedication our instructors have for our students as we strive to offer the best programs in the state. (Jeremy Smith, VP of SMCC-CTE) Since the course, test scores have improved. Students appear to be more comfortable using the computer to complete the test. (Aurelia Gayden, Counselor/CPAS Test Proctor, SMCC) CPAS preparation has given our students an excellent opportunity to improve CPAS scores. It has provided practice in testing taking and allowed the students to review their studies throughout the program. It has improved final scores. (Carol Ann McMorris, Early Childhood Technology Instructor, SMCC)

13 Soldier Comments Cont d Collectively my student s scores on the CPAS test have increased since the CTE 2001 CPAS Prep Course was added. In addition their scores have increased on classroom administered test thereby helping the HRAC program achieve a higher rate of student completion. (Michael Kyzar, Heating and Air Conditioning Instructor, SMCC) My students have done so much better on CPAS after going to the CPAS Review. We had one student score 98% and she said that the CPAS review helped her so much, because while taking the tests each week, she realized what she needed to go back and review before the real CPAS later in the year. (Kim Burkett, Early Childhood Technology Instructor, SMCC)

14 Soldier Comments Cont d The CTE 2001 PREP course has been a huge help to the Automotive program by helping prepare students for the CPAS. They must apply what they have learned in the shop back to a written test and handson. This course has also helped me as an instructor to realize areas that we should go back and spend more time on to help the students have a better understanding of the material. (Josh Troxler, Automotive Technology Instructor, SMCC) One main point of practicing the CPAS test is that it teaches the students to carefully read the questions before answering, and helps them learn how to take a test. The other aspect is that it helps them realize how much information they do not know and has given them more of an incentive to study the workbooks in class. (Joe Cornacchione, Residential Carpentry Instructor, SMCC)

15 Soldier Comments Cont d I feel that the CTE 2001 CPAS Prep course has had a positive impact on me, our program, and our students in the following ways: Students are made aware, through practice test, of the possible content for CPAS testing. They no longer have to go in blind-sided not knowing what to expect on the day of CPAS testing. Students test scores are improved due to the fact that they have to attend focused CPAS prep test sessions. By making it a requirement and a credit, students take the CPAS Assessment seriously and do try to do their very best on it. This helps to improve our state scores. If other community colleges are not already requiring this as one of their program requirements, I would highly recommend them implementing this type of requirement into their curriculum. (Kathy Boyte, Business & Office Related Technology Instructor, SMCC)

16 Soldier Comments Cont d CTE 2001 has afforded my students in the Business & Marketing Management program an opportunity to better prepare for our state mandated CPAS exam. The students have become more comfortable with testing on the computers and familiarizing themselves with the atmosphere and conditions which they will experience sitting for their actual CPAS exam. As an instructor, I feel the CPAS prep course provides a wonderful platform and opportunity for me to present a review of my program s state competencies to my students! I am also able to track my students efforts; including viewing their scores and the time they spend taking each test. I can use this information to motivate and encourage my students to learn something from each practice test in order to improve their test score each week; whether it s to read the questions more thoroughly, spend more time taking the test or familiarizing themselves with material that they did not remember. As a result, most of my students challenge themselves to improve their test score each week; therefore, improving their odds of performing better on their actual CPAS exam. (Deanna Martin, Marketing Management Technology Instructor, SMCC)

17 Soldier Comments Cont d The CPAS Prep Course has helped changed my attitude about CPAS which in turn has created a positive attitude and learning environment for my students. Our attitude and behaviors trickle down to our students. (Brad Van Norman, Electrical Technology Instructor, SMCC) It s the best thing that s every happened at Southwest, getting students to practice what they ve learned through tests. They practice what they ve learned a year and a half ago, which will help increase their scores. (Danny Esch, Diesel Equipment Technology Instructor, SMCC) The biggest way CPAS Prep has affected my classes is that my students are not afraid of the test. They used to be intimidated by the test. Now they are relaxed because they practice once a week. As a matter of fact, they get competitive and that s a good thing. (Phil Evans, Welding and Cutting Instructor, SMCC)

18 Contents of CD When you insert CD, it will auto run an executable menu with the following items available from that menu. CTE 2001-CPAS Prep Course Information Folder ExamView Information Folder Software Folder Presentations Folder SMART Sync Information Folder Evaluation Version 30 Day Folder Test Files Per Program Area Folder The Online Environment Folder Online Test Files Per Program Area Folder

19 CTE 2001-CPAS Prep Course Folder CPAS Computer Instructions for Students Word Document Step-by-step pictorial guide for students to complete practice assessments CPAS Gradebook Excel document that contains a pre-calculated grading system for the CTE 2001 CPAS Prep Course First column provides space for student names per program area 12 additional columns for each test score One column (in red) to place actual CPAS score at end of the semester and students averages at bottom of each program area Grade automatically generated based upon 50% completion of practice assessments + 50% completion of MS-CPAS2 Assessment CPAS Review Schedule Excel Document to place on door CTE 2001 CPAS Prep Course Syllabus Word Document/PDF

20 ExamView Information Folder Software Folder ExamView 6.2 OLD Version Contains executable version of the software. This software is useful if you are accessing your server remotely because it allows easy-access of folder location ExamView 7.5 NEW Version Contains the installation files for installing ExamView Instructor version and the ExamView Player software for the client/student computers. Also contains a user-friendly, 95-page ExamView Manual (PDF file). ExamView Player Executable Program Folder Contains 4 executable files that can be placed on a server and accessed by students without installing the ExamView Player on each client computer.

21 Presentations Folder Contains the following PowerPoint Presentations: 2010 How To Use ExamView (PPT) Presentation on the ExamView Assessment Suite Version 6.2 including how to use the Test Generator, Test Manager, Test Player, Viewing Test Results, and the Import Utility (applicable to 7.5) 2010 KTynes Dissertation PDF document (Research Data) 2012 CPAS Presentation (PPT) Presentation on the longitudinal study conducted in 2010 that led to the current creation of the CTE 2001 CPAS Prep Course. Additional information on how the ExamView Assessment Suite 7.5 has been utilized to effectively administer the testing sessions for the course SMART Sync software introduced as a secondary lab monitoring tool for the CPAS Prep Course 2014 CPAS Survival Boot Camp (PPT) A copy of this presentation has been placed on the CD

22 SMART Sync Information Folder Evaluation Version 30 Day Folder Contains four installation files for a 30-day trial version: 1. SMART Sync Teacher Setup Windows version 2. SMART Sync Student Setup Windows version 3. SMART Sync Teacher Setup MAC version 4. SMART Sync Student Setup MAC version Regedit Instructions (.txt file) Simple text file containing instructions to setup one student computer in desired configuration (such as auto-connect to instructor, not allowing students to disconnect, etc.) and then to be copied to all additional installations. SMART Sync Fact Sheet PDF file SMART Sync User Manual 110-Page PDF File SMART Sync Presentation Video Basic How-to in 6.5 minutes

23 Test Files Per Program Area Folder ATT Automotive Technology BOT Business and Office Related Technology Department CAV Residential Carpentry CDT Early Childhood Technology DET Diesel Equipment Technology ELT Electrical Technology HVAC Heating and Air Conditioning IST Computer Networking MMT Marketing Management Technology PPT Process Operations Technology WLV Welding and Cutting

24 Test Files Folder Continued Each program folder contains the following information: Test Files Folder contains the ExamView test files (.tst) along with the ExamView test banks (.bnk) 12 ExamView Online Test files (.eot) that the students will access The 4 executable files that are accessed by students without installing the ExamView Player on each client computer. Students will simply open his/her program folder then double-click ExamView Player.exe CPAS Review Class Roster A Sample ExamView Class file (.cls) that displays sample student information and sample setup of the 12 practice online test files TIP: Select all test files except ExamView Player.exe, rightclick and change to Hidden. Helps eliminate confusion for students accessing the practice tests.

25 The Online Environment Folder Online Test Files Per Program Area Folder Contains folders for each program area previously listed. Each folder contains six compressed test files (.zip) These are the same six test files utilized in the in-person course CTE 2001 CPAS Prep Online Syllabus Document Final Exam Information Document Instructions for Students Document Resume Project Document

26 In-Person Class Software ExamView Assessment Suite Testing Software FREE Smart Sync Classroom Management Software Approximately $1800 for 12 instructor computers and unlimited students

27 In-Person Class Server/LAN Setup One regular classroom computer needed with any flavor of server software installed One shared folder setup with the following access for students and full access for you: Root folder will propagate the same rights to any folder within If you decide to run the ExamView Player from the server instead of installing on all client computers, place the four executable files in same folder(s) as the online test files (.eot).

28 Server/LAN Setup Continued Server setup advantage: Internet connection not needed Student access: Open your shared folder on client computer. Click and drag to make shortcut on desktop. Or click start, run, and type in \\servername and press enter.

29 Canvas Setup To create tests for CANVAS in ExamView, export each test file as a WebCT CE 6/VISTA 4 compressed file format

30 Canvas Setup Continued Within CANVAS, go to Settings. Select Import Content into this Course on the right. Select QTI.zip file from the Content Type list. Click Browse to locate your zip file Click Import

31 Canvas Setup Continued You have two ways to administer the test. 1. With total questions you imported or 2. Select Quizzes Create a New Quiz. Select Questions tab. Click New Question Group. Select the Link to a Question Bank option. Select your test from the list. (NOTE: upon initial import, test has no name. Now you have option to select amount of questions and as a random block. You can go to Manage Course Question Banks to rename each bank as you import them. Don t forget to PUBLISH quiz in Canvas

32 Canvas Setup Continued Easy way to keep up with grades. Change Quiz Type to Practice Quiz. Select Allow Multiple Attempts. Practice Quizzes will not be added to your gradebook; therefore, if you have students from multiple programs enrolled in your online course, you will not have test columns for each program area visible to all students. Plus, the gradebook is more manageable for you. To view student results, select Quizzes, select a quiz, select to show student quiz results on the right. Attempts are shown as total points.

33 Canvas Setup Continued Within Assignments, items are weighted in three categories: Resume Project, CPAS Test, Participation Practice Tests. Select Add Assignment Group to create groups. On the right in Canvas, you can assign weights per group area. Students are required to have their school s test proctor fax/ me official CPAS scores.

34 Additional Uses for Test Files If you prefer paper tests, you can print out any of those ExamView test files (.tst) as long as the ExamView Assessment Suite is installed on your computer You can export those test files as rich text files (.rtf) and open them in Microsoft Word if you prefer this method You can utilize the Online Test Files, export to CANVAS and utilize CANVAS in your in-person courses instead of the ExamView Test Player/LAN setup.

35 Future Survival Tips Limit all interactive test files to 50 questions. Students react better to questions instead of Student averages increase and they tend to retake tests more often when they can do so in shorter time spans. Work with the students!! Positive reinforcement!! Communication is the key to successful passage rates Utilize student and instructor feedback Online course still a work in progress Remember the test files provided are a work in progress and should be updated on a continuous basis!!! CD TIP: If you do not have admin rights on your office computer, you will need to copy the ExamView test files to your computer before you can open them. CPAS Prep will always be a work in progress. If it helps at least one student, it is worth it!

36 Presented by: Kimberly Tynes, Ph.D. Instructor, Southwest Mississippi Community College