Computer Based Assessment & Evaluation ETS Major Field Test (MFT) Business Test. A TPACK Test Administration Professional Development/Training Lesson

Transcription

1 Computer Based Assessment & Evaluation ETS Major Field Test (MFT) Business Test A TPACK Test Administration Professional Development/Training Lesson By Christopher Harrigan November Integrating and Implementing Technology

2 Initial Strategy: Invitation Qualtrics Survey Instrument used to invitations, check for responses or non-responses, send reminders, and thank you letters to Testing Center staff and proctors. Initial invitation contents include a brief introduction, a link to training session, and an advance thank you for your participation.

3 Next Strategy: Online Instruction Introduction About ETS MFT Pre-administration of ETS MFT Administration of ETS MFT Print Video Peer mentoring overview Assessment Survey / Feedback

4 Next Strategy: Peer Mentoring Peer Partner Learning Takes place live in Testing Center Peer Mentor/Trainer Demonstrate administration of ETS MFT Test Observation/review of Peer Trainee Feedback provided for Peer Trainee Peer Trainee Demonstrate administration of ETS MFT Test Evaluation by Peer Mentor/Trainer Feedback provided by Peer Mentor/Trainer

5 Assessment CBAE Online Formative Quizlet Instant Feedback Summative Qualtrics Multiple Choice Immediate» Score» Feedback CBAE Testing Center Summative On-The-Job Training/Evaluation Peer Mentoring/Peer Partner Learning» Observation» Review» Assessment» Feedback

6 Qualtrics Reports Proctors Invitations Responses Reminders Thank you letters Proctor Participants Number of responses Assessment of Proctors Score report Response report Survey Proctors on Lesson Response report Artifacts

7 Artifacts CBAE Testing Center ETS MFT Administration Peer Mentor Peer Mentee Student E-Check-in/E-Check-out report ETS MFT Administration Report Number of College of Business Strategic Management students completed test in CBAE Testing Center with assistance from peer mentor or peer mentee proctor

8 TPACK has definitely influenced development of this lesson and how to effectively integrate and implement technology for professional development and training, even with barriers from the onset of the project. Although the ETS MFT lesson is still in development mode during its implementation, TPACK played a major role in meeting audience, or proctor staff, needs by providing an effective framework for development of a quality lesson in various formats, and making it conveniently available online and on-the-job due to proctor staff work/class schedule constraints. In addition, as a result of using TPACK in the development of this ETS Major Field Test lesson plan, implementation of this lesson has actually generated positive learning outcomes since nearly every Test Center proctor who completed training has been able to successfully administer the ETS MFT to students without any assistance from a peer mentor. Lesson Reflection Discuss your thought process in the development of this lesson. After learning about TPACK how has this knowledge influenced the way you developed this lesson? Project planning, analysis, design, development, integration and implementation of administering the ETS Major Field Test (MFT) in the CBAE Testing Center, including its training /professional development program, started with a short timeline, including barriers from the start and throughout its progression. The training program/lesson consists of an online independent learning module, in addition to on-the-job training with a peer partner mentoring/learning component. Given Test Center proctors time constraints due to work/class schedules, to date a majority of training has been successfully conducted on the job via peer partner mentoring /learning, while some Test Center proctors have utilized the online training module, and presently initial learning outcomes have been effective although the online lesson continues to be a work-in-progress.

9 Lesson Reflection How is the development of your planning with the use of technology changed in terms of how you integrate technology into your classroom/training session/professional development program? Development of planning with the use of technology has definitely changed in terms of integrating technology into a professional development/training program through a whole new awareness and effective use of instructional technology resources, such as the TPACK framework, the SAMR model, ADDIE, instructional design techniques, various learning theories, and other educational models. An awareness and knowledge of these resources are significant in the development process, including effective methods of successfully applying these resources to a learning environment. These and/or other educational resources combined, and tools on how to apply these resources, allow for effective planning with the use of technology in a learning environment.

10 Lesson Reflection How do you measure the impact that technology has on your student learning? Measuring impact of technology on student learning for the ETS MFT Lesson will be based on review and analysis of the following: Access Lesson Data Online modules Number of times accessing learning materials Time spent on learning materials Assessment Data Quantitative and qualitative results of Peer Partner Mentoring/Learning observation/assessment Quantitative results of online multiple choice quiz Item analysis