AUTHENTIC ASSESSMENT STRATEGIES FOR ONLINE LEARNING

Transcription

1 AUTHENTIC ASSESSMENT STRATEGIES FOR ONLINE LEARNING Denise Lowe University of Central Florida 1 AFTER PARTICIPATING IN THIS WEBCAST. You will be able to align assessments with learning activities and outcomes in an online environment. 2 Academic Impressions 1

2 AGENDA Student Integrity Faculty Methodology Authentic Assessment Cognitive Load Anatomy of a Test Item LMS Assessment Tool Options 3 Do you expect technology to compensate for a lack of ethics? Charles Dzuiban, PhD, RITE, UCF STUDENT INTEGRITY 4 Academic Impressions 2

3 STUDENT INTEGRITY Cheating is being redefined. Helping 5 25% 6 Academic Impressions 3

4 TOP 5 WAYS STUDENTS CHEAT WITH TECHNOLOGY FORD, C. (2009) ACADEMICS, SPECIAL REPORT: RNING.COM/CATEGORY/SPECIAL-REPORT 7 STUDENT INTEGRITY No magical way to prevent cheating Cheating occurs in all educational modalities No such thing as a closed book assessment in online courses 8 Academic Impressions 4

5 Using a learning taxonomy as a guide FACULTY METHODOLOGY 9 Bloom s Taxonomy 10 Academic Impressions 5

6 Traditional Alternative 11 Bloom s Taxonomy 12 Academic Impressions 6

7 , not control is the goal 13 How is the issue of academic integrity being handled at your institution? 14 Academic Impressions 7

8 Using other assessment strategies AUTHENTIC ASSESSMENT Academic Impressions 8

9 Interpretations Quote applied to different eras, economies, countries, etc. October 7, 2008 "...I think it [health care] should be a right for every American. In a country as wealthy as ours March 2, 1943 National compulsory insurance for all classes for all purposes from the cradle to the grave. 17 Different messages in time and modality with similar meanings 18 Academic Impressions 9

10 Pictorials and Audio Using photographs, drawings, schematics, artwork, or musical clips 19 Using hot spots to edit a technical document 20 Academic Impressions 10

11 Medicine Simulations, Role Play, Games Theater 21 Social Work Home Studies, Real-World Events Political Science 22 Academic Impressions 11

12 Collaboration Use problem-based learning as a group project with a specific challenge to address 23 Socratic Dialogue Small group discussions Buzz groups Case discussions Debate Jigsaw groups Mock trials 24 Academic Impressions 12

13 Assessment Construction 25 Critical Thinking Assessment Construction Relevant Transfer of Knowledge 26 Academic Impressions 13

14 What is the acceptance level among faculty for using alternative assessments at your institution? 27 What factor seems to mostly affect the adoption of alternative assignments in online courses? 28 Academic Impressions 14

15 What is it and how does it effect my assessment strategy? COGNITIVE LOAD 29 Cognitive Load 30 Academic Impressions 15

16 Types of Cognitive Load 31 Magic #7 32 Academic Impressions 16

17 33 Overload? 34 Academic Impressions 17

18 Higher Complexity Impact? Less Items Needed 35 Examples of effective test questions ANATOMY OF A TEST ITEM 36 Academic Impressions 18

19 Anatomy of Test Item Keep it simple: Only include relevant information in the question stem Add common words to stem instead of in each alternative 37 Anatomy of Test Item Limit the use of: Negatives (e.g., Not, Except) Distractors (All or None of the Above) Put alternatives in a logical order Include the same number of alternatives for each item 38 Academic Impressions 19

20 True / False: #1 Test Objective: Identify how the issue of slavery impacted the Civil War and American society at that time. One of the causes of the Civil War were differences concerning the elimination of slavery. This is simple recall of information, yes/no answer. 39 Test Objective: Identify how the issue of slavery impacted the Civil War and American society at that time. Improved The type of individual that would support abolitionism would likely be a rural farmer or capitalist. This requires an understanding of the concept of abolitionism and its impact on the lives & livelihood of societal members. 40 Academic Impressions 20

21 Multiple Choice #1 When differentiating between a supervisor and a leader, it is best to remember that a leader: a. Is a person who has commanding authority or influence b. Is at the forefront of a movement c. Is tending toward a definite result d. All of the above* Requires knowledge recall, no concept understanding 41 Improved As the overseer of a major retail department store, Jennifer received a directive to increase departmental profits. She implements a change in procedures, but this has never been tried before. The leadership trait she is mostly demonstrating is: a. Commanding authority or influence b. Using existing policies to address an issue c. Taking initiative by setting a new precedent* d. Discussing the concerns of superiors with her staff Requires differentiation of traits and knowledge application 42 Academic Impressions 21

22 Multiple Choice #2 As discussed in the lecture notes, the three power bases are: a. Knowledge, educational, and textbook b. Positional, personal, and knowledge* c. Educational, experiential, and practical Requires knowledge recall only, no concept relationships 43 Improved Jack works for IBM as a computer programmer. He is known for his multi-colored hair styles, casual dress, and body piercings. Jack is a talented programmer who works well with his peers. Jack s style is expressed through which power base? a. Knowledge b. Personal* c. Positional d. Educational Requires knowledge application and concept understanding 44 Academic Impressions 22

23 Multiple Choice #3 Being proactive as a leader, as defined by Covey, is to: a. Take responsibility for the course of our lives* b. Prioritize c. Creatively cooperate with others d. All of the above Requires knowledge recall, no understanding of the individual concepts 45 Improved Sandy has experienced conflict with a co-worker for some time. She has complained of her situation to her peers. After learning about Covey s 7 Habits, she decides on a proactive approach - taking responsibility for her actions. Which of the following actions best reflects that position? a. Speaks directly with her co-worker to resolve the issue* b. Blames her co-worker for creating the conflict c. Signs up for a team project with her co-worker d. Files a complaint against her co-worker with their supervisor Requires knowledge application, concept relationship 46 Academic Impressions 23

24 Multiple Choice #4 Ribosomes are important for: a) the nucleus b) DNA c) Cellulose d) Protein synthesis* Knowledge recall - Must know what ribosomes are. 47 Improved Suppose you thoroughly and adequately examined a particular type of cell, using the transmission electronic microscope, and discovered that it completely lacked ribosomes. You would then conclude that this cell also lacked: a) A nucleus b) DNA c) Cellulose d) Protein synthesis* Knowledge application - must know the relationship between ribosomes and cells. 48 Academic Impressions 24

25 Multiple Choice #5 Which of the following is a category in the taxonomy of the cognitive domain? a. Reasoning ability b. Critical thinking c. Rote learning d. All of the above e. None of the above* Only asks for simple identification of a category; contains all of the above and none of the above as option choices, which should be avoided, if possible. (recall) 49 Improved What is the most complex level in the taxonomy of the cognitive domain? a. Knowledge b. Synthesis c. Evaluation* d. Analysis e. Comprehension This item asks for differentiation between levels. (comprehension) 50 Academic Impressions 25

26 Which tool options should I use.and why? LMS ASSESSMENT TOOL OPTIONS 51 Randomization LMS Assessment Tool 52 Academic Impressions 26

27 Assessment time limits LMS Assessment Tool 53 LMS Assessment Tool Rules for assessment completion Proctoring 54 Academic Impressions 27

28 What type of faculty development is offered at your institution to encourage authentic assessment? 55 Resources Available Faculty Seminars in Online Teaching Socratic Dialogue Teaching Online Pedagogical Repository 56 Academic Impressions 28

29 Questions, Comments, Feedback Dr. Denise Lowe Instructional Design Team Lead University of Central Florida THANK YOU! Please remember to complete the event evaluation. You comments will help us continually improve the quality of our programs. Follow us: 58 Academic Impressions 29