1 ASKING MORE EFFECIVE QUESTIONS William F. McComas and Linda Abraham Rossier School of Education Introduction From the development of the Socratic method, to the 1860 edition of Barnard s American Journal of Instruction that states, to question well is to teach well, educators have long known that questioning is a useful way to aid in the transfer of knowledge from instructor to pupil (Ross, 1860). Over the past 100 years, multiple U.S.-based studies have focused on the use of questioning as a successful and universal pedagogical approach. Yet despite these studies and their findings, not much has changed in terms of the manner in which teachers ask questions. Leven and Long found that teachers in 1912 spent approximately eighty percent of the school day asking questions a statistic that was replicated by their study of classroom teachers and their use of questioning in the 1980s (Leven and Long, 1981). And Wilen s work shows that the vast majority of questions asked by teachers are low-level cognitive questions that require students to focus on the memorization and recall of factual information rather than questions which foster deeper student understanding (1991). Questioning plays a critical role in the way instructors structure the class environment, organize the content of the course and has deep implications in the way that students assimilate the information that is presented and discussed in class. Given that questioning can be a tremendously effective way to teach, and recognizing that teachers are willing to engage in the process of asking questions while instructing (Leven and Long s research shows that the typical teacher asks between questions per day), the purpose of this paper is to articulate a taxonomy of questions that will help instructors to recognize how to more effectively use questioning as a pedagogical strategy (1981). A Taxonomy of Question Types Multiple approaches to classifying questions exist in the education literature. In fact, according to William Wilen, one study which reviewed classification systems for classroom questions found over 21 systems in place in 1974, with many more appearing since then (1991). The taxonomy presented below is based on the research of William W. Wilen, and informed by the work of Angelo V. Ciardiello, both of whom have published extensively on best practices in questioning skills. Wilen s simplified classification system is based on the taxonomy presented by Gallagher and Aschner s research from 1963 and takes into account the Bloom s categories of learning (1956) (See Appendix A). The taxonomy presented separates questions into four quadrants with paired criteria: Questions can be either high or low order, and can be either convergent or divergent in their design. A low order question is one that requires the student to simply recall a single fact, while a high order question asks the students to recall facts but to show that they comprehend the topic, situation or solution to a stated problem. A high order question will require that a student understand the relationship between a fact or piece of knowledge within the greater context of the situation.
2 2 Comparing Low and High Order questions: Low order: What color is the lion in that diorama? This question checks a student s ability to recognize color and identify the color. There is a very narrow range of possible answers (tan, light yellow, fawn) High order question: Why do you suppose the lion is that color? This question allows the student to recognize and identify color, but then asks the student to consider the relationship of the lion s color to other things (its environment, other lions, other species of animal, its place on the foodchain) The descriptor convergent refers to the limits placed on the response to a given question. A convergent question by its nature has a more narrowly defined correct answer the answer is generally short, requires little reflection and requires that the responded recall from memory a bit of factual information. Convergent questions may also be referred to as closed-ended questions, meaning that the instructor is looking for an anticipated response that requires little original thought on the student s part. Convergent questions will not require students to put original thought to the development of an answer. In other words, the answer will have been provided within the context of the lecture or readings assigned by the instructor. A divergent question on the other hand, is open-ended by nature. To respond to a divergent question, a student must be able to recall some information from memory, but must apply that knowledge and other knowledge to explain, extrapolate or further analyze a topic, situation or problem. Divergent questions are broader in nature, can have multiple answers, and require then a higher level of thinking on behalf of the student. Comparing Convergent and Divergent questions: Convergent: What other animals can you think of that use color as camouflage? This question checks a student s ability to identify what role camouflage and animal coloration play in nature and suggest other examples. (The responses are fairly easily anticipated and require that students recall other examples of animals they have seen or studied). Divergent: Suppose the lion had been born with a much darker colored coat, what do you predict would happen to that lion in the wild? This question allows the student to consider a scenario, use knowledge regarding camouflage, coat coloration and the environment the animal lives in to create an original answer that is logical and correct.
3 3 Lower Level Convergent Emphasis What is required of the student? What Cognitive Operations are involved? What typifies these questions? Signal Phrases Example Aligned to Bloom s taxonomy of learning Pros Cons Memorization, recall, rote drilling Recall or recognize information (identify or name, quote or define). Call for the transfer of information in predictable ways. Questions at this level will determine if students can organize and select facts as well as state the main ideas. Answers are easily anticipated by the teacher and are often closed requiring a yes or no answer. Questions found at the back of the textbook chapter are typically low-level convergent questions. Who, what, where, when According to our study of plant physiology, what conditions are required for photosynthesis to occur? Knowledge level Easy to develop questions and to anticipate student responses, so directing class discussion becomes routine. Helps identify students with large deficits in general knowledge. Least effective method for enhancing knowledge transfer. Students who respond correctly may have memorized material but without understanding it. Higher Level Convergent Emphasis What is required of the student? What Cognitive Operations are involved? What typifies these questions? Signal Phrases Example Aligned to Bloom s taxonomy of learning Pros Cons Reasoning and critical thinking which usually requires some direction from the instructor Demonstration of understanding and ability to apply the information (students describe, compare, contrast, rephrase, summarize, explain, translate, interpret or provide an example). Explaining, stating relationships, comparing and contrasting Students will look for evidence to support their response, and may break ideas, situations or events down into their component parts Why, how and in what ways In what way do plant cells differ from animal cells? Comprehension and application levels Helps students to make connections between facts and begin to understand relationships. Fosters critical thinking and skills such as comparing and contrasting. Can lead to digressions in lesson plan, answers are longer and more elaborate and may not be easily anticipated by teacher.
4 4 Lower Level Divergent Emphasis What is required of the student? What Cognitive Operations are involved? What typifies these questions? Signal Phrases Example Aligned to Bloom s taxonomy of learning Pros Cons Synthesis of information and analysis of information to develop response. Think critically about information, ideas, opinions. Students discover motives, reasons or causes, draw conclusions, inferences or generalizations. Hypothesizing, reconstructing Questions that ask students to think of alternative ways of doing something, or require them to synthesize a number of elements to create an original idea. How could, What are some possible consequences, Imagine How might life be different if peace was declared in the middle east? Analysis level Focuses on critical thinking skills and allows for in-depth student discussions. May lead to more student-generated questions and conversations thus engaging the learner at a deeper level. More difficult for teachers to determine in what direction the lesson might be drawn. Requires more pre-planning, energy and effort on behalf of the instructor. Higher Level Divergent Emphasis What is required of the student? What Cognitive Operations are involved? What typifies these questions? Signal Phrases Example Motivate students to higher levels of thinking and encourage creative thinking Students produce original communications, make predictions, propose solutions, create, solve lifelike problems, speculate, construct, devise, synthesize, develop/judge ideas, problems solutions, express opinions, and make choices and decisions. Predicting, inferring, performs original, creative and evaluative thinking Teachers are required to think of the content they are presenting I different ways by creating different contexts for learning the material. Defend, Judge, Predict, If then, Can you create, What is your opinion Suppose you are the President of USC. How would you devise a plan to increase the retention rate of minority first-year students?
5 5 Aligned to Bloom s taxonomy of learning Pros Cons Synthesis & Evaluation Levels Stimulate knowledge-seeking and hypothesis generation. Difficult and more energy intensive. Teacher must challenge his or her own way of thinking and encourage the learner to as well. More difficult to assign grades as the responses to these questions may be highly original or personal. Another way to classify or evaluate the level of questioning in a classroom can be illustrated by Christenbury and Kelly s model of the Questioning Circle. The three intersecting circles represent domains of cognition, and rather than presenting a hierarchical approach to classifying questions, they present an overlapping model with a high degree of flexibility. To Christenbury and Kelly, the three circles each represent a different aspect of reality: (1) the Matter the subject of discussion (issue, problem, topic), (2) the Personal Reality the student s relationship with the subject, and (3) the External Reality the broader perspective of the subject. According to the Christenbury-Kelly model, the most significant questions are higher-order and are developed from areas where the circles overlap (Wilen 1991, Christenbury and Kelly, 1983). Bringing the student s personal perspective into the questioning schema begins to introduce a constructivist view towards question generation. The Matter The Personal Reality The External Reality Following are sample questions representing the circles and their interactions from one incident in Huckleberry Finn: 1. The Matter What does Huck say when he decides not to turn Jim in to the authorities? 2. Personal Reality When would you support a friend when everyone else thought he or she was wrong? 3. External Reality What was the responsibility of persons finding runaway slaves? 4. The Matter/Personal Reality In what situations might someone be less than willing to take the consequences of his or her actions? 5. Personal Reality/External Reality Given the social and political circumstances, to what extent would you have done as Huck did? 6. The Matter/External Reality What were the issues during the time which caused both Huck s and Jim s actions to be viewed as wrong? 7. The Matter/Personal Reality/External Reality When is it right to go against social and/or political structures of the time as Huck did when he refused to turn Jim into the authorities? (Christenbury and Kelly, 1983)
6 6 Research shows that only 5% of teacher directed questions are higher-order divergent (Wilen, 1987). While the taxonomy above articulates a wide breadth of question types and while teachers know that asking multiple types of questions is good pedagogy, the research indicates that teachers consistently revert to asking lower level convergent questions far more often that any other type of question. The following table illustrates a number of studies that sought to determine the number of higher-order or divergent questions teachers asked compared to lowerorder convergent questions. The studies are summarized in Questioning Skills, for Teachers by W. Wilen (1991). The results of each study illustrate the magnitude of the problem we face in using questions well. Study % higher order % lower order % operational Haynes (1935) Floyd (1960) 6 42 Davis & Hunkins (1966) 90 Trachtenberg (1974) 95 Gall (1987) Wilen (1991) 5 Study after study reveals that although educators know that the higher-order divergent questions hold significantly more power to engage the learner and ensure transfer of knowledge, we consistently retreat to using lower-order, convergent style questions when teaching and testing students. Techniques for Asking More Effective Questions The first step in asking better questions is to identify the types of questions we are currently asking, why we are asking them, and finally, what techniques can we utilize to improve the questioning that occurs in our classrooms. Questions help teachers fulfill multiple agendas in the classroom. Questions are used to help teachers ascertain the level at which their students understand (or misunderstand) concepts presented during lecture, they are used to engage or encourage students active participation in a lesson, they are used to allow students to express their thoughts and hear explanations offered by their peers, and they are used to keep students alert or on task during class time (Brualdi, 1998). Focusing on why questions are asked leads us to ask the deeper question of how questions are being asked. When we look within the broader context of classroom interaction, how questions are asked has a tremendous impact on learneroutcomes. These outcomes are shaped not just by how the instructor phrases and uses questions, but are also shaped by the ways in which students are encouraged to generate their own questions (Wilen, 1991). How questions are asked and answered has broader implications than mastering content. Effective instructors model the process of inquiry and organizing the search for solutions for their students (Teach Talk, 1995). Teach Talk, a newsletter for educators dedicated to promoting best practices in the classroom, suggests that successful questioners utilize several skills when crafting and asking good questions. These include: phrasing and sequencing questions effectively, responding to questions so that class time is used efficiently, keeping questions from leading to digression (unless the
7 7 digression is useful), and using the right tone and delivery both when asking and responding to question. (1995) Techniques for Successful Questioning 1. Phrasing; teacher communicates the question so that the students understand the response expectation (ie: no run-on questions). 2. Adaptation; teacher adapts the question being asked to fit the language and ability level of the students. 3. Sequencing; teacher asks the questions in a patterned order indicating a purposeful questioning strategy. 4. Balance; teacher asks both convergent and divergent questions and balances the time between the two types. The teacher uses questions at an appropriate level or levels to achieve the objectives of the lesson. 5. Participation; teacher uses questions to stimulate a wide range of student participation, encouraging responses from volunteering and non-volunteering students, redirects initially asked questions to other students. 6. Probing; teacher probes initial student answers, and encourages students to complete, clarify, expand or support their answers. 7. Wait Time (Think Time); teacher pauses three to five seconds after asking a question to allow students time to think. The teacher also pauses after students initial responses to questions in class. 8. Student Questions; teacher requires students to generate questions of their own. The techniques listed above are straightforward points that most instructors are familiar with. However, even though we know that these simple techniques make for best practice in the classroom, many of us simply forget to employ them regularly. Most often forgotten is the practice of wait time. Research shows that instructors wait between.7 seconds and 1.4 seconds for pupils to respond to questions. Furthermore, teachers will wait less than.7 seconds if they believe that their students might not know the answer to the question posed. Wait time or the time an instructor waits silently between asking a question and expecting an answer can impact the classroom dynamic tremendously. Mary Bud Rowe first described the positive outcomes associated with wait time in Rowe s research indicated that when teacherdirected questions were followed by at least three seconds of undisturbed silent time for students to formulate responses, the students answered the question more successfully. Student success in formulating answers was not the only positive outcome observed when wait time techniques were introduced to classrooms. Other researchers found that regular use of wait time had positive impacts on both students and teacher attitude and behaviors.
8 8 Student behaviors observed when increased wait time was introduced to the classroom: 1. Decrease in I don t know responses 2. Length and accuracy of answers increased 3. The number of volunteered, appropriate responses by larger number s of students increased. 4. Achievement test scores rose. Teacher behaviors observed when increased wait time was introduced to the classroom: 1. Questioning strategies became more flexible and varied. 2. The quantity of questions asked decreased, while the quality and variety of questions increased. 3. Higher-order, divergent questions were asked more often. In 1985, Stahl updated Rowe s conception of wait time with the introduction of think time. Stahl s idea is based upon Rowe s research, but goes a step further, defining this time as a distinct period of uninterrupted silence by the teacher and all students so that they can both complete appropriate information processing tasks, feelings, oral responses and actions (Stahl, 1994). Stahl articulates his preference for the term think time over wait time in a 1990 article published by the Arizona State University: 1. It [think time] names primary academic purpose and activity of the period of silence thus allowing students and teachers to complete on-task thinking. 2. There are numerous places where periods of silence are as important as those wait time periods reported in the literature. 3. There is at least one exception labeled impact pause time that allows for periods of less that 3 seconds of uninterrupted silence. Whether calling it wait time or think time, instituting breaks between the questions and anticipated student responses proves to be a technique that makes questions more powerful teaching tools. Questioning at post-secondary level Few students, even those at graduate levels are skilled at asking higher-cognitive questions in class, and observations of college-level instructors reveal that even at the post-secondary level, teachers are not modeling high level divergent questioning for their students (Ciardiello, 1991).
9 9 APPENDIX A BLOOM'S TAXONOMY OF THINKING SKILLS WITH BEHAVIORIAL OBJECTIVES Illustrative General Instructional Objectives KNOWLEDGE Remembering or recalling learned material Knows common terms Knows specific facts Knows methods and procedures Knows basic concepts Knows principles COMPREHENSION Understanding or grasping meaning of material Understands facts and principles Interprets verbal material Interprets charts and graphs Translates verbal material to mathematical formulae Estimates future consequences implied in data Justifies methods and procedures APPLICATION Using learned information in new situations Applies concepts and principles to new situations Applies laws and theories to practical situations Solves mathematical problems Constructs charts and graphs Demonstrates correct usage of a method or procedure ANALYSIS Critically reducing arguments to elements to see their relationships, organization and principles Recognizes unstated assumptions Recognizes logical fallacies in reasoning Distinguishes between facts and inferences Evaluates the irrelevancy of data An Analyses the organizational structures of a work (art, music, writing) SYNTHESIS Forming a new whole from various parts Writes a well-organized theme Gives a well-organized speech Writes a creative short story (or poem, or music, etc.) Proposes a plan for an experiment Integrates learning from different areas into a plan for solving a problem Formulates a new scheme for classifying objects (or events, or ideas, etc.) EVALUATION Judging based on defined criteria Judges the logical consistency of written material Judges the adequacy with which conclusions are supported by data Judges the value of a work by use of internal criteria Judge the value of a work (art, music or writing) by using external standards of excellence Behavioral Terms for Learning Objectives Example; List the bones or muscles in the arm. Define, describe, identify, label, list, match, name, outline, recognize, reproduce, select and/or state Example; Explain how muscles operate in pairs. Convert, defend, distinguish, restate, rephrase, estimate, explain, extend, generalize, infer, give examples, paraphrase, predict, rewrite, summarize Example; Show the similarities between the bones and muscles of the arms and legs. Apply, change, compute, demonstrate, discover, illustrate, manipulate, modify, operate, predict, prepare, produce, relate, show, solve, use Example; Show the similarities between the bones and muscles of the arms and legs. Break down, diagram, differentiate, discriminate, distinguish, identify, infer, outline, point out, relate, select, separate, subdivide Example; Design an artificial limb that will have the structural and functional abilities of an arm or leg. Categorize, combine, compile, compose, create, devise, design, explain, extend, generate, modify, organize, plan, propose, question, rearrange, revise, reconstruct, relate, reorganize, restructure, rewrite, summarize, tell, write Example; Compare the parts of a human limb and an artificial limb in terms of durability, flexibility, etc. Appraise, assess, compare, conclude, contrast, criticize, describe, differentiate, discriminate, document, explain, interpret, judge, justify, relate, summarize, support
10 10 APPENDIX B THE AFFECTIVE DOMAIN The taxonomy of objectives in the affective domain extends from least committed to most committed: 1. Receiving: Being aware of or attending to something in the environment, this is the I'lllisten-to-the-concept-but-I-won't-promise-to-like-it level. 2. Responding: Showing some new behavior as a result of experience; at this level a person might applaud after a concert or hum some of the music the next day. 3. Valuing: Showing some definite involvement or commitment; at this point a person might choose to go to a concert instead of a film. 4. Organization: Integrating a new value into one's general set of values, giving it some ranking among one's general priorities; this is the level at which a person would begin to make long-range commitments to concert attendance. 5. Characterization by value: Acting consistently with the new value; at this highest level, a person would by firmly committed to a love of music and show it openly and consistently. Krathwohl, D.R., Bloom, B.S. and Masia, B.B. (1964). Taxonomy of educational objectives. Handbook II: The affective domain. New York: David McKay and Co.
11 11 Asking Better Questions Transcript of Questions from Teaching Video: BSAP (South Carolina Science Program) Soil Texture and Color 8 th grade science class. Even without watching the video itself, you can examine the questions asked and make judgments about their level and potential to engage students. Segment A 06:53:08 09:52:00 T Okay now what did we get on that sheet of paper? When we poured those layers out, where you very surprised about our results? Sean, what did we get? What did that first layer look like? Do you remember that? S Rocks T Okay it was mostly rocks right? What else might have been in there? S Um little grains T Okay, good, grains. Okay, what else? S Sticks or roots T Sticks, roots, acorns, very good. But mostly it was very large pieces and then these were graded down to the very finest pieces, and Ryan, what did that very finest layer feel like to you? S It was rough T Okay some particles were very rough, but mostly what did it feel like? Latrika? S Like powder T Okay, like powder, like powder that you would even, like face powder like talcum powder or something, okay it was very fine. Okay, so that one thing we noticed. Another thing that we noticed from that activity were the different colors of the soil, right? Alright Corey, the different colors of the soil, name a few of the colors that we saw. S Dark orange and like an orangey color T A dark orange and orangey color, alright, what else? April, do you remember? Help him out a little bit. S Brown T Okay some different shades of brown, alright now where did our soils come from? Sean? Where did our soils that we used in that seive activity come from?
12 12 S Around the surrounding areas of Saluda T Alright around the surrounding areas of Saluda, and if you look up on the map of Saluda County, we have a different soil sample from various areas of the county. If you can see that okay? And what you see mostly up at the top up here are the reddish soils, alright, then these are more brown over in here and these types of soils down here by Ridge Spring, Willy, what type of soils do you mostly find in the Ridge Spring area? S Clay T Okay some clay, and what else? Brian? S Sand T Sandy soils right? A little bit of clay in there, but mostly a lot of sand mixed in with that clay because that s a very sandy area. T Today s activity is going to be about the texture of soil, okay? Now what does texture mean to you? Brian, texture, tell us a little bit about texture. What are you going to do? S Um, you re going to observe it and perhaps run your fingers through it, and it ll give you how it feels and how it looks. T Okay, how it feels and how it looks. And what is that thing Robby that we call when we use or 5 senses? What skill are we using when we use our 5 senses to look or feel at something? S A guess or hypothesis T Right, okay we could be doing that. April? S Observation T Observation, very good, we re going to observe. Section B 28:15:00 30:31:0 T Okay, now what is the manipulated variable here? Willy, which is the manipulated variable? S The type of soil T The type of soil. We changed the kind of soil, right? Now when we changed that type of soil, Tamika, which is the responding variable? S How much water you get (out of it) ( )
13 13 T Alright how much water over here, so those are the 2 things we re looking at, those are the 2 variables in this activity. Now, who can tell me what a control is? Name Corey a control that we have in our activity here. S How much water we put in it. T That was what? That was how much water we put in initially? S That was how much water we put in all 3 of them. T Well, not really, that s not really a control. Okay? A control, remember is something that stays the same. It s something that we re going to control for in the activity. Sean, what is a control? S How much drained of the soil when we put water in and let it drain. T Well, that would be our responding variable wouldn t it? How much water that drained out. Alicia? S The amount of water we started with. T Alright you started with what? S 150 ml T 150 ml Very good. Okay, on all of them. That could be one control. Brian, what is another control? S The size of what we put the soil (samples in). T Alright, did we all use the same size tuna fish cans here? We did, didn t we? Everybody had the same size can. We all had one giant can and one small can. That s one control. Alright, what about the minutes we let it sit? Franklin? S We let it sit about at least five or ten (minutes). T Alright, about the same range of time. You let them sit all exactly the same time. What about the way Sylvester, what about the way that the soil was put into the can? Did you really pack it in on one and just leave it laying loose in another sample? S No ma am. T What did you do? S We hung it, we put it on the side and let the water just drain out from the side.
14 14 T Right, that s exactly right. You let the water drain out the same way and you had the types of soil samples packed in there the same way, didn t you? So all those things are controls. Segment C 38:29:12 39:54:05 T Okay, most of you are finished with your graph right now, let s think a little bit about the activity that we just completed, alright? Let me ask you some questions. Okay, first of all, Brian, we stated that we were going to find out about soil texture right? Okay, what did you find out about the texture of your soils? In other words, what did you find out about the water that drained in and drained out? S It was sometimes the color of the soil and it had many particles in it (the soil). T What did that tell you when it was the color of the soil? For example, clay, right? That clay, when that clay drained out, man that water was muddy wasn t it? You could tell it came from clay couldn t you? What did that tell you about that soil sample? S That when the water drained out of it washed away with it. T Okay it washed away that clay, didn t it? How many of you have driven by roads in our county that have been cut or stripped and you see that red clay? What do you notice about that red clay? Robby? S Its been washed (away) T Its been washed. Right and what color, and we had all those rains a few weeks ago, what color was that water running out in front of that ditch in front of school? S (red) T Red,what did that tell you? Where did that water wash over? S Clay T Alright some clay, that s exactly right. Good.
15 15 APPENDIX C HOW DOES YOUR QUESTIONING BEHAVIOR RATE? 1. How often do you challenge students by asking questions that arouse their curiosity? Do you make them want to know more? 2. How often do you use questions to establish a foundation for new work? 3. To what extent do your questions encourage students to listen to each other s responses, opinions? 4. How do your questions help reveal or clear up misconceptions? 5. To what extent do your questions verify the degree of comprehension of your students? 6. To what extent do your questions promote self-evaluation by your students? 7. To what extent do your questions ask students to interpret, to analyze, to think critically, to see relationships, or to judge? 8. Does your question asking regime help build class rapport? 9. Do you ask questions to discover special interests of your students? 10. Does your question asking regime help students to feel that each one has something positive to contribute to the class? 11. To what extent do you preplan key questions you want to ask during the lesson? 12. To what extent do you consider possible responses to these key questions and strategies to use in the event that something goes astray? 13. To what extent do your questions call for students to think for themselves? 14. Do you ask a variety of questions recall vs. thought questions? 15. Do you get all students involved in class discussions? 16. Do you distribute your questions both to students who volunteer to answer and to those who do not? 17. Do you distribute your questions in a widespread fashion rather than limiting them to one group of students or one part of the room? 18. Do students speak to each other when responding or only to you? 19. Do you wait a reasonable time for students to think about their responses before calling on them or permitting them to speak? 20. Do you accept student responses in a neutral manner or do you use verbal rewards (Good! Fine idea! Great!) or sanctions (No! Wrong!)? 21. Do you consistently repeat students responses? 22. Do you encourage your students to ask questions?
16 16 References Cited Brualdi, Amy C. (1998). Classroom questions. ERIC Clearinghouse on Assessment and Evaluation, Washington DC. Ciardiello, Angelo, V. (1998). Did you ask a good question today? Alternative cognitive and metacognitive strategies. Journal of Adolescent & Adult Literacy, 42(3), Leven, T. and Long, R. (1981). Effective instruction. Washington DC: Association for Supervision and Curriculum Development. Ross, W. (1860). Methods of instruction. Barnard s American Journal of Education 9, (1995) Question: What makes a good question. Teach Talk 8(1). Wilen, William W. (1991). Questioning Skills for Teachers, third edition. National Education Association, Washington DC.
IACBE Advancing Academic Quality in Business Education Worldwide Bloom s Taxonomy of Educational Objectives and Writing Intended Learning Outcomes Statements International Assembly for Collegiate Business
TAXONOMY OF EDUCATIONAL OBJECTIVES (Excerpts from Linn and Miller Measurement and Assessment in Teaching, 9 th ed) Table 1 Major categories in the cognitive domain of the taxonomy of educational objectives
Writing learning objectives This material was excerpted and adapted from the following web site: http://www.utexas.edu/academic/diia/assessment/iar/students/plan/objectives/ What is a learning objective?
HONORS INDEPENDENT STUDY GUIDELINES: According to the Lake Land College catalog course description, independent study is designed to permit the student to pursue a course of study not typically available
Resources for Writing Program Learning Outcomes Supplementary Materials for Writing and Revising Learning Outcomes Workshop Presented Jointly by TLA and Student Affairs LEVEL OF SPECIFICITY AND REACH Learning
Lesson Planning 101: Essential Parts of a Lesson Plan by Sarah Sahr email@example.com Part 1: Objectives No one would argue that writing a good lesson plan starts with an excellent objective or two Let s
Bloom s Taxonomy Bloom s Taxonomy provides an important framework for teachers to use to focus on higher order thinking. By providing a hierarchy of levels, this taxonomy can assist teachers in designing
Developing Clear Learning Outcomes and Objectives The Design phase of a typical curriculum development process (Analysis, Design, Development, Implementation, Evaluation) is largely concerned with developing
SLO Action Verbs Action verbs are abundant in the English language, but how to do we know which ones are right to include in our SLO statements? Benjamin Bloom, an American educational psychologist, created
Writing Learning Outcomes What is a learning outcome? Learning outcomes are statements that indicate what learners will know or be able to do at the completion of a learning experience (program, conference,
Outcome-Based Education Outcome based education A student-centred learning system focusing on measuring student performance. Does not specify any specific style of teaching just that the student be able
2.5: Inquiry Tutor/Student Handout 2.5.1 (1 of 2) Three-Story House (Costa s Levels of Questioning) To better understand the content being presented in their core subject areas, it is essential for students
Alignment of Taxonomies Bloom s Taxonomy of Cognitive Domain Bloom s Taxonomy Cognitive Domain Revised Cognitive Demand Mathematics Cognitive Demand English Language Arts Webb s Depth of Knowledge Knowledge
APPENDIX Revised Bloom s Taxonomy In 1956, Benjamin Bloom and his colleagues published the Taxonomy of Educational Objectives: The Classification of Educational Goals, a groundbreaking book that classified
Writing Student Learning Outcomes for an Academic Program Student learning outcomes (SLOs) are statements of the knowledge, skills, competencies, or attitudes that students are expected to gain through
Critical Thinking Skills Student Edition 2010 Document created by DCPS Critical Thinking Classrooms PLC Sources DeBono, E. (1999). Six thinking hats. New York: Back Bay Books. Foundation for Critical Thinking.
March 2010 BLOOM'S TAXONOMY AND CRITICAL THINKING Critical Thinking across the Curriculum Page 2 of 7 Contents Bloom's Taxonomy and Critical Thinking... 3 Bloom s in a group ICT project -... 4 Learning
Revised Bloom s Taxonomy Revised Bloom s Taxonomy (RBT) employs the use of 25 verbs that create collegial understanding of student behavior and learning outcome. Bloom s Revised Taxonomy Taxonomy of Cognitive
Understanding Depth of Knowledge and Cognitive Complexity Keystone Exam Review of Items One of the steps in the item-review process involves Pennsylvania educators review of items for cognitive complexity
Bloom s Taxonomy Each of the three categories requires learners to use different sets of mental processing to achieve stated outcomes within a learning situation. Benjamin Bloom (1913-1999) was an educational
What is a learning outcome? A learning outcome states what a student should be able to do or know as a result of having completed a particular course or program. Learning outcomes can include knowledge,
SLOs, Bloom s Taxonomy, Cognitive, Psychomotor, and Affective Domains. Benjamin Bloom (1948) developed classifications of intellectual behavior and learning in order to identify and measure progressively
Assessment and Learning Partnerships Short Course for School Leaders Using Data for Decision-Making Unit 2 Data is essential in monitoring the learning progress a student is making. It is integral in identifying
Planning your questions using Bloom s Taxonomy Taken from The Ultimate Teaching Manual Gererd Dixie published by Continuum - available at all good book stores from 14 th April Research (Wragg and Brown,
CREATING LEARNING OUTCOMES What Are Student Learning Outcomes? Learning outcomes are statements of the knowledge, skills and abilities individual students should possess and can demonstrate upon completion
Concept-Mapping Software: How effective is the learning tool in an online learning environment? Online learning environments address the educational objectives by putting the learner at the center of the
Training & Instructional Design Creating a Lesson Plan Creating a Lesson Plan Learning Objectives Write measurable objectives for a training program Write learning objectives that use Blooms Taxonomy to
Getting Started A working definition of a performance-based objectives: A Learning objective is a statement that describes the specific skills or knowledge a student will be able to demonstrate as a result
Selecting Verbs for Task Statements Choosing the most appropriate verb to begin a task statement takes practice. The lists below contain verbs arranged according to learning domain and according to concept.
Chapter 2 Determining Learning Objectives In this chapter we help you identify the goals and objectives you want students to reach by the end of the course, and provide guidelines for using your objectives
Learning Outcomes Workbook Student Services How to write Learning Outcomes Academic Affairs July 2012 Overview of the Learning Outcomes Workbook This workbook will serve as your introduction to the concept
The Six Levels of Questioning Level 1 Knowledge Exhibit memory of previously-learned materials by recalling facts, terms, basic concepts, and answers. who what why when where which omit choose find how
Module 6; Managing Large Classes Approaches to Language Teaching: Extension; Video Length: Approximately 11 Minutes; Notes to the Trainer; For best results, have participants go through the readings for
Bloom's Taxonomy Revised Key Words, Model Questions, & Instructional Strategies Bloom s Taxonomy (1956) has stood the test of time. Recently Anderson & Krathwohl (2001) have proposed some minor changes
Exploring Cognitive Demand in Instruction and Assessment Karin K. Hess Over the past decades, educators and psychologists have attempted to develop models for understanding cognitive complexity as it relates
Looking at the First Year Objectively Stephen C. Zerwas University of North Carolina Greensboro 1 Measuring Student Learning What do we want students learn? Do students have the opportunity to learn it?
Integrating Critical Thinking Skills into the Standard Curriculum Bob Iseminger, Pieces of Learning, IAGC, 02/09/16 firstname.lastname@example.org WHAT IS CRITICAL THINKING? Accepting ideas and acting on them
Black Board Vista project Checklist How to use this Check List... 2 Analysis... 5 Targeted Students / Identify... 5 Content Analysis... 5 Design / Identify... 5 Objectives... 5 Evaluation / Validation...
Framework for the Doctoral Transformation: Application of a Taxonomy of Educational Objectives The doctoral learning process is life changing. It begins with the decision to seek the doctorate and becomes
6 Week Strategic Onboarding Program: Creating a Culture of Learning to Increase Success for Financial Services First Timers Matt Ragan- GMAC Mortgage The New Hire Process A successful New Hire On-boarding
New York State Common Core 2 Mathematics Curriculum GRADE GRADE 2 MODULE 3 Topic E: Model Numbers Within 1000 with Place Value Disks 2.NBT.A Focus Standard: 2.NBT.A Understand place value. Instructional
Three domains of learning Leslie Owen Wilson all rights reserved Three domains of learning What are the differences between the cognitive, affective, and psychomotor taxonomies? There are three main domains
A Guide for Writing Student Learning Outcomes Office of the Provost University of Florida Continuous Quality Enhancement Series Institutional Assessment Timothy S. Brophy, Director Website: http://assessment.aa.ufl.edu/
Bloom s Taxonomy: A New Look at an Old Standby Traditional Hierarchy of Thinking Processes In 1956, Benjamin Bloom wrote Taxonomy of Educational Objectives: Cognitive Domain, and his sixlevel description
Arthur Costa s Levels Arthur Costa s Model of Intellectual Functioning in Three Levels from Developing Minds: A Resource Book for Teaching Thinking Level 1: defining Ex. What is the definition of "lunar
WORLD-CLASS INSTRUCTIONAL DESIGN AND ASSESSMENT The English Language Learner CAN DO Booklet Grades 9-12 Includes: Performance Definitions CAN DO Descriptors For use in conjunction with the WIDA English
Educational Goals and Objectives A GUIDE TO DEVELOPING LEARNER BASED INSTRUCTION Educational Objectives for this Presentation At the end of this presentation you will be able to: Compare and contrast educational
Exemplary Planning Commentary: Elementary Literacy! This example commentary is for training purposes only. Copying or replicating responses from this example for use on a portfolio violates TPA policies.
Building Critical Thinking Skills in General Education and Career Programs Wayne County Community College District Presented By: Mary Mahoney Jo Ann Allen Nyquist College Definition of Critical Thinking
Webb Webb s Depth of Knowledge Guide Career and Technical Education Definitions 2009 1 H T T P : / / WWW. MDE. K 12.MS. US H T T P : / / R E D E S I G N. R C U. M S S T A T E. EDU 2 TABLE OF CONTENTS Overview...
The following strategies have been shared by Kate Christensen from William Colenso College. Kate offers detailed explanations for how each strategy support learners to develop comprehension skills, how
Connections to the Common Core State Standards for Literacy in Middle and High School Science This document is based on the Connections to the Common Core State Standards for Literacy in Science and Technical
Interactive Notebook Instructions: 1. Print the following pages out and cut them to fit your composition notebook. 2. Tape or glue the first page onto the outside of the notebook cover and write your name
FORMATIVE ASSESSMENT STRATEGIES, DEFINITIONS, EXAMPLES 1 Minute Essay Give students an open-ended question and one to three minutes to write their answers. Good questions: What is the most important thing
What Connections Do I Make As I Read? What Connections Do I Make As I Read? Strategy: Make Connections Good readers note pieces of text that relate to or remind them of: their own lives, such as past experiences
The University of Tennessee, Memphis Writing Learning Objectives A Teaching Resource Document from the Office of the Vice Chancellor for Planning and Prepared by Raoul A. Arreola, Ph.D. Portions of this
UNDERSTAND Construct meaning from instructional messages. What is the main idea of? Can you find an example of...? How would you summarize? What might happen next? How do you explain? What ideas or facts
Developing Data Workshops BDK 31-01 Best practices for engaging audiences and using the BDK resources Jackie Wirz, PhD Oregon Health & Science University BD2K Open Educational Resources Oregon Health &
Degree- Level Expectations and Course Learning Outcomes Introduction to DLEs Degree-Level Expectations (DLEs) are a threshold framework for the expression of the intellectual and creative development of
Learning Domains Bloom's Taxonomy The Three Types of Learning There is more than one type of learning. A committee of colleges, led by Benjamin Bloom, identified three domains of educational activities:
Instructional Design Principles in the Development of LearnFlex A White Paper by Dr. Gary Woodill, Ed.D. Chief Learning Officer, Operitel Corporation email@example.com Dr. Karen Anderson, PhD. Senior
Selected Instructional Aids from Biography-Driven Culturally Responsive Teaching SOCORRO HERRERA Teachers College, Columbia University New York and London This material appears in Biography-Driven Culturally
The Commons: Our Right and Our Responsibility? Teacher s Guide Grade: 9-12 Lesson: The Commons: Our Right and Our Responsibility? Number of Class Periods: 3 45-minute periods The Healthy Commons Lesson
Questioning Techniques Chad Giacomozzi This paper was completed and submitted in partial fulfillment of the Master Teacher Program, a 2-year faculty professional development program conducted by the Center
Industrial Engineering Definition of Tuning Tuning is a faculty-led pilot project designed to define what students must know, understand, and be able to demonstrate after completing a degree in a specific
Degree- Level Expectations and Course Learning Outcomes Introduction to DLEs Degree-Level Expectations (DLEs) are a threshold framework for the expression of the intellectual and creative development of
Tutor s Creed As tutors, we are responsible for improving the skills of our peers. As tutors, we will consider the body of work presented at the session in the following manner: First, we will impart to
Overview 9 th grade English Research Report/Expository Essay Unit 2006-2007 Aya Allen The Effects of Marijuana Grade 9 2 weeks Overview of unit: This unit is a response to a non-fiction article. Students
Tool 4.1 Relationship between training outcomes and training components Purpose Use this tool to demonstrate the impact of coaching on teachers practices. 4.2 Coaching interactions Gain an understanding
Name Subject Area: Unit: Topic: Grade Level: Example Reading, Math, Social Studies, Science Example Biographies, Addition/Subtraction, Wars, Environment Example Famous Women, 4 digit, World War II, Recycling
Designing and Teaching a Course with a Critical Thinking Focus Centre for Excellence in Teaching and Learning (CETL) Lunch and Learn Seminar Facilitator: Dr Mervin E. Chisholm Manager/Coordinator, CETL
USING THE PRINCIPLES OF ITIL ; SERVICE CATALOGUE Examination Syllabus V 1. October 009 ITIL is a Registered Trade Mark of the Office of Government Commerce in the United Kingdom and other countries APMG
A Taxonomy of Reflection 1. A Taxonomy of Lower to Higher Order Reflection Assume an individual has just completed a task. What types of questions might they use to reflect on the experience? How might
Literature Circles Implementing Literature Circles may seem like a daunting task, but, with foresight and planning, this approach provides students an opportunity for tremendous growth. Literature Circles
Socratic Dialogue Activity Taxonomy A classification system Based on scientific theory and/or empirical data Typically hierarchical Bloom s Taxonomy A method for categorizing educational knowledge A structure
Step by Step Guide to Developing Targeted Professional Development Sessions Aligned with the Core Body of Knowledge Step1. Gather Information 1. If possible, conduct an observation of the early childhood
A New Lens for Examining Cognitive Rigor in Standards, Curriculum, & Assessments What are some implications for the transition to Common Core State Standards? Karin K. Hess, Ed.D., Senior Associate National
Bloom's Taxonomy of Educational Objectives The development and use of instructional objectives is discussed in detail in chapter 15. At the present time it is sufficient to state that instructional objectives
The Learning Skills Pyramid Brett A. Brosseit, 2013 To develop strong critical thinking and legal analysis skills, students need to: Develop new patterns of thinking Understand the mental processes they
MONROE TOWNSHIP PUBLIC SCHOOLS WILLIAMSTOWN, NEW JERSEY Williamstown Middle School Computer Animation Grade 8 September 2010 Written by: Marilyn Kurz Supervisor of Curriculum and Instruction Lesley McGiboney