OTHER KNOWLEDGE CAPTURE TECHNIQUES

Transcription

1 OTHER KNOWLEDGE CAPTURE TECHNIQUES CHAPTER 6 On-site observation Consensus methodologies Brainstorming Consensus decision Repertory grid Nominal group Delphi method Blackboarding 2 1

2 On-Site Observation Process of observing, interpreting, and recording problemsolving behavior while it takes place More listening than talking During the process, the knowledge developer is able to ask questions but does not correct or modify, in any way, what the expert is doing. Some experts do not like to be observed Fear of giving away expertise is a concern by the one observed Process can be distracting to others in the setting Continuous shuttle process important Possible problem with the accuracy or completeness with which the knowledge captured is recorded, since there exists a gap from when the knowledge is observed and when it is documented. 3 Brainstorming Unstructured approach to generating ideas about a problem All possible solutions considered equally Emphasis is on frequency of responses during the session Idea generation, followed by idea evaluation 4 2

3 Brainstorming Procedure Introduce brainstorming session Give experts a problem to consider Prompt experts to generate ideas Watch for signs of convergence Call for a vote or a consensus to reach agreement 5 Protocol Analysis Think-aloud method Expert keeps talking, speaking out loud while solving a problem Effective source of information on cognitive processes Makes expert cognizant of the processes being described Provides wealth of information toward knowledge representation Box

4 Consensus Decision Making Consensus decision-making follows brainstorming in two ways: Each method allows all experts to present their views or ideas, but discussions invariably proceed before consensus. The knowledge developer tries to rally the group in each method towards one final decision that will hopefully lead to a consensus. 7 Consensus Decision Making Clear agreement regarding the best solution to a problem As a tool, it follows brainstorming Procedure ensures fairness and standardization in the way experts arrive at a consensus A bit tedious and can take hours The rigidity of the consensus method can be a problem for many experts 8 4

5 Brainstorming v.s. Consensus Decision Making Brainstorming is idea generation of multiple solutions to a problem, is unstructured, and results in a wide variety of creative ideas. Consensus decision making involves a controlled exercise in which the knowledge developer focuses the group on one or two of the solutions from the brainstorming exercise. It follows brainstorming. The goal is to arrive at a clear agreement regarding the best solution to a problem. 9 The Repertory Grid Domain expert viewed as a scientist who categorizes a problem domain using his or her own model Grid used to capture and evaluate the expert s model Experts see problems based on reasoning that has stood test of time A representation of the experts way of looking at a particular problem A grid is a scale or a bipolar construct on which elements are placed within gradations 10 5

6 The Repertory Grid (cont d) Benefit: May prompt the expert to think more seriously about the problem and how to solve it. Drawback: Difficult to manage when large grids are accompanied by complex details Because of difficulty in simplicity and manageability, the tool is normally used in the early stages of knowledge capture 11 NGT Procedure KD explain procedure Each expert lists the pros and cons of the problem or the alternative solutions Complies a list of pros and cons Each expert rank the compiled pros and cons KD conducts a discussion about the pros and cons and the respective rank KD compiles the alternative solution followed by a group discussion 12 6

7 NGT (cont d) Technique can be time consuming Has been known to promote impatience among experts who must listen to discussions with other experts With experts sharing expertise, things can jell in adopting the best solution NGT is ideal in situations of uncertainty regarding the nature of the problem 13 NGT (cont d) Effective in multiple expert knowledge capture, especially when minimizing differences in status among experts is important In NGT, each expert has an equal chance to express ideas in parallel with other experts in the group With discussion accommodated in sequential order, NGT can be a more efficient and productive approach than brainstorming 14 7

8 Delphi Method A panel of experts prepare an anonymous opinion about the focused problem. In the second round, each expert is given a summary of the first round and asked to make addition estimate based on the addition information. Repeat step 2 until all of the extreme estimates are deleted, and the answers are converge to a narrow range. 15 Delphi Method A survey of experts A series of questionnaires used to pool experts responses in order to solve a difficult problem Each expert s contributions shared with rest of experts by using results of one questionnaire to construct the next questionnaire Anonymous response 16 8

9 Delphi Method (cont d) Controlled feedback Statistical group response Experts often lack necessary knowledge on which to base final judgment Poorly designed questionnaire could cause all kinds of problems 17 Concept Mapping A network of concepts, consisting of nodes and links A node represents a concept and a link represents the relationship between concepts. See Fig. 6.5 An effective way for a group to function without losing their individuality 18 9

10 Figure 6.5 Conceptual Map An Example Birthday has not same as White horse rides SAINT NICOLAS gives has lives in Bear d Spain helper of At chimneys listens lives in BLACK PETER brings On roofs climbs Santa Clause Presents 19 Figure 6.6 Steps in Concept Mapping 1 Preparation of Project Participants, focus, schedule 6 Utilization 5 Interpretation (cluster analysis) STEPS IN CONCEPT MAPPING 4 Statement Representation 2 Idea Generation (focus for brainstorming) 3 Idea Structuring (sorting/rating statements) 20 10

11 Blackboarding Assumes all participants are experts with unique experience Initial data are written on the blackboard Each expert has equal chance to contribute to the solution via the blackboard Process continues until the problem has been solved Diverse approaches to problem solving 21 Blackboarding (cont d) Participants share a common language for interaction Flexible representation of information Efficient storage and location of information Organized participation Iterative approach to problem solving 22 11

12 OTHER KNOWLEDGE CAPTURE TECHNIQUES CHAPTER 6 12