TEAM LEARNING IN AN ONLINE LAB

Transcription

1 EAM EARNING IN AN ONINE AB Bernardo Wagner 1 and Jörg uttas 2 Abstract his contribution deals with the implementation and subsequent evaluation of a distance-learning experiment as part of a laboratory for process control for students of electrical engineers in the main section of their studies. In one of our control laboratory experiments students have to design, implement and test a discrete controller for a process engineering plant. ast winter term we have started to investigate students motivation, acceptance and learning results in conjunction with online laboratory access. o compare and online lab access a summary evaluation has been performed with twenty students grouped into eight small teams. Four teams were not allowed to enter the room with the process engineering plant inside, so they had to operate and control the whole experiment through the Internet. he other four teams have worked on the laboratory experiment in the traditional way while sitting in the same room as the process to be controlled. Index erms Evaluation, team learning, control laboratory, problem-based learning. based on exercises (see Figure 1). ogether with the problem statement and the actual distance-learning experiment as well as metacognitive sequences they form the pedagogical articulation scheme of a complete action [5]. Based on conventional technologies (HM, Java etc.), it is thus possible to observe and control our distancelearning experiment from the institute as well as from anywhere in the world. In our learning scenario the laboratory devices can be observed through a web camera and can be operated by a controller connected to the Internet. he control program is designed, implemented and tested interactively by small teams during the lab exercises. o do that they use a graphical Petri net editor and some other software tools which were developed at our institute [6]. All tools are programmed in Java. he necessary information regarding the lab experiment (theoretical background, user manuals, etc.) is provided on our institute's web pages. DISANCE-EARNING EXPERIMEN In contrast to current purely receptive uses of the Internet for obtaining information, in a distance-learning experiment the Internet becomes a constructivist medium where knowledge is build up by the student in the learning situation (learning by doing). On the condition that the experiments include design and construction exercises with a high degree of interactivity real learning spaces are formed. Conception he notion of learning behind the conception of our teaching and learning environment is based on the model of the reflexive subject as described in [1]. In line with the constructivist paradigm, students dealing with the teaching and learning environment are confronted with a problematic situation, in this case with a technical problem. he distancelearning experiment creates for the learner a greater proximity to professional reality due to its concreteness as an object which is inherent in the system, in contrast to pure software simulation. his concreteness also serves to greatly increase the learners motivation, since they see directly the physical effects of their actions and they are given responsibility for a materially represented process. Purely instructional sequences based on a course of lectures (here: the learning materials in our course Design of Discrete Controllers ) alternate with example sequences FIGURE. 1 DISANCE-EARNING EXPERIMEN WIH INSRUCIONA AND CONSRUCIVIS EEMENS. aboratory Experiment he lab experiment starts with the description of a fault in the process engineering plant. he students have to work one after the other on four subtasks which have an increasing intellectual demand. 1 Bernardo Wagner, earning ab ower Saxony, University of Hannover, Hannover, ange aube 32, Germany, b.wagner@computer.org 2 Jörg uttas, Center for Engineering Education, University of Hannover, Hannover, ange aube 32, Germany, tuttas@learninglab.de 1F-18

2 In accordance with the nature of the task the students have to analyze a given Petri net to detect and to repair the fault (temperature exceeds a maximum). o avoid a renewed appearance of the fault the students have to expand the Petri net in a way that the fault is now reported through a web page (implementation in HM), where an operator has to confirm the new error message. Afterwards the graphical control program has to be optimized using opening and synchronizing of parallel Petri net structures. In the last subtask it is requested to design a cyclic operation of a sequence of different heating phases. EVAUAION After a formative evaluation a summary evaluation has followed which was intended to provide information as to the suitability of distance-learning experiments in professional education. he results will allow us to discuss questions of whether distance-learning experiments in contrast to pure simulations or other computer-based learning arrangements are more suited to the promotion of professional competence. Based on Kirkpatrick s levels approach [2], we have the following levels of evaluation which feed into a needs analysis. ABE I EVAUAION QUESIONS ON DIFFEREN EVAUAION EVES [3] Evaluation level Central evaluation question E1: product level What result do experts arrive at on evaluating the program? E2: reaction level How do learners react to the program? E3: learning level What learning successes were achieved? E4: action level Could the learning content be transferred? E5: success level What effect did the learning unit have? E6: return-oninvestment level How should one judge the investment in continuing education? he evaluation approach As success in learning is dependent both on situational as well as constituted parameters, the intention is to carry out the evaluation of the distance-learning experiment using a theory-based holistic approach. UCI (Universal Constructive Instructional heory) [4], developed since 1991, provides a suitable, subtle and systematic theoretical framework. According to UCI, the teaching and learning system is divided into four components (learner, learning task, learning environment and reference framework) and three processes (knowledge use, knowledge acquisition and knowledge storage). Within the evaluation, suitable methods are used to examine the learning requirements with respect to the professional, method and social competencies of the learners. In addition to this, it documents their motivation and acceptance with regard to the distance-learning experiment. he evaluation of the component learning task is supported by its future and present significance, the exemplary nature of the topic and the question of whether the topic contributes to structuring in terms of content. Also, problematic aspects of the topic with regard to different learning groups need to be evaluated. After the distancelearning experiment has been carried out, we need to check what extent the learning objectives formulated within the methodological planning of the teaching/learning unit have been reached. It should also be related to the tests of prior knowledge carried out at the beginning. he evaluation of the learning environment relates to the entire instruction process and has an influence on the instructional design of the teaching/learning environment. By instructional design we mean the entire process of designing the learning environment. Evaluation of the learning environment thus takes place on the visual, content and structural level. Evaluation methods A suitable way of evaluating a distance-learning experiment is a comparative investigation of the process which varies of the reference framework. hree scenarios are conceivable (see Figure 2 and able II). he network-based infrastructure enables methods which are not possible in conventional teaching/learning arrangements. hus synchronic recording of the learners and their activities in the teaching and learning environment, database-based tracking or screen capturing allow us to obtain information on the learning strategies of the learners. Because of the big amount of data in this first evaluation we have restricted the recording of the screen content, mouse movements and clicks to one group. he obtained data will serve us as a basis for the development of new analysis methods for such amounts of digital data. For evaluation of our distance-learning experiment we have developed an online questionnaire. It is divided into the categories "existing knowledge", "preparation", "lab taking" and "transfer". he online questionnaire was filled in by the students immediate after finishing the lab exercises. he type of possible answers include simple yes/no, multiple choice, grading and free text. 1F-19

3 aboratory Scenario 1: conventional form of teaching (real group work) aboratory aboratory Scenario 2: conventional form of teaching, but with a distance-learning experiment learner tutor FIGURE. 2 Evaluation Scenarios Scenario 3: distributed, virtual groups ABE II EAM EARNING SCENARIOS Scenario One Scenario wo Scenario hree Scenario 1 is a conventional scenario of a laboratory experiment. utor, learners and the test object (in this case the process which is to be controlled) are in one room. Although the technological basis is identical with scenarios 2 and 3 (the process is controlled via an Internet connection), learners can see the result of their actions directly in front of them. In contrast to scenario 1, the learners are now in a different room, at a distance to the actual object. hey receive visual impressions by a video transmission as well as some software tools (images of process states, graphic process visualization). utorial supervision is direct here too. he idea is altered here to the extent that the groups, the experiment and the tutorial supervision are spread out over different rooms. his scenario will probably be carried out in winter term 2001/2002. the internet. Others will follow in the near future. wo or three students have formed a lab team which ones collaborated during the whole lab course. Four teams have worked ly on the Petri net experiment (see Figure 3) via Internet. We call this teams the online teams. he other four teams worked in the traditional way with direct, connection to the lab devices. Our small database will not deliver valid statements. Nevertheless this first evaluation brings up interesting results. HE EXPERIMEN his winter term twenty students in electrical engineering have taken part on the lab course in discrete control. he complete course consists of eight individual experiments. hemes dealt with are Petri net and state machine modeling, PC and robot programming and distributed control using field busses. Currently, only one experiment is connected to FIGURE. 3 REMOE EAM 1F-20

4 Most students had prepared the lab exercises in working groups. In average they spent two hours for preparing themselves. Main focus of preparation was on understanding the problem statements and how to operate the laboratory tools and devices (75%) and to work on additional exercises given in the lab description to prepare the students (70%). Almost all students (95%) have used the delivered hypertext-based information system (delivered on CD- ROM). 25% used the course materials and 15% other reading books for additional reference. ABE IV FREE-EX ANSWERS O REEVANCE (EXCERP) Question Answers (selection) FIGURE. 4 PERI NE EDIOR WIH AN INERNE RUNIME SYSEM he resulting Petri net of one team is shown in Figure 4. A medium sized Petri net has been implemented interactively on screen. In the pop-up window one can see the dialog for connecting the engineering and runtime system with the lab server. RESUS he online and the teams have slight difference in existing knowledge. 25% of all students have taken the corresponding course of lectures in "Design of Discrete Controllers", 40% of them belong to the group. his course of lectures introduces to the theoretical foundations of Petri nets and their application in automatic control. All teams from both groups have finished successfully the lab experiment within the given four hours. No difference in the achieved results has been observed between and online teams. ABE III REEVANCE AND ACCEPANCE (EXCERP) 1: Will maintenance and engineering have any practical value to you in the future? (1=very important... 6=no value) 1,7 2,1 2: Does this lab experiment (Petri net design and programming for controllers) has any practical value for electrical engineers? (1=very important... 6=no value) 2,4 2,3 3: Please assign a grading level to the whole lab experiment: (1=EXCEEN... 6=VERY BAD) 1,7 2,6 I like to work in a laboratory, because you don't have to go to the university. You can do all the lab work very comfortable from home. I liked the experiment, even though I think the team and the tutor need to be at one place. Otherwise it will be difficult to communicate and this will increase the time necessary to complete the lab experiment.... it was fun. he experiment was a new and challenging experience, therefore I enjoyed it.... I could do it from home at any time.... I think that this new way of working will become more and more important in the near future. he group has given the lab experiment a significant better grade (average 1.7 in comparison to 2.1, see able III). Both groups graded the technology value of the Petri net experiment similarly (2.3 and 2.4). he most significant result was that the teams graded the whole lab experiment much better than the group (1.7 and 2.6, see able III, question 3). As a result of our experiment one could see that possibly lab experiments will have a positive impact on acceptance and motivation. Almost all students could imagine to accept further laboratories (95%). As one could see in able IV student especially recognize the additional value of online labs for their future engineering work. CONCUSION Despite the small database our evaluation shows that distance-learning experiments can lead to the same learning results than traditional lab experiments. We have investigated two scenarios. In both cases teams have shown 1F-21

5 that they are able to transfer theoretical knowledge to concrete problem situations. Additionally the online teams have noticed that diagnosis and maintenance could be important for them in the near future. Because of limited perception (computer screen) the online teams have to plan and operate more carefully the lab experiments than the teams. It is indicated that online experiments could possibly be used to teach planning and analyzing competencies in a more effective and inherent way. Almost all students do accept online lab experimenting and understand that net-based forms of learning have several advantages in comparison to presence teaching. As with most new ways of teaching and learning students motivation is increased at first. his has been measured by asking the students to grade the whole experiment. It is plainly visible the online teams have been more satisfied than the teams. REFERENCES [1] Smith, K.A. and Waller, A.A.: "New Paradigms for Engineering Education"; FIE Conference, 1997, Pittsburgh, Pennsylvania [2] Kirkpatrick, D..: "Evaluating raining Programs. he Four evels"; Berrett-Koehler; San Francisco [3] atchman, H. A.: "Salzmann, Ch.; Gillet, Denis: Information echnology Enhanced earning in Distance and Conventional Education"; IEEE ransactions on Education, Vol. 42, No. 4; November 1999; Seite [4] Schott, F.; Kemter, S.; Seidl, P.: "heoretical aspects of instruction of multimedia learning environments"; In. Issing & P. Klimsa (Hrsg.); Information und ernen mit Multimedia ; Psychologie Verlags Union; Weinheim 1997; Seite [5] uttas, J.: Fernexperimente in der ingenieurswissenschaftlichen Ausbildung von rezeptiver Informationsvermittlung zum konstruktivistischen ernen im Internet ; GI FG 1.1.5/7.0.1 Intelligente ehr- / ernsysteme, Proceedings; Dezember; Hamburg [6] Wagner, B.: From Computer-Based eaching to Virtual aboratories in Automatic Control"; FIE Conference, November 1999, San Juan, Puerto Rico 1F-22