elearning in College Mathematics an Online Course in Algebra with Automatic Knowledge Assessment


 Winfred Terry
 1 years ago
 Views:
Transcription
1 elearning in College Mathematics an Online Course in Algebra with Automatic Knowledge Assessment Przemysław Kajetanowicz Institute of Mathematics and Computer Science Wrocław University of Technology Jdrzej Wierzejewski Institute of Mathematics and Computer Science Wrocław University of Technology Abstract A collegelevel online course Algebra with Analytic Geometry is presented. Math concepts and methods are taught through a collection of highly interactive web pages that can be easily turned into an IMS or SCORM package. Nearly 80 types of math problems have been implemented in the form of Javapowered interactive tests that can further be combined into comprehensive exams. The whole process of knowledge assessment can be made automatic. The course was delivered on the blendedlearning basis to a group of 55 students in the spring semester 2005, with stunningly good results. 1. Introduction In the fall 2004, the authors created an experimental Webbased secondary level math lesson with fully automatic knowledge assessment system based on Java technology (see [4]). Encouraged by the obviously promising results of the experiment, we designed, created and taught a complete course in collegelevel algebra. Throughout the paper, we describe both the functionality of the ecourse and its reallife implementation at Wroclaw University of Technology in the spring semester Organization of math content The math content of the course is logically divided into five main chapters: Complex Numbers, Polynomials and Rational Functions, Matrices and Linear Systems, Analytical Geometry in Space, and Conic Sections. Each chapter represents a multipage Shareable Content Object (SCO). The whole content can be easily aggregated into an IMS or a SCORM package (see [1]). Actually, it was turned into an IMS package that was further imported into WebCT as a Content Module. From the presentation point of view, the content of the course can be categorized as follows. Lecture notes: those are Web pages where traditional exposition of material is supplemented with conceptillustrating calculators, interactive animations, and powerful selfassessment tools in the form of interactive Javapowered tests. In that way, a student is given instructional environment in which the study of concepts and methods is supported by a big amount of interaction. Exercise pages: those are pages where interactive exercises (again in the form of Javapowered tests) are gathered together to address a group of related notions or methods. Sometimes, exercises are further split into groups of varying difficulty. Exams: individual singletypeproblem tests can be combined into comprehensive exams that can be used both for practice (socalled practice exams) and for administrative assessment purposes in the instruction process. Many parameters, such as the number, the type, and the difficulty level of exam problems, the time assigned to student for the submission, the scores for individual problems, and the whole exam grading system, can all be controlled at design time, thus offering an instructor a very flexible assessment tool. 3. Functionality of tests and exams Nearly 80 types of math problems are supported in the form of interactive tests, varying from simple, drilltype exercises to quite sophisticated graphing problems or problems where the user is supposed to demonstrate mastery of a given method Functionality of a single test An individual test addresses a problem of a given type and has these features. Random generation of data the user can generate an unlimited collection of problems.
2 The level of difficulty can be set at design time. More specifically, it is possible to control the test behavior in such a way that problems with desired level of difficulty are generated according to predefined probabilities. Immediate grading is available as soon as the student submits his or her solution in the applet window. Immediate correct stepbystep solutions are available. Various methods of grading for a given problem can be set at design time, depending on the purpose that the underlying test serves (an individual drilltype exercise or a part of an exam). Time constraint can be imposed on every test, forcing the student to provide the solution within prescribed amount of time. The lettergrading system can be defined at design time, so that the exam total score can be transformed into a letter grade. The correct solution of each problem is available as soon as the student submits the exam. The students greeted this feature with true interest. Many students pointed out that immediate access to the correct solution helped them identify their own errors easily. Fig. 1. Singleconcept test 3.2. Functionality of an exam An exam is a collection of problems gathered in a common window, and serving the purpose of more comprehensive knowledge assessment. In the actual implementation of the course, the assessment strategy was completely based on automatic exams. This is discussed in the sequel. All the features of single tests that we listed before carry over to an exam. Additionally, exams have the following functionality features. Random generation of problems the type of problems that the student will be given can be controlled at design time. The designer can either predefine the exact type of each problem on the exam, or the probability with which problems of given types will appear. In that way, two students get two different sets of problems. The order in which the problems of individual types appear in the exam window can be fixed or randomized. Fig. 2. Comprehensive exam An exam can be used both for practice and as a formal assessment element in the course. In the latter case, additional authentication and security mechanisms are available, and the exam results can be stored in an SQL database. In the future, this will be replaced by SCORM mechanisms Special tools Many mathematical methods are actually algorithms that are difficult to understand without a considerable amount of practice. This, in turn, often involves tedious computations. Typical examples are algorithms used in geodesy, or the Gauss algorithm in algebra. Tools are provided that release a student from the burden of a great deal of hand computation, letting him or her focus on successive steps of the algorithm instead. A student only prescribes a specific step (e.g., add the third row of the matrix to its first row ) by setting appropriate parameters in an applet window. The actual numerical computation is left to the software. Another obvious benefit of having a utility of that kind is that a student is protected from the risk of frustrating computational errors.
3 administered in a computer lab during the semester and were all fully automatic. It should be emphasized that the students final grades turned out evidently better as compared with similar courses taught in the traditional way, even though the local mathematical community definitely judged the problems given on the automated exams as more difficult than those given traditionally. 6. Student evaluations Fig. 3. Tools for elementary row/column operations 4. Calculators and interactive animations In addition to automatic tests and exams, the student is given a collection of interactive calculators that allow him or her to experiment with some of the math concepts and methods. The elementary row/column operations calculator, for example, enables the student to easier grasp the idea of Gauss elimination. Additionally, interactive animations have been created to illustrate certain geometrical phenomena (e.g., the geometrical definitions of conic sections). 5. Implementation The course was delivered (on a blendedlearning basis) to a group of 55 students of Wroclaw University of Technology in the spring semester Two hours of lectures and one hour of recitation per week were the inclass part of the course. Necessary students drill and practice work having been supported by software, more time in class was available for a teacher to discuss advanced topics and applications. WebCT Learning Management System was used to host the electronic content of the course. In addition to the LMSindependent functions described above, the authors made an extensive use of WebCT functionality, such as online quizzes, discussions, mail, chat, student tracking etc. Online quizzes were a part of the whole assessment system. Two midterm exams and the final exam were An anonymous survey was carried at the end of the course, in order to obtain both the quantitative and the descriptive evaluation from the course participants. The students were asked 8 questions. The first 6 questions were intended to gather students quantitative judgment of various course elements. Each student was asked to provide his or her evaluation, preference or the degree of agreement in the form of a grade ranging from 1 (very low) to 6 (very high). A question about the amount of time spent on the course was included to verify the claim (expressed by a few math faculty during the course) that technologysupported learning will cause so much time burden for students that they might neglect other courses. Question 8 was the descriptive element of the survey students were encouraged to provide written remarks or comments that might have occurred to them Survey results Below we present the survey questions together with the distribution of students responses. Survey was released to students by means of the WebCT Survey tool. The students were confident that the responses were anonymous. Question 1. To what extent did you find the new form of the course (in particular, automatic tests and exams) helpful in your mastering the course material (as confronted with traditional way of learning)? 26% 30% 6% 2
4 Question 2. Would you be interested in other math courses, were they offered in a similar form? Question 4. How strongly would you agree with the statement that the new form implies no more need for classroom recitations? 3% 11% 6% 20% 20% 71% 20% 11% 2 Question 3. Did you find the Webbased lecture notes complete enough to give up classroom lectures? Grade 2 3% Note: the majority of students are willing to drop classroom lectures meetings, yet they are not just as willing to drop the recitations. Question 5. Did the instructors provide sufficient technical support so that you had no problem operating the interactive elements of the course? 6% 62% 17% 31% 63%
5 Question 6. How fairly, in your opinion, was your knowledge assessed by the system of automatic exams? 26% Grade 2 3% 6.2. Students written comments The students were asked this additional question survey: Question 8. Please give us any remarks or comments regarding the course that may occur to you. Except for 3 persons that showed strong frustration and were highly skeptical about the advantages of the new form over the traditional way of teaching, the comments on the course were close to enthusiastic. Here are a few excerpts from students responses: 28% 25% What I especially liked was the availability of all the lecture materials and exercises that could be taken repeatedly, until you mastered a problem completely. Practice exams were of particular value, since they motivated us to work. Note: the exam questions were similar to those given on traditional exams. No such survey has been carried out among students taught traditionally, so no comparison can be made here in terms how students generally judge the fairness of exam questions in algebra courses. The results show that the majority of students judged the system as fair (grades 4 to 6). Question 7. How many hours weekly did you spend working on this course? Do not include the time spent in class. 6 to 10 hrs 53% 5% 2 to 5 hrs 16 to 20 hrs 5% less than 1 hr 37% Note: contrary to the concern expressed by some math faculty, the amount of time spent on the course by the majority of students does not indicate that students attention was drawn away from other courses. I liked the fact that all the materials were available online and thus I could concentrate on listening rather than taking notes during lectures. At the beginning I was terrified at the perspective of taking a course that was delivered in that way, but now I would like to heartily thank the instructors for the opportunity of being a part of this experiment. I can definitely say that thanks to this course I understood things that had been all Greek to me before (...) I truly believe that more courses should be taught that way. I wish to thank again for the opportunity to have been in this course. 7. The present and the future As of this writing, in the fall semester 2005, the second edition of the course is being taught. A group of over 400 freshmen are enrolled in the course. The course is now nearly onethird into the semester. Due to a very large number of students, the grading procedures have been altered. Each student is supposed to individually take six online tests. Obviously, there is no security check (e.g., no guarantee that a student does all the work without someone else s help). Therefore, at the end of the semester, an inlab comprehensive exam will be administered for all the students. The results of the online tests will contribute to the final grade only if a student obtains a predefined minimum score on the final exam. One thing can be immediately noted: except for fewer than 20 cases, the whole group seamlessly jumped into the system. Selfregistration did not posed a problem for students, nor had they any trouble getting used to interactive tools. There is a large group of participants who show very active attitude towards the use of the course utilities.
6 It is the authors strong belief that other math courses would be equally successful if offered in similar form. Active exploration of study concepts and automatic knowledge assessment are obviously an element whose role in successful online math teaching cannot be overestimated (see [2] and [3]). 8. References [1] ADL Technical Team, Sharable Content Object Reference Model (SCORM) Version 1.2, Advanced Distributed Learning, [2] E.Cosyn, JP.Doignon, JC.Falmagne, N.Thiery, The Assessment of Knowledge, in Theory and Practice, [3] J.Engelbrecht, A.Harding, Teaching Undergraduate Mathematics On the Internet, Educational Studies in Mathematics, 58 (2005), p [4] P.Kajetanowicz, J.Wierzejewski, Elesson on Quadratic Function. A Step Towards an Online Remedial Math Course, Proceedings, 5th International Conference Virtual University, Bratislava, Slovakia, December 2004
CHAPTER 1 INTRODUCTION TO MASTERY LEARNING Introduction by Carla Ford 1 Perspective on Training: Mastery Learning in the Elementary School 2
Table of Contents THE MASTERY LEARNING MANUAL CHAPTER 1 INTRODUCTION TO MASTERY LEARNING Introduction by Carla Ford 1 Perspective on Training: Mastery Learning in the Elementary School 2 CHAPTER 2 AN OVERVIEW
More informationTop 10 Reasons Faculty Fail When Using Blackboard CMS
Top 10 Reasons Faculty Fail When Using Blackboard CMS Dr. Penny Johnson Computer Science Carroll College johnsonp@cc.edu Abstract In today s ever increasing world of information technology it is not enough
More informationThe Accuracy and Validity of Online Homework Systems by
The Accuracy and Validity of Online Homework Systems by Kathleen Malevich MS Candidate: Program in Applied and Computational Mathematics Advisor: Carmen Latterell Department of Mathematics and Statistics
More informationSTUDENT OUTCOMES ASSESSMENT PLAN. Course Assessments. And. Program Reviews
STUDENT OUTCOMES ASSESSMENT PLAN Course Assessments And Program Reviews Dr. Jerry Standahl Office of Assessment and Institutional Research Paul D Camp Community College Franklin, Virginia 23851 November
More informationMethods for Understanding Student Learning University of Massachusetts Amherst Contributing Authors:
R Urban Policy Calculus Lively Arts Minute Paper Accounting Syllabus Metaphysics Pre/Post Cervantes Cyberlaw Primary Trait COURSEBased Review and Assessment Methods for Understanding Student Learning
More informationEstablishing Guidelines for Determining Appropriate Courses for Online Delivery
www.ncolr.org/jiol Volume 4, Number 2, Fall 2005 ISSN: 15414914 Establishing Guidelines for Determining Appropriate Courses for Online Delivery Janet Smith Strickland Judy Butler University of West Georgia
More informationTechnology Support: Its Depth, Breadth and Impact in America's Schools. Amy Ronnkvist Sara L. Dexter Ronald E. Anderson
Technology Support: Its Depth, Breadth and Impact in America's Schools Amy Ronnkvist Sara L. Dexter Ronald E. Anderson Teaching, Learning, and Computing: 1998 National Survey Report #5 Center for Research
More informationThe Acceptance of Online Graduate Coursework by. School Districts in Wisconsin and Illinois. Dawn A. Oler, CFCS
The Acceptance of Online Graduate Coursework by School Districts in Wisconsin and Illinois Dawn A. Oler, CFCS A Research Paper Submitted in Partial Fulfillment of the Requirements for the Master of Science
More information2. Tuning methodology 5. 3. Competences in the teaching and learning process 17. 4. ECTS, student workload and learning outcomes 47
Introduction to Tuning2.indd a 7/3/07 18:08:28 Content 1. Introduction 1 2. Tuning methodology 5 3. Competences in the teaching and learning process 17 4. ECTS, student workload and learning outcomes
More informationGRE. Practice Book for the Paperbased. GRE revised General Test. Second Edition. www.ets.org/gre
GRE Practice Book for the Paperbased GRE revised General Test Second Edition www.ets.org/gre 19587 Note to Test Takers: Keep this practice book until you receive your score report. This book contains
More informationWHAT COMMUNITY COLLEGE DEVELOPMENTAL MATHEMATICS STUDENTS UNDERSTAND ABOUT MATHEMATICS
THE CARNEGIE FOUNDATION FOR THE ADVANCEMENT OF TEACHING Problem Solution Exploration Papers WHAT COMMUNITY COLLEGE DEVELOPMENTAL MATHEMATICS STUDENTS UNDERSTAND ABOUT MATHEMATICS James W. Stigler, Karen
More informationGeneral Portfolio Instructions
Part 1: General Portfolio Instructions Part 1 provides the following key resources, guidelines, and support: How to Use the Portfolio Instructions outlines the content of these instructions and provides
More informationTechnology and Assessment Study Collaborative. An AlphaSmart for Each Student: Does Teaching and Learning Change With Full Access to Word Processors?
Technology and Assessment Study Collaborative An AlphaSmart for Each Student: Does Teaching and Learning Change With Full Access to Word Processors? Michael Russell, Damian Bebell, Jennifer Cowan, and
More informationEnhancing Student Performance in Online Learning and Traditional FacetoFace Class Delivery
Journal of Information Technology Education Volume 3, 2004 Enhancing Student Performance in Online Learning and Traditional FacetoFace Class Delivery Mark Stansfield, Evelyn McLellan, and Thomas Connolly
More informationA SelfDirected Guide to Designing Courses for Significant Learning
A SelfDirected Guide to Designing Courses for Significant Learning L. Dee Fink, PhD Director, Instructional Development Program University of Oklahoma Author of: Creating Significant Learning Experiences:
More informationUsing Peer Evaluations and Teams in Online Classes
Using Peer Evaluations and Teams in Online Classes Joy L. Colwell 1 and Carl F. Jenks 2 Abstract  Students should have the ability to work together in teams, plan effective strategies for identifying
More informationNew Approaches to Online Accounting Education
New Approaches to Online Accounting Education Mark Myring, Ph.D. Department of Accounting Miller College of Business Ball State University mmyring@bsu.edu 7652855100 Jennifer P. Bott, Ph.D., SPHR Department
More informationIntellectual Need and ProblemFree Activity in the Mathematics Classroom
Intellectual Need 1 Intellectual Need and ProblemFree Activity in the Mathematics Classroom Evan Fuller, Jeffrey M. Rabin, Guershon Harel University of California, San Diego Correspondence concerning
More informationClimate Surveys: Useful Tools to Help Colleges and Universities in Their Efforts to Reduce and Prevent Sexual Assault
Climate Surveys: Useful Tools to Help Colleges and Universities in Their Efforts to Reduce and Prevent Sexual Assault Why are we releasing information about climate surveys? Sexual assault is a significant
More informationStudent Learning in Hybrid French and Spanish Courses: An Overview of Language Online 1
N. Ann Chenoweth, Eiko Ushida, and Kimmaree Murday 115 Student Learning in Hybrid French and Spanish Courses: An Overview of Language Online 1 ABSTRACT N. ANN CHENOWETH University of TexasPan American
More informationPractical RiskBased Testing
Practical RiskBased Testing Product RISk MAnagement: the PRISMA method Drs. Erik P.W.M. van Veenendaal CISA Improve Quality Services BV, The Netherlands www.improveqs.nl May, 2009 2009, Improve Quality
More informationAssessing Online Asynchronous Discussion in Online Courses: An Empirical Study
Assessing Online Asynchronous Discussion in Online Courses: An Empirical Study Shijuan Liu Department of Instructional Systems Technology Indiana University Bloomington, Indiana, USA shijliu@indiana.edu
More informationGathering faculty teaching evaluations by inclass and online surveys: their effects on response rates and evaluations
Assessment & Evaluation in Higher Education Vol. 29, No. 5, October 2004 Gathering faculty teaching evaluations by inclass and online surveys: their effects on response rates and evaluations Curt J. Dommeyer*,
More informationSAMPLE COPY NOT FOR DISTRIBUTION
U.S. CULTURE SERIES: U.S. Classroom Culture MICHAEL SMITHEE SIDNEY L. GREENBLATT ALISA ELAND Funded by a grant from the Bureau of Educational & Cultural Affairs of the U.S. Department of State About NAFSA:
More informationIs that paper really due today? : differences in firstgeneration and traditional college students understandings of faculty expectations
DOI 10.1007/s1073400790655 Is that paper really due today? : differences in firstgeneration and traditional college students understandings of faculty expectations Peter J. Collier Æ David L. Morgan
More informationCollege Handbook. Guidance Department
College Handbook Guidance Department Dear Cadet and Parents: This College Application Handbook was designed to provide you with a resource to help all of you successfully navigate the college admission
More informationCurrent Status of Research on Online Learning in Postsecondary Education
LITERATURE REVIEW Current Status of Research on Online Learning in Postsecondary Education William G. Bowen Kelly A. Lack May 18, 2012 Ithaka S+R is a strategic consulting and research service provided
More informationPROmisinG PRACtiCes in Online learning A Parent s Guide to Choosing the Right Online Program
February 2010 PROmisinG PRACtiCes in Online learning A Parent s Guide to Choosing the Right Online Program PROMISING PRACTICES IN ONLINE LEARNING A Parent s Guide to Choosing the Right Online Program Written
More informationFebruary 2010. A Parent s Guide to Choosing the Right Online Program
February 2010 Promising Practices in online learning A Parent s Guide to Choosing the Right Online Program PROMISING PRACTICES IN ONLINE LEARNING A Parent s Guide to Choosing the Right Online Program Written
More informationTraditional vs. Modern Teaching Methods: Advantages and Disadvantages of Each Master s Diploma Thesis
Masaryk University Faculty of Arts Department of English and American Studies English Language and Literature Bc. Viera Boumová Traditional vs. Modern Teaching Methods: Advantages and Disadvantages of
More information