BOARD OF REGENTS OF THE UNIVERSITY SYSTEM OF GEORGIA. USG Learning Management System (LMS) Taskforce. Student Survey Results

Transcription

1 BOARD OF REGENTS OF THE UNIVERSITY SYSTEM OF GEORGIA USG Learning Management System (LMS) Taskforce Student Survey Results January 2011

2 Table of Contents Survey Background... 4 Comments on Survey Analysis... 4 Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Page 2 of 33 pages

3 Q Q Q Q Q Q Q Q Q Q Q Q Page 3 of 33 pages

4 Survey Background The University System of Georgia (USG) Learning Management Transition (LMS) taskforce was charged in August 2010 with recommending an LMS to replace the current system (Vista 8) which will no longer be supported by Blackboard effective January The taskforce has a broad range of representation, including students and faculty as well as other USG stakeholders. For more information about the taskforce, please visit the website: In an effort to gather input from the main users of the USG LMS users, the taskforce distributed several surveys. This document catalogues the results of the survey that was distributed to the students at all of the USG campuses. Comments on Survey Analysis The survey contained several categories of questions: Choose one, choose many ( select all that apply ), choose one with option to specify other, choose many with the option to specify other, yes/no, and free or open response. Because of the large number of respondents, some of the questions that allowed respondents to specify their own category of response created difficulties in the analysis. For example, question 14 was stated as follows: Q14: From which of the following mobile platforms would you be likely to access an LMS? Page 4 of 33 pages

5 This question listed 6 choices for possible answers and an Other, please specify option. We were surprised that of the 9,410 responses, 1,148 (approximately 12 percent of the sample) chose to select the Other category. We had the option of simply listing all 1,148 responses but believed a qualitative analysis of the responses would yield more accurate and more instructive information. In the aforementioned question, a new table of results was created which now contained 12 items, under the subheader Revised Table. This analysis was quite complex and time consuming and also complicated any reports we were to write, but we believed it was the best and most accurate approach. In this report, if a question offered the opportunity for respondents to specify an Other response, the revised table has been presented. Since some questions offered in the survey had conditional responses and redirection to different questions depending upon a respondent s answers, the question numbers have been renumbered in numerical order for clarity; that is, the numbers appearing in these results do not match identically with the original question numbers appearing in the survey. Page 5 of 33 pages

6 Q1. In which institution in the University System of Georgia are you currently enrolled? (If you are a transient student please select the university at which you have transient status.) Note: Private colleges and out of state colleges are not considered USG Institutions and should be filled in with the out of state option below. Institution Count % Total Abraham Baldwin Agricultural College % Albany State University % Armstrong Atlantic State University % Atlanta Metropolitan College % Augusta State University % Bainbridge College % Clayton State University % College of Coastal Georgia % Columbus State University % Dalton State College % Darton College % East Georgia College % Fort Valley State University % Gainesville State College % Georgia College & State University % Georgia Gwinnett College % Georgia Highlands College % Georgia Institute of Technology % Georgia Perimeter College % Georgia Public Library Service % Georgia Southern University % Georgia Southwestern State University % Georgia State University % Gordon College % Kennesaw State University % Macon State College % Medical College of Georgia % Middle Georgia College % North Georgia College & State University % Savannah State University % South Georgia College % Southern Polytechnic State University % University of Georgia % University of West Georgia % University System Office % Valdosta State University % Waycross College % Total Page 6 of 33 pages

7 Q2. If you have transient status at more than one USG institution, please select the institutions below: Institution Count % Total Abraham Baldwin Agricultural College % Albany State University % Armstrong Atlantic State University % Atlanta Metropolitan College % Augusta State University % Bainbridge College % Clayton State University % College of Coastal Georgia % Columbus State University % Dalton State College % Darton College % East Georgia College % Fort Valley State University % Gainesville State College % Georgia College & State University % Georgia Gwinnett College % Georgia Highlands College % Georgia Institute of Technology % Georgia Perimeter College % Georgia Public Library Service % Georgia Research Alliance % Georgia Southern University % Georgia Southwestern State University % Georgia State University % Gordon College % Kennesaw State University % Macon State College % Medical College of Georgia % Middle Georgia College % North Georgia College & State University % Savannah State University % South Georgia College % Southern Polytechnic State University % University of Georgia % University of West Georgia % USG System Office % Valdosta State University % Waycross College % Total 683 Page 7 of 33 pages

8 Q3. If you have transient status at more than one USG institution, please select the institutions below: Institution Count % Total Abraham Baldwin Agricultural College % Albany State University % Armstrong Atlantic State University % Atlanta Metropolitan College % Augusta State University % Bainbridge College % Clayton State University % College of Coastal Georgia % Columbus State University % Dalton State College % Darton College % East Georgia College % Fort Valley State University % Gainesville State College % Georgia College & State University % Georgia Gwinnett College % Georgia Highlands College % Georgia Institute of Technology % Georgia Perimeter College % Georgia Southern University % Georgia Southwestern State University % Georgia State University % Gordon College % Kennesaw State University % Macon State College % Medical College of Georgia % Middle Georgia College % North Georgia College & State University % Savannah State University % Skidaway Institute of Oceanography % South Georgia College % Southern Polytechnic State University % University of Georgia % University of West Georgia % Valdosta State University % Total 253 Page 8 of 33 pages

9 Q4. If your home institution is out of state, please type it in below: (Sorted alphabetically) Institution Count Indeterminate/ Not applicable 39 Not specified 18 Alabama 10 Florida 10 International 7 Tennessee 7 South Carolina 6 Georgia 5 Online 5 New York 4 Kansas 3 North Carolina 3 Ohio 3 California 2 Illinois 2 Iowa 2 Maryland 2 Pennsylvania 2 Virginia 2 Arizona 1 Arkansas 1 Louisiana 1 Massachusetts 1 Mississippi 1 Oklahoma 1 Texas 1 Virgin Islands 1 Page 9 of 33 pages

10 Q5. Please select your student classification. (Respondents could only choose a single response) Revised Table Response Percentage Count Freshman Student who has earned 0 29 college semester credit hours.* 29.46% 3551 Sophomore Student who has earned college semester credit hours.* 23.49% 2831 Junior Student who has earned college semester credit hours % 1986 Senior Student who has earned 90 or more college semester credit hours.* Graduate Student pursuing a Master s, Education Specialist, or doctoral degree (Ph.D or Ed.D.).* First Professional Student enrolled in Veterinary Medicine, Law, Medicine, Dentistry, or Doctor of Pharmacy. Post Baccalaureate Student who has a Baccalaureate degree who is taking first professional or graduate courses but who is not working toward a degree. Unclassified Undergraduate (Other) Student who has a bachelor's degree who is enrolled for credit at the undergraduate level but not pursuing another degree. Transient Student taking one or more courses which he/she has permission to transfer to his/her home institution % % % % % % 59 Medical/Dental/Veterinary Medicine Interns and Residents. 0.19% 23 Unspecified/indeterminate** 0.62% 75 2nd Bachelors** 0.29% 35 Dual/Joint Enrollment** 0.26% 31 Certificate/Add on/endorsement** 0.25% 30 Page 10 of 33 pages

11 Faculty/staff** 0.08% 10 Post baccalaureate, Seeking Associate** 0.02% 3 Total * Response count augmented after analyzing other responses. ** New category added after analyzing other responses. Q6. How would you describe your race/ethnicity? (Respondents could only choose a single response) Response Chart Frequency Count White or Caucasian (Non Hispanic Origin) Black or African American (Non Hispanic Origin) 60.6% % 2727 Prefer not to answer 5.7% 683 Asian or Pacific Islander 3.7% 440 Hispanic 3.6% 436 Multiracial 3.4% 409 American Indian or Alaskan Native 0.4% 44 Not Answered 118 Valid Responses Total Responses Page 11 of 33 pages

12 Q7. Please enter your current major of study. (Sorted by number) Response Percentage Count Nursing 16.05% 2000** Early Childhood Education ** Biology ** Psychology ** Management ** Accounting ** Computer Science ** Health* Business* Education* Political Science ** Criminology ** Mass Communications ** English ** Marketing ** General/Undecided* Information Technology* Engineering* History ** Middle Grades Education Mathematics ** Sociology ** Art ** Chemistry ** Finance ** Pharmacy* Secondary Teacher Education ** Social Work* Management Information Systems ** Athletics/Exercise Science/Kinesiology* Medicine* Agriculture* Consumer Sciences* Economics ** Physical Therapy* Law/Legal* Page 12 of 33 pages

13 Response Percentage Count Library Sciences* Business Teacher Education Technology Support Services ** Other* Physical Education Spanish Language & Literature ** Physics ** Theatre ** Anthropology ** Counseling* Environmental Studies ** Biology/Secondary Education Performance ** Veterinary* Dentistry* Science* Aviation* Language & Literature* Construction Management* Architecture* Speech Language Pathology ** Integrated/Interdisciplinary* Biochemistry* Geography ** Music Teacher Education Foreign Language* Occupational Therapy* Social Studies* French Language & Literature ** Teaching Field Mental Retardation Geology ** Global Studies ** International Economics ** Philosophy ** Earth Science/Secondary Education Economics, general Biotechnology* Environmental Sciences Real Estate Recreation ** Page 13 of 33 pages

14 Response Percentage Count Chemistry/Secondary Education Economics/Secondary Education German ** Physics/Secondary Education Theory & Composition TOTAL 12,462 *New category added after analysis of survey responses to option other **After analysis of survey responses to the option other, responses were coded and added to the counts of appropriate survey options Q8. The majority of the courses I take at my institution are: (Respondents could only choose a single response) Response Chart Frequency Count Traditional Face to Face Instruction Little or no online component Traditional Face to Face Instruction Heavy online component Online Only/Distance Learning Hybrid (50% online, 50% face to face) 59.1% % % % 1264 Not Answered 480 Valid Responses Total Responses Page 14 of 33 pages

15 Q9. Please select all LMS you have experience with. (Respondents were allowed to choose multiple responses) Revised Table Response Frequency Count GeorgiaView VISTA* 29.76% 7150 Blackboard 25.36% 6093 WebCT 25.13% 6037 Blackboard Learn 11.53% 2771 I do not know any Learning Management Systems. 2.48% 596 ANGEL 2.34% 563 Moodle* 1.29% 310 FirstClass 0.52% 125 T Square 0.36% 87 Misclassified/Unclassifiable** 0.30% 72 Publisher/Textbook Website** 0.27% 64 Desire2Learn 0.23% 55 Sakai 0.23% 55 Portfollio/Assessment** 0.10% 23 Other LMS** 0.09% 21 Anlon 0.02% 4 *New category added after analysis of survey responses to option other 24,026 **After analysis of survey responses to the option other, responses were coded and added to the counts of appropriate survey options Page 15 of 33 pages

16 Q10. Please select the primary LMS you currently use. (Respondents could only choose a single response) Response Chart Frequency Count Blackboard Vista 12.4% 1435 CourseDen 1.6% 185 Distance Learning VSU Vista (BlazeVIEW) 1.1% 128 elearning@gsc 3.8% 441 elearning Commons (elc) 8.4% 977 GaVIEW Vista 5.7% 664 GeorgiaONmyLINE (GeorgiaVIEW) 1.3% 155 GeorgiaVIEW 9.0% 1043 GeorgiaVIEW (Blackboard Vista) GeorgiaVIEW (WebCT Vista) 14.7% % 1401 GeorgiaVIEW Vista 8.0% 929 GeorgiaVIEW Waycross College 0.1% 17 GeorgiaVIEW Vista 8 4.7% 544 GeorgiaVIEW@ASU 0.3% 39 GeorgiaVIEW@BC 0.3% 30 GGC Bb Vista 0.9% 104 icollege 6.8% 793 MGC Online (GeorgiaVIEW) 1.0% 119 Moodle 0.2% 26 MSC Vista (GeorgiaVIEW) 2.5% 289 Online GCSU 0.2% 19 Pirates' VIEW 1.0% 113 Sakai 0.0% 5 SSU elearning 0.1% 7 Page 16 of 33 pages

17 Response Chart Frequency Count T Square 0.4% 46 ulearn 3.1% 364 Not Answered 9 Valid Responses Total Responses Q11. Approximately how many times do you log in to the primary LMS you currently use? (Respondents could only choose a single response) Response Chart Frequency Count Never 2.0% 233 Monthly 2.9% 332 Weekly 6.8% times per week 8.5% times per week 23.0% times per week 22.9% times per week 17.9% 2063 >20 times per week 16.0% 1837 Not Answered 29 Valid Responses Total Responses Page 17 of 33 pages

18 Q12. Please check all features you actively use in the primary LMS you currently use. (Respondents were allowed to choose multiple responses) Response Chart Frequency Count Grades/MyProgress 89.9% 8460 Course 72.6% 6831 Online Quizzes and Exams 66.3% 6238 Online Assignment Turn in 66.1% 6221 Discussion Boards 65.2% 6140 Calendar 41.3% 3889 Online Lecture (Recorded) 16.2% 1526 Task Management 15.0% 1413 Live Chat 13.4% 1257 Cloud based File Storage 7.4% 700 Online Lecture (Live) 6.4% 599 Valid Responses 9410 Total Responses 9410 Page 18 of 33 pages

19 Q13. Please rate the importance of each feature in an LMS. Calendar Cloud based File Storage Course Discussion Boards Grades/MyProgress Live Chat Online Assignment Turn in Online Lecture (Live) Online Lecture (Recorded) Online Quizzes and Exams Task Management Page 19 of 33 pages

20 Page 20 of 33 pages

21 Q14. From which of the following mobile platforms would you be likely to access an LMS? (Respondents were allowed to choose multiple responses) Revised Table Response Percentage Count Apple ios (e.g., iphone, ipad) 30.74% 3137 Google Android (e.g., Droid) 25.35% 2587 RIM Blackberry OS* 17.75% 1811 Windows Phone 9.14% 933 Do not have access/do not want** 5.06% 516 Palm webos* 3.75% 383 Symbian OS (e.g., Nokia phones) 2.73% 279 Specific cell/all cell model phones** 2.12% 216 Laptop/Netbook computers** 1.63% 166 Unclassifiable/Misclassified** 1.55% 158 Specific mobile/all mobile devices** 0.14% 14 e Readers** 0.05% 5 Total 10,205 *New category added after analysis of survey responses to option other **After analysis of survey responses to the option other, responses were coded and added to the counts of appropriate survey options Page 21 of 33 pages

22 Q15. Which features of the primary LMS you currently use would you most likely access via a mobile device? (Check all that apply.) Revised Table Response Frequency Count Grades/MyProgress 20.43% 6099 Course * 18.60% 5552 Course Announcements* 13.83% 4129 Calendar* 10.73% 3204 Discussion Boards 10.31% 3077 Online Quizzes and Exams 5.85% 1746 Online Assignment Turn in* 5.41% 1614 Task Management 4.11% 1226 Online Lecture (Recorded) 3.11% 928 Live Chat 2.32% 692 Online Lecture (Live) 2.11% 629 Cloud based File Storage 1.71% 509 Will not access/cannot access** 1.33% 396 Class content** 0.06% 17 Unclassifiable/multiple responses** 0.04% 12 Everything** 0.02% 7 Syllabus** 0.02% 5 Unique responses** 0.01% 3 Access to other web tools** 0.01% 2 Page 22 of 33 pages

23 Response Frequency Count Learning Modules** 0.01% 2 Total 29,849 *New category added after analysis of survey responses to option other **After analysis of survey responses to the option other, responses were coded and added to the counts of appropriate survey options Q16. Which features do you consider the most useful in the primary LMS you currently use? Please rank your top three choices below. Ignore the "Not Ranked" column. Calendar Cloud based File Storage Course Discussion Boards Grades/MyProgress Live Chat Online Assignment Turn in Online Lecture (Live) Online Lecture (Recorded) Online Quizzes and Exams Task Management Page 23 of 33 pages

24 Page 24 of 33 pages

25 Q17. For which of the following do you use the primary LMS you currently use? (Respondents were allowed to choose multiple responses) Revised Table Response Percentage Count Classroom 53.97% 8090** Studying ** Research Work ** Personal Work ** Student Organizations Social Organizations Other* None* TOTALS 14,990 *New category added after analysis of survey responses to option other **After analysis of survey responses to the option other, responses were coded and added to the counts of appropriate survey options Q18. How do you rate your expertise as a user of technology items in the following areas? Educational work (classroom, studying) Research work Personal work (outside of school) Entertainment Page 25 of 33 pages

26 Page 26 of 33 pages

27 Q19. How strongly would you agree or disagree with the following statements regarding potential barriers to your using technology in learning? Accessibility is an important issue in technology. I didn't have adequate technical support. I don't have the skills to use technology. Instructors didn't know how to implement it. Software accessibility was not an issue. Technology added extra work with little connection to the course. Technology is too complicated. Technology is too expensive. Technology takes too much time. The technology didn't work on my computer. Page 27 of 33 pages

28 Page 28 of 33 pages

29 Q20. What method(s) do you use to learn new technologies? (Respondents were allowed to choose multiple responses) Response Percentage Count Self Taught 38.13% 7560** Help from family, friends, ** colleagues Ask IT support staff ** Learn at your workplace ** Taking online computer classes Attend face to face seminar ** Course (not online)* Instructor/Classmates* Other* None* TOTALS 19,455 *New category added after analysis of survey responses to option other **After analysis of survey responses to the option other, responses were coded and added to the counts of appropriate survey options Q21. If you have a problem with technology for a class, where are you MOST likely to seek assistance first? (Respondents could only choose a single response) Response Chart Frequency Count Friends or colleagues 28.4% 2308 Course instructor 27.4% 2229 Self help website 18.7% 1523 Talk to technical help support on phone 9.9% 807 E mail technical support 7.3% 597 Use technical help support Chat Talk to technical help support in person 4.8% % 284 Not Answered 127 Valid Responses 8138 Total Responses 8265 Page 29 of 33 pages

30 Q22. Please rate your overall satisfaction with the primary LMS you currently use. (Respondents could only choose a single response) Response Chart Frequency Count Completely dissatisfied 3.4% 274 Could be better 33.1% 2691 Indifferent 10.5% 858 Satisfied 40.2% 3271 Completely satisfied 12.8% 1042 Not Answered 69 Mean Standard Deviation Valid Responses 8136 Total Responses 8205 Q23. How difficult is it for you to navigate the primary LMS you currently use? (Respondents could only choose a single response) Response Chart Frequency Count Very easy/no trouble 30.8% 2507 Easy 46.7% 3802 Indifferent 16.3% 1322 Difficult 5.5% 447 Very difficult 0.7% 56 Not Answered 71 Valid Responses 8134 Total Responses 8205 Page 30 of 33 pages

31 Q24. Please rate the usefulness of the primary LMS you currently use in improving your success in a course. (Respondents could only choose a single response) Response Chart Frequency Count Not useful at all 4.3% 352 Slightly useful 19.6% 1593 Indifferent 17.0% 1382 Mostly useful 37.0% 3007 Very useful 22.0% 1783 Not Answered 88 Valid Responses 8117 Total Responses 8205 Q25. What do you like most about the primary LMS you currently use? (Deleted, available in qualitative analysis report) Q26. What do you dislike most about the primary LMS you currently use? (Deleted, available in qualitative analysis report) Page 31 of 33 pages

32 Q27. In your opinion, how important is it to have ONE standard learning management system across the University System of Georgia institutions? (Respondents could only choose a single response) Response Chart Frequency Count Extremely important 36.9% 2990 Important 34.3% 2784 It does not matter 22.9% 1859 Not important 3.1% 250 Not important at all 2.8% 230 Not Answered 92 Valid Responses 8113 Total Responses 8205 Q28. Do you think you would find an interactive tutorial helpful if you were a first time user? (Respondents could only choose a single response) Response Chart Frequency Count Yes 67.6% 5439 No 13.5% 1087 Uncertain 18.9% 1525 Not Answered 102 Valid Responses 8051 Total Responses 8153 Q29. If the primary LMS you currently use had more appealing features do you think you might log on more? Please explain. (Deleted, available in qualitative analysis report) Page 32 of 33 pages

33 Q29. If you had comments or clarifications on an earlier question, please type them below. (Deleted, available in qualitative analysis report) Q30. If you have comments about other issues relating to LMS not covered in this survey, please type them below. (Deleted, available in qualitative analysis report) This report was prepared under the direction of Dr. Hilliard Gastfriend. If you have any questions, please contact him at: for clarification or corrections. Page 33 of 33 pages