Noel Levitz Priorities Survey for Online Learners (PSOL) Summary

Transcription

1 Noel Levitz PrioritiesSurveyfor OnlineLearners(PSOL) 2009 Summary OfficeofInstitutionalEffectiveness January11,2010

2 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary TableofContents Introduction... 2 PSOL Institutional Summary... 4 Summary of Items by Category... 7 Summary Items... 8 Demographic Data... 9 Appendix PSOLNationalComparisonInstitutions LibertyUniversityMission,Aims,andGoals SelectedRelevantSACSAccreditationCriteria Contacts in the Office of Institutional Effectiveness...18

3 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary INTRODUCTION Liberty University exists to develop Christ-centered men and women with the values, knowledge, and skills essential to impact tomorrow s world. This mission is accomplished through a rigorous academic program and structured social environment for residential students and a comparable academic program for distance learning students. Beginning in with its first distance learning class of 1,300 students in three programs (A.A. in Religion, B.S. in Church Ministries, and M.A. in Counseling), Liberty University Online (LUO) has grown to more than 40,000 students in 45 associate, bachelor s, master s, and doctoral programs. In order to ensure that LU maintains quality academic programs and continues to be responsive to its growing distance learning students, the University must maintain an extensive assessment program. Several of the goals of the University assessment program are: To enhance student learning by strengthening the University s academic curriculum and improving services to distance learning students To comply with accreditation requirements 2 from the University s accrediting agencies, including the Southern Association of Colleges and Schools; and To assess progress in moving forward with the University s five-year strategic plan. 3 A major part of Liberty University s overall Assessment Plan is participating in national surveys where much can be learned about student satisfaction with their educational experience and where the institution can be compared with its peers. The Noel-Levitz Priorities Survey of Online Learners (PSOL) is one of the national surveys in which LU Online students have participated. Administered in November 2009, the PSOL was sent to 19,358 with the following response rate: 1 Liberty sdistancelearningprogramwasfirstcalledthe SchoolofLifelongLearning (LUSLL),thenthe External DegreeProgram (EDP),thenthe DistanceLearningProgram (DLP),andfinally LibertyUniversityOnline (LUO). 2 SeeAppendixforrelevantSACScriteria. 3 SeeAppendixforLibertyUniversity smissionandgoalsfor

4 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary Liberty University PSOL Data from Noel-Levitz Website as of December 8, 2009 Completed Surveys 5,740 30% Out of a possible 19, % Noel-Levitz estimates that the typical response rates at universities across the nation are between 20 and 30%; consequently, Liberty University s 30% response was very good. 3

5 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary LIBERTY UNIVERSITY INSTITUTIONAL SUMMARY PSOL 2009 (See notes following for explanation of columns.) Item Liberty University Import 1. This institution has a good reputation My program advisor is accessible by telephone and Instructional materials are appropriate for program content Faculty provide timely feedback about student progress My program advisor helps me work toward career goals Tuition paid is a worthwhile investment Program requirements are clear and reasonable Student-to-student collaborations are valuable to me Adequate financial aid is available This institution responds quickly when I request information Student assignments are clearly defined in the syllabus There are sufficient offerings within my program of study The frequency of student and instructor interactions is adequate I receive timely information on the availability of financial aid Channels are available for providing timely responses to student complaints Appropriate technical assistance is readily available Assessment and evaluation procedures are clear and reasonable Registration for online courses is convenient Online career services are available The quality of online instruction is excellent Adequate online library resources are provided I am aware of whom to contact for questions about programs and services Satis / SD 6.45 / / / / / / / / / / / / / / / / / / / / / / 1.45 Gap Import National Online Learners Satis / SD 5.91 / / / / / / / / / / / / / / / / / / / / / / 1.48 Gap Mean Difference 0.54 *** *** 0.39 *** *** 0.60 *** 0.34 *** 0.09 *** 0.40 *** 0.43 *** 0.44 *** 0.40 *** 0.26 *** 0.33 *** 0.33 *** 0.30 *** 0.29 *** 0.24 *** ** 0.46 *** 0.14 *** 0.10 *** 23. Billing and payment procedures are convenient for me / / *** 4

6 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary Item Liberty University Import 24. Tutoring services are readily available for online courses Faculty are responsive to student needs The bookstore provides timely service to students Campus item 1 (The design of the online courses makes them easy to navigate.) 28. Campus item 2 (The institution s Christian worldview is demonstrated in the online courses.) 29. Campus item 3 (Intensive or face-to-face course are a valuable part of online programs.) 30. Campus item 4 (The academic rigor of my courses has challenged me intellectually.) Campus item 5 (My courses were instructed by well-qualified staff.) Campus item 6 (Faculty show concern and support for each student s spiritual growth) 33. Campus item 7 (Student appeal procedures for grades and discipline issues are fair.) 34. Campus item 8 (I have grown spiritually as a result of my learning experiences at this university.) 35. Campus item 9 (Volunteer church/ministry involvement is encouraged by this institution.) 36. Campus item 10 (I chose this university because it is an evangelical Christian academic institution.) Satis / SD Gap Import National Online Learners Satis / SD / / / / Source of information: Catalog and brochures (printed) Source of information: Catalog (online) Source of information: College representatives Source of information: Web site Source of information: Advertisements Source of information: Recommendation from instructor or program advisor 43. Source of information: Contact with current students and / or recent graduates of the program / / / / / / / / / Factor to enroll: Ability to transfer credits Factor to enroll: Cost Factor to enroll: Financial assistance available Factor to enroll: Future employment opportunities Factor to enroll: Reputation of institution Factor to enroll: Work schedule Factor to enroll: Flexible pacing for completing a program Factor to enroll: Convenience Factor to enroll: Distance from campus Factor to enroll: Program requirements Factor to enroll: Recommendations from employer / / / 1.35 Gap Mean Difference *** 0.39 *** 0.42 *** 5

7 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary NOTES ON CHART: The previous chart shows (from left to right): Item -- as asked on the survey (#27-36 were campus-specific questions) Import the average importance score for LU students (based on a 7-point Likert scale) Satis/SD The average satisfaction score for LU students with standard deviation (the larger the standard deviation, the greater the variability in the responses; the smaller the SD the less variability in the responses) Gap the expectation gap for LU students (found by subtracting the satisfaction score from the importance score) in most cases the expectation gap is smaller between importance and satisfaction for LU students when compared to the average expectation gap of the other universities sampled across the nation. Import, Satis/SD, and Gap for the national sample (see Appendix for list of institutions) Mean Difference the difference in satisfaction between LU students and the national sample; if the mean difference is positive, LU students are MORE satisfied than students in the national sample. LU had only three items where students were less satisfied than the national sample. The asterisks indicate statistical significance (no asterisks -- no significant difference; one asterisk significant at the.05 level; two asterisks significant at the.01 level; and three asterisks significant at the.001 level). The greater the number of asterisks, the greater the confidence in the significance of the difference. LU had all but four items with three asterisks and a positive mean difference. 6

8 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary LIBERTY UNIVERSITY INSTITUTIONAL SUMMARY OF ITEMS BY CATEGORY PSOL 2009 The following chart shows items grouped by category, indicating that Liberty University Online students are more satisfied than the national comparison group in these categories as a whole. Liberty University National Online Learners Scale Import Satis / SD Gap Import Satis / SD Gap Mean Difference Institutional Perceptions / / *** Academic Services / / *** Instructional Services / / *** Enrollment Services / / *** Student Services / / *** DEFINITIONS: Institutional Perception assesses how students perceive the institution. Academic Services assesses the services students utilize to achieve their academic goals. These services include advising, course offerings, technical assistance, online library resources, and tutoring services. Instructional Services measures students academic experience, the instructional materials, the faculty/student interactions, evaluation procedures, and the quality of the instruction. Enrollment Services assesses the processes and services related to enrolling students in the online program, including financial aid, registration, and payment procedures. Student Services measures the quality of student programs and services, including responses to student requests, online career services, and the bookstore. SUMMARY ITEMS 7

9 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary Liberty University PSOL 2009 The following chart provides a bottom line summary of how LU students feel about their experience with LU Online: LU students rating of how well their college experience has met their expectations is SIGNIFICANTLY HIGHER than students in the national sample. LU students are SIGNIFICANTLY MORE SATISFIED than students in the national sample with their online college experience. When asked if they would enroll again in the LU Online, results are SIGNIFICANTLY HIGHER than the answers from those in the national sample. Summary So far, how has your college experience met your expectations? Liberty University National Online Learners Mean Difference *** 1=Much worse than expected 0% 2% 2=Quite a bit worse than I expected 0% 1% 3=Worse than I expected 3% 6% 4=About what I expected 18% 27% 5=Better than I expected 25% 25% 6=Quite a bit better than I expected 18% 14% 7=Much better than expected 32% 21% Rate your overall satisfaction with your experience here thus far *** 1=Not satisfied at all 0% 1% 2=Not very satisfied 0% 2% 3=Somewhat dissatisfied 2% 5% 4=Neutral 2% 5% 5=Somewhat satisfied 7% 12% 6=Satisfied 35% 39% 7=Very satisfied 50% 33% All in all, if you had to do it over, would you enroll here again? *** 1=Definitely not 0% 2% 2=Probably not 1% 4% 3=Maybe not 1% 3% 4=I don't know 3% 6% 5=Maybe yes 3% 7% 6=Probably yes 20% 28% 7=Definitely yes 67% 47% DEMOGRAPHICDATAFROMPSOLRESPONDENTSCOMPAREDTOTOTALONLINEPOPULATION 8

10 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary (PSOL 2009 respondents are in the first two columns; all LU Online students, as of fall 2009, are in the second two columns.) Liberty University Online Fall 2009 PSOL All LUO Gender N % N % Female % 18, % Male % 15, % Total % 33, % No Answer PSOL All LUO Age N % N % 18 and under % % 19 to % % 25 to % % 35 to % % 45 to % % 55 to % % 65 and over % % Total % 33, % No Answer 52 PSOL Current Residence N % Own house % Rent room / apartment / house % Relative's home % Residence hall % Other residence % Total 5655 No Answer % PSOL All LUO Marital Status N % N % Single % Single with children % Married % Married with children % Marital - Prefer not to respond % Other % % 10.16% Total % % PSOL All LUO No Answer Ethnicity/Race N % N % African-American % % American Indian or Alaskan Native % % Asian or Pacific Islander % % Caucasian/White % 18, % Hispanic % % Other race % % Race - Prefer not to respond % 2, % Total % % No Answer Current PSOL All LUO Enrollment Status N % N % Primarily online % 33, % Primarily on-campus % % Total % 33, % No Answer 66 0 PSOL Current Plans N % Complete online degree program % Complete degree on campus % Transfer credits % Complete this course % Total 5650 No Answer 90 PSOL All LUO % Current Class Load N % N % Full-time % % Part-time % % Total % % No Answer (or 0 credits for LU Statistics) PSOL All LUO 9

11 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary PSOL All LUO Class Level N % N % First year % % Second year % % Third year % % Fourth year % % Special student % % Graduate/professional % % Other class level % % Total % % No Answer 57 Current Online N % N % 1-3 credits % % 4-6 credits % % 7-9 credits % % credits % % credits % % More than 15 credits % % Total % % No Answer (or 0 credits for LU statistics) PSOL Educational Goal N % Associate degree % Bachelor's degree % Master's degree % Doctorate or professional degree % Certification (initial or renewal) % Self-improvement/pleasure % Job-related training % Other educational goal % Total % No Answer 70 PSOL Employment N % Full-time % Part-time % Not employed % Total % No Answer 81 PSOL Previous Online Enrollment N % no classes % 1-3 classes % 4-6 classes % 7-9 classes % classes % classes % More than 15 classes % Total % Institution Question PSOL All LUO Religious Affiliation N % N % Southern Baptist % % Pentecostal or Charismatic % % Other Denomination % % Roman Catholic % % Non-church affiliated, but Christian % Other faith or none % % Total % No Answer Institution Question % PSOL Family Income N % Less than $15, % $15,001-$25, % $25,001-$50, % $50,001-$75, % $75,001-$100, % More than $100, % Total % No Answer 216 No Answer

12 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary PSOL Group Code N % 1000 Undergraduate Business % 1001 Graduate Business % 1002 CMIS % 1003 Counseling % 1004 Human Services % 1005 Criminal Justice % 1006 Graduate Education % 1007 Undergraduate Education % 1008 General Studies % 1009 Liberty Bible Institute % 1010 Nursing (UG and Grad) % Psychology % Religion % Seminary % Total % No Answer

13 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary APPENDIX 12

14 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary PSOL Comparison Group as of May ,760 Students institutions AIB College of Business, IA Alaska Pacific University, AK Alexandria Technical College, MN American InterContinental University (AIU), IL Anoka Technical College, MN Anoka-Ramsey Community College, MN Ashford University, IA Baker College Online, MI Bellevue University, NE Bemidji State University, MN Bismarck State College, ND Brenau University, GA Bryant & Stratton College, NY Colorado Technical University - Online, IL Capella University, MN Centenary College, NJ Central Lakes College, MN Century College, MN Colorado State University, CO Concordia University, St. Paul, MN Coosa Valley Technical College, GA Cowley County Community College, KS Cuyahoga Community College, OH Dakota County Technical College, MN Dallas TeleCollege, TX DeVry University - Oakbrook, IL DeVry University Online, IL Dickinson State University, ND Eastern New Mexico University Main Campus, NM Excelsior College, NY Florida Community College Jacksonville, FL Florida Hospital College, FL Fort Hays State University, KS Golden Gate University, CA Gwinnett Technical College, GA Hennepin Technical College, MN Hibbing Community College, MN Hillsborough Community College, FL Hutchinson Community College, KS Inver Hills Community College, MN Itasca Community College, MN Kettering College of Medical Arts, OH Lake Region State College, ND Lake Superior College, MN Minnesota State Community& Technical College, MN Minnesota State University Moorhead, MN Minnesota State University, Mankato, MN Mayville State University, ND Mesabi Range CC, MN Metropolitan State University, MN Minneapolis Community& Technical College, MN Minnesota State College, MN Minot State University - Bottineau, ND Minot State University, ND Normandale Community College, MN North Dakota State College of Science, ND North Hennepin Community College, MN Northeast Wisconsin Technical College, WI Northland Community and Technical College, MN Northwest Technical College, MN Northwood University, MI Ouachita Technical College, AR Patrick Henry College, VA Pine Technical College, MN Pulaski Technical College, AR Ridgewater College, MN Rio Salado College, AZ Riverland Community College, MN Rochester Community & Technical College, MN Savannah College Art & Design, GA Schoolcraft College, MI South Central College, MN Southern Oregon University, OR Southwest Minnesota State University, MN St. Cloud State University, MN Texas Woman's University, TX University of North Dakota Main, ND University of Illinois Springfield, IL University of Houston - Clear, TX University of Mary, ND Valley City State University, ND Vermilion Community College, MN Virginia College - Birmingham, VA Western Dakota Technical Institute., SD Westwood College Online - WOL, CO Williston State College, ND Winona State University, MN 13

15 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary LIBERTY UNIVERSITY STRATEGIC PLAN MISSION/AIMS/GOALS ( ) (Areas related to online programs are in bold.) MISSION To develop Christ-centered men and women with the values, knowledge, and skills essential to impact tomorrow s world. The mission is carried out for resident students through a rigorous academic program and structured social environment. It is carried out for external students in a comparable academic program but without the structure of the resident community. GOALS Academic Goal: The University provides a quality curriculum with a strong liberal arts and Christian foundation for each program of study to prepare students for rich, full lives, productive careers, and church and community leadership. Enrollment Management Goal: Enrollment is optimized and stabilized to achieve 10,000 traditional students and 20,000 distance or adult students by the year 2008, with the desired number and mix of students appropriate to the University s mission. Spiritual Life Goal 1: All University programs encourage maintenance and development of Spiritual Life. Goal 2: The student s commitment to the local church and the community is strengthened. Goal 3: All University programs encourage Christian living and provide exposure to positive role models who demonstrate Christian applications and principles in all walks of life. Student Life Goal 1: The University promotes the total development of all students. Goal 2: Students have a quality campus environment. Technology Goal 1: Liberty University will embrace emerging technologies to distinguish itself from peer institutions in creating a dynamic learning environment and achieve operational efficiencies for students and faculty. Goal 2: Liberty University will ensure that in all issues relative to technology, automation, and communication, its biblical worldview will determine policies that guide behavior for both faculty and students. 14

16 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary Goal 3: The University will improve its local influence through leveraging of critical technology skills and resources to serve the local community. Administrative Resources Goal 1: The University provides for perpetual financial support for quality education programs and student activities. Goal 2: Human resources are recognized as a vital University investment and asset. Goal 3: Physical resources are adequate to support the University s strategic goals. Goal 4: The University adheres to and annually assesses its Strategic Plan. 15

17 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary Selected Relevant SACS Accreditation Criteria (Areas in bold relate to PSOL questions.) The Principles of Accreditation: Foundations for Quality Enhancement Commission on Colleges Southern Association of Colleges and Schools 2008 Core Requirements 2.8 The number of full-time faculty members is adequate to support the mission of the institution and to ensure the quality and integrity of its academic programs. Upon application for candidacy, an applicant institution demonstrates that it meets the comprehensive standard for faculty qualifications. (Faculty) 2.9 The institution, through ownership or formal arrangements or agreements, provides and supports student and faculty access and user privileges to adequate library collections and services and to other learning/information resources consistent with the degrees offered. Collections, resources, and services are sufficient to support all its educational, research, and public service programs. (Learning Resources and Services) 2.10 The institution provides student support programs, services, and activities consistent with its mission that promote student learning and enhance the development of its students. (Student Support Services) Comprehensive Standards 3.3 Institutional Effectiveness The institution identifies expected outcomes, assesses the extent to which it achieves these outcomes, and provides evidence of improvement based on analysis of the results in each of the following areas: (Institutional Effectiveness) educational programs, to include student learning outcomes administrative support services educational support services research within its educational mission, if appropriate community/public service within its educational mission, if appropriate 3.4 All Educational Programs The institution provides appropriate academic support services. (Academic support services) 16

18 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary The institution places primary responsibility for the content, quality, and effectiveness of the curriculum with its faculty. (Responsibility for curriculum) For each major in a degree program, the institution assigns responsibility for program coordination, as well as for curriculum development and review, to persons academically qualified in the field. In those degree programs for which the institution does not identify a major, this requirement applies to a curricular area or concentration. (Academic program coordination) The institution s use of technology enhances student learning and is appropriate for meeting the objectives of its programs. Students have access to and training in the use of technology. (Technology use) 3.5 Educational Programs: Undergraduate Programs 3.7 Faculty The institution employs competent faculty members qualified to accomplish the mission and goals of the institution. When determining acceptable qualifications of its faculty, an institution gives primary consideration to the highest earned degree in the discipline. The institution also considers competence, effectiveness, and capacity, including, as appropriate, undergraduate and graduate degrees, related work experiences in the field, professional licensure and certifications, honors and awards, continuous documented excellence in teaching, or other demonstrated competencies and achievements that contribute to effective teaching and student learning outcomes. For all cases, the institution is responsible for justifying and documenting the qualifications of its faculty. (See Commission guidelines Faculty Credentials. ) (Faculty competence) 3.8 Library and Other Learning Resources The institution provides facilities and learning/information resources that are appropriate to support its teaching, research, and service mission. (Learning/information resources) The institution ensures that users have access to regular and timely instruction in the use of the library and other learning/information resources. (Instruction of library use) 3.9 Student Affairs and Services The institution publishes a clear and appropriate statement of student rights and responsibilities and disseminates the statement to the campus community. (Student rights) 17

19 LibertyUniversity Noel Levitz PrioritiesSurveyforOnlineLearners(PSOL)2009 Summary CONTACTS IN THE OFFICE OF INSTITUTIONAL EFFECTIVENESS Dr. Bill Wheeler Associate Vice President for Institutional Effectiveness Dr. Terri Cornwell Associate Dean for Graduate and Online Assessment Mr. Brian Ross Williams Research Coordinator Mr. Daniel Smith Graduate Assistant 18