1 USING PREDICTIVE ANALYTICS TO UNDERSTAND HOUSING ENROLLMENTS Heather Kelly, Ed.D., University of Delaware Karen DeMonte, M.Ed., University of Delaware Darlena Jones, Ph.D., EBI MAP-Works
2 Predictive Analytics: A variety of statistical techniques that analyze current and historical facts to make predictions about future events. Study the past, if you would divine the future Confucius
3 Why Retention? Retention affects Enrollment numbers Institutional image Institutional rankings Finances (revenue and funding) Retention is often part of our institutional planning. Retention is essential to student and institution success. Because retention strongly impacts the institution, it makes sense to use predictive analytics to better understand retention
4 Why Predict Retention Risk? Faculty/staff can t accurately predict students perceptions of program or risk of retention Most faculty are focused on Research Course load Advising Most staff are focused on Putting out fires Working with students who self-identify issues Working with students with judicial issues Not a good strategy?
5 Why is Predicting Difficult? Many factors come into play. The impact of any one factor can be affected by other factors. Some factors are exacerbated by others. Some factors are mitigated by others. Time frame is long. Our judgment may be affected by: Anecdotes Outlier data points Issues we care about Institutional initiatives Other issues
6 Our best predictor is not a sum of issues It s fairly obvious that Travis Gatlin is at risk It s less obvious that Jessica Anderson, is equally at risk.
7 NATIONAL PREDICTIVE MODELS ACUHO-I/EBI Resident Assessment
8 Users of Predictive Modeling Administrators CHO Hall Staff Researchers Understand what drives success for improvement and accreditation review Identifies predictors for program to focus resources in these areas Identifies predictors for their area/hall (may be different from program) to focus work Understand the impact of housing on housing and institutional enrollments
9 Statistical Methods EBI s Reporting Research Automatically generated by institution Reported in written and online formats Uses linear multi-variant regression Descriptive Analysis Correlations Linear or Logistic Regression Discriminant Analysis Classification Trees Measurement and Path Models Neural Networks Simulation Models
10 Predicting Residence Hall Retention Factor Description Predictor Status Contribution to the Total Variance Factor Performance Overall Resident Satisfaction 1st Predictor Moderate Overall Learning Experience 2nd Predictor Moderate Satisfaction: Room Assignment or Change Process 3rd Predictor Moderate Climate: Sense of Community 4th Predictor Good Climate: Fellow Residents are Respectful 5th Predictor Moderate NOTE: Data from 2011 ACUHO-I/EBI Resident Assessment, 271 institutions, 317,000 responses, R 2 =.173
11 Predicting Satisfaction Improving these predictors should improve resident satisfaction for future populations NOTE: Data from 2011 ACUHO-I/EBI Resident Assessment, 271 institutions, 317,000 responses
12 Predicting Learning Experience Improving these predictors should improve resident learning for future populations NOTE: Data from 2011 ACUHO-I/EBI Resident Assessment, 271 institutions, 317,000 responses
13 Limitations of a National Model Data definitions Using data definitions developed for a national model can make it difficult for some institutions to align with their internal data data Outlier Institutions Some institutions housing operations are outside the average thus making a national model less applicable Outlier Populations Some student populations are served by specialized institutions (e.g., HBCU) which is outside the average Solution: Institutional Models
14 INSTITUTIONAL PREDICTIVE MODEL University of Delaware
15 Enrollment Projections: The Variables New Students + Continuing Students Freshmen Transfers Readmitted Total number enrolled from prior semester minus (number of graduates + number of withdrawals)
16 Enrollment Projections: The Model Historical Data Predicted Data FALL 2009 FALL 2010 FALL 2011 History SPRING 2010 SPRING 2011
17 Enrollment Projections: The Output
18 Persisters Report TABLE 1: ENROLLMENT, DROPOUT RATES AND GRADUATION RATES FOR FIRST-TIME FRESHMEN ON THE NEWARK CAMPUS (Total) Enrollment and Dropout Rates Graduation Rates Entering 1st 2nd 3rd 4th 5th 6th within within within Fall Term Fall Fall Fall Fall Fall Fall 3 yrs 4 yrs 5 yrs Total 1995 N % enrollment 100.0% 84.7% 77.3% 75.3% 19.0% 3.6% 0.7% 54.6% 70.4% 74.3% % dropout 0.0% 15.3% 22.7% 24.7% 26.4% 26.1% 1996 N % enrollment 100.0% 85.2% 78.6% 76.3% 18.4% 3.3% 0.7% 55.5% 70.0% 73.8% % dropout 0.0% 14.8% 21.4% 23.7% 26.1% 26.7% 1997 N % enrollment 100.0% 87.0% 79.3% 77.5% 18.3% 3.7% 0.8% 57.5% 71.8% 75.5% % dropout 0.0% 13.0% 20.7% 22.5% 24.3% 24.5% 1998 N % enrollment 100.0% 86.9% 79.8% 78.5% 18.4% 3.3% 0.6% 58.6% 73.9% 76.9% % dropout 0.0% 13.1% 20.2% 21.5% 22.9% 22.7% 1999 N % enrollment 100.0% 89.0% 81.7% 79.4% 15.0% 2.4% 0.9% 62.4% 74.9% 76.4% % dropout 0.0% 11.0% 18.3% 20.6% 22.6% 22.7% 2000 N % enrollment 100.0% 87.5% 80.7% 79.2% 15.9% 2.7% 0.8% 60.2% 73.4% % dropout 0.0% 12.5% 19.3% 20.8% 23.9% 23.8% nd Fall Retention Rate: 90.3% 2005 Cohort Graduation Rates: Within 4 yrs: 64.1% Within 5 yrs: 76.1% Within 6 yrs: 78.4% nd Fall Retention Rate: 92.5% 2001 N % enrollment 100.0% 88.6% 81.8% 80.6% 14.1% 0.0% 0.9% 63.7% % dropout 0.0% 11.4% 18.2% 19.4% 22.3% 0.0% 2002 N % enrollment 100.0% 89.9% 84.3% 83.2% 0.0% 0.0% 1.2% % dropout 0.0% 10.1% 15.7% 16.8% 0.0% 0.0% 2003 N % enrollment 100.0% 88.4% 81.8% 0.0% 0.0% 0.0% % dropout 0.0% 11.6% 18.2% 0.0% 0.0% 0.0% 2004 N % enrollment 100.0% 89.0% 0.0% 0.0% 0.0% 0.0% % dropout 0.0% 11.0% 0.0% 0.0% 0.0% 0.0%
19 Student Retention Benchmarks
20 Accuracy of Enrollment Projection Model
21 THE IMPACT OF RETENTION ON HOUSING ENROLLMENTS University of Delaware
22 The Issue 22
23 23 Why the concern? Impact of student outcomes and success Facilities under-utilized Loss of revenue
24 24 What is our Goal? Identify areas for improvement to help reverse the trend of second year students moving off-campus and reestablish acceptable occupancy rates.
25 25 Methodology Utilize existing information Student Extracts National Survey of Student Engagement (NSSE) Educational Benchmarking, Inc. (EBI) Undergraduate Student Satisfaction Survey Develop new instrument for further exploration Housing Retention Survey developed by UD administered by Campus Labs
26 26 EBI 2010 ACUHO-I/EBI Resident Study Overall Results University Experience Residential Experience Overall Residential Value Source: 2010 ACUHO-I/EBI Resident Study
27 Impact on Overall Program Effectiveness 27 Which factors predict students overall perception of the Full Residential Experience? Regression Variables Performance Factor R 2 β Mean Descr. Learning Outcomes: Personal Interactions Top Predictor Good Satisfaction: Room Assignment or Change Process 2nd Predictor Good Satistaction: Room/Floor Environment 3rd Predictor Good Satisfaction: Dining Services 4th Predictor Good Learning Outcomes: Manage Time, Study, Solve Problems 5th Predictor Good Climate: Sense of Community 6th Predictor Excellent Satisfaction: Res Hall Student Staff 7th Predictor Excellent Source: 2010 ACUHO-I/EBI Resident Study
28 28 Impact on Cost to Quality Rating Which factors predict students rating of the overall value of their residence hall experience? Regression Variables Performance Factor R 2 β Mean Descr. Satisfaction: Dining Services Top Predictor Good Learning Outcomes: Manage Time, Study, Solve Problems 2nd Predictor Good Satistaction: Room/Floor Environment 3rd Predictor Good Learning Outcomes: Personal Interactions 4th Predictor Good Satisfaction: Services Provided 5th Predictor Good Climate: Sense of Community 6th Predictor Excellent Satisfaction: Safety and Security 7th Predictor Excellent Satisfaction: Room Assignment or Change Process 8th Predictor Good Source: 2010 ACUHO-I/EBI Resident Study
29 29 Impact on Intent to Live On Campus Which factors predict students degree of their intent to live on campus the following year? Regression Variables Performance Factor R 2 β Mean Descr. Satisfaction: Dining Services Top Predictor Good Learning Outcomes: Personal Interactions 2nd Predictor Good Satisfaction: Facilities 3rd Predictor Good Satisfaction: Safety and Security 4th Predictor Excellent Learning Outcomes: Diverse Interactions 5th Predictor Good Climate: Fellow Residents are Respectful 6th Predictor Good Source: 2010 ACUHO-I/EBI Resident Study
30 30 What does it all mean? Where should we focus our efforts? What areas do we simply monitor? What further questions do we ask?
31 31 Next Steps Establish student needs Discuss results with our Stakeholders Dining, Residence Life, Facilities, etc. Investigate and Communicate perceived value and student satisfaction factors Focus Groups for in-depth discussion Enhance marketing efforts to parents
32 32 Changes to Date & Future Recommendations New marketing messages Approval to purchase new Housing Administration System
33 33 Changes to Date & Future Recommendations Develop Resident Life Living Learning Communities (LLC)
34 34 Changes to Date & Future Recommendations Rodney Complex facility improvements
35 35 Changes to Date & Future Recommendations East Campus Freshmen Residence Complex and Dining Hall Projects Planning and Recommendations Source: New dorms to open in 2013, The Review, February 22, 2011.
36 FINAL THOUGHTS
37 Predicting Retention Group behaviors are easier to predict Individual student behaviors are impossible to predict Student decisions strongly impact departmental budgets Limitations National data doesn t factor in institutional characteristics Departmental/institutional data may not have large enough populations Accuracy of our predictive models is important, but we must also focus on getting people to use the data. Don t forget this is about informing and motivating behavior
38 Want to Learn More? Visit the EBI / MAP-Works booth in the exhibit hall Attend one of EBI s free educational webinars (www.webebi.com/community) Heather Kelly, Ed.D., Karen DeMonte, M.Ed., Darlena Jones, Ph.D.,
Student Retention A Clear and Present Danger to Institutional and Student Success A training model 3 A Clear and Present Danger to Institutional and Student Success A training model for embedding student
How to Graduate High-Risk Students Lessons from Successful For-Profit Colleges and Schools in Texas June 2010 How to Graduate High-Risk Students: Lessons from Successful For-Profit Colleges and Schools
Student Success: Progress, but Challenges The University Professional and Continuing Education Association Center for Research and Consulting In partnership with 2013 UPCEA & InsideTrack, All Rights Reserved.
Moving From Data To Action LESSONS FROM THE FIELD VOLUME 2 Volume 2 highlights new examples of NSSE data use to enhance undergraduate teaching and learning 2 Overview of NSSE The National Survey of Student
Montana School Counseling Program Montana School Counselor Association 2004 www.mtschoolcounselor.org Foreword In June 2001, The Montana Board of Public Education published a revision of the Accreditation
Leader Keys Effectiveness System Implementation Handbook Office of School Improvement Teacher and Leader Keys Effectiveness Division Acknowledgments The s (GaDOE) (LKES) Handbook was developed with the
Bachelor of Science in Business Human Resource Management The Bachelor of Science in Business Human Resource Management is a competency-based program that enables students to earn a Bachelor of Science
` University of Wisconsin-Stout Master of Science In Clinical Mental Health Counseling Student Handbook 1 INTRODUCTION This handbook is designed to provide students in the UW-Stout M.S. Clinical Mental
Bachelor of Science in Business Management The Bachelor of Science in Business Management is a competencybased program that enables leaders and managers in organizations to earn a Bachelor of Science degree.
Adams State College Graduate School and School of Business Proposed Masters of Business Administration Overview of the Proposed Program: Name of Program: Business Administration Degree Type: Masters of
Updated 4/1/14 at 4:30 pm School Psychology Masters Program Prioritization Report Graduate Program Prioritization Criteria and Questions/Elements 1. History, Development and Expectations of the Program
Master of Business Administration The Master of Business Administration program is specifically designed for experienced business professionals and managers seeking upward career mobility or professionals
The motivation and satisfaction of the students towards MBA at Karlstad University Business Administration Master s Thesis-One year program (FEAD01) 15 ECTS Academic Year Spring 2011 Thesis Advisors Inger
Communities In Schools National Evaluation Five Year Summary Report Prepared by: ICF International 9300 Lee Highway Fairfax, VA 22031 6050 (703) 934 3000 www.icfi.com October 2010 CIS National Evaluation:
Master of Business Administration Healthcare Management The Master of Business Administration Healthcare Management is specifically designed for those in an array of leadership roles as well as those transitioning
Bachelor of Science in Marketing Management The Bachelor of Science in Marketing Management is a competencybased program that enables marketing and sales professionals to earn a Bachelor of Science degree.
Artigos originais The Evaluation of Treatment Services and Systems for Substance Use Disorders 1,2 Dr. Brian Rush, Ph.D.* NEED FOR EVALUATION Large numbers of people suffer from substance use disorders
Bachelor of Science in Accounting The Bachelor of Science in Accounting is a competency-based program that enables professionals in accounting to earn a Bachelor of Science degree. The Accounting degree
Master of Science in Nursing Leadership and Management The Master of Science for is a competency-based program that prepares graduates to be leaders and managers in diverse settings: hospitals, long term
Starbucks and ASU: Partners in educating leaders for the world. Starbucks Questions ASU Questions What is this new program? ASU is joining with Starbucks to offer an extraordinary new program to all of
Master of Science in Nursing Education The Master of Science degree is a competency-based program that prepares graduates to be educators in diverse settings: hospitals, community agencies, schools, industry
The New Metrics: Tracking Today s Post-Traditional Students Cherron Hoppes, Author Helix Education firstname.lastname@example.org Panelists: Wendy McEwen University of Redlands Wendy.McEwen@redlands.edu Cherron
A STUDY OF CAREER CHOICE FACTORS AND STUDENTS ACADEMIC SUCCESS AT AN AVIATION SCHOOL By JAMES FRANKLIN PENDERGRASS Bachelor of Science in Business Administration University of Tulsa Tulsa, Oklahoma 1983
Online Human Touch (OHT) Instruction and Programming: A Conceptual Framework to Increase Student Engagement and Retention in Online Education, Part 1 Kristen Betts Drexel University School of Education
Commission on Colleges Southern Association of Colleges and Schools Best Practices For Overview to the Best Practices These Best Practices are divided into five separate components, each of which addresses
COUNSELOR Coun EDUCATION PROGRAMS: CMH & CPS CED Master s Degree Handbook Department of Special Education, Rehabilitation and Counseling 2084 H ALEY C ENTER TABLE OF CONTENTS DEPARTMENTAL OVERVIEW... 1