Doing learning analytics in higher education -Critical issues for adoption & implementation-
|
|
|
- Janis Roberts
- 10 years ago
- Views:
Transcription
1 Doing learning analytics in higher education -Critical issues for adoption & implementation- Dragan May 8, 2015 Learning Analytics Network University of Edinburgh and JISC
2 Growing demand for education!
3 Feedback loops between students and instructors are missing/weak!
4 Student Information Systems Learners Educators Learning environment
5 Mobile Student Information Systems Networks Learners Educators Search Learning environment Blogs Videos/slides
6 Mobile Student Information Systems Networks Learners Educators Search Learning environment Blogs Videos/slides
7 Learning Analytics What? Measurement, collection, analysis, and reporting of data about learners and their contexts
8 Learning Analytics Why? Understanding and optimising learning and the environments in which learning occurs
9 CASE STUDIES
10 100.00% 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% 10.00% 0.00% Year 1 Year 2 Year 3 Year 4 Course Signals No Course Signals Student retention Arnold, K. E., & Pistilli, M. D. (2012, April). Course Signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp ).
11 Can teaching be improved? Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using Signals for appropriate feedback: Perceptions and practices. Computers & Education, 57(4),
12 Wright, M. C., McKay, T., Hershock, C., Miller, K., & Tritz, J. (2014). Better Than Expected: Using Learning Analytics to Promote Student Success in Gateway Science. Change: The Magazine of Higher Learning, 46(1),
13 Wright, M. C., McKay, T., Hershock, C., Miller, K., & Tritz, J. (2014). Better Than Expected: Using Learning Analytics to Promote Student Success in Gateway Science. Change: The Magazine of Higher Learning, 46(1),
14 INSTITUTIONAL ADOPTION: CURRENT STATE
15 Very few institution-wide examples of adoption
16 Sophistication model Siemens, G., Dawson, S., & Lynch, G. (2014). Improving the Quality and Productivity of the Higher Education Sector - Policy and Strategy for Systems-Level Deployment of Learning Analytics. Canberra, Australia: Office of Learning and Teaching, Australian Government. Retrieved from
17 Sophistication model Siemens, G., Dawson, S., & Lynch, G. (2014). Improving the Quality and Productivity of the Higher Education Sector - Policy and Strategy for Systems-Level Deployment of Learning Analytics. Canberra, Australia: Office of Learning and Teaching, Australian Government. Retrieved from
18 ~70% institutions in phase 1 Goldstein, P. J., & Katz, R. N. (2005). Academic analytics: The uses of management information and technology in higher education (Vol. 8). Educause. 305 institutions, 58% at stage 1, 20% at stage 2 Yanosky, R. (2009). Institutional data management in higher education. ECAR, EDUCAUSE Center for Applied Research.
19 Interest in analytics is high, but many institutions had yet to make progress beyond basic reporting Bichsel, J. (2012). Analytics in higher education: Benefits, barriers, progress, and recommendations. EDUCAUSE Center for Applied Research.
20 What s necessary to move forward?
21 DIRECTIONS
22 Data Model Transform Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83,
23 Data Model Transform Creative data sourcing Necessary IT support Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83,
24 Data Model Transform Question-driven, not data-driven Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83,
25
26 Learning analytics is about learning
27 Instructional conditions % 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% Model 1 Moodle Model 1 + Moodle 30.00% 20.00% 10.00% 0.00% All courses together ACCT 1 BIOL 1 BIOL 2 COMM 1 COMP 1 ECON 1 * GRAP 1 MARK 1 MATH 1 Model 1 demographic and socio-economic variables * - not statistically significant Gašević, D., Dawson, S., Rogers, T., Gašević, D. (2015). Learning analytics should not promote one size fits all: The effects of course-specific technology use in predicating academic success. The Internet and Higher Education (forthcoming).
28 Learner agency Large effect sizes ( σ) on critical thinking and academic success Kovanović, V., Gašević, D., Joksimović, S., Hatala, M., Adesope, S. (2015). Analytics of Communities of Inquiry: Effects of Learning Technology Use on Cognitive Presence in Asynchronous Online Discussions. The Internet and Higher Education (forthcoming).
29 Once size fits all does not work in learning analytics
30 Data Model Transform Participatory design of analytics tools Analytics tools for non-statistics experts Develop capabilities to exploit (big) data Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83,
31 Visualizations can be harmful Corrin, L., & de Barba, P. (2014). Exploring students interpretation of feedback delivered through learning analytics dashboards. In Proceedings of the ascilite 2014 conference (pp ). ascilite.
32 What s our reality?
33 CHALLENGES
34 Current state Benchmarking learning analytics status, policy and practices for Australian universities
35 Senior management perspective
36 Senior management perspective
37 Solution-driven approach Bought an analytics product. Analytics box ticked!
38 Lack of data-informed decision making culture Macfadyen, L., & Dawson, S. (2012). Numbers Are Not Enough. Why e-learning Analytics Failed to Inform an Institutional Strategic Plan. Educational Technology & Society, 15(3),
39 Researchers not focused on scalability
40 FINAL REMARKS
41 Embracing complexity of educational systems
42 Rapid Outcome Mapping Approach (ROMA) Macfadyen, L. P., Dawson, S., Pardo, A., & Gasevic, D. (2014). Embracing big data in complex educational systems: The learning analytics imperative and the policy challenge. Research & Practice in Assessment, 9(2),
43 Capacity development Multidisciplinary teams in institutions critical
44 Learning from the successful examples
45 An institutional learning analytics vision Tynan, B. & Buckingham Shum, S. (2013). Designing Systemic Learning Analytics at the Open University. SoLAR Open Symposium Strategy & Policy for Systemic Learning Analytics.
46 Cross-institutional experience sharing & collaboration
47 Learning Analytics Initiative
48 Ethical and privacy consideration
49
50 Sclater, N. (2014). Code of practice for learning analytics: A literature review of the ethical and legal issues.
51 Development of analytics culture Manyika, J. et al. (2011). Big Data: The Next Frontier for Innovation, Competition, and Productivity. McKinsey Global Institute,
52
53 Thank you!
THE ROLE OF LEARNING ANALYTICS IN FUTURE EDUCATION MODELS
THE ROLE OF LEARNING ANALYTICS IN FUTURE EDUCATION MODELS CONTENTS EXECUTIVE SUMMARY 3 1.0 INTRODUCTION 4 2.0 IMPORTANCE OF DATA-INFORMED APPROACHES FOR EDUCATION 5 3.0 LEARNING ANALYTICS OVERVIEW 7 3.1
Exploring students interpretation of feedback delivered through learning analytics dashboards
Exploring students interpretation of feedback delivered through learning analytics dashboards Linda Corrin, Paula de Barba Centre for the Study of Higher Education University of Melbourne The delivery
Abstract. Introduction
Let s not forget: Learning analytics are about learning 1 Let s not forget: Learning Analytics are about Learning Dragan Gašević, Shane Dawson, George Siemens Abstract The analysis of data collected from
Improving the Quality and Productivity of the Higher Education Sector
Improving the Quality and Productivity of the Higher Education Sector Policy and Strategy for Systems-Level Deployment of Learning Analytics Society for Learning Analytics Research George Siemens Shane
LEARNING ANALYTICS: A SOUTH AFRICAN HIGHER EDUCATION PERSPECTIVE
LEARNING ANALYTICS: A SOUTH AFRICAN HIGHER EDUCATION PERSPECTIVE A few steps on an analytics journey Juan-Claude Lemmens and Michael Henn Presentation Outline Introduction to the research Establishing
TECHNOLOGY ENHANCED ANALYTICS (TEA) IN HIGHER EDUCATION
International Conference on Educational Technologies 2013 TECHNOLOGY ENHANCED ANALYTICS (TEA) IN HIGHER EDUCATION Ben Kei Daniel and Russell Butson Educational Technology Group - Higher Education Development
Loop: A learning analytics tool to provide teachers with useful data visualisations
Loop: A learning analytics tool to provide teachers with useful data visualisations Linda Corrin, Aneesha Bakharia David Williams Gregor Kennedy Lori Lockyer Macquarie University Shane Dawson Paula de
Learning Analytics in Higher Education: A Summary of Tools and Approaches
Learning Analytics in Higher Education: A Summary of Tools and Approaches Amara Atif, Deborah Richards Department of Computing, Faculty of Science, Macquarie University Ayse Bilgin Department of Statistics,
The skinny on big data in education: Learning analytics simplified
The skinny on big data in education: Learning analytics simplified By Jacqueleen A. Reyes, Nova Southeastern University Abstract This paper examines the current state of learning analytics (LA), its stakeholders
Implementing Timely Interventions to Improve Students Learning Experience*
Implementing Timely Interventions to Improve Students Learning Experience* Sue Whale Fredy-Roberto Valenzuela Josie Fisher This paper describes the development of an approach aimed at increasing student
Learning Analytics: Targeting Instruction, Curricula and Student Support
Learning Analytics: Targeting Instruction, Curricula and Student Support Craig Bach Office of the Provost, Drexel University Philadelphia, PA 19104, USA ABSTRACT For several decades, major industries have
Using Learning Analytics to Predict (and Improve) Student Success: A Faculty Perspective. Beth Dietz-Uhler & Janet E. Hurn Miami University
www.ncolr.org/jiol Volume 12, Number 1, Spring 2013 ISSN: 1541-4914 Using Learning Analytics to Predict (and Improve) Student Success: A Faculty Perspective Beth Dietz-Uhler & Janet E. Hurn Miami University
Analytics: An exploration of the nomenclature in the student experience.
Analytics: An exploration of the nomenclature in the student experience. Rhonda Leece Student Administration and Services University of New England Abstract The student journey through higher education,
Learning and Academic Analytics in the Realize it System
Learning and Academic Analytics in the Realize it System Colm Howlin CCKF Limited Dublin, Ireland [email protected] Danny Lynch CCKF Limited Dublin, Ireland [email protected] Abstract: Analytics
A topical start-up guide series on emerging topics on Educational Media and Technology
A topical start-up guide series on emerging topics on Educational Media and Technology CEMCA EdTech Notes 1 Introduction Introduction Teachers who lack the visual cues that are available in a face-to-face
FOUNDATIONS OF ONLINE LEARNING IN CALIBRATE
FOUNDATIONS OF ONLINE LEARNING IN CALIBRATE The policies and implementation of Medallion Learning's Calibrate ensure the use of best practices in online education in the areas of Content Development, Course
Learning Analytics: Readiness and Rewards
1 Learning Analytics: Readiness and Rewards May 2013; Norm Friesen ([email protected]) Executive Summary: This paper introduces the relatively new field of learning analytics, first by considering the relevant
E-Learning Standards and Learning Analytics
E-Learning Standards and Learning Analytics Can Data Collection Be Improved by Using Standard Data Models? Ángel del Blanco, Ángel Serrano, Manuel Freire, Iván Martínez-Ortiz, Baltasar Fernández-Manjón
Student Perspectives on the Use of their Data: Between Intrusion, Surveillance and Care
Student Perspectives on the Use of their Data: Between Intrusion, Surveillance and Care Sharon Slade, Open University, United Kingdom, Paul Prinsloo, University of South Africa, South Africa Abstract Best
Online teaching: Moving from good to great
Journal of the NUS Teaching Academy Volume 3 Number 1 February/March 2013 From the Desk of... Online teaching: Moving from good to great Rosemary PAPA 1, Ric BROWN 2 1 Del and Jewell Lewis Endowed Chair,
Strengthening Intelligence and Investigations with Incident Management Software
WHITE PAPER by Brian McIlravey, CPP and Peter Ohlhausen Strengthening Intelligence and Investigations with Incident Management Software by Brian McIlravey About the Authors: Brian McIlravey, CPP, is Co-CEO
CASE STUDY I: Predictive analytics at Nottingham Trent University
CASE STUDY I: Predictive analytics at Nottingham Trent University One of the most prominent learning analytics initiatives in the UK is at Nottingham Trent University (NTU). The institution-wide rollout
Academic Analytics and Data Mining in Higher Education. Paul Baepler University of Minnesota Minneapolis, Minnesota, USA baepl001@umn.
Academic Analytics and Data Mining in Higher Education Paul Baepler University of Minnesota Minneapolis, Minnesota, USA [email protected] Cynthia James Murdoch University of Minnesota Minneapolis, Minnesota,
DID YOU KNOW? KNIGHT FRANK OUR SERVICES PROPERTY MANAGEMENT FACILITIES MANAGEMENT. Management FACILITIES. Management. Property PROPERTY ACCOUNTING
KNIGHT FRANK Knight Frank is the world s largest privately owned property consultancy firm. We have a strong global presence with 335 offices, in 52 countries on six continents, and we provide a complete
An Experiment in Using Twitter in Teaching a Student Affairs Practicum Course
http://studentaffairs.com/ejournal/summer_2013/anexperimentinusingtwitter.html An Experiment in Using Twitter in Teaching a Student Affairs Practicum Course Paul G. Brown PhD Student Boston College [email protected]
DRAFT LAMC Addendum to the Course Outline of Record Course Approval Application for Online/Distance Learning Delivery
Date of Submission: DRAFT LAMC Addendum to the Course Outline of Record Course Approval Application for Online/Distance Learning Delivery Credit and Acknowledgements: Special thanks and credit to both
Plug and play learning application integration using IMS Learning Tools Interoperability
Plug and play learning application integration using IMS Learning Tools Interoperability Simon Booth University of Stirling Susi Peacock Queen Margaret University Stephen P. Vickers The University of Edinburgh
Distance Learning Disruptions: Implications for Practice and Policy
Distance Learning Disruptions: Implications for Practice and Policy Paper presented in track 6 at the EAIR 37 th Annual Forum in Krems, Austria 30 August till 2 September 2015 Maureen Snow Andrade Contact
Learning Analytics: Definitions, Processes and Potential. Tanya Elias January, 2011
Learning Analytics: Definitions, Processes and Potential Tanya Elias January, 2011 Learning Analytics: The Definitions, the Processes, and the Potential Learning is a product of interaction. Depending
Learning analytics approach of EMMA project. Kairit Tammets Centre for educational technology Tallinn University Estonia Contact Kairit@tlu.
Learning analytics approach of EMMA project Kairit Tammets Centre for educational technology Tallinn University Estonia Contact [email protected] Francis Brouns Welten Institute Open Universiteit, Nederland
Model for E-Learning in Higher Education of Agricultural Extension and Education in Iran
Model for E-Learning in Higher Education of Agricultural Extension and Education in Iran Jafar Yaghoubi 1 and Iraj Malekmohammadi 2 1. Assistant Professor, Zanjan University, Iran, [email protected] 2.
Demystifying Academic Analytics. Charlene Douglas, EdD Marketing Manager, Higher Education, North America. Introduction
Demystifying Academic Analytics Charlene Douglas, EdD Marketing Manager, Higher Education, North America Introduction Accountability, stakeholders, dashboards this is the language of corporations, not
And. ENGL 101: College English I must take the Professional Purposes Pa
HKU SPACE COMMUNITY COLLEGE WICHITA STATE UNIVERSITY ASSOCIATE DEGREE PROGRAM 83 11000: General English I No credit - Remedial 83 11200A: General English II No credit - Remedial 83 11200B: Foundations
Online Course Standards Rubric
Online Course Standards Rubric The Online Course Standards Rubric provides a framework for online course design based on the University of New Mexico s online course standards and expectancies for quality
Learning Management System-An Effective ICT Tool in. Higher Education
Learning Management System-An Effective ICT Tool in Higher Education Department of Computer Science, Parvatibai Chowgule College of Arts and Science (Autonomous), Gogol, Margao Goa 403 602, India. ABSTRACT
BEST PRACTICES: CREATING AN INNOVATIVE EDUCATIONAL EXPERIENCE
Education Perspectives BEST PRACTICES: CREATING AN INNOVATIVE EDUCATIONAL EXPERIENCE PERSONALIZED LEARNING PRACTICES TO ENGAGE STUDENTS AND INCREASE PERFORMANCE Barbra Thoeming 2 INTRODUCTION BEST PRACTICES
Learning Analytics: Making learning better?
Learning Analytics: Making learning better? Dr Doug Clow Institute of Educational Technology, The Open University, UK @dougclow dougclow.org [email protected] CC-BY You are free to: copy, share, adapt,
MAOL: 2013-2014 Assessment Report. Master of Arts in Organizational Leadership (MAOL) Assessed by: MAOL Faculty
Master of Arts in Organizational Leadership (MAOL) Assessed by: MAOL Faculty Cycle of Assessment: Fall 2013-Spring 2014 Mission Statement: The Master of Arts in Organizational Leadership is designed to
Learning Analytics in Higher Education: An Annotated Bibliography
1 Learning Analytics in Higher Education: An Annotated Bibliography Current State of Learning Analytics in Higher Education Drivers, Trends, Benefits, and Challenges Bichsel, J. (2012). Analytics in Higher
e-learning in Practice Developing the Leadership Learning Environment
e-learning in Practice Developing the Leadership Learning Environment Casey Wilson and John Mackness Lancaster University [email protected], [email protected] ABSTRACT This paper presents
A Conceptual Framework for Online Course Teaching and Assessment in Construction Education
A Conceptual Framework for Online Course Teaching and Assessment in Construction Education Namhun Lee Department of Manufacturing and Construction Management Central Connecticut State University With the
5 Steps to Creating a Successful Optimization Strategy
5 Steps to Creating a Successful Optimization Strategy Many companies are now recognizing that in a world of mobile devices and increasingly sophisticated online services, the creation of an excellent
2012 Education Strategy
1 About Education Strategy 25 year history of assisting institutions in over 100 different markets develop and deploy curriculum First online partnership, a complete major, was in 2002 Executive team members
Creative Critique in Visual Communication: Effective Feedback in Design Projects Through Voice- Centred Studio-Based Communication and Online Delivery
Creative Critique in Visual Communication: Effective Feedback in Design Projects Through Voice- Centred Studio-Based Communication and Online Delivery Mary-Jane Taylor University of Canberra; School of
Student retention and learning analytics: A snapshot of Australian practices and a framework for advancement
Student retention and learning analytics: A snapshot of Australian practices and a framework for advancement Final report 2015 University of South Australia The University of Melbourne University of Technology
PERKS OF BEING A WALLFLOWER: LEARNING WITHOUT ENGAGING IN DISCUSSION FORUMS
PERKS OF BEING A WALLFLOWER: LEARNING WITHOUT ENGAGING IN DISCUSSION FORUMS Angelique Hamane 1, Farzin Madjidi 2, Stephanie Glick 3 1 California State University, Los Angeles, [email protected] 2
Running head: LEARNING ANALYTICS, ASSESSMENT FOR LEARNING!1. Learning Analytics as Assessment for Learning. Lisa Rubini-LaForest
Running head: LEARNING ANALYTICS, ASSESSMENT FOR LEARNING!1!!!!! Learning Analytics as Assessment for Learning Lisa Rubini-LaForest University of Calgary LEARNING ANALYTICS, ASSESSMENT FOR LEARNING!2 Abstract
Assessment of Asynchronous Online Discussions for a Constructive Online Learning Community
Assessment of Asynchronous Online Discussions for a Constructive Online Learning Community Ping An Wang, Senior Member, IACSIT Abstract This paper proposes a new Online Learning Community Model for asynchronous
WHERE IS EDTECH HEADING? Brian Stewart CANNHEIT June 17, 2015
WHERE IS EDTECH HEADING? Brian Stewart CANNHEIT June 17, 2015 Prediction is very difficult, especially if it's about the future. Niels Bohr - Physicist 2 Those who have knowledge, don't predict. Those
http://espace.library.curtin.edu.au:80/r?func=dbin-jump-full&local_base=gen01-era02&object_id=187303
Citation: Robertson, Rachel. 2012. Using knowledge networks to teach online writing skills in the professional writing classroom, in Herrington, A. and Schrape, J. and Singh, K. (ed), Engaging students
Talent management: an overview
Homepage > HR Resources > Factsheets > Talent management: an overview Talent management: an overview Revised August 2012 In this factsheet What is talent management? The changing context and business case
1 of 5 23/06/2015 9:56 AM
1 of 5 23/06/2015 9:56 AM The Higher Education Technology Agenda This flipped session targets participants interested in human-centered design in relation to big data and learning analytics. We invite
Big Data and analytics in higher education: Opportunities and challenges
British Journal of Educational Technology (2014) doi:10.1111/bjet.12230 Big Data and analytics in higher education: Opportunities and challenges Ben Daniel Dr. Ben Daniel is a Senior Lecturer in Higher
University Strategy 2011-2015
University Strategy 2011-2015 FOREWORD Dear Colleagues Thank you for your contributions to the University Strategy 2011-2015, which was endorsed by University Council at its meeting in December 2010. The
Issues in offering numeric based courses in an online environment
Abstract Issues in offering numeric based courses in an online environment Scott Mensch Indiana University of Pennsylvania When developing online classrooms it is necessary to ensure that all learners
DAVE CORMIER. Charlottetown, PE, Canada [email protected] @davecormier 902-566-0908 (work) 902-367-6465 (home)
DAVE CORMIER Charlottetown, PE, Canada [email protected] @davecormier 902-566-0908 (work) 902-367-6465 (home) http://davecormier.com/citations http://davecormier.com/edblog Areas of Expertise Rhizomatic
Teaching with Web 2.0 Technologies: Benefits, Barriers and Best Practices
Teaching with Web 2.0 Technologies: Benefits, Barriers and Best Practices Yun-Jo An Bosede Aworuwa Glenda Ballard & Kevin Williams College of Liberal Arts and Education Texas A&M University-Texarkana Abstract
c o n t e m p o r a r y
c o n t e m p o r a r y MCEETYA A u s t r a l i a - N e w Z e a l a n d 21 st century education integrates technologies, engaging students in ways not previously possible, creating new learning and teaching
Academic Analytics: Business Intelligence For Higher Education
Academic Analytics: Business Intelligence For Higher Education Campus Technology Magazine Introduction For more than a quarter of a century, corporate America has benefited from business intelligence the
Teaching smarter: How mining ICT data can inform and improve learning and teaching practice
Teaching smarter: How mining ICT data can inform and improve learning and teaching practice Shane Dawson Graduate School of Medicine University of Wollongong Erica McWilliam and Jen Pei-Ling Tan ARC Centre
Creepy Analytics and Learner Data Rights
Creepy Analytics and Learner Data Rights Scott Beattie Central Queensland University Carolyn Woodley RMIT Kay Souter Deakin University Enthusiasm for the potential of learning analytics and big data technologies
Syllabus Subject: Relational, Direct and Interactive Marketing (II) Degree: Titulación Superior en Dirección de Marketing y Gestión Comercial
Syllabus Subject: Relational, Direct and Interactive Marketing (II) Degree: Titulación Superior en Dirección de Marketing y Gestión Comercial Academic year 2012/2013 Teachers: Oscar VEGA Period of classes