STRATEGIES FOR IMPLEMENTING A SYSTEMATIC INSTITUTIONAL ASSESSMENT PROCESS TAMU 2010 Katherine Perez and Jacqueline Peña Institutional Effectiveness Coordinators
Florida International University: Institutional Profile Large Urban Public 4-year Research University Enrollment 40,455 30,928 Undergraduate 7,299 Graduate 2,228 Non-Degrees Total Number of Degree Programs: 191 Primarily Commuter Students
Evolution of Assessment Key stakeholders Assessment requirements/needs Alliances Roles and responsibilities Streamline multiple assessment needs System of collecting data Timeline for assessment Documentation of procedures Disseminating information Support system for faculty and staff Checks and balances Sustainability plan
Identify Stakeholders Administrative Leadership Team Faculty Students Staff Members From Essential Areas
Identify Assessment Requirements Regional Accreditation Agencies Discipline Specific Accreditation Agencies State/Local Assessment Reporting Requirements Internal Assessment Needs Program review Annual reports Faculty driven assessment General education
Identify Alliances Assessment Experts Within Institution Institutional Research Central Research Office Units already engaged with extensive assessment efforts Faculty Conducting Research Other Institutions External Consultants Assessment Groups or Mailing Lists
Organize Roles and Responsibilities President Institutional Effectiveness Faculty Student Affairs Provost Institutional Research Department Chairs Administrative Offices Other Key Members Deans
Organize Multiple Assessment Needs
Integration of Collaboration: Assessment Review Process Academic Assessment Liaisons Administrative Staff IE Office Faculty Members Administrative Assessment Liaisons
Organize a System of Data Collection What will the assessment collection and review process be like? Centralized all assessment processes are initiated, managed, and reviewed through an institution-wide office Decentralized assessment processes are initiated, developed, and reviewed by individual units; institutionwide office serves as resource and reservoir
Organize a System of Data Collection What type of assessment documentation system will be used? Low tech Word or Excel documents High tech Commercial software system Open source software system Locally developed software system
Organize a System of Data Collection Word or Excel Templates Advantages Fast implementation Little to no technological training required Low costs Formatting easily modified Commercial Assessment Application Advantages Integrated features (e.g., attachments, rubrics, flagging) Tracking and reporting capabilities Facilitates collaboration and access to documentation Locally Developed or Open Source Application Advantages Highly customized to institution s assessment needs Ownership of data Flexible for future changes Disadvantages Time consuming to track versions Lack of automation Limited features: no reporting Formatting easily modified (by anyone) Disadvantages Cost Technological training requirements Control of data dependant on external agency Modifications costly or slow Disadvantages Requires IT team Software/Server maintenance Time and expertise requirements Cost dependant on existing resources
Assessment Management Software Commercial TrakDat TK20 WEAVEOnline Black Board TaskStream Compliance Assist LiveText Open Source PRISM (Program Improvement Research) OATS (Online Assessment Management System) OpenIGOR
Centralized/Decentralized Systems Decentralized Hybrid Centralized Decisions: Individual Departments Review Process: Faculty Within Academic Program Assessments: Program or Course Developed Measures Decisions: Representative Committee Review Process: Peer Review Across Academic Areas Assessments: Combination of Program/Course and Large Scale Measures Decisions: Centralized Assessment Office Review Process: Administrators or Consultants Assessments: Large Scale National Exams and Surveys; IR Data
Organize a System of Data Collection What kind of assessment data will be gathered? When and where will these measures be collected?
Sources of Assessment Data Course Level Essays Presentations Minute papers Embedded questions Pre-post tests Program Level Portfolios Exit exams Graduation surveys Discipline specific national exams Institution Level Factbook data National Surveys Voluntary national exams
Develop Timelines Long Term Deadlines Assessment cycles Review cycles Regional accreditation requirements Program review Institutional assessments (e.g. surveys) Short Term Deadlines Roll-out of assessment reporting Assessment training
Sample Timeline
Develop Documentation Assessment Report Templates Handbooks and Instruction Sheets Website Quick facts Deadlines Announcements Assessment Directories
Develop Documentation
Develop Documentation
Develop Documentation
Develop Methods of Disseminating Information Establish Contacts Assessment Liaisons University Mailing System Mailing Lists Types of Information Distributed Deadlines Workshops or Professional Development Events Accomplishments Letters of Appreciation Assessment Fast Facts Upcoming Changes
Implement Support System Resources Assessment support: visits, phone, e-mail Books and publications Department or program specific examples Internal Publications Newsletters Handbooks Workshops Rubric construction Student learning assessment Using assessment data Administrative assessment Curriculum maps
Implement System of Checks and Balances Review Process Intra-department Inter-department External reviewers Central assessment office University-wide committees Document Tracking Clear Guidelines for Assessment Submission Requirements
Implement Structure for Sustainability Assessment Research Partnerships Faculty assessment presentations Teaming IE staff with faculty for publication Assessment Committees Share Accomplishments and Future Goals Facilitate Assessment Work Manageable assessment requirements Learning groups Faculty and staff participation in decision-making Incentives Financial/course release Tenure and promotion Awards/acknowledgement
Academic Planning and Accountability Institutional Effectiveness http://apa.fiu.edu Katherine Perez 305-348-1418 kathpere@fiu.edu Jacqueline Peña 305-348-1367 jpena@fiu.edu