Assessing Graduate Programs: Outcomes-Based Assessment. Workshop 1

Transcription

1 Assessing Graduate Programs: Outcomes-Based Assessment Workshop 1

2 What Is Outcomes-Based Assessment? The process of (1) determining the indicators of an effective program, (2) using those indicators as criteria for assessing the program, and (3) applying the results of the assessment toward the ongoing and continuous improvement of the program.

3 Outcomes for Workshops Outcome for workshop 1: By the end of the workshop, you will be able to lead your graduate committee in the process of generating objectives and outcomes for your programs. Outcome for workshop 2: By the end of the workshop, you will be able lead your graduate committee in the process of identifying ways of assessing the program outcomes and creating an assessment plan.

4 Pilot Programs Food Science Mathematics Education Mechanical and Aerospace Engineering Psychology Science Education

5 Potential Benefits of Assessment Planning Process Gives faculty a voice in defining the program and thus a stake in the program Gives faculty an investment in assessing the program Provides faculty-approved indicators for gauging and improving the effectiveness of the program

6 What Are Objectives? Program objectives are the general goals that define what it means to be an effective program.

7 Objectives: Food Science 1. To guide the graduate education of students preparing for professional careers 2. To prepare students to be effective researchers in contributing to the advancement of the safety, variety, and quality of food products for the state, the nation, and the world 3. To maintain and improve the program s leadership position nationally and internationally

8 Objectives: MAE 1. To enable students to develop as successful professionals for highly competitive positions in industry, government, and academic departments 2. To prepare students to be effective researchers in the fields of mechanical or aerospace engineering 3. To enhance visibility of the doctoral programs in mechanical and aerospace engineering nationally

9 Objectives: Science Education 1. To prepare students to achieve their professional goals in science education in a collaborative environment 2. To prepare students to conduct research effectively in science education in a collaborative environment 3. To provide leadership and expertise at local, state, national and international levels for the improvement of science education

10 Three Common Objectives Developing students as successful professionals in the field Developing students as effective researchers in the field Maintaining or enhancing the overall quality of the program

11 What Are Outcomes? Program outcomes are specific results the program seeks to achieve in order to attain the general goals defined in the objectives.

12 Outcomes: MAE 1. To enable students to develop as successful professionals for highly competitive positions in industry, government, and academic departments, the programs aim to provide a variety of experiences that help students to: a. achieve the highest level of expertise in mechanical or aerospace engineering, mastery of the knowledge in their fields and the ability to apply associated technologies to novel and emerging problems b. present research to local, regional, national, and international audiences through publications in professional journals and conference papers given in a range of venues, from graduate seminars to professional meetings c. participate in professional organizations, becoming members and attending meetings d. broaden their professional foundations through activities such as teaching, internships, fellowships, and grant applications

13 Outcomes: Science Education 2. To prepare students to conduct research effectively in science education in a collaborative environment, the program aims to offer a variety of educational experiences that are designed to develop in students the ability to: a. read and review the literature in an area of study in such a way that reveals a comprehensive understanding of the literature b. identify research questions/problems that are pertinent to a field of study and provide a focus for making a significant contribution to the field c. gather, organize, analyze, and report data using a conceptual framework appropriate to the research question and the field of study d. interpret research results in a way that adds to the understanding of the field of study and relates the findings to teaching and learning in science

14 Outcomes: Food Science 3. To maintain and improve the program s leadership position nationally and internationally, the program aims to: a. continue to be nationally competitive by attracting high-quality students b. provide effective mentoring that encourages students to graduate in a timely manner c. place graduates in positions in industry and academics d. maintain a nationally recognized faculty that is large enough and appropriately distributed across food science disciplines to offer students a wide range of fields of expertise

15 Objectives and Outcomes Objectives: general, indefinite, not intended to be measured; they set the overall agenda for the program Outcomes: specific, definite, intended to be measured; they establish the particular means by which the agenda is achieved

16 Program Outcomes: Similarities and Differences DGPs at each table work as a group to study the same kind of objective from two different programs and identify similarities and differences between the sets of outcomes. Designate one person to take notes on the discussion. What do the similarities and differences suggest about the two programs?

17 Procedure for Generating Programs Outcomes Lead collective brainstorming of committee members; take notes Draft the notes in the form of objectives and outcomes Direct collective revision of drafts Gain approval of committee/graduate faculty for final draft

18 Generating Program Outcomes DGPs at each table work as a group: Designate a group leader Choose one of the standard objectives Using one or two of the Questions to Guide Brainstorming, the group leader will guide brainstorming related to chosen objective Group leader will take notes Together the group members will compose two or three outcomes based on the notes Write outcomes on the large tablet and post on a wall

19 Questions and Concerns What questions or concerns do you have about working with your graduate committee in creating program objectives and outcomes?

20 Consultant Mike Carter