Graduate Assessment Plan (Doctoral program) Environmental Sciences Graduate Program (ESGP) Graduate School

Transcription

1 Graduate Assessment Plan (Doctoral program) Environmental Sciences Graduate Program (ESGP) Graduate School 1. Program Information: Program Environmental Sciences Graduate Program (ESGP) Department ESGP College Graduate School Report Submitted by Andrew R. Blaustein 2. Program Outcomes Provide the Graduate Learning Objectives/Outcomes for your PhD program. Attachment 1 ( Graduate Learning Objectives/Outcomes ), below, includes a broad statement of universal graduate learning objectives and outcomes for programs in the sciences. Objectives and outcomes specific to Environmental Sciences Graduate Program include: The purpose of the ES Graduate Program is to develop scientists who will be able to analyze and understand environmental systems, predict environmental change, and participate in the management of the environment. Upon completing their ES graduate degrees, students will be prepared to conduct research in national research laboratories, field stations, universities, as well as institutes and corporations in the private sector. Graduates may find careers in federal, state, and local government agencies that are charged with managing natural resources. Students completing the ES Graduate Program will also find employment in the private sector with productive careers in industry and consulting firms. 3. Measurement Provide a detailed narrative or schematic to articulate how all the outcomes will be measured. a) Describe the methods you will use to assess each outcome. Paragraph 2 in Attachment 1 lists the means of assessment employed in measuring outcomes: minimum admission standards, assessment of application materials, admissions process interviews; meeting a predetermined standard in graduate level coursework (content/subject matter and GPA); graded cumulative exams; a pass/fail oral preliminary exam; written thesis or research paper; oral defense. Measurement methods specific to ESGP include: See attachments and details outlined in the ESGP Handbook available online:

2 b) Describe and attach any measurement tools to be used (exam results, performance criteria, evaluation/performance rubrics, etc.,) Attachment 2 is a Scoring Guide (Rubric) for the Ph.D. Preliminary Exam; attachment 3 is a Scoring Guide for the Ph.D. Thesis Defense. These tools will be used in conjunction with existing metrics as listed above and in Attachment Please provide a skeletal assessment plan (Mapping Guide) for your program: Provide a skeleton plan describing the specific activities and assessment method for each outcome. Map all required courses (with their learning outcomes) and assessments to the program outcomes. The mapping guide is included as Attachment 4, Mapping Guide for the Ph.D. Degree. ESGP 5. Other activities that have informed decision making: Please report on any other activities that you feel fall under assessment that were not captured above. This may include general satisfaction surveys, employer input, or other initiatives that contribute to student learning or program improvement. Participation in the joint Inter-campus conference is required. This is an annual meeting of Environmental Science/Studies students from Oregon State University, University of Oregon and Portland State University. OSU students are required to attend and present either a poster or oral talk once during their career. Students are encouraged to attend each year.

3 Graduate Learning Objectives/Outcomes for Ph.D. & MS Programs ESGP, Graduate School The following table indicates what we have identified as universal graduate learning objectives, by which we assess graduate learning outcomes; also for each we include the broadly used means of assessment. Individual programs and Departments may have additional graduate learning objectives; most often these are explicitly stated in a Departmental Graduate Handbook, in documentation provided by a professional organization or society, or included as degree requirements. The overarching objectives in the table address what are considered to be critical areas of competency (a comprehensive appreciation of the field of study, an understanding of current issues of importance in the field, a grounding in ethics, and a demonstration of creativity) at various points on the path through graduate studies (admissions, matriculation to candidacy, graduation). Some of the objectives apply to any degree program, and some are specific to the non-thesis (coursework) MS, the non-thesis (project) MS, the thesis MS, or the PhD, as indicated. Likewise there is some variation amongst the degree programs as regards means of assessment. Means of assessment referenced in the table below include: (1) minimum admission standards, assessment of application materials, admissions process interviews; (2) meeting a predetermined standard in graduate level coursework (content/subject matter and GPA); (3) graded cumulative exams; (4) a pass/fail oral preliminary exam; (5) written thesis or research paper; (6) oral defense; (7) participation in the inter-campus conference. Ph.D. Objective Students will have met the objectives for learning outcomes in an undergraduate discipline relevant to their graduate field of study. Scoring methods: 1 Graduates will be able to summarize major central issues and current research problems in their field. Scoring methods: 2,3,4,5,6 Graduates will be able to communicate the major tenets of their field and their work orally and in writing for students, peers and the lay public. Scoring methods: 2 Graduates will be able to explain and identify areas of uncertainty in their fields. Scoring methods: 2,3,4 Graduates will be able to identify areas where ethical issues may arise in their work or discipline. Graduates will be able to articulate strategies for dealing with ethical issues in their field. Scoring methods: 2,4,5,6 Graduates will have designed, carried out and presented an original work of research at the leading edge of their discipline. MS Objective Students will have met the objectives for learning outcomes in an undergraduate discipline relevant to their graduate field of study. Scoring methods: 1 Graduates will be able to summarize major central issues and current research problems in their field. Graduates will be able to communicate the major tenets of their field and their work orally and in writing for students, peers and the lay public. Scoring methods: 2 Graduates will be able to identify areas where ethical issues may arise in their work or discipline. Graduates will have completed and defended: (1) an original manuscript based on either a review and synthesis of the primary literature [nonthesis (project) MS] or original research [thesis MS]; or (2) mastery of appropriate advanced coursework in the field. [non-thesis (coursework) MS] Attachment 1

4 Scoring Guide (Rubric) for Graduate Learning Outcome Assessment Ph.D. PRELIMINARY EXAM in ESGP Candidate Name: Date: Title of Thesis: Evaluation/Guidance 1. Problem Definition: States the research problem clearly, providing motivation for undertaking the research 2. Literature and Previous Work: Demonstrates sound knowledge of literature in the area, and of prior work on the specific research problem 3. Impact of Proposed Research: Demonstrates the potential value of the proposed solution to the research problem in advancing knowledge within the area of study 4. Solution Plan: Provides a sound plan for applying state ofthe-art research methods/tools to solving the defined problem and shows a good understanding of how to use methods/tools effectively 5. Expected Results: Provides a sound plan for analyzing and interpreting research results/data 6. Quality of Written Communication: Communicates research proposal clearly and professionally in written form 7. Quality of Oral Communication: Communicates research proposal clearly and professionally in oral form 8. Critical Thinking: Demonstrates capability for independent research in the area of study, preparedness in core disciplines relevant to research, and ability to complete the proposed research 9. Broader Impact: Demonstrates awareness of broader implications of the proposed research. Broader implications may include social, economic, technical, ethical, business, etc. aspects. Does not meet Expectations Meets Expectations Overall Assessment: The assessment of the overall performance of the candidate based on the evidence provided in items 1 9 above. CRITERIA OVERALL, My rating of this preliminary exam indicates that it: PERFORMANCE RATINGS for PRELIMINARY EXAM Does NOT PASS Exam PASSES Exam Does not meet Meets expectations expectations Name of the Examining Committee Member: Signature of the Examining Committee Member: Examiner: Please use the reverse side of this form for written commentary as needed. Attachment 2

5 Scoring Guide (Rubric) for Graduate Learning Outcome Assessment Ph.D. THESIS DEFENSE EXAM in ESGP Candidate Name: Date: Title of Thesis: Evaluation/Guidance 1. Problem Definition: Has stated the research problem clearly, providing motivation for undertaking the research 2. Literature and Previous Work: Demonstrated sound knowledge of literature in the area, and of prior work on the specific research problem 3. Impact of Proposed Research: Demonstrated the potential value of solution to the research problem in advancing knowledge within the area of study 4. Solution Approach: Has applied sound state-of-the field research methods/tools to solve the defined problem and has described the methods/tools effectively 5. Results: Analyzed and interpreted research results/data effectively 6. Quality of Written Communication: Communicates research results clearly and professionally in written form through a thesis and or publications in peer reviewed journals 7. Quality of Oral Communication: Communicates research results clearly and professionally in oral form 8. Critical Thinking: Has demonstrated capability for independent research in the area of study and expertise in the area 9. Broader Impact: Demonstrated awareness of broader implications of the concluded research. Broader implications may include social, economic, technical, ethical, business, etc. aspects. 10. Publications: Journal or conference publications have resulted (or are anticipated) from this research 11. Knowledge of Ethical Considerations in Science Does not meet Expectations Meets Expectations Overall Assessment: The assessment of the overall performance of the candidate based on the evidence provided in items 1 10 above. CRITERIA OVERALL, My rating of the Thesis indicates that it: PERFORMANCE RATINGS for THESIS EXAM Does NOT PASS Exam PASSES Exam Does not meet Meets expectations expectations Name of the Examining Committee Member: Signature of the Examining Committee Member: Examiner: Please use the reverse side of this form for written commentary as needed. Attachment 3

6 Mapping Guide for the Ph.D. Degree - ESGP Only the top 5 activities are listed for each outcome. Other activities may also support the outcomes, however data will be collected for those listed in each column Learning Outcomes: Graduate students in the PhD program will demonstrate Activities and Evidence: 1. Teaching Seminar (one time for all incoming graduate students) 2. Research Seminar (for advanced 2nd or 3rd year PhD students) 3. Plan of Study Coursework Outcome 1: Knowledge and Scholarship Identify and conduct original research, scholarship or creative endeavors Gain knowledge needed for conducting original research 4. Research credits Earn a Satisfactory in all credits of ENSC Core Courses Earn a Satisfactory in Core Courses ENSC 515, 520, 508 (Inter-campus Conference) Outcome 2: Communication Effectively communicate their field of study Outcome 3: Critical Thinking and Problem Solving Think critically, creatively and solve problems in their field of study Critically analyze ideas and data presented and discussed by others and participate in the peer review process Outcome 4: Ethical Conduct Conduct research in an ethical and responsible manner Attend workshops or take online training on effective service as a TA and responsible conduct of research Participate in discussions on responsible conduct of research Outcome 5: Professional Development Demonstrate attributes of professional development consistent with expectations within their field of study Gain appreciation for membership in professional societies; Attend scientific seminars across campus Understand the importance of membership in professional societies; Organize a departmental seminar with an invited speaker; Participate in a graduate research competition; Attend at least one professional development workshop

7 6. PhD Research Proposal Define and justify a set of original research objectives in a formal research proposal Write and defend an original proposal Define and defend a set of research methods and analyses that will achieve the research objectives Define methods to achieve the research objectives in an ethical and responsible manner 7. Oral Preliminary Exam Demonstrate sufficient knowledge of subject matter to become a PhD Candidate Demonstrate ability to communicate knowledge and research through an oral preliminary exam Demonstrate the ability to think clearly and solve problems through an oral preliminary exam 8. Publish Research in Appropriate Outlets 9. Presentation of Research at Appropriate Venues Submit manuscripts for publication in the peerreviewed literature Present an oral presentation or poster to a professional audience Publish research, extension, or teaching results in peer-reviewed and/or other outlets Present an oral presentation or poster to a professional audience and at least one presentation in the Inter-Campus Conference with the University of Oregon, OSU and Portland State University 10. Ph.D. Dissertation Prepare a dissertation that meets expectations for original, independent research Prepare a dissertation that demonstrates critical thinking and creativity Prepare a dissertation based on ethical and responsible research.

8 11. Dissertation Defense Present the research in a public seminar and defend the dissertation Defend the dissertation research before the student s Advisory Committee Present the dissertation research in a public seminar and defend the dissertation research before the student s Advisory Committee Attachment 4

9