Graduate Assessment Plan (Master s programs) 1. Program Information: Program Marine Resource Management Department College College of Earth, Ocean, and Atmospheric Sciences Report Submitted by Robert Duncan, Associate Dean 2. Program Outcomes Provide the Student Learning Objectives/Outcomes for your Master s program. Through participation in and successful completion of the Master of Science in the Marine Resource Management (MRM) program, students will graduate with: Outcome 1: SCHOLARSHIP: The ability to conduct original marine resource management related scholarship (research or project) that extends the knowledge of both natural and social science disciplines. This will be demonstrated through mastery and application of critical thinking, and application of standard and innovative theory and methods in both coursework and an individual research or project. Outcome 2: KNOWLEDGE: Substantive knowledge in an area of concentration of his/her choosing that allows for immediate immersion in a relevant marine resource management issue. This includes an understanding of the interplay between the natural and social sciences (including but not limited to oceanography, coastal zone, fisheries, and/or natural resource management, sociology, anthropology, economics, law, policy, and communications) and an ability to analyze contemporary marine resource management issues from a range of perspectives including those of industry, government, indigenous peoples, stakeholders, and NGOs. This also includes an ability to employ technical knowledge and leadership skills to evaluate the cost and benefits of management decisions across ecological, economic, and social dimensions, and to design and implement strategies that foster collaboration among stakeholders and decision-makers. This will be accomplished through coursework and research or scholarly project. Outcome 3: COMMUNICATION & SERVICE: Skills and experience in designing and communicating in both formal and informal venues with learners, practitioners, and community members. This will be demonstrated through university course assignments, development and implementation of community outreach/education programs, professional development seminars, and/or presentations at professional conferences. Outcome 4: ETHICS AND DIVERSITY: A commitment to diversity and high ethical standards in marine resource management scholarship, teaching, and service. This will occur through participation and training in research methods courses, professional development seminars, seminars focused on diversity and ethics, IRB (human subjects) training, and courses in natural and social sciences. 3. Measurement Provide a detailed narrative or schematic to articulate how all the outcomes will be measured for all outcomes. a) Describe the methods you will use to assess each outcome. 1
Assessment strategies for each of the learning outcomes are discussed: OUTCOME 1: Students in the MRM program conduct independent research or a scholarly project with oversight by a major advisor. When the research or project is completed, the thesis or project paper is examined along with an oral defense so that faculty can assess the qualifications of the student as an independent scholar and successful communicator. The Scoring Guide for Graduate Learning Outcomes Assessment will be used at each oral defense (see attachment #1). Success rate for defenses is collected by the MRM Assistant Director; documentation of deficiencies that delay or inhibit successful completion of the MRM degree are noted and reviewed on an annual basis by both the MRM Director and the College Director of Student Development. OUTCOME 2: Performance in core and discipline-specific courses (revealing the level of fundamental knowledge, communication skills, and ability to synthesize). Students in the MRM program must maintain a 3.00 GPA in all coursework. Any term that GPA falls below this average, the student will meet with the major advisor and MRM Program Director to develop an educational plan for addressing difficulties. The student will have one term to raise the GPA to appropriate levels or will face termination from the program. Information about classes taken by students, grades, as well as educational plans is tracked by the MRM Assistant Director and reviewed on an annual basis with both the MRM Director and the College Director of Student Development. OUTCOME 2 & 3: Students will be encouraged, supported, and provided the opportunity to design and communicate in both formal (teaching) and informal settings (community and professional education). GTA reviews and learner evaluations will be provided by the supervising instructor and Office of Student Programs. For College or unit seminars, students will be video recorded and observed by MRM faculty member and peers and, as appropriate, someone from the academic unit in which they are teaching or from the organization that is sponsoring the professional or community education. All teaching observations will be shared with the student and with the MRM Program Director. Students will also be encouraged and supported in leadership/service as well, including but not limited to Student Advisory Committee activities, davinci days, Seafest, Salmon Bowl, graduate assembly, etc. Student awards and participation will be tracked by the CEOAS Student Programs Office. OUTCOME 4: Students are expected to develop a commitment to diversity and high ethical standards throughout their coursework (knowledge), scholarship (research / project), and service (informal and formal teaching). PROGRAM OUTCOMES: The MRM Assistant Director will track information about the program including a. the number of applicants, offers, and acceptances on a yearly basis; b. information about students background qualifications (e.g., undergrad/grad degrees, schools attended, GPA, GRE scores, etc.) will be collected and reviewed on a yearly basis. c. an annual student self-assessment of progress and achievement (MRM faculty review will contribute to this report) d. a Current Student Survey and an Alumni Survey (anonymous) e. retention and graduation rates f. graduate exit interview 2
g. post-graduation employment. All data will be complied and synthesized the MRM Director and College Director of Student Development to determine areas for improvement. At one meeting each year, a summary of the full assessment package will be shared yearly with the MRM Faculty, MRM Alumni Advisory Committee, the College Director of Student Development, the College Instructional Programs Committee, and the Dean of the College for review and input to determine if program goals are being met. b) Describe and attach any measurement tools to be used (exam results, performance criteria, evaluation/performance rubrics, etc.,) As described above, the MRM Program Director will be ultimately responsible for collecting and maintaining information listed in (a) above. This includes but not limited to the following additional tools: Scoring Guide for Graduate Learning Outcomes Assessment will be used at each oral defense (see attachment #1). Mapping Guide for the MS Degree Marine Resource Management will be presented to each student at the beginning of their tenure in MRM program (see attachment #2) 4. Please provide a skeletal assessment plan (Mapping Guide) for your program: Provide a skeleton plan describing the specific activities and assessment method for each outcome. Map all required course (with their learning outcomes and assessments to the program outcomes). See attachment #2 as well as this narrative. Outcome 1 and 2: Required 57 credit hours of coursework (project) or 40 (thesis) in a substantive MRM concentration including Coastal Processes, Policy and Hazards, Fisheries Management, Marine Pollution and Coastal Water Quality, and Marine Conservation (approved courses are located at the MRM website http://www.coas.oregonstate.edu/index.cfm?fuseaction=content.display&pageid=209). Required core courses: OEAS500, OEAS520, OEAS530, OEAS540, MRM507, MRM520, and MRM530. Required core courses as electives, including but not limited to: SOC 515, 516, 519 (Social Research), GEO 565, 533, 544, etc. (GIS related), FW520, 526, 563, etc. (Fisheries or Coastal Management), plus many others including but not limited to Forestry, Anthropology, Communications, Science Education, Philosophy, and AREc (Marine Economics). This coursework supports student s independent research or project, along with thesis or project credits. Outcome 3: This will occur through the design and participation in university teaching assignments, development and implementation of community outreach/education programs and presentations at professional conferences, and educational courses and seminars throughout the entire program including but not limited to the following required core courses: MRM 507 Orientation Seminar; OC507 COAS Student Seminar. Outcome 4: Commitment to diversity and high ethical standards in marine resource management scholarship (research), learning (teaching, and engagement (service) will be accomplished through participation and training in research methods courses, professional development seminars, seminars focused on diversity and ethics, and core courses in natural and social science, including but not limited 3
to OEAS500, OEAS520, OEAS530, MRM507, OEAS540, MRM520, MRM530, and MRM552, and electives, including but not limited to: SOC 515, 516, 519 (Social Research), GEO 565, 533, 544, etc. (GIS related), FW520, 526, 563, etc. (Fisheries or Coastal Management), plus many others including but not limited to Forestry, Anthropology, Communications, Science Education, Philosophy, and AREc. 5. Other activities that have informed decision making: Please report on any other activities that you feel fall under assessment that were not captured above. This may include general satisfaction surveys, employer input, or other initiatives that contribute to student learning or program improvement. In 2007-8 the College of Oceanic and Atmospheric Sciences undertook an extensive decadal self-study of its overall graduate program. This self-study was part of a Graduate School review by an external panel of peers and included many issues relevant to the assessment and evaluation of the MRM program. The constructive criticism provided in the report from that panel has been incorporated in this assessment plan. ATTACHMENTS BELOW 4
ATTACHMENT #1: Scoring Guide (Rubric) for Graduate Learning Outcome Assessment MS DEFENSE EXAM* in Marine Resource Management Date: Candidate Name: Title of Thesis / Project: Evaluation/Guidance Does not meet Expectations Meets Expectations Exemplary Performance 1. Problem Definition: Has stated the research/project problem clearly, providing motivation for undertaking the research 2. Literature and Previous Work: Demonstrated sound knowledge of literature in the area, and of prior work on the specific research/project problem 3. Impact of Research/Project: Demonstrated the potential value of solution to the research/project problem in advancing knowledge within the area of study 4. Solution Approach: Has applied sound state-of-the-art research/project methods/tools to solve the defined problem and has described the methods/tools effectively 5. Results: Analyzed and interpreted research/project results/data effectively 6. Quality of Written Communication: Communicates research/project results clearly and professionally in written form 7. Quality of Oral Communication: Communicates research/project results clearly and professionally in oral form 8. Critical Thinking: Has demonstrated capability for independent research/project in the area of study and expertise in the area 9. Broader Impact: Demonstrated awareness of broader implications of the concluded research/project. Broader implications may include social, economic, technical, ethical, business, etc. aspects. 5
10. Publications: Journal, conference, or some other scholarly publications have resulted (or are anticipated) from this research/project Overall Assessment: The assessment of the overall performance of the candidate based on the evidence provided in items 1 10 above. CRITERIA Does NOT PASS Exam PERFORMANCE RATINGS for THESIS EXAM PASSES Exam Does not meet Meets Exemplary OVERALL, My rating of the Thesis / Project Paper indicates that it: expectations expectations performance Name of the Examining Committee Member: Signature of the Examining Committee Member: Examiner: Please use the remainder and/or reverse side of this form for written commentary as needed. 6
ATTACHMENT #2. Mapping Guide for the MS Degree Marine Resource Management Only the top 6 activities are listed for each outcome. Other activities may also support the outcomes, however data will be collected for those listed in each column Learning Outcomes: Graduate students in the MS program will demonstrate Activities and Evidence: Outcome 1: Scholarship Identify and conduct original research, a project, or some other creative endeavor that provides evidence of scholarship. Outcome 2: Knowledge Think critically, creatively and solve problems; understand the interplay between the natural and social sciences; analyze contemporary marine resource management issues from a range of perspectives; employ technical knowledge and leadership skills to evaluate the cost and benefits of management decisions across ecological, economic and social dimensions; and design and implement strategies that foster collaboration. Outcome 3: Communication & Service (Education, and Professional Development) Effectively design and communicate in formal and informal venues. Demonstrate through teaching assignments, community outreach and education, professional development seminars, and/or presentations at professional conferences. Outcome 4: Commitment to Diversity and Ethical Conduct in Scholarship, Learning, and Engagement Conduct research and education in an ethical and responsible manner for appropriate and diverse audiences. 1. Teaching Seminar (one time for all incoming graduate students) Attend workshops or take online training on effective and responsible conduct of research. Attend workshops or take online training on effective service as a GTA. Gain appreciation for membership in professional societies; Attend scientific seminars across campus. 7
2. Presentation of Research / Project at Seminars and Other Appropriate Venues Critically analyze ideas and data presented and discussed by others and participate in the peer review process. Deliver an oral presentation or poster to a professional audience. Understand the importance of membership in professional societies; Organize a departmental seminar with an invited speaker; Participate in a graduate research competition; Attend at least one professional development workshop; Deliver educational efforts to appropriate audiences. Participate in discussions on diversity and responsible conduct of research, teaching, and service. Make sure that whatever is delivered is appropriate and ethical. 3. Plan of Study Coursework Gain knowledge to apply to related scholarship (research / project). Gain knowledge regarding the interplay between natural and social sciences, and the ability to analyze contemporary marine resource management issues from a range of perspectives; employ technical knowledge and leadership skills to evaluate the cost and benefits of management decisions across ecological, economic and social dimensions; and design and implement strategies that foster collaboration. Gain knowledge related to designing and communicating in formal and informal venues. Gain knowledge related to audience appropriate and ethical scholarship, learning, and engagement. 4. Research or project credits Earn a Satisfactory in 12 thesis credits or 9 project credits. 8
5. MS Project Report or Thesis Publish this Scholarship in Appropriate Outlets Prepare a dissertation that meets expectations for original, independent scholarly work. Submit manuscripts for publication in the peerreviewed literature. Prepare a dissertation that demonstrates critical thinking and creativity. Make sure that notice of your completed work gets shared with appropriate audiences (direct them to Scholar s Archive at a minimum). Publish research, extension, or teaching results in peer-reviewed and/or other outlets that are audience appropriate. Prepare a dissertation based on ethical and responsible scholarly work that is appropriate for the target audience(s). Make sure that whatever is published is appropriate and ethical. 6. MS Oral Defense Present the research / project report, thesis or coursework regimen in a public seminar (as required) and defend the research / project report, thesis or coursework regimen. Defend the research / project report, thesis or coursework regimen before the student s Advisory Committee. Present the research project report, thesis or coursework regimen in a public seminar and defend the body of work before the student s Advisory Committee. 9