COLLEGE OF PHARMACY Graduate Assessment Plan (Master s program) 1. Program Information: Program Pharmacy M.S. degree Department Pharmaceutical Sciences College College of Pharmacy Report Submitted by Taifo Mahmud, Director of Pharmacy Graduate Programs 2. Program Outcomes Provide the Graduate Learning Objectives/Outcomes for your M.S. program. Attachment 1 ( Graduate Learning Objectives/Outcomes ), below, includes a broad statement of universal graduate learning objectives and outcomes for programs in the sciences. Objectives and outcomes specific to Pharmacy include: Please see Appendix 1 for learning outcomes/objectives and assessment methods for the Pharmacy M.S. program. 3. Measurement Provide a detailed narrative or schematic to articulate how all the outcomes will be measured. a) Describe the methods you will use to assess each outcome. Appendix 1 lists the means of assessment employed in ensuring attainment of outcomes. In addition we will measure: average undergraduate GPA and GRE scores of admitted students average GPA of graduate students in didactic (non-blanket) courses and overall GPA We require a minimum of 3.0 in didactic coursework as well as overall Time to completion of the thesis Number of alumni placed in job/career position of choice. b) Describe and attach any measurement tools to be used (exam results, performance criteria, evaluation/performance rubrics, etc.,) Appendix 2 is a Scoring Guide for the M.S. Thesis Defense. These tools will be used in conjunction with existing metrics as listed above and in Appendix 1.
4. Please provide a skeletal assessment plan (Mapping Guide) for your program: Provide a skeleton plan describing the specific activities and assessment method for each outcome. Map all required courses (with their learning outcomes) and assessments to the program outcomes. The mapping guide is included as Appendix 3, Mapping Guide for the M.S. Degree. 5. Other activities that have informed decision making: Please report on any other activities that you feel fall under assessment that were not captured above. This may include general satisfaction surveys, employer input, or other initiatives that contribute to student learning or program improvement. Appendix 4 is a copy of our annual assessment of M.S. candidates Appendix 5 is a copy of our annual report of activities Additional assessment activities that are not captured include: Employer feedback on student internships. The availability of internships for interested students to increase their preparedness for the work place. Anecdotal information from newly graduated students on their perception of the overall quality of the program provided to the Graduate Program Director during exit surveys. Formal alumni and current student surveys conducted for the graduate program review. Student evaluation of teaching data for the small number of our students who choose to be a lead instructor for the Phar 210 course as a GTA.
Appendix 1 Graduate Learning Outcomes/Objectives for the M.S. in Pharmacy OSU required M.S. Learning Outcomes: (a) Conduct research or produce some other form of creative work, and (b) Demonstrate mastery of subject material, and (c) Be able to conduct scholarly or professional activities in an ethical manner. M.S. Learning Outcomes specific to Pharmacy: I. Be able to expand the knowledge base in pharmaceutical sciences II. Be able to communicate research findings to improve the knowledge base in pharmaceutical sciences, and improve drug discovery, drug use and human health III. Be able to conduct all scholarly and creative activities in an ethical manner IV. Be able to successfully enter the profession of pharmaceutical sciences The following table indicates what we have identified as graduate learning objectives, by which we assess graduate learning outcomes; also for each we include the means of assessment (scoring methods). The objectives address critical areas of competency at various points on the path through graduate studies (admissions, matriculation to candidacy, graduation). Means of assessment referenced in the table below include: (1) minimum admission standards, assessment of application materials, admissions process interviews; (2) meeting a predetermined standard in graduate level coursework (content/subject matter and GPA); (3) written thesis or research paper; (4) oral defense; (5) annual assessment of progress for M.S. candidates (i.e., annual advisor assessment of progress); (6) completion of required ethics course; (7) required annual research presentations at the College of Pharmacy retreat; (8) submission of applications for competitive fellowships (optional). MS Objective Students will have met the objectives for learning outcomes in an undergraduate discipline relevant to pharmaceutical sciences. Scoring methods: 1 Graduates will be able to summarize major central issues and current research problems in their field. Scoring methods: 2,4,5 Graduates will have knowledge of and effectively use modern, innovative methods pertinent to the discipline Scoring methods: 2,3,4,5,6,7 Graduates will be able to communicate the major tenets of their field and their work orally and in writing for students and peers. Scoring methods: 2,3,4,7 Graduates will display excellent oral and written communication skills and communicate their research findings Scoring methods: 3,4,7 Graduates will be able to identify areas where ethical issues may arise in their work or discipline. Scoring methods: 2,5,6 Graduates will have demonstrated the capability to conduct all scholarly activities in a safe, responsible and ethical manner and with an understanding of laws and procedures related to patient privacy if applicable. Scoring methods: 3,4,5,6 Graduates will have completed and defended: (1) an original manuscript based on either a review and synthesis of the primary literature [non-thesis (project) MS] or original research [thesis MS]; or (2) mastery of appropriate advanced coursework in the field. [non-thesis (coursework) MS] Scoring methods: 2,3,4
Appendix 2 M.S. THESIS DEFENSE EXAM in Pharmacy Student Evaluation and Scoring Guide Candidate Name: Date: Evaluation/Guidance 1. Problem Definition: States the research hypothesis clearly 2. Background: Demonstrates sound knowledge of the literature and of prior work on the specific research problem 3. Impact of Proposed Research: Explains the significance of the research and its value in advancing knowledge within the area of study and significance to improving health 4. Approach: Used appropriate research methods/tools to test the hypothesis, and can explain the principles behind the methods and limitations 5. Results: Data was appropriately analyzed and interpreted. Figures were clear, complete and indicated appropriate statistical analysis 6. Discussion: The results were connected with prior research in the field in a detailed and scholarly manner 7. Quality of Written Communication: The thesis was written clearly and professionally with minimal technical errors 8. Quality of Oral Communication: The oral presentation of the thesis was clear and professional, including the quality of any supporting media such as powerpoint slides 9. Critical Thinking: Responded thoughtfully, fully and clearly to public questions 10. Ethical Aspects: Student provides assurance that all aspects of the thesis research were conducted ethically and demonstrates awareness of the implication of that assurance Does not meet Expectations Meets Expectations Exemplary Performance Overall Assessment: based on the evidence provided in items 1 10 above. CRITERIA PERFORMANCE RATINGS for M.S. THESIS DEFENSE EXAM Does NOT PASS Exam PASSES Exam Does not meet Meets expectations expectations OVERALL, My rating of this M.S. thesis defense exam is: Exemplary performance Examiner/Major Advisor: Please use the reverse side of this form for written commentary. In particular, please provide an explanation for any items scored as does not meet expectations or detailed comments if the student does not pass. Please provide a copy of this completed evaluation form to the student and return the original SIGNED version to Debra Peters, 115 Pharmacy.
Appendix 2 M.S. THESIS DEFENSE EXAM in Pharmacy Student Evaluation, Written comments on performance. Name of the Examining Committee Member/Major Advisor: Signature of the Examining Committee Member/Major Advisor:
Appendix 3 Mapping Guide for the M.S. Degree - Pharmacy Only the top 5 activities are listed for each outcome. Other activities may also support the outcomes, however data will be collected for those listed in each column Learning Outcomes: Graduate students in the M.S. program will demonstrate Outcome 1: Knowledge and Scholarship Activities and Evidence: Identify and conduct original research, scholarship or creative endeavors by applying critical thinking and problem solving 1. Journal club and regular department seminars 2.Annual retreat presentations 3. Plan of Study Coursework Gain knowledge needed for conducting original research. Critically analyze ideas and data presented in upper level courses. 4. Research credits Complete OSU minimum required research credits. Develop critical thinking and problem solving skills by conducting research. Outcome 2: Communication Outcome 3: Ethical Conduct Outcome 4: Professional Development Effectively communicate their field of study Develop good oral presentations skills with practice on a yearly basis before a professional audience Conduct research in an ethical and responsible manner Gain awareness of issues in the responsible conduct of research Complete required class in the responsible conduct of research Complete required training courses relevant to the area of research Demonstrate attributes of professional development consistent with expectations within their field of study Gain appreciation for membership in professional societies; Attend scientific seminars across campus; Gain exposure to multiple career paths Participate in a graduate research competition; Meet a speaker or national or international reknown in the field Develop a vocabulary to communicate across disciplines in the required Phar 735 class and in journal club Use appropriate methods for research and data analysis including advanced instrumentation, statistical and computer methods
5. Presentation of Research at Appropriate Venues Answer questions for a professional scientific audience, defending and supporting the research Present an oral presentation or poster to a professional audience at a scientific gathering Give oral or poster presentations to audiences including researchers, students and health professionals 6. M.S. Thesis Prepare a thesis that meets expectations for original, independent research and provides a scholarly survey of prior research in the discipline Write a clear and professional thesis and orally present the research findings in a publically announced defense Prepare a thesis based on ethical and responsible research 7. Thesis Defense Defend the thesis research before the student s Advisory Committee. Answer questions in the seminar Present the research in a seminar and defend the thesis Present the thesis research in a seminar and defend the thesis research before the student s Advisory Committee
Appendix 4 Name: Advisor: Date: Pharmacy M.S. Student Annual Advisor Assessment of Progress Please rate this student on a scale of one to five in comparison with other successful graduate students at this stage of their program. 1=student is not making progress towards this goal, 3= student is progressing adequately and on par with other students at this stage towards this goal, 5= student excels almost all other students at this career stage in meeting this goal. Please use NA if not applicable to this student/project. We expect that most students should be receiving a majority of 3 s. For any score of 2 or below, please develop an action plan with the student for improvement. Please re-visit these areas for improvement with the student in 6 months. Goal Score 1 Is making progress in attainment of last year s goals 2 Has applied significant effort toward attainment of last year s goals 3 Understands and effectively uses modern, innovative methods pertinent to the discipline 4 Displays excellent oral and written communication skills. 5 Completes experiments, or other research tasks, with attention to detail, appropriate use of equipment, methodological approaches, and all appropriate controls 6 Demonstrates intellectual curiosity and creativity 7 Interacts well and works effectively with others 8 Demonstrates appropriate independence in development and execution of thesis project 9 Communicates research findings (e.g., publications, abstracts, presentations, etc.) 10 Displays excellent work habits and attitudes with a high potential to productively enter the research workforce. 11 Ethically conducts research in all environments 12 Works safely in all areas with concern for self and others 13 Demonstrates understanding of and protection for privacy concerns when dealing with patient-specific information
Please provide an overall evaluation of the student s academic and research progress over the past 12 months, and your goals for the student for the coming year, including an action plan for scores of 2 or less in any area *. Please discuss this completed form with your graduate student, comparing the student s selfevaluation with yours. For students in the 2 th year of the M.S. program, please provide an anticipated graduation date and plans for timely degree completion. I verify that I have discussed this completed evaluation with my advisor Student signature: Date: I verify that I have discussed this completed evaluation with my student Advisor signature: Date: Please sign and date both this form and the graduate student s self-evaluation form. Retain copies of both for yourself and send the completed originals to Debra Peters. * Advisors are encouraged to consult with the student s thesis committee and subsequently the Graduate Studies committee, if needed, regarding recurrent inadequate progress on action plans in deficient areas.
Appendix 5 Annual review of College of Pharmacy Graduate Students Name: Degree being sought? MS PhD Department or Degree Program: Thesis advisor: Year of entry into the program: Anticipated date of degree completion: Date of last thesis committee meeting: If no meeting has yet convened, please list anticipated date of first meeting: Oral prelims completed? Yes No If No, please list anticipated date of oral prelim exam: Dates (years) in which you gave an oral presentation at College of Pharmacy Graduate Student retreat: Please list all fellowships/scholarships applied for in the past year: Please list all fellowships/scholarships received in the past year, including funding agency, amount award, and date(s) of awards: Please list all manuscripts published in the previous year: Please list any awards received in the previous year, including local, regional or national poster awards or other: Please list attendance at any regional or national meetings to present either oral or poster form research findings: