COLLEGE OF PHARMACY Graduate Assessment Plan (Doctoral program)

Transcription

1 COLLEGE OF PHARMACY Graduate Assessment Plan (Doctoral program) 1. Program Information: Program Pharmacy PhD degree Department Pharmaceutical Sciences College College of Pharmacy Report Submitted by Taifo Mahmud, Director of Pharmacy Graduate Programs 2. Program Outcomes Provide the Graduate Learning Objectives/Outcomes for your PhD program. Please see Appendix 1 for learning outcomes/objectives and assessment methods for the Pharmacy PhD program 3. Measurement Provide a detailed narrative or schematic to articulate how all the outcomes will be measured. a) Describe the methods you will use to assess each outcome. Appendix 1 lists the means of assessment employed in ensuring attainment of outcomes. In addition we will measure: average undergraduate GPA and GRE scores of admitted students average GPA of graduate students in didactic (non-blanket) courses and overall GPA (We require a minimum of 3.0 in didactic coursework as well as overall) Pass/fail rate for the preliminary exam Performance on a scale of 1 to 3 on the prelim and thesis exams using the established rubrics Average time to completion of the thesis Number of student peer-reviewed publications, presentations at regional or larger scientific meetings, awards/honors/fellowships obtained during the graduate program Performance on the prelim and thesis exams using the established rubrics Number of alumni placed in job/career positions of choice. b) Describe and attach any measurement tools to be used (exam results, performance criteria, evaluation/performance rubrics, etc.,) Appendix 2 is a Scoring Guide (Rubric) for the Ph.D. Preliminary Exam; Appendix 3 is a Scoring Guide for the Ph.D. Thesis Defense. These tools will be used in conjunction with existing metrics as listed above and in Appendix 1.

2 4. Please provide a skeletal assessment plan (Mapping Guide) for your program: Provide a skeleton plan describing the specific activities and assessment method for each outcome. Map all required courses (with their learning outcomes) and assessments to the program outcomes. The mapping guide is included as Appendix 4, Mapping Guide for the Ph.D. Degree. 5. Other activities that have informed decision making: Please report on any other activities that you feel fall under assessment that were not captured above. This may include general satisfaction surveys, employer input, or other initiatives that contribute to student learning or program improvement. Appendix 5 is a copy of our annual assessment of PhD candidates (post-prelim students) Appendix 6 is a copy of our annual report of activities Additional assessment activities that are not captured include: Employer feedback on student internships. The availability of internships for interested students to increase their preparedness for the work place. Anecdotal information from newly graduated students on their perception of the overall quality of the program provided to the Graduate Program Director during exit surveys. Formal alumni and current student surveys conducted for the graduate program review. Student evaluation of teaching data for the small number of our students who choose to be a lead instructor for the Phar 210 course as a GTA.

3 Appendix 1 Graduate Learning Outcomes/Objectives for the PhD in Pharmacy OSU required PhD Learning Outcomes: (a) produce and defend an original significant contribution to knowledge; (b) demonstrate mastery of subject material; and (c) be able to conduct scholarly activities in an ethical manner. PhD Learning Outcomes specific to Pharmacy: I. Be able to expand the knowledge base in pharmaceutical sciences II. Be able to communicate research findings to improve the knowledge base in pharmaceutical sciences, drug discovery, drug use and human health III. Be able to teach and mentor future pharmaceutical science scientists IV. Be able to conduct all scholarly and creative activities in an ethical manner V. Be able to successfully enter the profession of pharmaceutical sciences The following table indicates what we have identified as graduate learning objectives, by which we assess graduate learning outcomes; also for each we include the means of assessment (scoring methods). The objectives address critical areas of competency at various points on the path through graduate studies (admissions, matriculation to candidacy, graduation). Means of assessment referenced in the table below include: (1) minimum admission standards, assessment of application materials, admissions process interviews; (2) meeting a predetermined standard in graduate level coursework (content/subject matter and GPA); (3) a pass/fail preliminary exam; (4) written thesis or research paper; (5) oral defense; (6) annual assessment of progress for doctoral candidates (i.e., post-prelim exam); (7) completion of required ethics course; (8) required annual research presentations at the College of Pharmacy retreat; (9) required research presentation at a regional or national meeting; (10) submission of applications for competitive fellowships. Ph.D. Objective Students will have met the objectives for learning outcomes in an undergraduate discipline relevant to pharmaceutical sciences. Scoring methods: 1 Graduates will possess a broad knowledge base of the discipline and deep knowledge of a subdiscipline within medicinal chemistry, pharmacology, or pharmaceutics Scoring methods: 2,3,4,5 Graduates will have knowledge of and effectively use modern, innovative methods pertinent to the discipline Scoring methods: 2,3,4,5,6 Graduates will perform research with attention to detail and appropriate use of equipment, methodology, and controls, and solve problems with creativity, critical thinking skills, understanding of methods, and facility with techniques Scoring methods: 4,5,6,8,9 Graduates will display excellent oral and written communication skills and communicate their research findings Scoring methods: 3,4,5,7,8,9,10 Graduates will be able to teach and mentor other researchers. Scoring methods: 6,7,8,9 Graduates will have demonstrated the capability to conduct all scholarly activities in a safe, responsible and ethical manner and with an understanding of laws and procedures related to patient privacy if applicable. Scoring methods: 3,4,5,6,7 Graduates will have designed, carried out and presented an original work of research at the leading edge of their

4 discipline. Scoring methods: 2,4,5,9 Graduates will have demonstrated the ability to write a competitive application for research funding Scoring methods: 3,10 Graduates will have displayed good work habits, the ability to work well with others and the ability to independently develop and execute a research project Scoring methods: 4,6,9 Graduates will have had the opportunity to interact with other pharmaceutical scientists outside of OSU Scoring methods: 8,9

5 Appendix 2 Ph.D. PRELIMINARY EXAM in Pharmacy Student Evaluation and Scoring Guide Candidate Name: Date: Evaluation/Guidance 1. Problem Definition: States the research hypothesis clearly and understands the gap in knowledge 2. Background: Demonstrates sound knowledge of literature in the research area, and of prior work on the specific research problem 3. Impact of Proposed Research: Demonstrates the potential value of the proposed research problem in advancing knowledge within the area of study and significance to improving health 4. Approach: Provides a sound plan for applying state of- the-art research methods/tools to testing the hypothesis, shows a good understanding of how to use methods/tools effectively, describes the limitations of the methods and provides appropriate alternatives 5. Expected Results: Provides a sound plan for analyzing and interpreting research results/data, including appropriate use of statistics 6. Timeline: Has developed an appropriate timeline for completion of the proposal given the Approach 7. Quality of Written Communication: Communicates research proposal clearly and professionally in written form 8. Quality of Oral Communication: Communicates research proposal clearly and professionally in oral form 9. Critical Thinking: Demonstrates capacity for critical thinking and problem solvent relevant to the capability to conduct independent research in the area of study 10. Broader Impact: Demonstrates awareness of broader implications of the proposed research. Broader implications may include social, economic, technical, ethical, business, etc. aspects. 11. Ethical Aspects: Demonstrates awareness of ethical aspects of the proposed research and tenets of responsible conduct of research in general 12.Subject Area Mastery: Demonstrates mastery of the subject areas encompassed by one of the sub-disciplines of pharmaceutical sciences, i.e., pharmacology, medicinal chemistry or pharmaceutics Does not meet Expectations Meets Expectations Exemplary Performance Overall Assessment: based on the evidence provided in items 1 12 above. CRITERIA PERFORMANCE RATINGS for PRELIMINARY EXAM Does NOT PASS Exam PASSES Exam Does not meet Meets expectations expectations OVERALL, My rating of this preliminary exam is: Exemplary performance Examiner/Major Advisor: Please use the reverse side of this form for written commentary. In particular, please provide an explanation for any items scored as does not meet expectations or detailed comments if the student

6 does not pass. Please provide a copy of this completed evaluation form to the student and return the original SIGNED version to Debra Peters, 115 Pharmacy. Ph.D. PRELIMINARY EXAM in Pharmacy Student Evaluation, Written comments on performance. Name of the Examining Committee Member/Major Advisor: Signature of the Examining Committee Member/Major Advisor:

7 Appendix 3 Ph.D. THESIS DEFENSE EXAM in Pharmacy Student Evaluation and Scoring Guide Candidate Name: Date: Evaluation/Guidance 1. Problem Definition: States the research hypothesis clearly and understands the gap in the knowledge. 2. Background: Demonstrates sound knowledge of the literature and of prior work on the specific research problem 3. Impact of Proposed Research: Explains the significance of the research and its value in advancing knowledge within the area of study and significance to improving health 4. Approach: Used appropriate and state of- the-art research methods/tools to test the hypothesis, and can explain the principles behind the methods and limitations 5. Results: Data was appropriately analyzed and interpreted. Figures were clear, complete and indicated appropriate statistical analysis 6. Discussion: The results were connected with prior research in the field in a detailed and scholarly manner 7. Quality of Written Communication: The thesis was written clearly and professionally with minimal technical errors 8. Quality of Oral Communication: The oral presentation of the thesis was clear and professional, including the quality of any supporting media such as powerpoint slides 9. Critical Thinking: Responded thoughtfully, fully and clearly to public questions 10. Ethical Aspects: Student provides assurance that all aspects of the thesis research were conducted ethically and demonstrates awareness of the implication of that assurance 11.Publications: At least one peer-reviewed journal article or book chapter has been published or submitted based on this research Does not meet Expectations Meets Expectations Exemplary Performance Overall Assessment: based on the evidence provided in items 1 11 above. CRITERIA PERFORMANCE RATINGS for Ph.D. THESIS DEFENSE EXAM Does NOT PASS Exam PASSES Exam Does not meet Meets expectations expectations OVERALL, My rating of this Ph.D. thesis defense exam is: Exemplary performance Examiner/Major Advisor: Please use the reverse side of this form for written commentary. In particular, please provide an explanation for any items scored as does not meet expectations or detailed comments if the student does not pass. Please provide a copy of this completed evaluation form to the student and return the original SIGNED version to Debra Peters, 115 Pharmacy.

8 Ph.D. THESIS DEFENSE EXAM in Pharmacy Student Evaluation, Written comments on performance. Name of the Examining Committee Member/Major Advisor: Signature of the Examining Committee Member/Major Advisor:

9 Appendix 4 Mapping Guide for the Ph.D. Degree - Pharmacy Only the top 5 activities are listed for each outcome. Other activities may also support the outcomes, however data will be collected for those listed in each column Learning Outcomes: Graduate students in the PhD program will demonstrate Activities and Evidence: 1. Journal club and regular department seminars 2.Annual retreat presentations 3. Plan of Study Coursework Outcome 1: Knowledge and Scholarship Identify and conduct original research, scholarship or creative endeavors by applying critical thinking and problem solving Gain knowledge needed for conducting original research. Critically analyze ideas and data presented in upper level courses. Outcome 2: Communication Effectively communicate their field of study Develop good oral presentations skills with practice on a yearly basis before a professional audience Outcome 3: Teach and Mentor Mentor or teach others in the field Present/teach current research findings and/or methods to peers Present research finds to peers, undergraduates, professionals, others Experience a compelling learning environment with inclusion of smaller classes with significant discussion components Outcome 4: Ethical Conduct Conduct research in an ethical and responsible manner Gain awareness of issues in the responsible conduct of research Complete required class in the responsible conduct of research Outcome 5: Professional Development Demonstrate attributes of professional development consistent with expectations within their field of study Gain appreciation for membership in professional societies; Attend scientific seminars across campus; Organize a departmental seminar with an invited speaker; Gain exposure to multiple career paths Participate in a graduate research competition; Meet a speaker or national or international reknown in the field Develop a vocabulary to communicate across disciplines in the required Phar 735 class and in journal club

10 4. Research credits Complete OSU minimum required research credits. Develop critical thinking and problem solving skills by conducting research over several years. 6. Written and Oral Preliminary Exam 7. Publish Research in Appropriate Outlets Demonstrate sufficient knowledge of subject matter to become a PhD candidate Demonstrate ability to communicate knowledge and research through a written and oral preliminary exam Write and defend an original proposal Submit manuscripts for publication in the peerreviewed literature Mentor undergraduates, visiting scientists, professionals or junior graduate students in the lab Complete required training courses relevant to the area of research Demonstrate an understanding of the responsible conduct of research Prepare a manuscript based on ethical and responsible research. Develop and use appropriate, state-of-the -art methods for research and data analysis including advanced instrumentation, statistical and computer methods Generate an NIH-style fellowship proposal in practice for future submissions Publish or submit research for publication in peer-reviewed outlets 8. Presentation of Research at Appropriate Venues Answer questions for a professional scientific audience, defending and supporting the research Present an oral presentation or poster to a professional audience at a regional or national scientific gathering. Give several oral and poster presentations to audiences including researchers, students and health professionals 9. Preparation of Ph.D. Dissertation Prepare a dissertation that meets expectations for original, independent research and provides a scholarly survey of prior research in the discipline Write a clear and professional dissertation and orally present the research findings in a publically announced defense Prepare a dissertation based on ethical and responsible research. 10. Dissertation Defense Defend the dissertation research before the student s Advisory Committee. Answer questions in the public seminar Present the research in a public seminar and defend the dissertation Present the dissertation research in a public seminar and defend the dissertation research before the student s Advisory Committee

11

12 Appendix 5 Name: Advisor: Date: Pharmacy PhD Student Annual Advisor Assessment of Progress Please rate this student on a scale of one to five in comparison with other successful graduate students at this stage of their program. 1=student is not making progress towards this goal, 3= student is progressing adequately and on par with other students at this stage towards this goal, 5= student excels almost all other students at this career stage in meeting this goal. Please use NA if not applicable to this student/project. We expect that most students should be receiving a majority of 3 s. For any score of 2 or below, please develop an action plan with the student for improvement. Please re-visit these areas for improvement with the student in 6 months. Goal Score 1 Is making progress in attainment of last year s goals 2 Has applied significant effort toward attainment of last year s goals 3 Understands and effectively uses modern, innovative methods pertinent to the discipline 4 Displays excellent oral and written communication skills. 5 Completes experiments, or other research tasks, with attention to detail, appropriate use of equipment, methodological approaches, and all appropriate controls 6 Demonstrates intellectual curiosity and creativity 7 Interacts well and works effectively with others 8 Demonstrates appropriate independence in development and execution of thesis project 9 Communicates research findings (e.g., publications, abstracts, presentations, etc.) 10 Displays excellent work habits and attitudes with a high potential to productively enter the research workforce. 11 Ethically conducts research in all environments 12 Works safely in all areas with concern for self and others 13 Displays skills to mentor and train future researchers in the discipline 14 Demonstrates understanding of and protection for privacy concerns when dealing with patient-specific information

13 Please provide an overall evaluation of the student s academic and research progress over the past 12 months, and your goals for the student for the coming year, including an action plan for scores of 2 or less in any area *. Please discuss this completed form with your graduate student, comparing the student s selfevaluation with yours. For students in the 4 th year of the PhD program, please provide an anticipated graduation date and plans for timely degree completion. I verify that I have discussed this completed evaluation with my advisor Student signature: Date: I verify that I have discussed this completed evaluation with my student Advisor signature: Date: Please sign and date both this form and the graduate student s self-evaluation form. Retain copies of both for yourself and send the completed originals to Debra Peters. * Advisors are encouraged to consult with the student s thesis committee and subsequently the Graduate Studies committee, if needed, regarding recurrent inadequate progress on action plans in deficient areas.

14 Appendix 6 Annual review of College of Pharmacy Graduate Students Name: Degree being sought? MS PhD Department or Degree Program: Thesis advisor: Year of entry into the program: Anticipated date of degree completion: Date of last thesis committee meeting: If no meeting has yet convened, please list anticipated date of first meeting: Oral prelims completed? Yes No If No, please list anticipated date of oral prelim exam: Dates (years) in which you gave an oral presentation at College of Pharmacy Graduate Student retreat: Please list all fellowships/scholarships applied for in the past year: Please list all fellowships/scholarships received in the past year, including funding agency, amount award, and date(s) of awards: Please list all manuscripts published in the previous year: Please list any awards received in the previous year, including local, regional or national poster awards or other: Please list attendance at any regional or national meetings to present either oral or poster form research findings: