Peer Review Self Assessment Exercise The following Exercise will ask for your analysis of various peer review experiences and your thoughts following several peer review scenarios. Satisfactory completion of this exercise is required. Satisfactory completion requires responding to all required questions and responding professionally. This is a self assessment. Please be honest. Some questions are optional and are indicated as optional. This exercise should take about 20 minutes. 1. What is/are the purposes of peer review? (If providing multiple purposes, please number your responses.) 2. Why is peer review important to the profession of pharmacy? (If providing multiple reasons, please number your responses.) Peer review is an evaluation process by individuals in the same field to maintain standards, improve performance, and provide credibility. The following questions refer to recent peer review activities within the curriculum. 3. (Insert Curricular Example of Peer Review from Curriculum) (Repeat Question as Needed to Examine Relevant Examples.) I don't remember I gave constructive feedback during the review process. I received constructive feedback during the review process. The review process improved the quality of the class's submissions. Page 1
4. Comments on Examples of Peer Review (Optional) The following questions refer to potential uses of peer review in practice. 5. You are a pharmacist in an MTM practice. Your employer has developed an internal review system as one means to advance the practice. In this system, practitioners review random samples of other practitioners' documentation. The practitioners meet to prepare for the internal review, discussing the practice standards and walking through a sample review together. Composite ratings and comments will be provided back to each practitioner. 6. You are a pharmacist in a community pharmacy. Twice a year, you are asked to review one of your colleague's work. You rate and provide feedback for your colleague on his/her inventory management, communication with patients, timeliness in getting transfers, and working relationship with other employees. Page 2
7. You are a pharmacist in a hospital practice where pharmacy services are being extended in the Emergency Room. Your ER pharmacy colleague has been collecting data on the impact of his services over the past six months. He has called together you and two other pharmacists to review the data. Following the review, your review panel will make recommendations on how to refine and advance pharmacy's work in the ER. The end result will be a report with the results of the review and recommendations. This report will help justify continued resources for staffing pharmacy in the ER. 8. The Board of Pharmacy has requested your participation on a Continuing Professional Development Review Committee. In your state, pharmacists can elect to complete CE credits or to maintain a CPD portfolio. Select CPD pharmacists are then audited and their portfolios are submitted for review. Your Committee's task is to determine whether the portfolios meet the Board's standards. The peer group meets to discuss the standards for acceptable submissions and reviews a number of portfolios together before commencing work. (Note: This process was just completed in North Carolina.) 9. You are a pharmacist working in benefits management. You have been contacted by the editors of the American Journal of Managed Care Pharmacy and have been asked to review a manuscript on Glycemic Control of Veterans Administration Patients, in order to determine its suitability for publication. Page 3
The following questions allow you to self assess your recent participation in peer review. 10. Please describe a recent time when you sought a colleague's review of your work. Who did you ask for review from? What did you ask them to do? Why did you ask for this review? 11. Please describe a recent time when you reviewed a peer's work. Whose work did you review? What did you review? 12. Considering the review situation you just identified, please rank the following skills based on how well you performed them. Create a list of strongest (1) to weakest (7). determining whether the work meets the standards and where it might fall short identifying areas of strength providing articulate comments describing areas performed well identifying specific areas where my colleague's work could be improved making specific suggestions for how they could improve their work giving examples of how to improve their work phrasing comments constructively on areas to improve Rank 13. How would you describe your experience providing peer review? Options I have had only a few experiences providing peer review. I have occasionally provided peer reviews. I regularly provide peer reviews. I am a seasoned peer reviewer. Select One Page 4
14. Please consider the peer review skills below and rate your overall ability related to peer review. (Note: This question could be modified to rate each individual skill.) Peer review skills: -determining whether the work meets the standards and where it might fall short -identifying areas of strength -providing articulate comments on areas performed well -identifying specific areas where my colleague's work could be improved -making specific suggestions for how they could improve their work -giving examples for how they could improve their work -phrasing comments constructively on areas to improve Rating scale: Novice: I understand these responsibilities, but may perform one or more inconsistently, at times (e.g. giving examples, constructive wording). Developing: I understand these responsibilities and perform them in a reliable, consistent and accountable manner once directed to the peer review task and oriented to review work expected. Skilled: Without direction, guidance or support from instructors, preceptors or managers, I perform these skills reliably, consistently and accountably. Facilitating/Leading: I am confident in assisting others with peer review responsibilities or proposing or creating options to fulfill these responsibilities. Educating: I have mastered these responsibilities and desire to learn more and share my learning with others. I demonstrate maturity, confidence and an ability to educate others in peer review through the use of evidence and strong interpersonal skills. Options Novice Developing Skilled Facilitating/Leading Educating Response We are interested in how this exercise may have changed your perceptions of peer review. To that end, please report your perceptions prior to the exercise and now. Page 5
15. Pre Exercise Response Peer review is valuable Peer review is important I am good at reviewing colleague's work. I am good at requesting a review of my work. I am good at responding to other's review of my work. In my future practice I will be asked to participate in peer review. 16. Post Exercise Response Peer review is valuable Peer review is important I am good at reviewing colleague's work. I am good at requesting a review of my work. I am good at responding to other's review of my work. In my future practice I will be asked to participate in peer review. 17. This exercise contained a number of self assessment questions that may have provided insights on areas you may want to focus on in your professional development efforts. What is one action you would like to take to enhance your ability to engage in peer review? 18. My recommendations for enhancing peer review in the curriculum are... (Optional) Developed at the University of Minnesota College of Pharmacy For Questions: Kristin Janke, Ph.D, janke006@umn.edu Page 6