Criterin 1.2.: Evaluatin. The prgram shall have an explicit prcess fr mnitring and evaluating its verall effrts against its missin, gals and bjectives; fr assessing the prgram s effectiveness in serving its varius cnstituencies; and fr using evaluatin results in nging planning and decisin making t achieve its missin. As part f the evaluatin prcess, the prgram must cnduct an analytical self-study that analyzes perfrmance against the accreditatin criteria defined in this dcument. a. Descriptin f the evaluatin prcesses used t mnitr prgress against bjectives defined in Criterin 1.1.d, including identificatin f the data systems and respnsible parties assciated with each bjective and with the evaluatin prcess as a whle. If these are cmmn acrss all bjectives, they need be described nly nce. If systems and respnsible parties vary by bjective r tpic area, sufficient infrmatin must be prvided t identify the systems and respnsible party fr each. The prcesses used t gather infrmatin fr ur measurable bjectives rely n bth qualitative and quantitative methds f data cllectin that are specifically tailred t each bjective. Similarly, the respnsible parties assciated with each bjective are specifically assigned accrding t their relevance t the designated bjective. Thse respnsible fr the bjective are als respnsible fr ensuring that data are cllected when apprpriate, analyzing the data, taking crrective actins as required either individually r by bringing the issue t a cmmittee r prgram leader and mdifying the data cllectin t meet new needs. The Prgram Directr is ultimately respnsible fr all bjectives, but has specific respnsibility fr selected bjectives as nted. Table 1.2.a. n the fllwing pages delineates the data systems used and the respnsible parties assigned t each f the Prgrams measurable bjectives as defined in Criterin 1.1.d.
Strategic Gal Objectives Data Systems Respnsible Party 1. T prvide engaging educatinal pprtunities preparing leaders t maximize the health and well-being f individuals, cmmunities and ppulatins. A. Increase and diversify curse fferings and frequency and methd f delivery. B. Increase the number f partnerships aimed at creating meaningful capstne field experiences available t students bth dmestically and internatinally. C. Offer increased numbers f student frums t prvide pprtunity fr discussing curses, verall curriculum and teaching. D. Maintain summary curse evaluatin scres that will ensure that high quality curses meet r exceed the expectatins f the students. Curse list and curse calendar Curriculum Cmmittee Prgrams Directr Capstne database Capstne supervisr Capstne Advisrs Master calendar Assistant Dean f Public Health Testing and Evaluatin Services Office (CursEval tm ) Curriculum Cmmittee Assistant Dean f Public Health Strategic Gal Objectives Data Systems Respnsible Party 2. T mbilize a diverse student bdy t address cmplex public health issues, including issues affecting vulnerable and underserved ppulatins. A. Increase the cultural diversity f the student bdy. B. Increase the diversity f academic backgrunds f MPH/MSPH students. C. Expand innvative interdisciplinary masters prgrams with partners within UM. Prgrams Student database OGPS Applicatin Prtal/ (Office f Research Management System) UM Prgrams f study Prgrams Directr Admissins Directr Admissins Cmmittee Prgrams Directr Admissins Directr Admissins Cmmittee Assistant Dean f Public Health
Strategic Gal Objectives Data Systems Respnsible Party 3. T fster an envirnment in which students and faculty cllabrate n scientific investigatins addressing public health issues and practice, with an emphasis n vulnerable and underserved ppulatins. A. Maintain the numbers f manuscripts accepted fr publicatin in peer-reviewed jurnals by ur faculty. B. Increase the number f presentatins at scientific meetings each year amng faculty and students. C. Increase the number f masters level students wh are engaged in a research experience. D. Maintain the dctral student grant submissin numbers. E. Increase the number f research prjects currently active in vulnerable and underserved cmmunities. PubMed and Faculty Curriculum Vitae Faculty and student Curriculum Vitae Prgrams Student database UMMSOM Research Reprting System and department rsters Divisin Heads Department Chair Individual Investigatrs Divisin Heads Department Chair Individual Investigatrs Prgrams Staff Prgrams Staff Faculty Self-reprt Individual Investigatrs Prgrams Staff Strategic Gal Objectives Data Systems Respnsible Party 4. T engage with cmmunities, prfessinals, leaders and thers as partners in imprving the health f ppulatins, including the mst vulnerable and underserved. A. Increase the frequency in which lcal cmmunities engage in disease preventin/health prmtin prgrams with ur faculty and students. B. Increase the number f faculty presentatins f research findings t lcal cmmunities whse members participated in the research prject. Faculty Self-Reprt Individual Investigatrs Prgrams Staff Annual Faculty Survey Individual investigatrs Prgrams Staff
Strategic Gal Objectives Data Systems Respnsible Party 5. T create educatinal pprtunities in public health fr public health and health prfessinals and the brader cmmunity. A. Increase cmmunity-based educatinal prgram pprtunities per year that aim t educate the cmmunity abut imprtant public health issues. B. Increase schlarship ffers t health prfessinals t cmplete certificate and degree wrk in ur graduate prgrams. Annual Faculty Survey Tuitin Expenditure Database Individual Investigatrs Prgrams Staff Prgrams Staff b. Descriptin f hw the results f the evaluatin prcesses described in Criterin 1.2.a are mnitred, analyzed, cmmunicated and regularly used by managers respnsible fr enhancing the quality f prgrams and activities. Metric reprts are prduced and distributed n a regular schedule fr sme data, e.g., curse evaluatin scres fllwing the end f each semester. Mst data are cllected annually, e.g., prpsal submissin numbers, publicatins and cmmunity interactins. Data frm all f these surces are used in varius meetings t assess prgress against bjectives. Sme examples f hw the data are used by cmmittee members and managers t enhance the quality f the prgrams are described in the table belw: Meeting Use f Data Student feedback sessins Discuss changes t curse fferings Discuss and recmmend changes t class schedule Refine master calendar t better accmmdate student schedules Review summary curse evaluatins Review capstne requirements and pprtunities Celebrate cultural, ethnic and racial diversity Curriculum Cmmittee meetings Supplement curse fferings Recmmend revisins t sequence f classes ffered Discuss and recmmend changes t class schedule Review f curse syllabi and prgram cmpetencies Review f student curse evaluatins Executive Plicy Cmmittee meetings Design prgrams t increase diversity f all types within the student bdy Analyze prpsals fr jint degree prgrams Advcate fr targeted student expenditures t meet prgram bjectives (increase travel funds, schlarship supprt, fellwship awards, etc.)
Meeting Use f Data Department Faculty meetings Prmte research experience fr students in light f advantages fr faculty Discuss prpsal submissin metrics and emphasize imprtance f research funding Cmmunicate new pprtunities fr instructr training Update the faculty n Prgrams initiatives and issues Executive Cmmittee meetings Discuss academic and research prductivity measures fr faculty Devise schlarship prgrams Priritize and apprve targeted student and prgram expenditures t meet prgram bjectives Prgrams Staff/Administratin meetings Mnitr curse enrllment and prvide feedback t the Curriculum Cmmittee Increase recruitment at clleges with diverse student bdies Lcate pprtunities with faculty fr students with an interest in research Cnnect faculty t cmmunity leaders Prvide and crdinate Capstne pprtunities fr students Divisinal meetings Advcate fr increased cmmunity based research Advcate fr increased student invlvement in faculty research Mst f the cmmittee meetings nted abve are held mnthly, which allws cntinual invlvement frm faculty, staff, and students. Thrugh these interactins, recmmendatins fr verall prcess imprvements, suggestins n methds t becming mre efficient, psitive feedback cncerning applied changes n prcedures, and even cnstructive criticism when things d nt wrk ut as planned are received by the decisin makers. All feedback is incrprated int ur planning initiatives. These varied frums have been indispensible fr mnitring, evaluating and prgressing tward ur gals, and bjectives. The Prgrams staff rutinely checks these data surces t infrm their decisins and actins. They share the respnsibility t identify trends, recmmend crrective actin as needed and implement apprved changes.
c. Data regarding the prgram s perfrmance n each measurable bjective described in Criterin 1.1.d must be prvided fr each f the last three years. T the extent that these data duplicate thse required under ther criteria (e.g., 1.6, 2.7, 3.1, 3.3, 4.1, 4.3, 4.4), the prgram shuld parenthetically identify the criteria where the data als appear. The fllwing table details the prgress made tward gals established in Criterin 1.1.d: Objective Outcme Measure Target 2010-11 2011-12 2012-13 Related 1A. Increase and diversify curse fferings and frequency and methd f delivery. 1B. Increase the number f partnerships aimed at creating meaningful capstne field experiences available t students bth dmestically and internatinally. 1C. Offer increased numbers f student frums t prvide pprtunity fr discussing curses, verall curriculum and teaching. Number f curse titles Number f curses with multiple sectins/fferings per year Number f curses taught with new frmat (timing, technlgy, nnlecture frmat, etc.) Number f new dmestic capstne partnerships Number f new internatinal capstne partnerships Number f Chairs Hurs Twn Hall meetings held Fcus grups 45 31 43 50 2.1 6 0 2 6 2.1 3 per year 4 8 9 1.7 Increase 1 5 7 2.4 Increase 2 1 3 2.4 2 per academic year 8 per academic year 1 per semester Nt yet implemented Nt yet implemented 1 1 4.4 4 11 4.4 2 3 2 4.4 1D. Maintain summary curse evaluatin scres that will ensure that high quality curses meet r exceed the expectatins f the students. Summary mean curse evaluatin scres (all curses) Bistatistics summary mean scre Epidemilgy summary mean scre Public Health summary mean scre 4.0 4.3 4.4 4.3 4.1 4.0 4.5 4.5 4.4 4.1 4.0 4.3 4.5 4.2 4.1 4.0 4.2 4.3 4.3 4.1
Objective Outcme Measure Target 2010-11 2011-12 2012-13 Related 2A. Increase the cultural diversity f the student bdy. 2B. Increase the diversity f academic backgrunds f MPH/MSPH students. 2C. Expand innvative interdisciplinary masters prgrams with partners within UM. Number f cuntries represented in student bdy* Number f freign universities with active recruitment activities Number f undergraduate degrees in the arts and humanities Number f undergraduate degrees in the bimedical/physical sciences Number f jint degree prgrams 10% Increase per year Increase by 1 per year 14 27 37 1.8 4 5 7 4.3 >30% 47% 42% 49% 4.3 >30% 53% 58% 51% 4.3 1 per year 5 6** 6** 2.11 Objective Outcme Measure Target 2010-11 2011-12 2012-13 Related 3A. Maintain the numbers f manuscripts accepted fr publicatin in peer-reviewed jurnals by ur faculty. Ttal number f publicatins per primary faculty Ttal number f publicatins f department faculty 7 per faculty member 7 per faculty member 8.0 6.0 7.0 3.1 5.7 5.5 5.0 3.1 3B. Increase the number f presentatins at scientific meetings each year amng faculty and students. Number f presentatins by primary faculty Number f presentatins by department faculty 5 per faculty member 5 per faculty member 6.8 6.5 5.4 3.1 3.1 Number f presentatins by Ph.D. students 2 per student 2.4 3.8 1.6 2.10
Objective Outcme Measure Target 2010-11 2011-12 2012-13 Related 3C. Increase the number f master level students wh are engaged in a research experience. 3D. Maintain the dctral student grant submissin numbers. Number f students engaged in the MSPH research capstne Number f MPH students engaged in research Number f grant submissins by students n/a 13 5 11 3.1 3.1 n/a 5 3 3 2.10 3E. Increase the number f research prjects currently active in vulnerable and underserved cmmunities. Number f research prjects currently active in vulnerable and underserved cmmunities with primary faculty as PI Number f research prjects currently active in vulnerable and underserved cmmunities with department faculty as PI 3.1 3.1 Objective Outcme Measure Target 2010-11 2011-12 2012-13 Related 4A. Increase the frequency in which lcal cmmunities engage in disease preventin/health prmtin prgrams with ur faculty and students. 4B. Increase the number f faculty presentatins f research findings t lcal cmmunities whse members participated in the research prject. Faculty engaged in the jint develpment f health prmtin/disease preventin interventins Primary faculty participating in cmmunity service Faculty presenting t lcal cmmunities wh participated in research 30% 39% 36% 33% 3.2 75% 88% 83% 67% 3.2 40% 44% 42% 36% 3.2
Objective Outcme Measure Target 2010-11 2011-12 2012-13 Related 5A. Increase cmmunitybased educatinal prgram pprtunities per year that aim t educate the cmmunity abut imprtant public health issues. 5B. Increase schlarship ffers t health prfessinals t cmplete certificate and degree wrk in ur graduate prgrams. Faculty cnducting cmmunity educatinal prgrams Department Grand Runds presentatins Number f schlarships t residents/fellws/pst dcs Number f schlarships t students (MD/MPH 5 year) 30% 33% 33% 28% 3.3 10 8 12 11 3.2 5 2 6 7 1.6 2 0 3 1 1.6 *Des nt include jint degree MD/MPH *MD/MPH jint degree has tw ptins, the 4 year track and the 5 year track. The 4 year track t cmplete bth degrees was first ffered in 2011-12. The 5 year ptin existed prir t 2010 and remains an ptin fr traditinal MD students. d. Descriptin f the manner in which the self-study dcument was develped, including effective pprtunities fr input by imprtant prgram cnstituents, including institutinal fficers, administrative staff, faculty, students, alumni and representatives f the public health cmmunity. An Accreditatin Wrkgrup was frmed in 2011 t fcus attentin n the accreditatin prcess, including the self-study. The members f the Wrkgrup, and their titles are included in the table belw: Name Title David Lee, Ph.D. Directr Prgrams Julie Krnfeld, Ph.D., MPH Assistant Dean f Public Health Heather Rse, MPH Accreditatin Directr Rsalie Blunden, MBA Assistant Vice President, Research Supprt Operatins Jhn Alzate, MBA Prject Manager (thrugh May 2013) Anya Nanayakkara/Lurdes Mlleda MPH student emplyees This wrkgrup met weekly and perfrmed a variety f activities including: Establish timelines Distribute assignments Create and review methds f data cllectin Cllect data and review it as it was cllected Analyze data Discuss appraches t invite participatin in the prcess
Draft surveys Identify cnstituencies Create methds f btaining input frm members f each cnstituency Draft self-study sectins Cllectively review and edit self-study Make the self-study available n the web Cntact selected reviewers as drafts f sectins were upladed t the web Send brad ntificatins t cnstituent grups as drafts were available fr review React t cmments frm reviewers. This same grup met mnthly with Department leadership fr guidance and assistance. The main methd by which the self-study dcument was made available t the varius prgram cnstituent grups is via a permanent website lcated at the fllwing address: http://epidemilgy.med.miami.edu/accreditatin. This website is designed and rganized based n CEPH accreditatin criteria t make each sectin f the self-study dcument easy t identify and access. T help with the review f the self-study dcument, the website is als designed t allw submissin f feedback by any individual. The feedback is emailed t the CEPH Accreditatin Wrkgrup which is respnsible fr reviewing and acting upn received feedback frms. The feedback is included in the fllwing CEPH Accreditatin Wrkgrup weekly meeting, where it is discussed and if necessary brught t ther cnstituent grups fr deliberatin. A review panel f faculty was assigned fr each sectin as a near-final draft is cmpleted. Their task was t read the assigned sectin, make cmments, suggest revisins, prvide additinal data, questin assumptins and verify cnclusins. These faculty sub grups met with the Prgrams Directr t further discuss their feedback. Their input was critical t the accuracy and cmprehensin f the selfstudy reprt. The Department Chair als reviewed each sectin in detail as the near-final draft f each majr sectin was cmpleted. His cmments prvided a glbal perspective assuring that the self-study reflects hw the Prgrams fit int the master plan fr the Department f Public Health Sciences. Cmmunity partners were sent an email t be certain they were aware f the accreditatin prcess and the availability f the self-study materials n the web. While their input was welcme n all aspects f the prgram, we pinted ut the mst pertinent sectins fr them t review. Current students were sent an email ntificatin that the self-study was n the web and asked t review the dcument frm their unique perspective. Their feedback was received via the web feedback frm and in cnversatins with the graduate prgrams staff. Alumni were ntified and asked fr cmments via the web feedback frm. Once again, input n the Prgrams frm this grup is nt limited t their frmal cmments n the self-study draft but is a cntinuus prcess as they interact with their frmer teachers and mentrs.
University leadership was given cpies f the self-study when it reached near-final draft fr frmal input. But their input n the prgram, gathered in the nrmal curse f business meetings and less frmal cnversatins, is reflected thrughut the self-study dcument. The Prgrams in Public Health wrk clsely within the Office f and Pstdctral Studies (OGPS) at the Miller Schl. Dr. Zafar Nawaz, the Senir Assciate Dean fr Educatin and head f OGPS, was cnsulted thrughut the self-study prcess. Once all sectins f the self-study dcument were cmplete and made available t all cnstituent grups fr feedback, the self-study dcument was printed as a cmprehensive text fr a final review by the Accreditatin Wrkgrup t assess the cnsistency f the dcument t ensure chesiveness and verall cntinuity amng all the varius sectins f the self-study dcument. The Chair als tk a final lk at the self-study at this pint, checking fr cnsistency between the final prduct, his gals fr the Prgrams and his plans fr the Department. Presentatins were made at faculty meetings t summarize the self-study dcument. This ensured that all faculty were familiar with all sectins, even thugh they may have reviewed nly ne sectin in detail. e. Assessment f the extent t which this criterin is met, and an analysis f the prgram s strengths, weaknesses and plans relating t this criterin. This criterin is met.