CRITERION 1: THE SCHOOL OF PUBLIC HEALTH

1.1: Mission CRITERION 1: THE SCHOOL OF PUBLIC HEALTH 1.1 MISSION The School shall have a clearly formulated and publicly stated mission with supporting goals, objectives and values. 1.1.a. A clear and concise mission statement for the school as a whole. Mission, Vision, and Values The Mission of the School of Public Health (SPH) is to create solutions for a healthier community by advancing public health knowledge through research, service, and the education of public health professionals. In January of 2013, Dr. Michael Williams was appointed as the Interim and ultimately selected President of the University of North Texas Health Science Center (UNTHSC). After his appointment, he requested that all units of the UNTHSC participate in the development of a new mission statement for the UNTHSC, as well as a new vision statement and a refined conception of its values. This process resulted in new mission and vision statements for the UNTHSC. These new statements are: Mission of the UNTHSC: Create solutions for a healthier community Vision of the UNTHSC: To be the team of choice for education, discovery and health care Each unit was directed to begin its mission statement with the above UNTHSC mission statement. The SPH s vision statement was drafted by its faculty, staff, students, and stakeholder communities during the self-study year and is now stated as: Vision of the School of Public Health: To be the team of choice for public health education, discovery, and service. 1.1.b. A statement of values that guides the School The values of the UNTHSC were refined during a process that engaged the entire health science center in 2013. Many SPH faculty and staff completed surveys and participated in focus groups to contribute to the values development. Several SPH faculty and staff were participants in an intensive blueprint workshop that articulated the values based upon the feedback garnered from the survey and focus groups. The entire SPH faculty and staff were participants in values roll-out sessions where final input was gathered. The five values which resulted from the process are a major aspect of the FY 2015 Strategic Plan. The values and associated behaviors are: 1

1.1: Mission Serve Others First Encourage growth, well-being and success of each other and people we serve o Empower one another to make values-based decisions o Consider the impact of your decisions o Be good stewards of people and resources o Demonstrate compassion, care and humility o Promote individual potential Integrity Uphold the highest ethical standards o Do what is right, not just what is easy o Conduct ourselves with honesty, trustworthiness and dependability o Be transparent in actions o Own, correct and learn from successes and failures o Demonstrate loyalty to our mission and vision Respect Treat everyone with dignity and compassion o Gratefully acknowledge contributions and efforts of others o Invite other perspectives and encourage dialogue o Communicate openly in a timely, courteous and relevant manner o Promote diversity of thought, ideas and people o Build trust by honoring our word through actions Collaboration Work together to achieve shared goals o Combine our strengths to discover new ideas and share best practices o Seek opportunities to engage others and break through barriers o Inspire one another to be more, collectively, than the sum of our individual parts o Give, ask for and value feedback o Recognize the contributions of others and celebrate successes Be Visionary Create innovative solutions in the pursuit of excellence o Respectfully challenge the way things have always been done o Create unique ways to provide remarkable service o Navigate change to move us forward o Proactively implement new ideas o Take thoughtful risks Since the initial roll-out of the values, the process of awareness and action has continued with participation of the students on the UNTHSC campus. The SPH has embraced the values as the framework for our collegial teamwork in the areas of teaching, research and service. 1.1.c. One or more goal statements for each major function through which the School intends to attain its mission, including at a minimum, instruction, research and service. To fulfill its mission the SPH has the following primary goals (strategic initiatives): Goal 1 (Strategic Initiative 1): Administration Create an environment that facilitates the education of exemplary public health professionals and creates and disseminates public health knowledge Goal 2 (Strategic Initiative 2): Academic Affairs Develop public health professionals and scientists devoted to the highest standards of health in Texas, nationally and internationally. 2

1.1: Mission Goal 3 (Strategic Initiative 3): Research Discover, translate, and disseminate public health knowledge that is recognized nationally and internationally. Goal 4 (Strategic Initiative 4): Community Engagement Serve communities and professional organizations to accomplish SPH and HSC goals and to improve population health. 1.1.d. A set of measurable objectives with quantifiable indicators related to each goal statement as provided in Criterion 1.1.c. In some cases, qualitative indicators may be used as appropriate. For five years prior to the appointment of the new president in January 2013, the UNTHSC developed and implemented a strategic planning process that was required by all UNTHSC units. This process began with an environmental assessment; continued with the development of a statement of mission, vision, and values; and, finally, focused on the creation of an approach that defined goals for the UNTHSC, along with their associated tactical initiatives and performance measures. Each unit was directed to implement a similar approach to planning. The result of this process for each unit was a Strategic Map for each year that included results and follow-up activities. This information was recorded in TracDat, the software application system used by the UNTHSC for the uniform reporting of assessment plans across units. Strategic plans for the last 3 years are provided in Appendix 1.1.d.1 located in the Electronic Resource File. The current strategic plan is also available to the UNTHSC community and the general public through the SPH website: http://web.unthsc.edu/info/20005/school_of_public_health/558/about_us. The goals in the strategic plan were designed to be relatively stable, with annual changes in tactical initiatives as they were accomplished or changed based on the continuing environmental assessment. These tactical initiatives are typically measured qualitatively, although there are no benchmark objectives. Each unit also produced performance measures for the goals, and these are typically measured quantitatively. The SPH primary goals along with the corresponding (i) performance measures and (ii) tactical initiatives are presented below in Table 1.1.d.1. Results of the School s performance in these areas over the last three years are summarized in the Outcomes Measures Table in Criterion 1.2.c (Table 1.2.c.1). 3

1.1: Mission Table 1.1.d.1: School of Public Health Goals and Objectives GOAL 1 (STRATEGIC INITIATIVE 1): ADMINISTRATION Objective: Create an environment that facilitates the education of exemplary public health professionals and creates and disseminates public health knowledge GOAL 1 (Administration) - PERFORMANCE MEASURES Outcome Measure Target 1.1 Maintain student-faculty ratio in all departments Maximum student-faculty ratio of 10:1 1.2 Percentage of students receiving financial assistance from the school (from scholarships and grant funding) At least 40% of students will receive financial assistance 1.3 1.4 1.5 Faculty/Staff Survey of Employee Engagement (administered in even years): Ratings on (1) quality of organizational culture, (2) job satisfaction, and (3) empowerment Faculty/Staff Denison Survey (administered in odd years): Ratings on team orientation Faculty recruitment and promotion (faculty promoted or hired as associate or full professor) Minimum rating of 350 in each area At or above 50 th percentile in all areas of team orientation Add at least one senior faculty member each year GOAL 1 (Administration) - TACTICAL INITIATIVES 1.6 Outcome Measure Complete departmental review of Office of Admission and Academic Services (OAAS), Dept. Behavioral and Community Health (BACH), Dept. Biostatistics (BIOS), Dept. Environmental and Occupational Health Sciences (EOHS), and Dept. Epidemiology (EPID) Target Complete all reviews by 2013-2014 1.7 Implement reorganization of administrative staff Redefine administrative assistant roles by 2012-2013 1.8 1.9 Review student fee structure, e.g., computing, portfolio, Certified in Public Health Examination (CPH) Investigate use of TracDat (and other learning management systems such as Canvas), for tracking the assessment of program competencies Complete revised fee structure by 2013-2014 Implement competency assessment software by 2014-2015 1.10 Implement a plan to increase full-time student enrollment 1.11 1.12 Plan SPH role in College of Pharmacy (CoP) and Texas College of Osteopathic Medicine (TCOM) curricula Complete recruitment of: (1) Faculty for EOHS, EPID, and BIOS (2) Chairs for Departments of EPID, BIOS and HMAP 1 (3) An Associate Dean for Research Reduce ratio of part-time to full-time student enrollment ratio to less than 1.5 to 1 (1.5:1) by Fall 2013-2014 Provide course content for CoP and TCOM implement by August 2014 Complete searches by 2013-2014 1.13 Prepare and complete self-studies for CAHME 2 accreditation of the Master of Health Administration (MHA), and SPH CEPH 3 accreditation. Complete CAHME by October 2013. Complete CEPH by May 2015 1.14 Implement a revised SPH faculty orientation Complete revisions and implement faculty orientation by 2012-2013 1 Health Management and Policy 2 Commission on Accreditation of Healthcare Management Education (CAHME) 3 Council on Education for Public Health (CEPH) 4

1.1: Mission GOAL 2 (STRATEGIC INITIATIVE 2): ACADEMIC AFFAIRS Objective: Develop public health professionals and scientists devoted to the highest standards of health in Texas, nationally and internationally GOAL 2 (Academic Affairs) - PERFORMANCE MEASURES 2.1 2.2 2.3 2.4 2.5 Outcome Measure As part of Southern Association of Colleges and Schools (SACS) accreditation, participate in the UNTHSC Quality Enhancement Plan (QEP) by implementing higher order thinking principles in target courses. Number of enrolled students: (1) Headcount (HC) (2) FTE Percentage of diverse students (African American, Hispanic, Asian and Native American) Student satisfaction with quality of education - (survey response to question Overall, I am satisfied with the quality of my education ) Student satisfaction with quality of teaching (survey response to level of satisfaction with quality of teaching) Target (1)2011-2012: Identify 3 target courses and revise syllabi to incorporate higher order thinking principles and assessment methods; (2) 2012-2014: Expand QEP principles to 3 courses each year. 2011-12: 340 HC and 260 FTEs 2012-13: 390 HC and 290 FTEs 2013-14: 425 HC and 310 FTEs At least 30% of student body 80% of students will respond Met or Exceeds on the annual campus-wide Student Satisfaction Survey administered in the Spring. 80% of students will respond Agree or Strongly Agree on the annual campus-wide Student Satisfaction Survey, administered in the Spring. GOAL 2 (Academic Affairs) - TACTICAL INITIATIVES 2.6 2.7 2.8 2.9 2.10 Outcome Measure Implement online course offerings for all core courses and two additional courses to create PH certificate and online MPH program Implement Blackboard, Turnitin, and syllabus template for all courses for all faculty Investigate Memorandum of Understanding (MOU) with All India Institute of Hygiene and Public Health Implement iwebfolio software for masters and doctoral programs Investigate undergraduate (UG) instruction through area universities Target Implement online courses within two academic years (by 2013-2014) Implement changes within two academic years (by 2013-2014) Secure MOU by Fall 2014 Implement iwebfolio by Fall 2013 Complete investigation and secure collaboration with at least 2 schools by 2013-2014 2.11 Explore a second online degree program at the master s level Develop second online degree program and admit first cohort by 2013-2014 2.12 Investigate dual degree with PA program Complete investigation of dual program by 2014-2015 2.13 Implement a Maternal and Child Health (MACH) concentration in the MPH degree program Implement MACH concentration and admit first cohort in Fall 2014 2.14 Implement utilization of Canvas (a learning management system) in all SPH courses. 2.15 Launch two certificate programs Complete implementation of Canvas usage in all courses by Fall 2014 Complete planning and launch two certificate programs by Fall 2015 5

1.1: Mission GOAL 3 (STRATEGIC INITIATIVE 3): RESEARCH Objective: Discover, translate, and disseminate public health knowledge that is recognized nationally and internationally GOAL 3 (Research) - PERFORMANCE MEASURES Outcome Measure 3.1 Total ongoing extramural research funding 3.2 Dollar value of grant applications submitted annually Target (All reported targets were established in conjunction with HSC Provost) 2011-2012: $3 million 2012-2013: $3.5 million 2013-2014: $3.5 million (All reported targets were established in conjunction with the UNTHSC Provost) 2011-2012: $25 million 2012-2013: $28 million 2013-2014: $32 million 3.3 Total number of unduplicated peer-reviewed publications (published/in press) 50 publications each year GOAL 3 (Research) - TACTICAL INITIATIVES 3.4 3.5 3.6 Outcome Measure Improve support for standard aspects of grant applications and implement infrastructure plan with the UNTHSC Research Office (ORA) and the Texas Prevention Institute (TPI) Identify and implement a research plan for each faculty member Implement a research colloquium series for faculty in conjunction with the TPI Target Create and implement research support structure by Fall 2014 Implement research plans for all faculty by Fall 2015 Implement research series by 2012-2013 3.7 Implement structure to focus SPH research on 5 core areas Implement by 2014-2015 3.8 Develop authorship and publication ethics guidelines Implement guidelines by 2015-2016 GOAL 4 (STRATEGIC INITIATIVE 4): COMMUNITY ENGAGEMENT Objective: Serve communities and professional organizations to accomplish SPH and HSC goals and to improve population health. GOAL 4 (Community Engagement) - PERFORMANCE MEASURES Outcome Measure Target 4.1 4.2 4.3 4.4 4.5 Number of target participants attending the North Texas Health Forum (NTHF) Percentage of faculty performing editorial and review duties for journals and agencies Percentage of faculty engaged in professional consulting and training Percentage of faculty participating in professional organizations Percentage of faculty participating in community service activities 200 250 participants At least 75% of all faculty At least 30% of all faculty At least 95% of all faculty At least 70% of all faculty 6

1.1: Mission GOAL 4 (Community Engagement) - TACTICAL INITIATIVES 4.6 4.7 Outcome Measure Continue the North Texas Health Forum (NTHF) as a twoday event Expand development opportunities through the Dean s Civic Council and other sources Implement NTHF annually Target Expand opportunities for SPH Initiatives each year 4.8 Expand alumni involvement in SPH activities Increase alumni involvement each year in SPH activities (e.g. SPH committees, recruitment events, orientation sessions, internship/practice experience placement, etc.). 4.9 4.10 4.11 Expand Center for Public Health Preparedness (CPHP) and Texas Public Health Training Center (TPHTC) programs with regard to public health Define and implement the role and function of a DrPH Advisory Council Expand SPH involvement in community planning and evaluation through Biostatistics and Evaluation Services and Training (BEST) Center Expand programs each year and seek alternate sources of funding Create a DrPH Advisory council by 2014-2015 Create and implement BEST by 2013-2014 1.1.e. Description of the manner through which the mission, values, goals and objectives were developed, including a description of how various specific stakeholder groups were involved in their development. Development of the School Strategic Plan (mission, values, goals and objectives) Based on the UNTHSC requirements, the planning process in the SPH was created to engage faculty and staff with one or two annual retreats where the current internal and external environment of the SPH was reviewed, and in which goals, tactical initiatives, and performance measures, along with associated measures/targets, were developed. This approach has continued as an annual review process for the plan with interim review by the SPH Executive Council, which consists of all chairs and deans, as well as the faculty (through its faculty meetings). The product of the initial phase of the process was reviewed with two external groups: the Public Health and Prevention Council (formerly the Dean s Council) and the Master of Health Administration Advisory Council. Both groups are comprised of community members from organizations and the general public who expressed an interest in assisting the SPH in its development. Formal student input into the ongoing development of the School s mission, goals, and objectives is provided through two primary mechanisms. First, student input is provided through the annual Student Satisfaction Survey, which is conducted by the UNTHSC Office of Strategy and Organizational Excellence (OSOE) and distributed to all UNTHSC students. This survey evaluates the level of student satisfaction in a number of areas including academics, facilities and services, and student services provided by individual programs. Results are used to outline areas for improvement within each school and the overall institution. Schools are required to prepare action plans to address areas that need improvement, and these plans are then used to inform strategic plans for subsequent years. In the SPH, the information gathered through the survey is reviewed by the Dean, department chairs, and faculty, as well as by students through focus groups created for each of the four basic degree programs, MPH, MHA, DrPH, and PhD. The faculty and the Dean then develop an improvement plan for each concern. The Student Satisfaction Survey is further discussed in Criteria 1.2.b and 4.4.c. SPH survey results and corresponding action plans for the last three years, 2011-2012 to 2013-2014, are provided in Appendix 4.4.c.1 located in the Electronic 7

1.1: Mission Resource File. Full OSOE reports that contain institutional and program results are available at: http://web.unthsc.edu/info/200302/strategy_and_measurement/1865/student_survey A second mechanism is the courses evaluation process which allows students to provide feedback on the extent to which courses achieve competencies associated with them. This information is gathered through the Individual Development and Educational Assessment (IDEA) System and feedback during the summer field placements (written reflection reports, a mid-course meeting with the site-supervisor (preceptor) and the Academic Advisor or Program Director. All MPH students complete these assessments, as they are required field placement activities and required components of the MPH Professional and Academic Development (PAD) course. This process of receiving feedback continues to ensure that when recommendations for revisions to either the mission, vision or the goals are made, all stakeholders, including faculty, staff and students are provided with the opportunity to participate in discussions, provide feedback, and engage in the approval process. 1.1.f. Description of how the mission, values, goals and objectives are made available to the School s constituent groups, including the general public, and how they are routinely reviewed and revised to ensure relevance. As noted above in section 1.1.e, the UNTHSC has an established review process for the strategic plan each year. In accordance with this process, the faculty and staff of the SPH review the plan annually through faculty and staff retreats, with student input provided through the annual Student Satisfaction Survey (presented in Criteria 1.1.d, 1.2.b and 4.4.c). The plan also receives input from its advisory bodies, the Provost, and the UNTHSC Office of Strategy and Organizational Excellence. This ongoing process further provides a mechanism for evaluating performance towards the goals and objectives outlined in the strategic plan, ensuring they are continuously monitored and revised as needed. The SPH mission, vision, values, goals and objectives are made available to all stakeholders through the SPH website: http://web.unthsc.edu/info/20005/school_of_public_health/558/about_us, and through promotional and recruitment materials. They are also posted on a bulletin board on the 7 th floor of the Everett Education and Administration (EAD), one of the two floors where the SPH is housed (facilities are discussed in Criterion 1.7.d). 8

1.1: Mission 1.1.g. Assessment of the extent to which this criterion is met and an analysis of the School s strengths, weaknesses and plans relating to this criterion. This criterion is met. Strengths: The planning process has been effective in allowing the School to identify specific initiatives to be annually completed during a period of substantial change guided by the UNTHSC administration. These changes included the implementation of the MHA program and its accreditation, the development and implementation of the PhD program, consistent growth in research awards, addition of faculty in response to program and student growth, and increased awareness of the School in the DFW metroplex. As noted above, the SPH worked with the UNTHSC in the development and implementation of a new planning process for FY 2015. We continue to use a comprehensive review process that is now based on the new structure created by the UNTHSC. Weaknesses: The weakness of this process has been the complexity of the reporting process, which was initially through WEAVE software and is now through TracDat software. This software provides an efficient means of recording the plan and its results but is less useful for management of the plan. Management is conducted by the Office of the Dean through reviews at meetings of the Executive Council and the faculty. Plans: The President of the UNTHSC has developed a new approach to strategic planning. The SPH plan for FY 2015 is included in Appendix 1.1.d.1 can be found online at: http://web.unthsc.edu/info/20005/school_of_public_health/558/about_us (click on SPH Strategic Plan 2015). 9

1.2: Evaluation 1.2 EVALUATION The School shall have an explicit process for monitoring and evaluating its overall efforts against its mission, goals and objectives; for assessing the School s effectiveness in serving its various constituencies; and for using evaluation results in ongoing planning and decision making to achieve its mission. As part of the evaluation process, the School must conduct an analytical self-study that analyzes performance against the accreditation criteria defined in this document. 1.2.a. Description of the evaluation processes used to monitor progress against objectives defined in Criterion 1.1.d, including identification of the data systems and responsible parties associated with each objective and with the evaluation process as a whole. If these are common across all objectives, they need be described only once. If systems and responsible parties vary by objective or topic area, sufficient information must be provided to identify the systems and responsible party for each. Progress on the achievement of each objective defined in Criterion 1.1.d is monitored on a regular basis by the SPH Executive Council that consists of the Dean, the Associate Dean of Academic Affairs, the Associate Dean for Administration and Student Services, and the department chairs. The Executive Council provides oversight for all SPH committees and oversees all data collection, analysis and interpretation. Sources of data available to evaluate the School s goals and objectives include: SPH Office of Admission and Academic Affairs (OAAS) reports on recruitment, admission, student progress toward degree completion, student conduct, student surveys, alumni records, and course syllabi. The primary databases used to access this information are the UNTHSC Registrar, the UNTHSC Enterprise Information System known as EIS, and the UNTHSC Catalog Reports from faculty, student and staff surveys administered by the UNTHSC Office and Strategy and Organizational Excellence (OSOE) Quality improvement reports coordinated by the Center for Innovative Learning (CIL). These include reports on results from the Quality Enhancement Plan (QEP) that aims to develop higher order thinking skills designed to improve student learning (further discussed in Criterion 1.7.g), and reports on the Quality Matters Implementation Plan that aims to help faculty deliver quality online and hybrid courses through the implementation of research based best practices for teaching with technology (discussed in Criterion 2.14.b). Annual performance reviews completed by all SPH faculty which detail instructional, research and service activities Research and grant funding reports coordinated by the SPH Office of Research Services (ORS) SPH program committee reports and meeting minutes (presented in Criterion 1.5.a.1) UNTHSC budgetary reports provided by the Provost Table 1.2.a lists all the objectives outlined in Criterion 1.1.d and identifies the primary parties responsible for the continual review and evaluation of all outcome measures used to assess each objective. 10

1.2: Evaluation Table 1.2.a.1: Responsible Parties Associated with each Objective Goal/Strategic Initiative Objective Responsible Parties 1: ADMINISTRATION 2: ACADEMIC AFFAIRS Create an environment that facilitates the education of exemplary public health professionals and creates and disseminates public health knowledge Develop public health professionals and scientists devoted to the highest standards of health in Texas, nationally, and internationally. Department Chairs, Associate Dean of Academic Affairs, Office of Admission and Academic Services, Office of Strategy and Organizational Excellence, Tenure and Promotion Committee, Executive Committee Associate Dean of Academic Affairs, Associate Dean for Administration and Student Services, Office of Admission and Academic Services, Department Chairs, Program Directors Committee, Individual Program Committees, Office of Strategy and Organizational Excellence, Center for Innovative Learning 3: RESEARCH Discover, translate, and disseminate public health knowledge that is recognized nationally and internationally SPH Dean, Associate Dean for Administration and Student Services, SPH Research Committee, Office of Research Services, Department Chairs 4: COMMUNITY ENGAGEMENT Create an environment that facilitates the education of exemplary public health professionals and creates and disseminates public health knowledge SPH Dean, Department Chairs, Executive Committee, 1.2.b. Description of how the results of the evaluation processes described in Criterion 1.2.a are monitored, analyzed, communicated and regularly used by managers responsible for enhancing the quality of programs and activities. The School monitors progress toward the goals and the strategic initiatives in its strategic plan in several ways. Faculty and Administration The strategic map constructed each year, which is stated explicitly through TracDat software, is reviewed on an ongoing basis by the Executive Council of the School and through several faculty meetings, especially those that take place at one or more retreats in the summer or early fall of each year. The Executive Council consists of the dean, chairs of each department, and the associate deans of the SPH. Other staff is included when needed to review a specific aspect of the strategic plan or to provide other information or insight. Some of these strategic initiatives are activities that must be completed to accomplish our goals and, hence, have a binary result of completed or not completed. Other strategic initiatives relate to activities that are ongoing and have a target for performance measures that may change each year. Through both approaches, the strategic initiatives act as a checklist for assessment of actions that are needed to achieve our goals. Final data are gathered annually for each performance indicator, and these results are reviewed by the 11

1.2: Evaluation Executive Council, by the faculty during retreats, and by the UNTHSC administration through the Provost s Office and the Office for Strategy and Excellence. Strategic initiatives (referred to as objectives in TracDat) that are not met are continued with action plans that specify how the objective will be met in subsequent years. Access to the TracDat system will be provided during the site-visit. The UNTHSC had an additional review procedure for a limited set of metrics, many of which are at the School level. These metrics were reviewed and discussed quarterly at Executive Team meetings. The Executive Team consists of the senior administration of the UNTHSC, the deans, and the vice presidents responsible for non-academic units. The Provost would follow up on these results with the dean of each school. As will be noted, some of these metrics were included as performance measures by the SPH in its strategic plan. Annual summaries of the results for the quarter metrics can be found in Table 1.2.c.1. Students Student involvement in ongoing evaluation processes has been critical for assessing what works and what does not work in the SPH in terms of curriculum structure and competency coverage, the incorporation of health system changes, internship/practice and graduate placement development and implementation, and extracurricular professional development activities. The primary means of assessment is an annual Student Satisfaction Survey, which is distributed by the UNTHSC Office of Strategy and Organizational Excellence (OSOE). The content of this survey is not directly related to the strategic plan but does cover some issues that are addressed in the plan, such as curriculum changes, field placement, and field operation. The assessment and review process consists of survey distribution; analysis of the data collected by the OSOE; review of results by a group of school administrators that include the dean, department chairs, and associate deans; review by students through focus groups; and development of action plans to address results that fall below the 80% satisfied and very satisfied combined standard. The results for the past three academic years are discussed in Criterion 4.4.c.1. The survey tool and results are provided in Appendix 4.4.c.1 in the Electronic Resource File. Every year feedback is also obtained from students concerning the extent to which the selected competencies are appropriate for the SPH s mission, goals, and objectives. This process formally takes place through Individual Development and Educational Assessment (IDEA) System (plus eight UNTHSC wide questions), feedback during the summer field placements (written reflection reports, a mid-course meeting with the site-supervisor (preceptor) and the Academic Advisor or Program Director), a post-placement presentation of project results as a poster, and selfassessment surveys administered to students three times: in their first semester of enrollment, immediately after the field experience, and at the end of capstone courses. All MPH students complete these assessments, as they are required field placement activities and required components of the MPH Professional and Academic Development (PAD) course. Informal feedback is also received through the day-to-day meetings and conversations between students, faculty members, the Program Directors, and the Department Chair. This informal feedback is unstructured but, by its nature, more candid than formal interactions, and it is very important, as it allows the Program Director and the Department Chair to ask follow up questions to address concerns about, for example, course content, coverage of competencies, suggestions for portfolio activities, and the need for changes to meet the mission, goals, and objectives of the SPH. The course evaluations conducted at the end of each course allow the programs and faculty to assess the extent to which learning objectives and competencies were met through course delivery and to solicit feedback on instructional strategies, teaching methods, and suggestions for 12

1.2: Evaluation improvement. IDEA evaluation results are distributed to each faculty member, each chair, and the Dean, and are then considered for course improvements. IDEA course evaluation results are provided in Appendix 2.1.b.1 located in the Electronic Resource File, and will be made available for review during the site-visit. Alumni Alumni engagement in ongoing evaluation processes has been important in assessing not only job placement success but also the extent to which students are prepared to become exceptional professionals and leaders based on MPH program competencies. Contact information is collected prior to graduation and later used by the Office of Admission and Academic Services (OAAS) to communicate with Alumni and to collect information on job placement, employment setting/sector, and effectiveness of program competencies in relation to job responsibilities. Alumni are also asked to provide feedback about the degree(s) and the SPH as a whole. Site Supervisors (Preceptors) Site supervisors are identified and contacted for the first time based on the interest students have in being placed at specific public health-related organizations. Public health related organizations are identified by the program director, the department chair, and/or the Field Placement Coordinator. Student preferences are also taken into account throughout this process to guarantee a strong match between a student, the preceptor, and the organization. Site supervisors are actively engaged in ongoing evaluation processes through an MPH field placement evaluation form as well as through a mid-placement visit by the Program Director or Academic Advisor to the site. The evaluation is structured to assess key performance areas such as knowledge of the public health environment, communication and professionalism, initiative and ability in working as a team member and. more specifically, the site supervisor s judgment of student s mastery of each competency. These opportunities to assess the progress of students in their placements are important because they allow the MPH program to track whether the competencies covered during the program are consistent with the expectations of employers. In addition, these opportunities allow for tracking of the public health environment as they help to build a long-term relationship between the student, the MPH program, and the health-related organization of the preceptor. Public Health and Prevention Council (PHPC) and Other Professionals The SPH constantly seeks the input of the PHPC and other health leaders in the region to better align the curriculum and other activities with the health system and the mission, goals, and objectives of the SPH. The PHPC meets two to three times annually, but it has more frequent meetings of its committees, which are focused on community interventions, healthy life styles in the community, and development. The dean and other faculty members participate in the activities of the PHPC and its committees. Through each of its committees, the PHPC is engaged in activities of the SPH that relate to its strategic plan. For example, the committee focusing on community interventions is working with the Healthy Moms, Healthy Babies, Healthy Community (H3) Initiative sponsored by the SPH. This activity offers the committee an opportunity to provide the School with feedback on its community research and other engagement activities. The committee focusing on healthy lifestyles integrated its activities with those of the planning committee for the annual North Texas Health Forum, which is sponsored by the SPH. Again, community members who related to one of the strategic initiatives of the SPH provided assistance and feedback on its accomplishment. PHPC members and other health leaders participate in the MPH and doctoral courses as guest speakers, and they facilitate field visits to their workplaces. These interactions with PHPC members and other health leaders allow for integrating their input into the curriculum, provide opportunities for students to engage with health leaders, and work as a reality check on MPH and doctoral program content, competencies, and relevance. 13

1.2: Evaluation 1.2.c. Data regarding the School s performance on each measurable objective described in Criterion 1.1.d must be provided for each of the last three years. To the extent that these data duplicate those required under other criteria (eg, 1.6, 1.7, 1.8, 2.7, 3.1, 3.2, 3.3, 4.1 and 4.3), the School should parenthetically identify the criteria where the data also appear. See CEPH Outcome Measures Template Table 1.2.c.1 below shows the SPH s performance on the goals, objectives and outcome measures as presented earlier in Table 1.1.d.1. The table covers the years 2011-2012, 2012-2013 and 2013-2014. All measures are discussed in more detail in later sections of the self-study. 14

1.2: Evaluation Table 1.2.c.1: Goals, Strategic Initiatives, Measures and Results (CEPH Outcome Measures Template) GOAL 1 (STRATEGIC INITIATIVE 1): ADMINISTRATION OBJECTIVE: CREATE AN ENVIRONMENT THAT FACILITATES THE EDUCATION OF EXEMPLARY PUBLIC HEALTH PROFESSIONALS AND CREATES AND DISSEMINATES PUBLIC HEALTH KNOWLEDGE PERFORMANCE MEASURES (Administration) 1.1 Outcome Measure Target 2011-2012 2012-2013 2013-14 Action Plan Maintain student-faculty ratio in all departments Maximum student-faculty ratio of 10:1 All departments had student-faculty ratios below target of 10:1 Department of Epidemiology had a student-faculty ratio of 10.3:1. All other departments met the target Department of Epidemiology had a student-faculty ratio of 11.7:1. All other departments met the target Faculty added for 2014-2015 which will change the epidemiology SFR Other Criteria (provide additional information related to the objectives) 1.7.b 4.1.a 4.1.b 4.3.c. 1.2 Percentage of students receiving financial assistance from the school (from scholarships and grant funding) At least 40% of students will receive financial assistance 16.6% were provided with financial 20.45% were provided with financial 24% were provided with financial Target to be changed to 25% due to changes in structure of financial aid. 2.12.b 3.1.e 1.3 Faculty/Staff Survey of Employee Engagement (administered in even years): Ratings on (1) quality of organizational culture, (2) job satisfaction, and (3) empowerment Minimum rating of 350 in each area (N/A) Survey not conducted (1) 381 (2) 355 (3) 369 Survey not conducted With the change in HSC administrations, this survey was not used after FY 2013 Survey/results presented in Appendix 1.2.c.1 in the Electronic Resource File 1.4 1.5 Faculty/Staff Denison Survey (administered in odd years): Ratings on team orientation Faculty recruitment and promotion (faculty promoted or hired as associate or full professor) Minimum rating of 350 in each area Add at least one senior faculty member each year Quality = 381 Satisfaction= 355 Empowerment = 369 Associate Professor added to Dept. of Behavioral and Community Health (BACH) (N/A) Survey not conducted Senior faculty member added as Professor to Dept. of Biostatistics (BIOS); Associate Professor added to Dept. of BACH (N/A) Survey not conducted 2 Assistant Professors added, one in BACH and one in BIOS. With the change in HSC administrations, this survey was not used after FY 2012 A decision was made to seek Assistant Professors in FY 2014 due to available resources Survey/results presented in Appendix 1.2.c.2 in the Electronic Resource File 1.7.a 1.7.b 4.1.a 4.1.b 15

1.2: Evaluation TACTICAL INITIATIVES (Administration) 1.6 1.7 Outcome Measure Target 2011-2012 2012-2013 2013-14 Current Action Plan Complete departmental review of Office of Admission and Academic Services (OAAS), Dept. Behavioral and Community Health (BACH), Dept. Biostatistics (BIOS), Dept. Environmental and Occupational Health Sciences (EOHS), and Dept. Epidemiology (EPID) Implement reorganization of administrative staff Complete all reviews by 2013-2014 Redefine administrative assistant roles by 2012-2013 Completed OAAS and BACH Completed EOHS and BIOS EPID review deferred Completed NA NA Departmental reviews were completed (or deferred) and submitted to Provost Because of state cutbacks Administrative Assistants are assigned to a set of tasks as a group rather than assigned to a department Other Criteria (provide additional information related to the objectives) 1.2 1.7.c 1.7.h 1.8 Review student fee structure, e.g., computing, portfolio (now Professional and Academic Development - PAD), Certified in Public Health Examination (CPH) Complete revised fee structure by 2013-2014 Partially Complete Completed Proposed structure completed but fee structure is reviewed each year Student fees added for PAD and CPH Examination 1.6 1.9 1.10 1.11 Investigate use of TracDat (and other learning management systems such as Canvas), for tracking the assessment of program competencies Implement a plan to increase full-time student enrollment Plan SPH role in College of Pharmacy (CoP) and Texas College of Osteopathic Medicine (TCOM) curricula Implement competency assessment software by 2014-2015 Reduce ratio of part-time to full-time student enrollment ratio to less than 1.5 to 1 (1.5:1) by Fall 2013-2014 Provide course content for CoP and TCOM implement by August 2014 TracDat assessment completed Development of Canvas completed Canvas implemented for SPH courses Partially completed Completed NA Completed CoP role established; TCOM role in rural health established NA TracDat found not to be useful and UNTHSC plan for Canvas implementation completed. Competency assessment pilot planned for 2014-2015 Initial plan to increase enrollment completed but focus on growth continues with a balance on the quality of student applications SPH to teach half of CoP introductory health system course and open SPH core courses to CoP students as electives. SPH collaborating with TCOM rural health program. 2.7.a 4.3 3.3 1.12 Complete recruitment of: (1) Faculty for EOHS, EPID, and BIOS (2) Chairs for Departments of EPID, BIOS and HMAP 1 (3) An Associate Dean for Research Complete searches by 2013-2014 Associate Dean for Research search deferred Faculty hired for EOHS, BIOS, EPID, and BIOS Chair HMAP chair search extended Chair for combined Biostatistics Epidemiology Department appointed. Interim Chair of HMAP appointed 1.4 4.1 16

1.2: Evaluation 1.13 Outcome Measure Target 2011-2012 2012-2013 2013-14 Action Plan Prepare and complete self-studies for CAHME 2 accreditation of the Master of Health Administration (MHA), and SPH CEPH 3 accreditation 1.14 Implement a revised SPH faculty orientation Complete CAHME by October 2013. Complete CEPH by May 2015 Complete revisions and implement faculty orientation by 2012-2013 1 Health Management and Policy (HMAP) 2 Commission on Accreditation of Healthcare Management Education (CAHME) 3 Council on Education for Public Health (CEPH) Completed but dates extended by accreditation bodies NA CAHME Self-study completed and submitted -Plan developed for overall faculty orientation -Orientation conducted for faculty teaching courses CEPH Self-study ongoing -One-day faculty orientation conducted -OAAS faculty training on advising conducted -Orientation conducted for faculty teaching courses CAHME accreditation received These orientations will continue annually with special attend to new faculty members and those teaching online Other Criteria (provide additional information related to the objectives) 1.2.d 2.8 4.2 GOAL 2 (STRATEGIC INITIATIVE 2): ACADEMIC AFFAIRS OBJECTIVE: DEVELOP PUBLIC HEALTH PROFESSIONALS AND SCIENTISTS DEVOTED TO THE HIGHEST STANDARDS OF HEALTH IN TEXAS, NATIONALLY, AND INTERNATIONALLY. PERFORMANCE MEASURES (Academic Affairs) Outcome Measure Target 2011-2012 2012-2013 2013-14 Action Plan Other Criteria (provide additional information related to the objectives) 2.1 As part of Southern Association of Colleges and Schools (SACS) accreditation, participate in the UNTHSC Quality Enhancement Plan (QEP) by implementing higher order thinking principles in target courses. (1)2011-2012: Identify 3 target courses and revise syllabi to incorporate higher order thinking principles and assessment methods; (2) 2012-2014: Expand QEP principles to 3 courses each year. Three (3) Health Management & Policy courses identified for QEP program and participation began. (HMAP 5300, HMAP 5324, HMAP 5328) 3 QEP participation continues QEP participation continues SACS QEP began with 3 courses in HMAP and has expanded to the entire SPH faculty QEP information available in Appendix 1.2.c.3 in the Electronic Resource File 2.2 Number of enrolled students: (1) Headcount (HC) (2) FTE Varied target by year 2011-12: 340 HC and 260 FTEs 2012-13: 390 HC and 290 FTEs 2013-14: 425 HC and 310 FTEs HC = 352 students FTE = 283.5 HC = 394 students FTE = 381.5 HC = 436 students FTE = 341.5 FTEs Continue increasing fulltime enrollment through addition of new concentrations (Maternal and Child Health in 2014) 1.7.b 4.3.d 4.3.e 4.3.f 17

1.2: Evaluation 2.3 2.4 Outcome Measure Target 2011-2012 2012-2013 2013-14 Action Plan Percentage of diverse students (African American, Hispanic, Asian and Native American) Student satisfaction with quality of education - (survey response to question Overall, I am satisfied with the quality of my education ) At least 30% of student body 80% of students will respond Met or Exceeds on the annual campus-wide Student Satisfaction Survey administered in the Spring 45% of SPH student body (Total n=209) MPH = 81% (n=143) MHA = 77% (n=30) DrPH = 65% (n=20) PhD = 82% (n=16) 46% of SPH student body (Total n=227) MPH = 78% (n=180) MHA = 62% (n=24) DrPH = 77% (n=13) PhD = 80% (n=10) 42% of SPH student body (Total n=231) MPH = 78% (n=171) MHA = 96% (n=25) DrPH = 58% (n=12) PhD = 70% (n=23) The school continues to recruit diverse students. Our absolute numbers have increased but relative numbers have declined with increase in international students Results reviewed with students through focus groups. Detailed plans created to address each issue Other Criteria (provide additional information related to the objectives) 1.8 4.1.d 4.4.c 2.5 Student satisfaction with quality of teaching (survey response to level of satisfaction with quality of teaching) 80% of students will respond Agree or Strongly Agree on the annual campus-wide Student Satisfaction Survey, administered in the Spring (Total n=208) MPH = 81% (n=140) MHA = 81% (n=31) DrPH = 50% (n=20) PhD = 100% (n=17) (Total n=224) MPH = 76% (n=177) MHA = 50% (n=24) DrPH = 54% (n=13) PhD = 60% (n=10) (Total n=227) MPH = 85% (n=167) MHA = 88% (n=25) DrPH = 50% (n=12) PhD = 87% (n=23) Results reviewed with students through focus groups. Detailed plans created to address each issue 4.1.d 4.4.c TACTICAL INITIATIVES (Academic Affairs) 2.6 Implement online course offerings for all core courses and two additional courses to create PH certificate and online MPH program Implement online courses within two academic years (by 2013-2014) Partially completed Certificate implementation completed Online MPH program completed PH Practice Certificate implemented in online format 2.14 2.7 Implement Blackboard, Turnitin, and syllabus template for all courses for all faculty Implement changes within two academic years (by 2013-2014) Partially completed Turnitin and syllabus template completed Shift from Blackboard to Canvas learning platform Canvas will be implemented for all AY 2015 courses N/A 2.8 Investigate Memorandum of Understanding (MOU) with All India Institute of Hygiene and Public Health Secure MOU by Fall 2014 Deferred NA NA Proposal for MOU was rejected N/A 2.9 Implement iwebfolio software for masters and doctoral programs Implement iwebfolio by Fall 2013 Partially completed Completed NA Portfolio implemented using Canvas software N/A 2.10 2.11 Investigate undergraduate (UG) instruction through area universities Explore a second online degree program at the master s level Complete investigation and secure collaboration with at least 2 schools by 2013-2014 Develop second online degree program and admit first cohort by 2013-2014 Communication begun with four universities Began work with UNT-Denton and UNT-Dallas. Work with UNT- Denton and UNT- Dallas continued NA Rejected NA SPH is providing assistance to UG programs at UNT- Denton and Dallas Decision was made to not go forward at this time N/A 2.14 18

1.2: Evaluation 2.12 2.13 2.14 Outcome Measure Target 2011-2012 2012-2013 2013-14 Action Plan Investigate dual degree with UNTHSC Physician Assistant (PA) Studies program Implement a Maternal and Child Health (MACH) concentration in the MPH degree program. Implement utilization of Canvas (a learning management system) in all SPH courses. 2.15 Launch two certificate programs Complete investigation of dual program by 2014-2015 Implement MACH concentration and admit first cohort in Fall 2014 Complete implementation of Canvas usage in all courses by Fall 2014 Complete planning and launch two certificate programs by Fall 2015 NA Deferred Deferred NA NA NA Planning begun NA NA Planning and implementation completed Planning completed and implementation of competency assessment in EOHS Planning completed for three programs Discussions with PA Studies program continues First students accepted for Fall 2014 Implementation for all Fall 2014 courses Awaiting budgetary approval for launch in Fall 2015. 3 QEP courses identified were: HMAP 5300 Introduction to Health Management and Policy/HMAP 5324 Strategic Management & marketing/hmap 5328 Human Resources Management. Other Criteria (provide additional information related to the objectives) 2.13 2.1 2.6.c 2.7.a 3.3.c GOAL 3 (STRATEGIC INITIATIVE 3): RESEARCH OBJECTIVE: DISCOVER, TRANSLATE, AND DISSEMINATE PUBLIC HEALTH KNOWLEDGE THAT IS RECOGNIZED NATIONALLY AND INTERNATIONALLY PERFORMANCE MEASURES (Research) Outcome Measure Target 2011-2012 2012-2013 2013-14 Action Plan 3.1 Total ongoing extramural research funding Varied Targets by Year (All reported targets were established in conjunction with HSC Provost) 2011-2012: $3 million 2012-2013: $3.5 million 2013-2014: $3.5 million $8.7 million $6.9 million $6.7 million Targets for each year were exceeded. Other Criteria (provide additional information related to the objectives) 3.1.d 3.2 Dollar value of grant applications submitted annually Varied Targets by Year (All reported targets were established in conjunction with HSC Provost) 2011-2012: $25 million 2012-2013: $28 million 2013-2014: $32 million $33 million $21 million $24 million Target was not met in past two AYs but awards was exceeded 3.1.d 3.3 Total number of unduplicated peer-reviewed publications (published/in press) 50 publications each year 83 publications 27 publications 55 publications Our publications target was not met in the past two AYs 3.1.d 19

1.2: Evaluation TACTICAL INITIATIVES (Research) 3.4 3.5 Outcome Measure Target 2011-2012 2012-2013 2013-14 Action Plan Improve support for standard aspects of grant applications and implement infrastructure plan with the UNTHSC Research Office (ORA) and the Texas Prevention Institute (TPI) Identify and implement a research plan for each faculty member Create and implement research support structure by Fall 2014 Implement research plans for all faculty by Fall 2015 Discussion with TPI and ORA begun Plan developed TPI-SPH infrastructure implemented Ongoing Ongoing Ongoing Plan implemented as Office of Research Services. Plans in place for existing faculty and underdevelopment for new faculty Other Criteria (provide additional information related to the objectives) 3.1 1.1 3.1 3.6 Implement a research colloquium series for faculty in conjunction with the TPI Implement research series by 2012-2013 Planning completed Plan implemented NA Work in Progress Series implements in FY 2013 3.1 3.7 Implement structure to focus SPH research on 5 core areas Implement by 2014-2015 Discussion of existing plan New Research Manager hired NA Discussion shifted to development of a new research plan 3.1 3.8 Develop authorship and publication ethics guidelines Implement guidelines by 2015-2016 NA NA Authorship and publication ethics guidelines drafted by the Research Committee Guidelines to be reviewed by faculty during AY 2015 3.3.a GOAL 4 (STRATEGIC INITIATIVE 4): COMMUNITY ENGAGEMENT OBJECTIVE: CREATE AN ENVIRONMENT THAT FACILITATES THE EDUCATION OF EXEMPLARY PUBLIC HEALTH PROFESSIONALS AND CREATES AND DISSEMINATES PUBLIC HEALTH KNOWLEDGE PERFORMANCE MEASURES (Research) Other Criteria (provide additional Outcome Measure Target 2011-2012 2012-2013 2013-14 Action Plan information related to the objectives) 4.1 Number of target participants attending the North Texas Health Forum (NTHF) 200 250 participants 150 participants (April 2012) 250 participants (April 2013) 230 participants (April 2014) North Texas Health Forum has been successfully implemented each year 3.3.b 4.2 Percentage of faculty performing editorial and review duties for journals and agencies At least 75% of all faculty 82.6% of faculty 80% of faculty 76.7% of faculty This target was met but there has been some decline with the addition of young faculty 3.1 20