Performance Indicators for Schools 4-5 March, 2013 Dr. Sami Mahroum, INSEAD Innovation & Policy Initiative Prof. Simon Bell, Open University, UK Prof. Nasser Yassin, American University of Beirut
The key concept behind the research was to answer the following question: Imagine What Indicators are to be most valuable in performance measurement of schools among all key stakeholders?
ADEC Personnel School Administrators & Teachers The stakeholder groups engaged in this research were: Parents
A1 B1 The stakeholders worked in groups of around 5. Six groups were organised as follows: ADEC Personnel Administrators Day 1: Group A1, B1, C1, X1, Y1, Z1 Day 2: Group A2, B2, C2, X2, Y2, Z2 C1 Parents
X1 Y1 Mixed Group of ADEC Personnel, Administrators & Parents Mixed Group of ADEC Personnel, Administrators & Parents Z1 Mixed Group of ADEC Personnel, Administrators & Parents
H1: All stakeholder homogenous groups (e.g. school administrators), because of their homogeneity would be expected to select a narrow range of performance indicators related to their stakeholder interest. Hypotheses / Assumptions: H2: Heterogeneous groups, because of their diversity, would be expected to produce a more diverse process of discovery, a more chaotic process of review and a more diverse range of indicators. The Stakeholders worked with over the two days spent one day in their homogeneous group, they spent the other day in a mixed or heterogeneous group. Arising from this change, further hypotheses can be made: H3: Because of H1 and H2, groups going from homogeneity to heterogeneity would be expected to be less effective in their second formation as they move from shared views to mixed views. H4: Because of H1 and H2, groups going from heterogeneity to homogeneity would be expected to be more effective in their second formation as they move from mixed understandings to more shared views. H5: Heterogeneous groups might be expected to be more chaotic and diverse. H6: Homogeneous groups might be expected to be less chaotic and diverse.
Over the two days the groups experienced the Triple Task Methodology: Task 1. Imagine: Each group attempted to develop and select indicators which they believed were most effective in measuring performance in and of the school system. Outcome: 1)A Rich Picture a free form diagrammatic representation of the groups considered view of the performance indicator situation at the present time. 2)Some notion of things that need to be done to improve the current situation and items that present as issues or problems. 3)A series of suggested performance indicators which are seen as being important to the group. Task 2. BECM: The group s dynamic and process was evaluated by the facilitators and marked against a seven point scale known as BECM. The scale assesses group behaviour in terms of the quality of a groups Being, Engaging, Contextualising and Managing. Task 3. Questionnaire: The group s assessed their own process, both as individual and as a group.
A2: Rich Picture B2: Rich Picture C2: Rich Picture A2: Tasks & Issues B2: Tasks & Issues C2: Tasks & Issues
X2: Rich Pictures Y2: Rich Picture Z2: Rich Picture X2: Tasks & Issues Y2: Tasks & Issues Z2: Tasks & Issues
Frequency Analysis
All groups on both days Fair Employment Practices CPD of Staff Student Demographics Staff Performance Monitoring School-ADEC Relations Quality of Teaching ICT Use Financial Management in Schools Fees Facilities Extra-Curricular Activities Curriculum Cultural Identity Community Engagement Tailored Education Students' Well-being Qualification of Teachers Parents-School Relations School Leadership & Management Health and Safety Academic Results Graduate Student Profile 0 1 2 3 4 5 6 7 8 9 10
All groups on Day 1 Student Demographics Staff Performance Monitoring Quality of Teaching Financial Management in Schools Fair Employment Practices Facilities Extra-Curricular Activities Curriculum CPD of Staff Community Engagement Tailored Education School-ADEC Relations ICT Use Cultural Identity Students' Well-being Parents-School Relations Academic Results School Leadership & Management Qualification of Teachers Health and Safety Graduate Student Profile 0 1 2 3 4
All groups on Day 2 Student Demographics Staff Performance Monitoring Quality of Teaching Qualification of Teachers Financial Management in Schools Facilities Curriculum Tailored Education Students' Well-being Fees Extra-Curricular Activities Community Engagement School Leadership & Management Parents-School Relations Health and Safety Academic Results Graduate Student Profile 0 1 2 3 4 5 6
All heterogeneous groups on day 1 Tailored Education Students' Well-being School-ADEC Relations Quality of Teaching Parents-School Relations Health and Safety Financial Management in Schools Facilities Extra-Curricular Activities Cultural Identity Community Engagement Academic Results School Leadership & Management Qualification of Teachers Graduate Student Profile 0 1 2 3 4
All heterogeneous groups on day 2 Tailored Education Students' Well-being Quality of Teaching Qualification of Teachers Graduate Student Profile Financial Management in Schools Facilities Academic Results School Leadership & Management Parents-School Relations Fees Health and Safety 0 1 2