Pierre-Marc Daigneault, Ph.D.

Transcription

1 CONTACT INFORMATION Pierre-Marc Daigneault, Ph.D. () Address: Johnson-Shoyama Graduate School of Public Policy University of Saskatchewan Campus Diefenbaker Building 101 Diefenbaker Place, Saskatoon, SK, Canada, S7N 5B8 Telephone: RESEARCH INTERESTS Canadian public policy; public administration; policy analysis program evaluation; social policy and welfare; methodology. EDUCATION Université Laval Ph.D. in Political Science August 2012 Dissertation: Stakeholder Participation in Evaluation: From Concept to Measurement While stakeholder participation is a major trend in the field of program evaluation, the concept is plagued by serious problems that hinder effective communication and knowledge development. A rigorous conceptualization and operationalization of the concept, based on the necessary and sufficient condition logic, is proposed to answer these problems. Using quantitative and mixed methods, an empirical validation of this instrument is then conducted based on a sample of published evaluation cases and a survey of their authors. The results show that the instrument generates scores which are globally reliable and valid, although a revised version appears to generate more valid scores. Advisor: Steve Jacob, Ph.D. (co-advisor: Mathieu Ouimet, Ph.D.) M.A. in Policy Analysis October 2006 Essay: L examen de qualité des évaluations fédérales: une méta évaluation réussie? (The Quality Review of Federal Evaluations: A Case of Successful Meta-evaluation?) This research seeks to assess the quality and utility of a meta-evaluation conducted by the Treasury Board of Canada Secretariat, based on documentary analysis and interviews conducted with federal civil servants. Its aim is to draw lessons from this exercise, in order to guide those in charge of evaluation units of public organizations in Canada and elsewhere who wish to ensure evaluation quality. Advisor: Steve Jacob, Ph.D.

2 McGill University Montreal, Quebec B.A. (Honours) in Political Science (Minor in Economics) May 2003 RESEARCH EXPERIENCE Postdoctoral Fellow April 2012-Present Johnson-Shoyama Graduate School of Public Policy Saskatoon, Saskatchewan University of Saskatchewan Project: Activating Social Security Recipients in the Canadian Provinces: A Comparative Analysis of Strategies and Program Theories Funding: Fonds de recherche du Québec - Société et culture (FRQ-SC) and Canada Research Chair in Public Policy, Johnson-Shoyama Graduate School of Public Policy. Scientific Collaborator PerfEval Research Laboratory Université Laval Project: Exemplary Practices in Participatory Evaluation: Development of a Toolbox for Decision-makers and Evaluators in the Canadian Government Funding: Canada School of Public Service (CSPS) - Innovative Public Management Research Fund Role: Preparing the response to the call for proposals; planning the research process; developing an instrument for measuring participation; selecting exemplary cases of participatory evaluation and identifying best practices. Scientific Collaborator PerfEval Research Laboratory Université Laval Project: Program Participation: Results Synthesis and Lessons Learned from Evaluations Funding: Human Resources and Skills Development Canada (HRSDC) Role: Preparing the response to the call for tenders; preparing the work plan and the methodological plan; collecting data; supervising research assistants; qualitatively and quantitatively analyzing the data; presenting preliminary results to clients; drafting technical reports and the final report. Research Assistant Center for the Analysis of Public Policy (CAPP) Université Laval Project: Règles, ressources et acteurs des politiques publiques au Québec et au Canada (Rules, Resources and Public Policy Actors in Quebec and Canada) Funding: Fonds québécois de la recherche sur la société et la culture (FQRSC) - 2 -

3 Role: Subproject Program Evaluation Stakeholders: Collecting and assessing the different conceptualizations of stakeholder involvement in program evaluation; developing a conceptual framework of participatory evaluation; analyzing the gap between discourse and action concerning stakeholder involvement in the field of development aid. Subproject Governance, Transparency and Accountability: Collecting and synthesizing literature on confidence in public institutions; creating an inventory of institutional mechanisms of transparency and accountability. Research Assistant 2005 Université Laval Project title: L évaluation de programme au Québec: état des lieux (Program Evaluation in Quebec: The State of the Field) Funding: Faculty of Social Sciences, Université Laval Role: Reviewing the literature on evaluation quality; creating an inventory of evaluation reports available on the Internet; assessing the quality of reports with a checklist and coding the results in a database. Research Assistant Official Opposition, Quebec National Assembly Role: Reviewing the literature on various subjects related to the news; conducting a comparative analysis of provincial student loan systems; creating an inventory of works on public-private partnerships (PPP) and second language instruction for young children; preparing summary notes for MNAs for press conferences and parliamentary commissions. TEACHING EXPERIENCE Sessional Lecturer Department of Political Science, Université Laval Description: Évaluation des politiques (Policy Evaluation), POL Graduate course (45 hours). Course taught two years in a row in 2010 and Guest Lecturer Johnson-Shoyama Graduate School of Public Policy Saskatoon, Saskatchewan University of Saskatchewan Description: Seminar on Research and Writing, JSGS 804. Graduate course for Master of Public Administration students. One lecture on Understanding Program Evaluation (September 2012)

4 Department of Political Science, Université Laval Description: Évaluation des politiques (Policy Evaluation), POL Graduate course (45 hours). Lectures on theoretical approaches in evaluation and meta-evaluation (2008, 2009 and 2012). SCHOLARSHIPS, HONOURS AND DISTINCTIONS Postdoctoral Research Fellowship 2012-Present Fonds de la recherche du Québec Société et culture (FRQ-SC) Description: $30,000/year; potential value of $60,000 in total (plus $4,000 for partnership activities). Postdoctoral Research Fellowship Canada Research Chair in Public Policy Johnson-Shoyama Graduate School of Public Policy Description: $9,000/year Present Canada Graduate Scholarship Doctoral Award Social Sciences and Humanities Research Council of Canada (SSHRC) Description: $35,000/year; $105,000 in total Participation Scholarship 2009 Consortium on Qualitative Research Methods (CQRM) Description: Awarded by the Department of Political Science, Université Laval, on behalf of the Consortium to participate to the Institute for Qualitative and Multi-Method Research, Maxwell School, Syracuse University $2,000. Honour Roll 2006 Faculty of Graduate Studies, Université Laval Description: Awarded to master s level students for a CGPA superior or equal to 4.00/4.33 (M.A. in Policy Analysis). Participation Scholarship 2006 International Political Science Association (IPSA) Description: Awarded by the Quebec Political Science Association and the International Political Science Association to participate in the 20 th World Congress of Political Science, Fukuoka, Japan $2,500. Best Student Presentation 2005 Société québécoise d évaluation de programme (SQEP) Description: Best student presentation at the 14 th Annual Conference of the Quebec Program Evaluation Society $

5 Jean-Charles-Bonenfant Foundation Scholarship Quebec National Assembly Description: Involves a parliamentary internship at the Quebec National Assembly $15,000. First-Class Honours in Political Science 2003 McGill University Description: Awarded to B.A. students with a CGPA superior or equal to 3.60/4.00 and for which half the political science grades are A- or higher. PUBLICATIONS Articles in Peer-Reviewed Journals Daigneault, P.-M. & S. Jacob (forthcoming: accepted for publication conditionally to minor revisions), Unexpected but most welcome: Mixed methods for the validation and revision of the Participatory Evaluation Measurement Instrument, Journal of Mixed Methods Research. Daigneault, P.-M., Jacob, S. et M. Ouimet (2012), Using systematic review methods within a Ph.D. dissertation in political science: Challenges and lessons learned from practice, International Journal of Social Research Methodology. Published online on October 9. Doi: / Daigneault, P.-M., Jacob, S. & J. Tremblay (2012), Measuring stakeholder participation in evaluation: An empirical validation of the Participatory Evaluation Measurement Instrument, Evaluation Review, 36(4): Daigneault, P.-M. & S. Jacob (2012), Les concepts souffrent-ils de négligence bénigne en sciences sociales? Éléments d analyse conceptuelle et examen exploratoire de la littérature francophone à caractère méthodologique (Do Concepts Suffer from Benign Neglect? Elements of Conceptual Analysis and Exploratory Review of the Francophone Methodological Literature), Social Science Information, 51(2) (June): Daigneault, P.-M., Jacob, S. & M. Tereraho (2012), Understanding and Improving the Take-up of Public Programs: Lessons Learned from the Canadian and International Experience in Human Services, International Journal of Business and Social Science, 3(1): Daigneault, P.-M. (2010), L examen de qualité des évaluations fédérales : une métaévaluation réussie? (The Quality Review of Federal Evaluations: A Case of Successful Metaevaluation?), Canadian Journal of Program Evaluation, 23(2):

6 Daigneault, P.-M. & S. Jacob (2009), Toward Accurate Measurement of Participation: Rethinking the Conceptualization and Operationalization of Participatory Evaluation, American Journal of Evaluation, 30(3): Edited Books, Special Issues and Symposia in Academic Journals Daigneault, P.-M. (Ed.) (2012), Conceptual analysis in political science and beyond (symposium), Social Science Information, 51(2) (June) (contains 6 peer-reviewed articles, an introduction and a critical conclusion). Book Chapters Daigneault, P.-M. & S. Jacob (2012), Conceptualiser et mesurer la participation à l évaluation (Conceptualizing and Measuring Stakeholder Participation in Evaluation). In V. Ridde & C. Dagenais (Eds.), Approches et pratiques en évaluation de programme, 2 nd edition, Montreal: Les Presses de l Université de Montréal: Jacob, S & P.-M. Daigneault (2011), La gouvernance et l implication des parties prenantes dans l évaluation des politiques : panacée ou boîte de pandore? (Governance and Stakeholder Involvement in Evaluation: Panacea or Pandora s Box?). In C. Rouillard et N. Burlone (Eds.), LʹÉtat et la société civile sous le joug de la gouvernance, Quebec City: Presses de lʹuniversité Laval: Research Reports Jacob, S. & P.-M. Daigneault (Report prepared for Human Resources and Skills Development Canada [HRSDC], Evaluation Directorate) (2009), Program Participation: Results Synthesis and Lessons Learned from Evaluations. Final Report, Ottawa: HRSDC, Nov. 2009, 49 pages. Intermediary reports list: - Final Work Plan, 29 pages, Mar. 2009; - Methodological Report, 29 pages, Apr. 2009; - National and International Experiences: Technical Report, 172 pages, May 2009; - HRSDC Experiences: Technical Report, 128 pages, July 2009; - Interviews and Review of Additional Documents: Technical Report, 20 pages, July Essays and Other Non-Peer-Reviewed Publications Daigneault, P.-M. (2012), Introduction to the symposium Conceptual analysis in political science and beyond, Social Science Information, 51(2) (June): Daigneault, P.-M. (Ed.) (2011), Les approches théoriques en évaluation (Theoretical Approaches in Evaluation), Cahiers de la performance et de l'évaluation, (4), Quebec City: PerfEval Research Laboratory (Université Laval), 42 p

7 Daigneault, P.-M. (2011), États des lieux et perspectives sur les approches évaluatives (The State of the Field and Perspectives on Evaluation Approaches). In P.-M. Daigneault (Ed.), Les approches théoriques en évaluation (Theoretical Approaches in Evaluation), Cahiers de la performance et de l'évaluation, (4), Quebec City: PerfEval Research Laboratory (Université Laval): 2-6. Jacob, S., Diallo, N. & P.-M. Daigneault (2009), L évaluation participative des politiques de coopération au développement : Analyse comparée des dispositifs du Canada, de l Union européenne et de la Banque mondiale (Participatory Evaluation of Development Cooperation Policies: Comparative Analysis of Canada, the European Union and the World Bank), Organisations et territoires, 18(3): Jacob, S. & P. M. Daigneault (2007), The Impact of Transparency and Accountability on Public Trust: A Comparative Analysis of Some Mechanisms to Counter Administrative Unilateralism. In M. C. Pardo (Ed.), Transparency for Better Governance, Brussels: International Institute of Administrative Sciences: Daigneault, P. M. (2005), Une Constitution formelle pour le Québec : mais qu attendons nous? (A Formal Constitution for Quebec: What are we Waiting for?), Bulletin d histoire politique, 14(1): Daigneault, P. M. (2005), Une Constitution formelle pour le Québec? (A Formal Constitution for Quebec?), Bulletin de la Bibliothèque de l Assemblée nationale du Québec, 34(1 2): Book Reviews Daigneault, P.-M. (forthcoming), review of Rubin, H. J., & Rubin, I. S. (2011). Qualitative Interviewing: The Art of Hearing Data (3 rd Ed.). Thousand Oaks, CA: Sage., in Canadian Journal of Program Evaluation. Daigneault, P.-M. (2011), review of Nick L. Smith & Paul R. Brandon (Eds.). (2008). Fundamental Issues in Evaluation. New York, NY: The Guilford Press, 266 p. in Canadian Journal of Program Evaluation, 25(1): Daigneault, P.-M. (2010), review of Michael Quinn Patton. (2008). Utilization-Focused Evaluation, 4 th Ed., Thousand Oaks, CA: Sage, 667 p. in Canadian Journal of Program Evaluation, 4(2): Daigneault, P.-M. (2010), review of David Collier & John Gerring (Eds.). (2009). Concepts and Method in Social Science: The Tradition of Giovanni Sartori. New York, NY: Routledge, 368 p. in Politique et Sociétés, 28(3):

8 Daigneault, P. M. (2009), review of Julia H. Littell, Jacqueline Corcoran & Vijayan K. Pillai (2008). Systematic Review and Meta analysis. Oxford: Oxford University Press. 216 p.; Mark Petticrew & Helen Roberts (2006). Systematic Review in the Social Sciences: A Practical Guide. Oxon: Blackwell. 352 p.; Margarete Sandelowski & Julie Barroso, (2006). Handbook for Synthesizing Qualitative Research. New York: Springer. 312 p. in Political Studies Review, 7(2): Daigneault, P. M. (2008), review of Sandra Mathison (Ed.) (2005), Encyclopedia of Evaluation, Thousand Oaks, CA: Sage, 481 p. in Canadian Journal of Program Evaluation, 23(1): Presentations at Scholarly Conferences Daigneault, P.-M. (2012), La participation favorise-t-elle l utilisation de l évaluation? Un examen systématique de la littérature quantitative (Does Stakeholder Participation Foster Evaluation Use?), paper presented at the annual conference of the Société québécoise d évaluation de programme, Montreal, October 12. Daigneault, P.-M. (2012), Activation of Saskatchewan Social Assistance Recipients: Paradigm Shift or Business as Usual?, paper presented at the Prairie Political Science Association (PPSA), University of Saskatchewan, Saskatoon, September Daigneault, P.-M. (2010), L analyse conceptuelle "pour les nuls": Comment utiliser les outils de conceptualisation pour juger de la qualité et améliorer les recherches en analyse des politiques (Conceptual Analysis "for Dummies": How to use Conceptualization Tools when Judging Quality and Improving Research in Policy Analysis), paper presented at the Student Conference of the Centre for the Analysis of Public Policy, Université Laval, Quebec City, March Daigneault, P.-M., Ouimet, M., & S. Jacob (2008), Perspectives théoriques sur l utilisation des évaluations de programme. Les trois "i": information, intérêt et interactions (Theoretical Perspectives on the Utilization of Program Evaluation. The Three "I s": Information, Interest and Interactions), paper presented at the Conference of the Network of Quebec Researchers on Public Policy, Center for the Analysis of Public Policy, Université Laval, Quebec City, December 5-6. Jacob, S., Diallo, N. & P. M. Daigneault (2007), Impliquer pour mieux évaluer? La rhétorique participative de la coopération au développement (Involvement for Improved Evaluations? Participatory Rhetoric in Development Cooperation), paper presented at the Conference of the Centre de recherche sur les politiques et le développement social (Research Center on Policies and Social Development) Montreal: Université de Montréal, November

9 Daigneault, P.-M. & S. Jacob (2007), Rethinking Participatory Evaluationʹs Conceptualization: Toward the Development of a Full blown, Useful Concept, paper presented at the 21 st Annual Conference of the American Evaluation Association (AEA), Baltimore, MD, November Jacob, S., Daigneault, P.-M., & N. Diallo (2007), L évaluation partenariale des politiques de coopération au développement. Héritage colonial ou vecteur d émancipation? Analyse comparée des dispositifs du Canada, de l Union européenne et de la Banque mondiale (Pluralist Evaluation of Development Cooperation Policies: Colonial Legacy or Emancipatory Vehicle? Comparative Analysis of Canada, the European Union and the World Bank), 27 th International Congress of the International Institute of Administrative Sciences, Abu Dhabi, United Arab Emirates, July Jacob, S. & P. M. Daigneault (2006), Gouvernance et implication des parties prenantes dans l évaluation des politiques : panacée ou boîte de pandore? (Governance and Stakeholder Involvement in Policy Evaluation: Panacea or Pandora s Box?), paper presented at the Conference of the Canada Research Chair on Governance and Public Management, Ottawa, University of Ottawa, December 8-9. Daigneault, P. M. (2006), L examen de qualité des évaluations fédérales : une métaévaluation réussie? (The Quality Review of Federal Evaluations: A Case of Successful Metaevaluation?), 15 th Annual Conference of the Société québécoise d évaluation de programme, Quebec City, November 3. Jacob, S. & P. M. Daigneault (2006), Les effets de la transparence et de l imputabilité sur la gouvernance publique : analyse comparative des dispositifs de rupture de l unilatéralité administrative (The Impact of Transparency and Accountability on Governance: A Comparative Analysis of Mechanisms to Counter Administrative Unilateralism), 3 rd International Regional Conference of the International Institute of Administrative Sciences, Monterrey (Mexico), July Daigneault P. M. & S. Jacob (2006), Transparency and Accountability: Solutions for Rebuilding Citizens Trust in Public Institutions? An Exploratory Study, 20 th World Congress of the International Political Science Association, Fukuoka (Japan), July Jacob, S. & P. M. Daigneault (2006), Transparence et imputabilité : panacée pour une re-légitimation des pouvoirs publics? Une analyse comparative (Transparency and Accountability: Panacea for the Re-legitimation of Public Institutions? A Comparative Analysis), Annual Conference of the Société québécoise de science politique, Montreal, May Daigneault, P. M. (2006), La qualité des évaluations au sein de l administration publique québécoise (Evaluation Quality within Quebec s Public Administration), Midis du CAPP, Quebec City, Université Laval, February

10 Daigneault, P. M. & S. Jacob (2005), Évaluation et suivi de l action publique : le pluralisme assure t il la qualité? (Evaluation and Monitoring of Government Interventions: Does Pluralism Foster Evaluation Quality?), 14 th Annual Conference of the Société québécoise d évaluation de programme (Quebec Program Evaluation Society), Montreal, November 4. Invited Presentations Daigneault, P.-M. (2012). Participation in the panel Assessing the Impact of the Quebec Provincial Election, Sept. 5, Johnson-Shoyama-Graduate School of Public Policy (with Roy Romanow, Daniel Béland and Joe Garcia). OTHER RELEVANT PROFESSIONAL EXPERIENCE Reviewer for Scholarly Publications Canadian Journal of Program Evaluation (1 manuscript); Evaluation and Program Planning (4 manuscripts). Media Experience Interview for Radio-Canada Saskatchewan on the results of the Quebec Provincial Election, September Professional Involvement and Community Service Conference Organization Committee Member 2011 Société québécoise d évaluation de programme Role: Selecting the theme for the annual conference, writing and advertising the call for paper proposal. Board Member Université Laval Political Science Student Association (APEUL) Role: President (2009), Vice-President (2008), Secretary ( ), Scholarship Committee Member ( ). Board Member Comité populaire Saint-Jean-Baptiste Role: Defining the big policy orientations of the organization, events organization and community outreach. Continuous Training Qualitative Comparative Analysis (QCA) February 2011 Université Laval (one day)

11 Introduction to Content Analysis Using the QDA Miner Software October 2009 PolText Project, Université Laval (one day) Institute for Qualitative and Multi-Method Research June 2009 Maxwell School, Syracuse University (two weeks) Syracuse, NY Introduction to Systematic Reviewing (3R) August 2008 Summer School in Data Analysis and Collection Colchester (U.K.) University of Essex (one week) Introduction to Endnote X February 2007 Université Laval (one day) Internships Quebec National Assembly (Jean-Charles-Bonenfant Foundation) Role: Assisting Members of the National Assembly (MNAs) in their work (i.e. preparing speeches for parliamentary committees, conducting a study on the constitutionalization of the Quebec Charter of Rights and Freedoms and analyzing supply problems in the wood furniture industry); organizing and participating in an exploratory travel mission to Belgium; drafting a thesis on Quebec s constitution. PROFESSIONAL AFFILIATIONS Political Science Canadian Political Science Association (CPSA) 2006-Present Société québécoise de science politique (SQSP) 2006-Present Prairie Political Science Association (PPSA) 2012-Present American Political Science Association (APSA) International Political Science Association (IPSA) Program Evaluation Canadian Evaluation Society (CES) Société québécoise d évaluation de programme (SQEP) American Evaluation Association (AEA) 2005-Present 2005-Present 2007-Present LANGUAGES French: Native language English: Fluent in speech, reading and writing