Use of Tablet Computers to Implement the Local Governance Performance Index (LGPI) in Tunisia

Transcription

1 Use of Tablet Computers to Implement the Local Governance Performance Index (LGPI) in Tunisia Lindsay J. Benstead - Assistant Professor of Political Science, Portland State University Kristen Kao - Research Fellow, The Program on Governance and Local Development, University of Gothenburg Pierre F. Landry - Professor of Political Science, Director of Global China Studies, New York University - Shanghai Ellen M. Lust - Professor of Political Science, University of Gothenburg, Director of the Program on Governance and Local Development Dhafer Malouche - Associate Professor of Statistics, University of Carthage

2 What are the poten+al benefits and drawbacks to CAPI? Drawn from Experience with Local Governance Performance Index (LGPI) in Tunisia, 2015 Examine Opportuni+es, Challenges and Recommenda+ons across the Survey Process.

3 Local Governance Performance Index (LGPI) Inspired by Public Administra+on Performance Index (PAPI), Vietnam Designed to: Provide a catalyst for policyrelevant research on governance and local development Develop a database of consistent measurement tools to tap into varia+on at na+onal and subna+onal levels Answer key theore+cal and substan+ve ques+ons regarding governance and development Disseminate findings through academic publica+ons and onthe- ground workshops and websites, through local partnerships Measures dimensions of local performance: Poli+cal Par+cipa+on, Corrup+on, Ver+cal Accountability, Service Delivery Security, Health, Educa+on

4

5 Sampling Process: 6 of 24 governorates Households randomly sampled using PPS Points of light data used as a proxy for local popula=on density

6 Sampling Opportuni+es: Random selec=on of the respondent (the Kish grid ) greatly Can determine if the interviewers went to the correct loca=on Challenges: Does not fully solve the challenge of sampling manipula=on by interviewers Recommenda+ons: Timestamps should be used to aid in data forensics. Do not allow survey to go backwards and redo the Kish table. Program the =mer to stop when interviews are suspended and to note when cases are closed and reopened

7 The Tool and the Technology Import tablets into the country or purchase locally Research the benefits of alterna+ve survey programs Consider specific needs (language capabili+es), before purchasing

8 Ques+onnaire Development and Programming Opportuni+es: The development and implementa=on of complex ques=onnaires Capabili=es for randomiza=on of ques=ons and response order Embedding of color photos, audio clips and QxQs Interviewer instruc=ons and rules for answering ques=ons are easy Challenges: Mistakes can be easily made in programming complex surveys Steep learning curve in implemen=ng surveys by tablet Recommenda+ons: Budget =me for learning the capabili=es and limita=ons of the sosware Program the survey directly into the tablets Create standardized scheme for coding; implement early on Think through how earlier randomiza=on procedures may affect later ones

9 PreTes+ng and Pilo+ng Opportuni+es: Maximum benefit from a field pilot because the data is coded immediately Easier and less conspicuous use of recording focus groups, behavior coding, and cogni=ve interviewing Challenges: Programming must be verified to avoid costly errors Pretes=ng and pilo=ng is both about programming and ques=on wording and should be done on tablets Recommenda+ons: Run pretests mul=ple =mes and pilot a few weeks before you want to field Write the costs of using these techniques into grants and contracts

10 Field Material Prepara+on Opportuni+es: Tablets allow for easy revisions to the survey, even as fielding approaches Challenges: Tablets require addi=onal considera=ons to ensure that researchers are not in the field without appropriate survey instruments Recommenda+ons: Implemen=ng surveys with tablets requires adjustments in field material prepara=on

11 Interviewer Recruitment and Training Opportuni+es: Interviewers appeared to generally enjoy and prefer working with tablets Challenges: Enumerators must learn how to use the tablets Requires beyer prepara=on of field materials Enumerators could be targets for thes. Recommenda+ons: Hire interviewers who are comfortable with technology Create a system for locking and storing tablets

12 Conduc+ng Interviews Opportuni+es: Cuts out hassle of paperbased surveys Less poten=al for interviewer error in using showcards or other tools Assures addi=onal data collected is linked to the correct interviews Challenges: Interviewers need to remember to charge tablets, upload surveys, etc. Poor connec=vity makes uploading new survey versions difficult Changing previous responses can disrupt randomiza=on payerns Difficul=es for supervisors to review the survey and track quality Recommenda+ons: Implement measures to assure the technology works Find ways to help supervisors review the survey Be strategic about where it is possible to go backwards in the survey

13 QualityControl and Data Forensics Opportuni+es: Reviewing data every night allows for early iden=fica=on of need for more training or possible chea=ng Recording interviews may be a way to validate data Detec=on of errors before survey is complete Reduces chance that human error affects the data collec=on process Challenges: Data uploading for review in the field due to lack of connec=vity Labeling and cleaning variables can be =me consuming Recommenda+ons: Use tablet features in data forensics, par=cularly =me stamps. Require supervisors to approve surveys before they enter the database Upload data as soon as possible to the servers Check the background of survey firm and have strict protocols in place should data falsifica=on occur Download all versions of collected data that are available

14 Addi+onal Considera+ons General infrastructure issues/environments: While tablets do not require a permanent connec=on to the internet, it is advisable to ensure that country or region where the study is conducted has a basic public service infrastructure Ethical considera+ons: Tablets streamline data collec=on, boost interviewer professionalism, and may offer respondents an increased sense of confiden=ality, ul=mately increasing par=cipa=on and item response rates. Yet, the technology also presents new risks to poten=al par=cipants.

15 Future Research Mode studies (e.g. facetoface vs. tablet interviews) should be implemented to assess how the use of tablet computers affects par+cipa+on rates, item response rates, and data quality, especially for sensi+ve ques+ons Tablets offer unprecedented opportuni+es for survey experiments, which can include audio or video recordings, photos, or standard text, offering different frames, ques+on wordings, or visual s+muli