The system offered by MGov Brasil has four main advantages: scope, absence of interviewer, low cost, and speed.

Transcription

1 Mobile solutions for public management and social impact MGov Brasil is a consulting firm specializing in public-policy management and social impact, using mobile solutions for impact evaluation, monitoring and mobilization. WHAT DO WE OFFER? MGov Brasil aims at meeting the demand by public managers, foundations, and institutions for information about the profile of users of public goods and services and their evaluation of these goods and services; information about the profile of beneficiaries of social-impact actions; rigorous impact evaluation and monitoring; and mobilization actions. The primary distinguishing factor of this methodology is its platform. Taking advantage of the high penetration of cell-phones among Brazilian households, MGov uses analogic technology text messaging (SMS) and voice calls to implement a two-way communication channel with respondents, gathering data and sending out information based on customer s needs. ADVANTAGES OF OUR METHODOLOGY The system offered by MGov Brasil has four main advantages: scope, absence of interviewer, low cost, and speed. SCOPE Due to the breadth of cell-phone coverage in the country, the platform s scope is extremely wide-ranging, reaching over 87% of Brazilian households (2012 data, according to the Brazilian Institute of Geography and Statistics, IBGE). In addition, the percentage of homes with at least one cell-phone is growing quickly from 83% to 87% between 2010 and 2012 corroborating the use of this tool for consulting the population in a statistically representative way.

2 Figure 1: Cell-phone penetration in Brazilian homes, by State Source: MGov Brasil Notes: (1) percentage of permanent private households that have landlines and cellular telephones or just cell-phones, according to data from the Demographic Census of IBGE; (2) States ordered by household per capita income from 2010 (IBGE). It should be pointed out that, despite the increase in smartphone sales in Brazil (52.4% of devices purchased in 2013, according to IDC Brasil), nearly 78% of active lines in the country are prepaid (National Telecommunication Agency, ANATEL, 2013), limiting the use of smartphones and applications for reaching a broader audience. Within this context, texting and voice solutions are better positioned to reach all audiences, a fundamental characteristic in the context of public policies and social-impact actions. ABSENCE OF INTERVIEWER The MGov methodology separates the two processes involved in traditional survey methodology: approach and interview. MGov takes a decentralized approach in which the interviewer obtains the interviewee s consent to participate in the survey through either a partnership when the contracting party provides enrollment information, taking advantage of its institutional interaction with the target audience and its reach or (anonymous and free) selfopt-in through SMS during an enrollment campaign.

3 After enrollment is complete, the interview is conducted in a centralized manner through either texting or an Audible Response Unit (ARU). This contributes in at least two ways to the quality of the data gathered. First, the absence of an interviewer allows sensitive issues to be addressed for instance, enabling us to document the percentage of those surveyed who do not meet the eligibility criteria for participation in a social program, or who misuse program s resources. Second, not having an interviewer means that, as the number of interviews increases, the variance of answers obtained is substantially smaller than that obtained under the traditional methodology, in which each additional interviewer adds noise to the data, as a result of idiosyncrasies in the formulation of questions and interpretation of results. low cost Given the absence of intermediaries, the low marginal cost of texting and voice, and the low compensation needed to encourage participation, data collection costs are significantly lower than the costs of any other conventional field research. METHODOLOGY APPROXIMATE COST PER INTERVIEW SOURCE MGov Brasil R$ 5 - R$20 MGov Brasil Face to face household Face to face pass-by point Telephone interview - CATI ARU R$ 90 R$ 80 R$ 55 R$ 35 Ipsos, Ibope, Datafolha Notes: (1) MGov estimates reflect its average costs across multiple projects, with total interviewees ranging from 700 to 25,000, and the exact parameter depends on participation incentives; (2) World Bank and Gallup cost estimates are from the Listening to LAC (L2L) project, which interviewed a representative sample by country using different methodologies in Peru and Honduras; (3) Ipsos, Ibope and Datafolha cost estimates were obtained by an invitation procedure (tomada de preços) for a survey involving 500 farmers and two survey waves. An additional advantage is the possibility of multiple replications, which are as costly as the original under the traditional methodology, but that can be done with significant economies of scale using the MGov Brasil methodology. SPEED Survey results are instantly available on a dashboard, as participants respond to the survey questionnaire. In addition to the possibility of rapid actions or policies to meet the identified needs, adjustments can be made to the questionnaire when implementing the survey or in the policy or action during the project, as a result of high-frequency monitoring of the target audience.

4 EXPERIENCE IN BRAZIL From February to March of 2013, MGov Brasil evaluated the Leite Potiguar program, the largest social initiative in the state of Rio Grande do Norte (funding of nearly R$ 80 million a year), which benefits around 150,000 families. Interviewing over 700 beneficiaries and producers in 40 cities across ten rural territories of the state, the evaluation overcame the difficulties of working with an extremely unsophisticated population that in many cases was located in remote, hard-to-access regions. This is the first initiative to evaluate the impact of a large-scale social program, like Leite Potiguar, using this technology. With these results, the government now has information to improve the program and to better meet the needs of all those involved: producers and beneficiaries, stated the State Secretary of Planning and Finance, Francisco Obery Rodrigues Jr. In March and June 2014, MGov Brasil conducted pioneering research with small farmers in the state of Ceará in partnership with researchers from Harvard (Cambridge, USA) and Warwick (England) universities, and the Meteorology and Water Resources Center of Ceará (Fundação Cearense de Meteorologia e Recursos Hídricos, FUNCEME). The study s goal was to evaluate the impacts of droughts on farmers living conditions, using cell phones. Over two weeks on each month, the project conducted nearly 4,000 interviews with over 700 family farmers residing in 54 of the driest municipalities in the State. In addition to gaining an understanding of the impacts of droughts on income and consumption, the researchers also developed a methodology for testing cognitive function, attention, and memory, performed over the cell-phone for the first time not just in Brazil, but worldwide. According to Eduardo Sávio Martins, the President of FUNCEME, The study provided significant information about how the public sector ought to design its governmental policies. In the case of FUNCEME, it also enabled an assessment of its communication strategy with the final users of the climate information. INTERNATIONAL EXPERIENCE Cell-phones have been successfully used to gather information at low costs by organizations such as the World Bank and UNICEF in Central America and Africa. In Guatemala, replacing the face-to-face survey model with texting-based data collection cut costs by over 70%, and increased the satisfaction of practically 100% of respondents. In Sudan, texting-based data collection enabled the government to gather information about remote regions that had cellular service, but were very difficult for enumerators to access.

5 ABOUT US Guilherme Lichand One of the leading innovators in Brazil under 35 and social innovator of 2014, according to the MIT Technology Review, he is currently pursuing a Ph.D. in Political Economy and Government at Harvard University, and has a Master in Economics from PUC-Rio, and a Bachelor of Economics from FGV-SP. He was a research analyst in the Poverty Reduction and Economic Management Department of the World Bank in Brazil. He has worked with the states of Alagoas, Bahia, Ceará, Rio Grande do Norte, and Rio Grande do Sul, and with the cities of São Paulo and Rio de Janeiro. Marcos Lopes Holding a Ph.D. in Public Administration and Government from FGV-SP, he works as a researcher in the Center of Politics and Economics of the Public Sector at FGV and as a consultant to the World Bank and the Inter-American Development Bank on matters related to public policy. He has worked with the states of São Paulo, Minas Gerais, Paraná, and Rio Grande do Sul, and with the city of São Paulo. Rafael Vivolo With an MBA in Business Management from FEA-USP and a Bachelor in Advertising from ESPM, he won the Itaú-Trip Transformers Award in 2012 for his work on promoting initiatives that have the power of social transformation. An expert in communication with considerable experience on the advertising market, he has worked with the Ministry of Finance and the city of São Paulo. - Guilherme Lichand [email protected] Marcos Lopes [email protected] - MGOV BRASIL Rua Vicente Leporace, 1534 Campo Belo - São Paulo - SP Brasil - CEP Rafael Vivolo [email protected]