CBI Monitoring Tools

Transcription

1 CBI Monitoring Tools

2 Summary Process and Impact Monitoring PDM, QPDM forms Market price monitoring Complaints and Feedback

3 What is monitoring? The process of observing and checking the progress or quality of (something) over a period of time; keeping things under systematic review.

4 Monitoring What should be monitored? Market price monitoring Household expenditure monitoring Feedback and Complaints data

5 Process and Impact Monitoring Process monitoring: Check that the process is being done well Impact monitoring: Check that you are achieving what you wanted to achieve

6 Project monitoring framework Baseline survey Regular process monitoring (post-distribution monitoring) Regular impact monitoring (post-distribution monitoring) Market price monitoring Evaluation

7 Examples of how to collect monitoring data Baseline survey Interviews with households Interviews with community members/leaders Market price data Process monitoring Post-distribution monitoring questions to beneficiary households Interviews with money transfer agency

8 How to collect monitoring data cont. Impact monitoring Interviews with beneficiary households Case study households (including photos) Market price monitoring & interviews with suppliers Interviews with traders (especially for voucher projects)

9 Minimum monitoring for all cash-based responses What are people spending their cash on? How accessible are the markets? Where are people buying key goods? What is happening to market prices? Did people receive the right amount of cash? Were beneficiaries able to spend the money safely? Source: Adams, L. and P. Harvey. (2006). Issue Paper 6. Series on learning from cash responses to the tsunami: Issue Papers. Humanitarian Policy Group, Overseas Development Institute, London.

10 PDM - Household spending of the cash transfer Monitoring of cash-based responses should always include data collection on how the cash transfer has been spent. Ask households to tell you how much of the cash transfer was spent on key household item of interest E.g. staple food, other food items, rent, water, health care, education, livestock etc.

11 Household expenditure data should be converted into figures - graphs, pie chart e.t.c (Proportion of total cash transfer spent on each item)

12 Project baseline End of project Staple food Other food 1% 1% 2% 2% 4% 5% 10% 2% 5% 10% 5% 5% 48% Water for humans Water for animals Health care 5% Education 75% 20% Shelter materials Productive assets Debt repayment

13 What do changes in expenditure patterns tell us? If a household is food insecure they often spend large proportions of their cash on a few basic items only food (or debt for food), water, medical The household is likely to be recovering if they spend greater proportions of the cash transfer on non-essential items like education, livestock, household items

14 Remember.. Design and use simple, practical monitoring systems and forms Raw data needs to be entered and analyzed as soon as possible after collection Make sure that updated monitoring information is available and easily accessible to all project staff (including management)

15 PDM A1 A4 ID Number Registration Type A: PERSONAL INFORMATION A2 District A3 Village Codes for A4: 1 = Old registration from Phase I, 2 = New registration for phase II A6 NGO A7 Date of interview A5 Village Type Codes for A5: 1 = Urban, 2 = Rur A8 Gender of respondent (1 = m, 2 = f) A9 Gender of the head of hh (1 = m, 2 = f) A10 Size of hh A11 Number of children in hh <5 years old A12 What Targeting method was used Codes for A12: 1 = Nutrition Centre Card, 2 = Community Based Targeting, 3 = other A13 What criteria were used: Codes for A13: 1 = Pregnant /Lactating Mother, 2 = Female or child headed HH, 3 = IDP, 4 = Elderly, 5 =malnourished, 6 = lack of assets, 7 = other A14 Hawala agent used A15 Name of Enumerator A16 Which best describes your household s status? Codes: 1 = normally resident in this area, 2 = moved here due to drought, 3 = moved here due to conflict, 4 = moved here for other reasons A17 What is your household s current livelihood strategy (code) 1 = pastoralist, 2 = agro-pastoralist, 3 = agriculture, 4 = urban, A18* Which of the following have you or members of your household received from NGOs or projects in the past month? (1 = yes, 0 = no) a. Plumpy Nut b. CSB c. other food aid eg. Rice, oil, beans etc. d. FFW e. Cash or CFW f. Medicine g. Water or water voucher h. NFI / other

16 PDM B1 B2 B: COLLECTION OF CASH If you walk directly to the cash distribution, without stopping along the way How many hours did you take to travel to the cash distribution site? (code) How long did you have to wait at the distribution site to get cash? (code) Codes for B1 & B2: 1 = <0.5 hours, 2 = hour, 3 = hours, 4 = hours, 5 = hours, 6 = >2.5 hours B3 B4 B5 B6 B7 B8 B9 B10 B11 B12 Record the respondents views on the following statements B3 B11 using the codes1 = yes 2 = no Was the length of time you spent travelling to collect cash acceptable? (code) Did the frequency of the cash distribution suit your household s needs? (code) Was the transfer sufficient to cover your household s basic food needs? (code) Would you prefer food or food vouchers rather than cash? (code) Did the transfer allow you to invite non-household members to come and eat at your household? Are you aware of a complaints mechanism to report problems with the programme? (code) Have traders increased their prices as a result of the cash transfers? (code) Has control over the cash caused conflict within your household? (code) Are other members of the community jealous of you because of the cash transfer? (code) What was the total size of the transfer you received last distribution? USD B13 Was this the amount you expected? (1 = yes, 2 = no)

17 PDM C1 C: USE OF CASH AND MARKET BEHAVIOUR What exchange rate did you get for the cash you received? (enter currency as appropriate) 1 US$ = Indicate how much of the last month s cash transfer was used for each item (in Somali Shillings) a. Food e. Water i. Transport m. Firewood SoS KeS Eth B C2 b. Gift/Share f. Medical c. Livestock g. School Fees j. Rent or shelter k. Agriculture inputs n. Clothes / shoes o. Saved / in hand C3 d. Business investment h. Debt repayment Where did you exchange your cash? (code) l. Household items p. Other Codes for C3: 1 = Local hawala, 2 = Local trader to whom you have debt, 3 = Other trader, 4 = Exchange agent, 5 = Bank, 6 = Other

18 QPDM D1 D2 D3 D: FOOD SECURITY AND DIETARY DIVERSITY How many meals did adults in the household eat yesterday? How many meals did children in the household eat yesterday? Which of the following food stuffs did you or another household member eat yesterday (tick) a. Rice g. Fruit m. Milk, milk products b. other cereals h. Flesh meat n. Oils c. Vitamin A rich vegetables i. Organ meat o. Sugar, sweets, honey d. White tubers or roots j. Eggs p. Spices, salt, tea, coffee e. Dark green leafy greens k. Fish, seafood f. Other vegetables l. Legumes, seeds, nuts

19 QPDM E1*: COPING STRATEGIES FOR PASTORALIST HOUSEHOLDS In the past 30 days, if there have been times when you did not have enough food or money to buy food, how often has your household had to: a. Reduce home milk consumption and sell more of milk produced? b. Consume less preferred cereals c. Borrow food on credit from another household (Aamah)? d. Reduce number of meals per day? e. Reduce the portion size/quantity consumed at meal times (Beekhaamis)? f. Rely on food donations (gifts) from the clan/community (Kaalmo)? g. Consume weak un-saleable animals (caateysi)? h. Send household members to eat (for food) elsewhere? i. Skip (go an) entire days without eating (Qadoodi)? j. Beg for food (Tuugsi/dawarsi)? k. Rely on hunting for food (ugaarsi)? Never (zero x week) Hardly at all (<1 x week) Once in a while (1-2 x week) Pretty often? (3-6 x week) All the time (Ever day)

20 QPDM E2*: COPING STRATEGIES FOR AGRO-PASTORALIST HOUSEHOLDS In the past 30 days, if there have been times when you did not have enough food or money to buy food, how often has your household had to: a. Shift from high priced cereal varieties to low price cereal varieties? b. Shift from high quality cereals to low quality cereals (from osolo to obo)? c. Borrow food on credit from shop (Deyn)? d. Borrow food on credit from another household (Aamah)? e. Reduce home milk consumption and sell more of milk produced? f. Reduce the number of meals in a day by adults? g. Stop all home milk consumption and sell all milk produced? h. Rely on food donations (gifts) from the close relatives (Qaraabo)? i. Rely on food donations (gifts) from the clan/community (Kaalmo)? j. Skip (gone) entire days without eating (Qadoodi)? k. Community identified your household as in need of food and fives support? (Qaraan) l. Send household children to live or eat with relatives (elsewhere)? Never (zero x week) Hardly at all (<1 x week) Once in a while (1-2 x week) Pretty often? (3-6 x week) All the time (Every day)

21 What is market price monitoring? Regularly collecting the prices of certain items in the market Price the specific items that you want people to buy (E.g. livestock, water, business items etc.) Price basic food items (staple food, water, vegetables, oil, milk etc.) Price basic non-food items (fuel, soap, laundry detergent etc.) The same items and the same quantities each time Looking at trends in price over time

22 Why is market price monitoring important? It helps you determine the value of cash/voucher to be paid. It tells you if you need to change the value during project implementation It helps prove that you provided sufficient amount (evaluation/donors/management) It helps inform if there is inflation in the market

23 Example market price monitoring form (tick if available) Maize Rice Sorghum Wheat flour Sugar Vegetable oil Milk Meat (goat) Milk powder Cowpeas Tea leaves Salt 50kg 1kg 50kg 1kg 50kg 1kg 50kg 1kg 50kg 1kg 1 Litre 1 Litre 1 kg 1 kg 1 kg 1 kg 1 kg

24 Once collected, the data should be entered, cleaned and analyzed (usually Excel) Jan. Feb. Mar. Apr. May June Jul. Aug. Sep Oct. Nov. Dec. Maize Rice Wheat flour Sugar Water Meat Milk Kerosene Grinding School Fees Health Care

25 The data is then converted into a graph Maize Rice Wheat Flour Sugar Water Meat Milk Kerosene Grinding School Fees Health Care 0 jan feb mar apr may jun jul aug sep oct nov dec

26 What could changes in market prices mean? Has the cash-based response caused inflation? Or is there another explanation? Start of cash-based response End of cash-based response

27 Example 1: Maize Price JAN FEB MARCH APR MAY JUNE JULY AUG SEPT OCT NOV DEC

28 Main points to remember Baseline information needs to be collected so that changes can be measured. E.g. information on level of vulnerability, food security, income, assets, coping mechanisms, etc. Continuous monitoring of both process and impact indicators is recommended. E.g. Safety of beneficiary spending Household expenditure patterns Market prices The impact of the cash on needs and livelihood The progress of cash-for-work projects

29 Main points to remember Monitoring data should be analyzed on a regular basis in case project changes need to be made. Market price monitoring and analysis is considered a minimum requirement for cash programming. An evaluation at the end of the project should analyze should check that the project has met its objectives and if there are ways to improve the project process next time to get a better impact.

30 Complaints Accountability - Feedback

31 Beneficiary Accountability and Feedback Mechanism This entails efforts made by Organizations to embed feedback gathering, creating dialogue, delivering timely information and allowing to be scrutinized by constituent beneficiaries. The designs of these mechanisms might be different based on agencies, regions, cultures and nature of programs. Most used ones are Information boards, Suggestion boxes, feedback desk, web based sms and hotlinescentralized or through Radio stations.

32 Initiative. Develop simple, easy to implement and innovative system to capture complaints, complement and remotely monitor delivery of cash. The system should be based on a complete database with EVERY beneficiary s details. Such as: 4 names, next of kin s name, mothers name, ID number, age, sex, Region, district, village, contact number. This makes it very easy to locate and verify every beneficiary's claims/ issues in seconds by click of the mouse.

33 Rationale. Why this? Previously some reports questioned aid work in the regions/countries we are working - for corruption, fraud and diversion. The security circumstances in those areas resulted in over reliance of local partners, Community leaders, Contractors, organized civil and armed groups for delivery of humanitarian aid. There were litany of claims of local authorities taxing aid recipients, staff colluding with VRCs and service providers, total diversion of aid by gate keepers and locally contracted orgs.

34 Category of Complaints

35 Category of Complaints

36 The Result This gives beneficiaries the opportunity to express themselves without being reprimanded and ridiculed. Makes beneficiaries voices be heard and counted. Voice to speak, dignity and power to participate in something that touches their lives. Help establish strong partnership with them, built closer and firm relationship and affirmed that agencies can be counted on. Built personalized relationships. Reaching and tracing become much simple and hustle free.

37 Challenges Very costly to beneficiaries and quite costly to the Org two way calling and feedback. Since the contact numbers are easily accessible to anyone, anyone can raise wild allegations and unless investigated it is difficult to substantiate. Quite slow and difficult to investigate sensitive issues thro phone calls. Community members do not easily open up to strangers. Buying power is slow and in some areas the network coverage isn't great. Some voices are likely unheard. High illiteracy rate.

38 Thank You Questions