Brent A. Neiser, CFP

Transcription

1 Nurturing financially capable individuals through financial education at schools: Programmes and Evaluation OECD-Brazilian International Conference on Financial Education December 16, 2009 Brent A. Neiser, CFP Director, Strategic Programs and Alliances, NEFE

2 Who is the National Endowment for Financial Education (NEFE )? A nonpartisan, independent, 501(c)3 nonprofit, self-funded foundation located outside of Denver, Colorado, USA Committed to educating Americans about personal finance and empowering them to make positive and sound decisions to reach their financial goals.

3 What does NEFE do? Education Programs Provides financial planning information to youth (high school and college) Strategic Programs and Alliances Provides financial education in cooperation with other nonprofit organizations and foundations Multimedia Access Shares financial education with consumers, educators, and media Innovative Thinking Supports fellowships programs, grantmaking, research, strategic activities, and public policy work

4 Evaluation: Think Outcomes, Not Outputs Inputs Activities Outputs Outcomes Outcomes are benefits/changes for participants during or after program activities New knowledge Increased skills Changed attitudes modified behavior improved condition Source: United Way

5 Evaluation of Student Programs We will cover: 1. NEFE s High School Financial Planning Program 2. NEFE s College Program, CashCourse 3. NEFE s Evaluation Toolkit and other grant projects

6 NEFE High School Financial Planning Program (HSFPP ) Complete money management curriculum Over 6,000,000 student guides sent out to an estimated 200,000 classrooms Teacher Training Program

7 Evaluation of NEFE High School Financial Planning Program Evaluated by the University of Minnesota in 1998, 2004, and 2010 Purpose of evaluation: Assess the impact of teens studying the HSFPP curriculum. Does the program work? Did the subject LEARN the information? Did the knowledge they gained from learning the information give them the CONFIDENCE to act? Did the confidence to act lead to the subject to TAKE POSITIVE ACTION?

8 Evaluation of NEFE High School Financial Planning Program What students were asked: 14 core questions about their financial knowledge, financial management behaviors, and confidence about managing finances. Measures the changes in students knowledge, behavior and confidence both after completing the course and then three months later 18-month program evaluation

9 Evaluation Results Students who studied the program reported significant improvement in their financial knowledge, behavior, and confidence immediately after studying the HSFPP A smaller sampling of students surveyed three months later showed that the positive impact of the HSFPP continued and increased over time

10 University of Minnesota HSFPP Evaluation: Know Difference Between Needs and Wants Sample Data Strongly Agree Before After 3 Months Later 41.7% 66.9% 80.5% Understand Costs of Buying on Credit Set Money Aside for future needs and wants 12.2% 31.1% 48.9% 18.5% 27.9% 36.2% Believe the way I manage money will affect my future 33.1% 58.6% 73.0% For full reports, go to

11 Methodology: post-thenpre evaluation method Students are first asked about what they learned from studying the curriculum content After that questioning, they are then asked what their level of knowledge, confidence, or behavior was prior to studying the material Methodology

12 Increased Reliability More traditional method is Pre-test/post-test, which is a pre-test given before studying subject matter with a post-test given at the end of the presentation of the subject matter Answers in the post-then-pre method often are more reliable because students often do not know what they do or do not know before studying the material Asking them first about what they learned serves as a foundation to indicate what it is they actually did not know or do prior to studying the content

13 New for 2010 Inclusion of a pre-evaluation study a close-up look at four classes in different parts of the country to: See what we can learn about the effect of the performance-based learning pedagogy we employed in this version of the program Follow students from these classes to assess the longer term effects of their experience within the program in the classroom. Results will be presented the end of 2010

14 CashCourse College Program

15 Introduction to CashCourse A free Web site to provide students financial education information for every stage of college life Unbiased, noncommercial content Branding of the school can be integrated into the Web site through the school s logo, color scheme, and resources Promotional materials are provided and can be customized (although schools using the materials cover the printing costs) Multiple campus departments can use the Web site Designed to compliment existing financial literacy programs on campus, or to kick-start financial literacy efforts.

16 CashCourse Content 5 Main Categories 1. Financial Basics Covers budgeting, banking, credit cards, retirement 2. Paying for College Financial aid, federal aid programs, managing loans 3. College Life Housing, roommates, studying abroad, peer pressure 4. World of Work Interviews, understanding benefits, taxes 5. Economic Survival Tips Your parents situation, income and employment in hard times Interactive Content Contains: Quizzes, calculators, worksheets, interactive budgeting wizard, and polls

17 CashCourse Additional Resources Workshop Kits 5 topics PowerPoint Presentations & Facilitators Guides Marketing templates Pre-composed financial education content to be used for s or newsletters Press Releases Reimbursement Program to help promote CashCourse on campus CashCourse Connection enewsletter with updates on new resources, and how other schools are using CashCourse on campus.

18 CashCourse Evaluation Working with outside evaluation firm Logic model development Final Impact: College students have the skills and knowledge to become financially healthy adults

19 Inputs Strategies Short Term Outcomes Long Term Outcomes Impact

20 CashCourse Evaluation Focus groups at three colleges/universities 2 focus groups each at diverse institutions Interviewing administrators at 15 schools 5 interviews each with highest-traffic, average, and low-traffic schools Pop-up surveys to reach broader audience Will be present on the CashCourse site at all schools; reward is a $5 gift card

21 Other Evaluation Components Feedback option within CashCourse Evaluation worksheets in all workshop kits Evaluation component part of programming (ex: Reimbursement Program)

22 Other ways NEFE is working with research and evaluation NEFE Evaluation Toolkit ( eval/) Various grants projects

23 NEFE Financial Education Evaluation Toolkit An innovative tool to evaluate the effectiveness of financial education programs that is accessible to individuals and organizations involved in financial literacy activities Developed by university researchers through a grant from NEFE Samples of evaluation instruments: Post Evaluation Only (Post Evaluation, Follow-up Evaluation, Program Information Sheet) Pre and Post Evaluation (Pre Evaluation, Post Evaluation, Follow-up Evaluation, Program Information Sheet Stages to Change Evaluation (Initial Observation, Mid-Term Observation, End-of-Program Observation, Progress Reporting Sheet, Follow-up Evaluation, Program Information Sheet) Train-the-Trainer Evaluation (Pre Evaluation, Post Evaluation, Follow-up Evaluation, Program Information Sheet)

24 Grant Projects Training New Teachers University of Wisconsin Madison Studies teacher preparedness and how money management impacts efficacy Matching methods and audiences Pennsylvania State University Harrisburg Research on which education methods help particular groups of people learn best

25 Grants, Cont. Financial management practices of college students from states with varying financial education mandates University of Wisconsin Madison Shows that financial behaviors of college students vary by state policy on financial education Longitudinal study highlighting college student financial behavior changes Arizona Pathways to Life Success for University Students (APLUS) and University of Arizona Three factors that create an effective solution to avoiding financial problems when students start college: 1. Parental Involvement (has the most influence) 2. Education (formal financial education in High School) 3. Workplace experience (part-time job)

26 For more information: National Endowment for Financial Education High School College Consumer Sites