2_Title Slide Better Buildings Residential Network Data & Evaluation Peer Exchange Call Series: Cost-Effective, Customer-Focused and Contractor-Focused Data Tracking Systems July 24, 2014 Call Slides and Discussion Summary
Agenda Welcome Call Logistics and Introductions Residential Network and Peer Exchange Call Overview Featured Speakers: Jenna Zelenetz, Empower Efficiency Kathryn Eggers, Elevate Energy Discussion: What data tracking systems have you tried? What are some attributes of a good data tracking system? What are some potential shortcomings? What advantages do tracking systems bring? What challenges have you encountered with data tracking systems? How did you overcome them? Other questions/issues related to data tracking systems? Poll: Future Call Topics 2
Participating Programs and Organizations Austin Energy Building Performance Center Center for Sustainable Energy (San Diego, CA) City of Providence, RI City of Savannah, GA City of Seattle, WA Clinton Foundation Efficiency Maine Trust Elevate Energy (Energy Impact Illinois) Empower Efficiency Energy Coalition (Irvine, CA) Snohomish County Public Utility District (Everett, WA) Vermont Energy Investment Corporation (Efficiency Vermont, DC Sustainable Energy Utility) 3
Better Buildings Residential Network Better Buildings Residential Network: Connects energy efficiency programs and partners to share best practices to increase the number of American homes that are energy efficient. Membership: Open to organizations committed to accelerating the pace of existing residential upgrades. Commit to providing DOE with annual number of residential upgrades, and information about benefits associated with them. Benefits: Peer Exchange Calls Tools, templates, & resources Newsletter updates on trends Recognition: Media, materials Optional benchmarking Residential Solution Center For more information & to join, email bbresidentialnetwork@ee.doe.gov. Better Buildings Residential Network Group on Home Energy Pros Join to access: Peer exchange call summaries and calendar Discussion threads with energy efficiency programs and partners Resources and documents for energy efficiency programs and partners http://homeenergypros.lbl.gov/group/better-buildings-residential-network 4
5 Better Buildings Residential Network Group on Home Energy Pros Website
Peer Exchange Call Series There are currently 6 Peer Exchange call series: Data & Evaluation Financing & Revenue Marketing & Outreach Calls are held the 2nd and 4th Thursday of every month at 12:30 and 3:00 ET Upcoming calls: July 24: Financing - Effective Loan Program Design and Integration with Contractors August 14: Program Sustainability Mastermind Multifamily/ Low-Income Housing Program Sustainability Workforce/ Business Partners August 14: Workforce - Home Performance Training & Mentoring: Lessons and Resources Send call topic ideas or requests to be added to additional call series distribution lists to peerexchange@rossstrategic.com 6
Designing a Cost-Effective Database: Lessons Learned from the Connecticut Neighbor to Neighbor Pilot Jenna Zelenetz, Empower Efficiency (Connecticut Neighbor to Neighbor)
Designing a Cost-Effective Database: Lessons Learned from the Connecticut Neighbor to Neighbor Pilot Jenna Zelenetz, Data Manager Salesforce.com Certified Developer July 24, 2014
CT Neighbor to Neighbor Energy Challenge Prove that community-based strategies are a cost-effective way to drive demand for residential upgrades Prove that investing in state-of-theart data tracking systems improve community-based program results CT. Gov. Malloy announces N2N 9
Test, Learn, Adapt Integrated Technology Platform Key Program Tools Internal Tools for Innovation Program Dashboards and Weekly Report Reviews Cost Effectiveness Modeling Behavioral Research and Solid Program Evaluation 10
Robust, Flexible Tracking Database Customizable architecture, fields, and workflow automation Integration with web forms, surveys, and contractor portals Report and dashboard-building capabilities with real-time data 11
Neighbor to Neighbor January 8, 2013 12
Neighbor to Neighbor January 8, 2013 13
Monthly Contractor Scorecard Project Owner Grand Total OR HES Savings Data (9/1/11 to 11/30/12) 1 2 3 6 7 9 10 11 Program Average # Visits w/ Savings Data 60 53 45 207 93 333 108 173 1221 Avg % Savings from HES 8.3% 7.2% 8.1% 7.5% 11.7% 9.3% 8.4% 9.3% 8.9% Savings >15% (% of visits) 7% 8% 0% 7% 25% 11% 9% 13% 11% Bids and Upgrades Bids Delivered 14 26 28 94 38 92 22 24 368 Bid Rate 12% 36% 44% 31% 24% 20% 13% 12% 21% Upgrades from HES Leads 7 1 4 16 17 50 7 11 120 Total Completed Upgrades 11 1 3 19 18 62 8 11 146 Upgrade % (of bid) 50% 4% 14% 17% 45% 54% 32% 46% 33% Upgrade % (of HES) 6% 1% 6% 5% 11% 11% 4% 6% 7% 14
15
Evaluating Cost Effectiveness Created program cost-effectiveness modeling tool for more robust performance metrics Used participant data and pulled in program administration and staff costs Calculates staff hours and cost for program action or energy savings by outreach activity Allows scenario modeling for future programs
17
Lessons Learned Customer Acquisition Costs $400 $350 $709 $300 $250 $200 $478 $150 $100 $303 $293 $204 $206 $222 $245 $204 $50 $91 $134 $91 $0 Q1 2012 Q2 2012 Q3 2012 Q4 2012 Q1 2012 - Alternate Scenario Q4 2012 - Alternate Scenario Cost per Customer Cost per Lead
Cost MMBtu $35 $30 $25 $20 $61 Lessons Learned Energy Acquisition Costs/ Savings 18 16 14 12 10 $15 $10 $26 11.8 $29 10.2 11.7 13.6 14.3 $16 $17 15.8 8 6 4 $5 $8 2 $0 Q1 2012 Q2 2012 Q3 2012 Q4 2012 Q1 2012 - Alternate Scenario Q4 2012 - Alternate Scenario 0 Cost per MMBtu Average MMBtu per Customer (Annual)
Recommendations When developing a data management platform, important to be: Thorough Anticipatory Flexible Realistic Rigorous
Connecticut Neighbor to Neighbor Program Data Tracking System Lessons Thoroughly outline what data you need upfront, and then invest in the right tool to track it over time Some metrics weren t built into Connecticut s tracking system at the beginning; this resulted in rework Don t paint yourself into a corner with complicated analysis use data fields and validation rules to avoid errors Monitor and clean up your data regularly to make sure you re getting what you want out of the system Design your data tracking and evaluation system with the scientific method in mind (i.e., with a clear strategy for testing and learning from different experiences) Connecticut s cost-effectiveness model allowed the program to create best case scenarios and identify the most cost-effective approaches across the 14 participating communities 21
Data Tracking Systems Lessons Learned: Kathryn Eggers, Elevate Energy
BBRN Peer Exchange Data & Evaluation: Cost-Effective, Customer-Focused and Contractor- Focused Data Tracking Systems July 2014 2014 Elevate Energy ElevateEnergy.org
Our Mission We promote smarter energy use for all. We give people the resources they need to make informed energy choices. We design and implement efficiency programs that lower costs, and protect the environment. We ensure the benefits of energy efficiency reach those who need them most. 2014 Elevate Energy
Mitigating barriers to energy efficiency retrofitting activities for residential, multifamily, and commercial building sectors Access to information Access to finance Access to a trained workforce Launched with funding from US Department of Energy Better Buildings Neighborhood Program Early challenges with single family contractors Inconsistent assessment reports across companies Modeling savings to meet Illinois Home Performance with ENERGY STAR and DOE reporting requirements 2014 Elevate Energy
To assist contractors we added a contractor tool to MyHomeEQ Luke Skywalker 123 Main St, Naperville IL Fred Flinstone 123 Rock Cut Rd, Chicago IL Ferris Bueller 123 Green St, Glencoe IL 2014 Elevate Energy
2014 Elevate Energy Sections are nearly all drop down options, making form easier and faster to complete
Basic Option is meant to cover measures required for Illinois Home Performance with ENERGY STAR 2014 Elevate Energy 29
2014 Elevate Energy Optional Package allows addition of further home improvement suggestions for the project
Automatically calculates rebate amounts using total cost & square footage Automatically calibrated based on Total Cost for Eligible Energy Automatically calibrated based on Square Feet of Attic Insulation Installed Total EI2 rebate 2014 Elevate Energy
2014 Elevate Energy Creates a PDFs to send to homeowner
Illinois Contractor Reporting and Tracking System Experiences 33 Contractors working with Energy Impact Illinois produced widely varied assessment reports, ranging from ½-page invoices to much more comprehensive energy assessment reports The program wanted to develop an easy-to-use process by which contractors could produce consistent, high-quality assessment reports that met the program s needs Strategies the program used included: Developing an on-line interface for contractors to enter data for assessments Coordinating with the utility to access utility bill data (homeowners must also sign a permission form) Drawing in basic info from the tax assessor records (e.g., square footage) Developing a basic package of pre-selected energy upgrade measures the program recommended contractors use, with options for contractors to tailor it Including estimated energy use savings and estimated rebates in the interface, as well as a report that could be provided to homeowners Contractors provide other forms to the program in addition to the report
Discussion Questions What data tracking systems have you tried? What are some attributes of a good data tracking system? What are some potential shortcomings? What advantages do tracking systems bring? What challenges have you encountered with data tracking systems? How did you overcome them? Other questions/issues related to data tracking systems? 34
Discussion: Data Tracking Approaches and Lessons 35 Several programs are using customer relationship management (CRM) systems (SugarCRM, Salesforce, etc.) for data tracking and customer and/or contractor management Customizing off-the-shelf CRM systems for energy efficiency requires a significant amount of staff time and effort, but many programs have found the investment to be worth it The Clinton Foundation has a proprietary tablet app that allows employees at companies to schedule energy assessments and produces a 1-pager for the auditor with basic info about the home Low-tech strategies are also helpful: The Center for Sustainable Energy (CSE) in California focuses on building face-to-face connections through workshops, where homeowners can set up appointments with contractors directly Regardless of the system, a commonly cited best practice is make it as simple as possible for contractors (or customers)
Discussion: Data Tracking Approaches and Lessons (continued) HPXML (Home Performance XML, a data transfer standard for the home performance industry) could make it possible to reduce the time different participants spend recollecting the same data HPXML is being mapped to DOE s Building for Environmental and Economic Sustainability (BEES) software, so there will be a common language Currently programs and their partners spend a lot of time collecting data, and there isn t a lot of repurposing/sharing of data 36
Future Call Topics Poll Which of the following topics are of interest for future data and evaluation peer exchange calls? Low income program data and evaluation practices: 57% Developing a benchmarking plan: templates, tools, and data: 57% Program management and audit software: 29% Evaluating whether there are increases in real estate values from EE: 14% If you would like to share your experiences on a call or have other ideas for a call topic, contact peerexchange@rossstrategic.com. 37