Evaluation of Energy Policies and Programs in the Asia Pacific Region: Current Status, Challenges and Opportunities Ahead

On October 20th 2020, Ed Vine of EEAP gave a Keynote Talk at the International Conference on Utilities and Exhibition (ICUE 2020) on Energy, Environment and Climate Change in Thailand.

View the recording of the presentation here

The Asia Pacific region is a center of interest and activity for energy efficiency and renewable energy technology, programs and policies. Evaluation will play an essential role to developing effective policy and to understanding the impacts of policy and program implementation.

Energy Evaluation Asia-Pacific (EEAP) is a non-profit organization that is taking a leadership role in expanding the practice of, and capacity for, objective evaluation in the energy efficiency and renewable energy fields. While some evaluation is occurring, COVID-19 has had a major impact on evaluation activities. Accordingly, this presentation discussed the following four topics: 

1. Evaluation of energy programs and policies

2. Impact of Covid-19 on evaluation

3. Strengthening the evaluation community in Asia Pacific: EEAP update

4. Eval4Action

FURTHER READINGS

– Vine, Ed, “Strategies and policies for improving energy efficiency programs: Closing the loop between evaluation and implementation.” Energy Policy 36 (2008) 3872–3881

– Vine, Ed, “Building a sustainable organizational energy evaluation system in the Asia Pacific” Global Energy Interconnection 2 (2019) 378-385

Quis custodiet ipsos custodes? The EU’s energy efficiency policies scrutinised by the European Court of Auditors

Webinar #17 of the Energy Evaluation Academy. Speaker: Peter Welch, Director “Sustainable use of natural resources” at the European Court of Auditors .

View the recordings of the webinar here.

Download the slides here.

The European Court of Auditors (ECA) promotes accountability and transparency, and acts as the independent guardian of the financial interests of the EU citizens. ECA recently published two reports about EU energy efficiency policies (about appliances and buildings) (see links below).

This webinar presented ECA’s role in the EU policy process, how it relates to evaluation, and the main conclusions from the two recent reports.

The webinar ended with a discussion between Peter Welch, Charles Michaelis (chair of Energy Evaluation) and Sarah Rieseberg (project manager at the Secretariat of the International Climate Initiative (IKI) ) about differences and possible interactions between the work of Courts of Auditors and the work of evaluators.

FURTHER READINGS

Recent publications of the European Court of Auditors related to EU energy efficiency policies:

– “EU action on Ecodesign and Energy Labelling: important contribution to greater energy efficiency reduced by significant delays and non-compliance” (published in January 2020) : https://www.eca.europa.eu/Lists/ECADocuments/SR20_01/SR_Ecodesign_and_energy_labels_EN.pdf

– “Energy efficiency in buildings: greater focus on cost-effectiveness still needed” (published in April 2020): https://www.eca.europa.eu/Lists/ECADocuments/SR20_11/SR_Energy_efficiency_in_buildings_EN.pdf

The Energy Evaluation Academy is jointly organised by Energy Evaluation and Leonardo Energy.

Reflections on the effect of COVID-19 on Energy Evaluation in the Asia Pacific Region

In a recent meeting, our Energy Evaluation Asia Pacific Group took some time to discuss the impact of COVID-19 on them personally, at work, nationally, and more widely on Energy Evaluation in the region. Here is a short summary of the discussion.

COVID-19 and energy

The global pandemic has affected the economic situation worldwide, with the global economy expecting to shrink by at least 6% in 2020.[1] It has also highlighted the importance of a reliable energy supply to enable hospitals to deliver vital care, and it has connected people in new ways despite working remotely in their own homes. Reduced energy consumption, in particular electricity, was a side-effect of economic slowdown and lockdowns.[2] However, an increased portion of this consumption and associated cost has fallen to individual households.

Working online

Face to face meetings are now tough to hold, and there’s a feeling that everything that can be done online, should be done online. Some of our members in China felt this had increased productivity, and had actually helped accelerate some projects. Others at the early stages of projects in Indonesia noted slow progress in the absence of face to face meetings. A colleague in New Zealand reported that they had used the time to organise for the future.

The current situation

Financial recovery and several stimulus programmes are happening in the region, some include energy efficiency measures but few plan to include evaluation.

In India, our members spoke about challenges and opportunities arising from the pandemic, with India being at a cornerstone point where new programmes on supply side and infrastructure are being initiated and are in a strong position to integrate energy efficiency and include evaluations at the design stage itself. Our colleagues in India had heard a lot of discussions by ministers about energy efficiency and renewable energy programmes and how they will contribute to generating jobs, but there is little discussion being had on energy efficiency and evaluation of these programmes in a serious manner.

Australia is planning both financial recovery programmes and energy efficiency programmes. Supporting low income and vulnerable households will be a clear priority, and recent multiple benefits work has provided evidence for governments wanting to have the maximum impact. Everyone is spending more time at home so households are now consuming energy and incurring costs which had been absorbed by workplaces previously.

In the USA, our members reported a lot of money going into financial recovery programmes which include spending on the energy transition. They believe that there is a need for policymakers to ensure energy and carbon emissions goals are being met while addressing the pandemic. Policymakers have been focused on the implementation of programs and policies and less attention has been spent on evaluation. There is an opportunity for evaluators to engage with policymakers to ensure evaluation is part of the mix when developing and implementing energy programs.

What next?

Past evaluations have produced a wealth of evidence which can be put to use in the current economic crisis. This discussion has prompted us to draw together the lessons we have learned from previous moments of crisis, and we will be publishing a blogpost on this soon, including useful resources. Watch this space!

Sign up to our mailing list to receive updates: https://expertevents.eventsair.com/energy-evaluation/eoi/Site/Register

Visit our website for more resources: https://energy-evaluation.org/

[1] http://www.oecd.org/economic-outlook/june-2020/

[2] https://www.iea.org/reports/covid-19-impact-on-electricity

Evaluating the UK’s Energy Savings Opportunity Scheme

Webinar #16 of the Energy Evaluation Academy. Speakers: Laura Edwards and Gary Shanahan (Department for Business, Energy and Industrial Strategy, UK) .

View the recordings of the webinar here.

Download the slides here.

In 2014, the UK introduced the Energy Savings Opportunity Scheme (ESOS) to implement requirements under the Article 8 of the Energy Efficiency Directive (mandatory energy audits for large companies/non-SMEs).

This webinar presented the methodology used in the evaluation and its key findings. It then ended with a broader discussion on policies to expand business energy efficiency.

FURTHER READINGS

Fore more details about the evaluation of the UK’s Energy Savings Opportunity Scheme:

– latest evaluation report: https://www.gov.uk/government/publications/energy-audits-and-reporting-research-including-the-energy-savings-opportunity-scheme

– interim evaluation report: https://www.gov.uk/government/publications/energy-savings-opportunity-scheme-esos-evaluation-of-the-scheme

The Energy Evaluation Academy is jointly organised by Energy Evaluation and Leonardo Energy.

US Department of Energy’s Uniform Methods Project

Webinar #15 of the Energy Evaluation Academy. Speakers: Charles “Chuck” Kurnik (US DOE National Renewable Energy Laboratory – NREL).

View the recordings of the webinar here.

Download the slides here.

This webinar provided an overview of the US Department of Energy’s Uniform Methods Project that develops protocols for determining energy savings from energy efficiency measures and programs.

The webinar will discuss the motivations of this project, the development process, measures, and how they are used.

For more details about the Uniform Methods Project, visit the website: https://www.energy.gov/eere/about-us/ump-protocols

The Energy Evaluation Academy is jointly organised by Energy Evaluation and Leonardo Energy.

Lessons learnt about evaluation practices for energy efficiency policies in Europe

Speakers:

• Gregor Thenius, Austrian Energy Agency
• Jean-Sébastien Broc, IEECP (Institute for a European Energy & Climate Policy)

View the recordings of the webinar here.

Download the slides here.

While we enter a transition in the European framework for energy efficiency, ex-post impact evaluations can bring facts and figures about current achievements towards the 2020 targets, and useful feedback to improve policies in view of the 2030 targets.

The Horizon 2020 EPATEE project analysed evaluation practices in EU countries and developed resources to help enhancing them. After an overview of these resources, this webinar presented the main lessons learnt from exchanging with evaluation customers and evaluators, with a focus on comparing estimated and metered energy savings, and how to integrate evaluation into the policy cycle.

Webinar joinlty organised by and

The EPATEE project has received funding from the European Union’s Horizon 2020 Research and innovation programme under grant agreement No 746265.

Disclaimer: Neither the European Commission nor any person acting on behalf of the Commission is responsible for the use which might be made of this webinar and related contents. The views expressed in this webinar are the sole responsibility of the speakers and do not necessarily reflect the views of the European Commission

How to improve the evaluation of complex systems to improve policy-making

Webinar #14 of the Energy Evaluation Academy. Speaker: Sara Giorgi (Research Consultant & Evaluator)

View the recordings of the webinar here.

Download the slides here.

Evaluation is intended to provide policymakers and practitioners with feedback and recommendations to improve policy making and implementation. The success of an evaluation and the impact of its findings hinges on the way policymakers and practitioners are involved in and perceive the evaluation process. The more complex the policy, the more challenging this relationship becomes.

New report launched on Australia’s progress towards the UN #SDGs shows gains in #health, #education 
& #employment but less success in reducing household #debt, housing affordability & action on #ClimateChange.
www.sdgtransformingaustralia.com

Energy Program and Policy Evaluation Capacity Building in the Asia Pacific

Webinar #13 of the Energy Evaluation Academy. Speaker: Edward Vine (Lawrence Berkeley National Laboratory)

View the recordings of the webinar here.

Download the slides here.

The Asia Pacific region is a center of interest and activity for energy efficiency and renewable energy technology, programs and policies. Evaluation will play an essential role to developing effective policy and to understanding the impacts of policy and program implementation.

Energy Evaluation Asia-Pacific (EEAP) is a non-profit organization that is taking a leadership role in expanding the practice of, and capacity for, objective evaluation in the energy efficiency and renewable energy fields.

This presentation highlights evaluation capacity building, EEAP, and key topics of EEAP’s Second Evaluation Conference (held in Bangkok in October 2019).

Multiple Benefits project partners to collaborate with businesses to improve competitive advantage and energy performance.

The EU-funded Horizon 2020 project “Valuing and Communicating the Multiple Benefits of Energy Efficiency” today launched its new web site. The site will serve as a platform for collaboration between project partners and businesses to make energy efficiency investments a lasting competitive advantage.

Why don’t companies invest more in energy efficiency? One answer is that efficiency projects are not viewed as strategic priorities. While energy engineers propose projects based on energy savings and payback, investment committees prioritise projects on the basis of strategic impacts to the company.

By quantifying and communicating multiple benefits of energy efficiency – like improved product quality, enhanced worker productivity, improved indoor air quality, reduced maintenance costs – energy efficiency can become strategic.

But, what does strategic mean? “An investment is strategic if it contributes to create, maintain or develop a sustainable competitive advantage” says Dr. Catherine Cooremans, a project partner from the Université de Lausanne who specialises in the strategic and cultural dimensions of investment decision-making.

Developing a training platform and toolkit with and for businesses

Starting in 2019, the project team will offer businesses a training platform and toolkit, including analysis methods and communication tools.

Partners will work directly with at least 50 businesses to analyse, communicate and evaluate the strategic impacts of energy-saving actions. In parallel, Multiple Benefits partners will compile a public evidence base of case studies, project examples and results to bolster investment proposals.

More information

The project website is now launched at the following URL: www.m-benefits.eu. Companies and others who are interested in learning more should sign up for the mailing list