The 3ie-IFPRI seminar series is designed to highlight innovative papers on impact evaluation and facilitate discussion of new impact evaluation research. The seminars are held on one Thursday of each month from 12:00-1:30pm at IFPRI’s Washington DC headquarters (2033 K St. NW). To RSVP to any event, please contact Alexandria Cannon (email@example.com)
June 25: Measuring the Unmeasurable: Applying a Broader View of Mixed Methods to Evaluate the Impact of Energy-Efficient Home Heating Stoves in Mongolia
Speaker: Leslie Hodel, Social Impact
Discussant: Donee Alexander, Global Alliance for Clean Cookstoves
Conference Room 4B
View the webcast here.
Abstact: This research demonstrates the value of mixed-methods approaches to overcoming common design challenges including missing baseline data, selection bias, and measurement difficulties of key outcomes given time and resource constraints. Social Impact (SI) encountered all of these issues in evaluating a Millennium Challenge Corporation (MCC) project which sold 103,255 energy-efficient stoves at subsidized prices to residents of Ulaanbaatar, Mongolia with the goal of reducing air pollution and the associated health and economic impacts in addition to decreasing coal usage. The SI team combined various triangulated measurements with modeling to attain a more comprehensive account of project impacts. Using these methods, SI found that MCC stove users reduced PM2.5 emissions by 65% and carbon monoxide (CO) emissions by 16% compared to traditional stove owners. Evaluators used data modeling to measure reductions in ambient concentrations of PM2.5 attributable to heating stoves in Ulaanbaatar with the result of 47 avoided deaths and 1,643 disability-adjusted life years during the 2012-2013 winter season. SI evaluators found no significant reduction in fuel consumption or expenditures, noting that MCC stove owners kept their homes warmer rather than reducing fuel consumption.