Sdg/Agenda 2030: Challenges And Opportunities For Evaluation

EVALUATIONSDG/AGENDA 2030:CHALLENGES AND OPPORTUNITIES FOREVALUATIONColombo7/02/2018Evaluation OfficeArild Hauge, Deputy Director, Independent Evaluation Office (IEO),IndependentUNDPExecutive Coordinator, United Nations Evaluation Group (UNEG)OutlineArchitecture of 2030 Agenda for Sustainable DevelopmentMajor challenges and opportunities of evaluation in the SDGs eraReview arrangements and principlesGoals and indicatorsVNROpportunities for EvaluationUNEG, UNDP and IEO role and contributionSG’s proposal to reposition UN development system for 2030Agenda

Agenda structureDECLARATIONVision, shared Principles andCommitments, A Call for Action toChange Our WorldSUSTAINABLE DEVELOPMEN GOALS17 SDGs and 169 TargetsThe 2030 Agenda forSustainable DevelopmentIMPLEMENTATIONFOLLOW-UP AND REVIEWNational, Regional and GlobalMeans of Implementation andGlobal PartnershipIndependent Evaluation Office3‘Ecosystem’ of SDG Follow-up and ReviewKeyGeneral AssemblyECOSOCReviewing bodyHigh Level PoliticalForum (HLPF)Reporting mechanismLead / convening institutionStrategic direction/guidanceAnnual Global SustainableDevelopment ReportAnnual SDGs Global ProgressReportUN DESAVoluntary National ReviewsNational SDG ReportsRegional ReviewsNational Statistical ServicesThematic ReviewsMember StatesUN Agencies?UN Regional Commissions?4Source:GroupOIOS- on SDG Indicators (IAEG)Inter-agency ExpertIEDHigh Level Group for partnership, coordination and capacitybuilding for statistics (HLG)UN Statistical CommissionIndependent Evaluation Office

5Challenges of Evaluation in the SDGs eraCurrent state of SDG goalsSource: Projecting Progress:Reaching the SDGs by 2030;ODI 20156Independent Evaluation Office

Complexity, interconnectedness of the goalsDynamic nature of development and SDGSMeasurement challengesConceptual and definitional challengesOperationalization tectionLandGoal 1TechnologyUrbandevelop-mentFinanceIndependent Evaluation Office7Interrelatedness of SDGsGoal 1End poverty in all its formsTarget 1.5Build the resilience of the poor andreduce their exposure and vulnerabilityto climate-related extreme events andother disasters8Goal 11Make cities and human settlementsinclusive, safe, resilient and sustainableGoal 13Take urgent action to combat climatechange and its impactsTarget 11.5By 2030, reduce the number of deathsand of people affected and decreasethe direct economic losses caused bydisasters Target 13.1Strengthen resilience and adaptivecapacity to climate-related hazards andnatural disasters in all countriesIndicator 1.5.1 & 11.5.1 & 13.2Number of deaths, missing persons andpersons affected by disaster per 100,000peopleIndependent Evaluation Office

Monitoring and evaluability of progress is constrained by bothdefinitional and data issuesTARGETS ARE BROAD IN SCOPEMeasurement challengesConceptual and definitionalchallengesOperationalization challengesIndependent Evaluation OfficeStatus of SDG indicator data sets10Independent Evaluation Office

3Opportunities for evaluation in the SDGs eraSDGs follow-up and review principlesStakeholder participationBuild and invest in rency, accountabilityEvaluation as a principle for goodgovernanceNew data; but tools need to gobeyond numbers and watch bias1DynamicHolisticEvaluationin the eraof leIndependent Evaluation Office

To reflect on progress the Voluntary National ReviewsAgenda 2030 encourages member states to “conduct regular and inclusivereviews of progress at the national and sub-national level”201622 VNR201743 VNR201848 VNRIndependent Evaluation Office1Building Blocks of National ‘review’Fostering mutualaccountabilityInclusive nationalpolicy dialoguePreparation of anational SDG reportCoordination by thenational statisticaloffice14Source: SDG country reportingguidelines, January 2017Cooperation andcollaboration amonggovernmentagencies andministriesFacilitatingcomparability acrossand within countriesOpportunities forcapacitydevelopmentIndependent Evaluation Office

UNDP: knowledge production and sharingERC: Publicly accessible repository of evaluations andmanagement responsesIndependent Evaluation Office15Advancing SDGs through the ICPEsRecommendations made2442018AfghanistanAngolaBosnia arMaliParaguaySierra ns withmanagement response244Key actions ahrainBangladeshBelarusBurkina FasoCameroonChinaCôte d'IvoireEl azakhstanKosovo*LebanonFormer YugoslavRepublic of rkmenistanUgandaUruguayUzbekistanZimbabweKey actions completed61%Key actions overdue11%15 ICPE inToward 100%8 ICPEs6 ADRsConducted 2018 (88%new CPD42 ADR Completeof new coverage inin 2017Completed d in 2016CPDs)2019/2020since 2012Independent Evaluation Office

National evaluation diagnostic guidance aims to facilitateinstitutional self-assessmentEnables unpack evaluation requirementsOutlines a series of steps to assess keyevaluation bottlenecks and needsFor use by government entities primarily and otherevaluation actors who will support governmentFlexible to use by the federal government,regional/state government as well as local levels17Independent Evaluation OfficeThe Guidance recognizes the complexity of national evaluationsComplex set of coordination of actorsand actions that interact in repeated,evolving, and sometimesunpredictable waysEvaluation capacities cannot bedeveloped with an output-orientedlinear approachEvaluation system needs to beintegrated with existing societalpractices and values, and evolve withthem18Independent Evaluation Office

Global conferences on National evaluation capacityIndependent Evaluation OfficeIndependent Evaluation Office

The Bangkok declaration: Ways of supporting EvaluationConduct of country-level ‘SDG evaluation needs’ reviews and diagnostic studiesEvaluability assessments pertaining to individual country or sector SDG goals and targetsFostering of evaluation as component of national governance and public sector management reformEstablishing national evaluation legal frameworks - legislation and policiesDeveloping national and sub-national mechanism for independent evaluation of SDG progressAssigning resources (a percentage of the initiatives’ costs) for the conduct of evaluations whendesigning/approving projects/programmes/policiesStrengthening national and local data systems to monitor SDG progressEstablishment of frameworks of formal competencies and professional evaluation standardsEstablishing evaluation training programmes within academic and public sector training institutionsCreating opportunities for local, young and emerging evaluatorsDeveloping systems to promote transparent follow-up of evaluations recommendationSupport to national, regional and global evaluation professional organizationsSupport for forums of exchange between users and producers of evaluation, via the right of access toinformation, including regional workshops and web-based platforms for knowledge management Independent Evaluation Office21UN Evaluation Group (UNEG): 46 UN system membersRevised Norms and Standards adoptedat UNEG AGM, April 2016 (Geneva)Operating manual for all UN evaluationofficesResponding to:2030 Agenda for SustainableDevelopment and the SDGsInternational Year of Evaluation (2015)UN GA adopted resolution 69/237 on“Building Capacity for the Evaluation ofDevelopment Activities at the CountryLevelIndependent Evaluation Office

Repositioning UN development system to deliver 2030 Agenda“we need a culture of evaluation,independent and real-timeevaluation with full transparency.”– UN Secretary General, GutteresUNDG & UNRCUNDAFISWEIndependent Evaluation Office23Download through links Independent Evaluation Office UNDPUnited Nations Evaluation Group (UNEG)Mainstreaming the 2030 Agenda, Reference GuideIEO’s Evaluation of the Role of UNDP in Supporting NationalAchievement of the Millennium Development GoalsBangkok DeclarationNEC 2017 ConferenceIndependent Evaluation Office

Thank you !Independent Evaluation Office, UNDP220 E 42nd St 20th floorNew York, NY 10017www.undp.org/evaluation/IEOUNDP/UNDP Evaluation/EvaluationOffice

To reflect on progress the Voluntary National Reviews 1 Agenda 2030 encourages member states to "conduct regular and inclusive reviews of progress at the national and sub-national level" 2016 22 VNR 2017 43 VNR 2018 48 VNR Independent Evaluation Office Building Blocks of National 'review' 14 Source: SDG country reporting guidelines .