Final Evaluation of YAPPIKA-ActionAid Tsunami Emergency Response and Recovery Programme in Central Sulawesi Indonesia - Executive Summary

YAPPIKA-ActionAid Indonesia launched the emergency response and recovery (ERR) programme in three districts of Central Sulawesi from October 2018 to September 2020. This response was implemented to address the impact of the earthquake and tsunami that struck the area, and caused destruction to the environment, resulting in more than 100 000 people losing their homes and the loss of more than 4 000 lives. The programme aimed at helping the most vulnerable groups affected by the disaster, namely women and children, to regain their footing and well-being and have access to protection mechanisms in the face of the dire situation the tsunami created. The project also involved women taking up leadership roles as focal points in their respective communities, to address the humanitarian crisis and facilitate the restarting of their livelihood activities to support their household and community economy.

The evaluation aims at providing inputs for the improvement of humanitarian actions by ActionAid and other humanitarian agencies. It also provides an analysis on adherence to accountability measures in humanitarian responses, and the assurance that women and other vulnerable groups affected by this disaster have been adequately supported by the programme.

The Core Humanitarian Standards (CHS) are used as a basic framework for the evaluation with reference to several other standards, such as ActionAid’s (AA) Accountability Framework and the Women-Led Community-Based Protection (WLCBP) concept. The evaluation used a combination of participatory approaches for data collection and analysis which included, amongst others, appreciative enquiries, participatory reflection and review processes, Focus Group Discussions (FGD), Key Informant Interviews and various tools for gender analysis and rural appraisal such as village mapping, Venn diagram, Harvard Gender Analysis Matrix, etc.

The analysis shows that overall, the programme has achieved almost all its objectives as outlined in the programme design and theory of change. The programme also demonstrates compliance with almost all CHS criteria but needs more work in the areas of coordination and collaboration among the partner organizations, accountability to affected populations and achieving a full participation of the community in decision-making processes.

One of the most notable achievements is the emergence of many women leaders among the communities. The programme, facilitated by the partner organisations, was able to successfully build the capacity of local women to become more confident and self-reliant, by providing spaces where they can express their concerns and opinions freely. Capacity building and strengthening the local capacity and community resilience are clearly the areas where this programme excels; cost efficiency and capacity to deliver results with the optimal use of resources is also another winning point for the programme. While the financial benefits were comparatively insignificant, for example the income from livelihood activities, the programme has clearly invested in the future by using the resources to develop local institutions, knowledge transfer and experiences and hone the skills of local partners and communities, particularly women, to address humanitarian crises and creating opportunities for women’s leadership in this area.

The programme findings that could be identified as lessons learned are as follows:

1) The requirement to follow the CHS and AA humanitarian standards such as the Accountability Framework, AA’s Humanitarian Signature and WLCBP should be accompanied with proper guidance on how to understand and put them into operation. Partners did follow YAA’s guidance but were yet to understand fully how it is interpreted in the design and implementation;

2) The initial assessment was sufficient to make informed decisions for the programme design, particularly in the first phase. In the second phase, however, a more in-depth needs assessment should be carried out to better address the needs of the community, instead of responding to a “wish list” such as in implementing livelihood activities where only a few of the beneficiaries could participate meaningfully;

3) Working with women focused organizations is a strategic choice of partnership. It is important, however, to provide clear guidance, regular monitoring and mentoring on how to measure their performance to ensure that it is in line with YAA’s agenda on women-led protection programmes humanitarian contexts;

4) The scale of the programme and type of intervention was quite challenging for implementing partners. Proper support to improve their capacity in planning, operations and financial management should be an integral part of the capacity building intervention from YAA;

5) Different focus, agenda and characteristics of partners affect the level of coordination and cooperation between implementing partners. While each achieved the targeted outputs, there was no connection or complementary agenda amongst them. Inter-partner cross learning and support should be encouraged and promoted;

6) Livelihood activities, albeit small in scale and limited to the production of certain commodities only, are a good entry point at the community level and have a lot of potential to be scaled up for sustainability;

7) Advocacy work should be inherent to the activities on the ground, as many initiatives could be promoted with sufficient support from relevant government agencies, be it in the form of legalizing land titles by village authorities, or providing links to external resources for scaling up production and access to markets, or improving product quality and business management capacity;

8) While the programme has encouraged partners to facilitate community-based disaster risk mapping, there is little understanding on how to assess the environmental impact of disasters or whether a mitigation plan is in place; and

9) It is unfortunate that the programme, despite YAA’s expertise and experience in advocacy work, has not yet addressed the pertinent issues relevant to disaster risk reduction and humanitarian action in the region; partners only launched sporadic advocacy work without significant results related to the rights of survivors. Interestingly, at the village level, several women, who engaged in the programme have successfully advocated for these issues and influenced government decisions – such as in obtaining a living allowance as well as a stimulant fund for housing. This needs to be documented and promoted for possible replication in other areas.

Recommendations for the improvement of the humanitarian actions:

  1. Set up a proper management structure for the ERR team: A defined management structure through partnerships or direct implementation would increase its effectiveness in managing humanitarian actions;

  2. Have YAA lead on coordination: For the coordination to be effective and strategic, YAA, based on its strengths and extensive experience, should take a leadership role in coordination from an early stage;

  3. Focus on organizational strengths and comparative advantages to increase visibility and significant impact: The promotion of WLCBP and AA’s Accountability Framework in humanitarian action would be more beneficial in the long run rather than investing in physical construction where AA probably has limited experience and expertise;

  4. Invest more in capacity building: Ensure that sufficient resources are being invested to map the available local institutions and human resources, with a clear mechanism and faculty for capacity building. This is particularly relevant to areas that are key to YAA/AAI such as in WLCBP, various humanitarian standards and frameworks, organizational management, including the capacity to evaluate environmental impacts. This applies to both partners and internal organizations;

  5. Use screening tools to select partners: No matter how small the window of opportunity is to conduct a stakeholder analysis, it is imperative to choose partners that are strategic to implementation based on a proper assessment. The use of YAA tools such as OCPAT would be useful to assess the capacity of local civil society organizations to engage in humanitarian action;

  6. Set exit and sustainability strategies: Despite the short period of engagement, it is necessary to integrate an exit strategy into each programme’s design so as to ensure that there is a proper handover in place, and to sustainability map out interventions that have potential to develop post-ERR;

  7. Proactively seek engagement with the government early on: It is important to engage early with the government, not only to increase visibility, but also to pave the way for future work should there be themes that need to be scaled up, promoted or supported by the government, and also to ensure a smooth handover of the programme by the end of the intervention. Such a relationship is also useful in case the programme and/or partners have an advocacy agenda related to survivors’ rights and empowerment in the aftermath of a disaster;

  8. Document and study ERR programme experience: It is important to continue learning from experiences, to continually improve humanitarian action considering that disasters could happen anywhere in different forms, scales, and circumstances. To enrich YAA’s repository, documentation and inventory of best practices, lessons learned, and successful models of women-led disaster management programmes where ActionAid has engaged would be valuable input for the organization in developing effective engagement strategies;

  9. Ensure all internal systems for programme support and management are well understood by all parties involved: It is important that all staff and partners involved understand what to expect from the project’s performance. The MOU should clearly spell out the rights and obligations of the partnership, including accountability measures, M&E system, grievance mechanisms, transparency and all the dos and don’ts to avoid mishaps or misinterpretation along the way.

  10. Set up a support system available to staff involved in the humanitarian response: Emergency situations are extremely stressful and hard on staff. It is important that proper services are also available to address staff well-being and avoid occupational hazards. Psychosocial services, R&R and other incentives to create a work-life balance should be integrated in SOPs and HR policies;

  11. Build local CSOs organizational strength for follow up advocacy programmes: YAA in Indonesia is recognized as an advocate to promote inclusive education and often leads in advocating socio-economic and citizens’ rights, both at the sub-national and particularly at the national levels. It would be strategic to use this experience and expertise to support local advocacy groups in their identifying issues that need to be tackled post-disaster. Further discussion with local CSOs as well as coordination with the local government could be the next step that YAA takes in the future.

Tag :