Tsunami Evaluation Coalition - AbsoluteAstronomy.com

The Tsunami Evaluation Coalition (TEC) was a unique learning and accountability initiative in the relief and development sector. It was first established in February 2005 to carry out joint evaluations of the response to the Asian earthquake and tsunamis of 26 December 2004.

The TEC had over 50 member agencies from the United Nations

United Nations

The United Nations is an international organization whose stated aims are facilitating cooperation in international law, international security, economic development, social progress, human rights, and achievement of world peace...

, Donors, Non-Governmental Organisations and the Red Cross. These organisations have been working together since the TEC was established to:

To improve policy and practice in the relief and rehabilitation sector.
To provide some accountability to both the donor and recipient public.
To improve evaluation in the relief and rehabilitation sector by learning from the TEC process itself.

Need for evaluation

Evaluation

Evaluation is systematic determination of merit, worth, and significance of something or someone using criteria against a set of standards.Evaluation often is used to characterize and appraise subjects of interest in a wide range of human enterprises, including the arts, criminal justice,...

is needed in humanitarian aid to maintain the quality of the response, as there is no commercial feedback mechanism as with running a business, or direct political feedback as with running local services. Evaluation helps to provide aid managers and policy-makers with feedback on how well the whole humanitarian system is doing.

The TEC was the most significant evaluation effort in the humanitarian sector since the Joint Evaluation of the response to the Rwanda Crisis in 1994, and followed in the footsteps of Study 3 of that evaluation which examined humanitarian aid and its effects.

Governance

The TEC was guided by a Core Management Group of about 15 members. The TEC was hosted by the Active Learning Network for Accountability and Performance in Humanitarian Action (ALNAP) Secretariat in London. The Secretariat was responsible for managing the day to day operations of the TEC under the direction of the Core Management Group. Participating agencies worked within a framework that encouraged sharing of information, lesson learning, accountability, and mutual support and transparency.

Each of the TEC thematic evaluations was separately managed by its commission agency or agencies and the steering committee for that evaluation.

Thematic Evaluations

TEC members commissioned five different thematic studies. The topics of the studies were chosen on the basis that they were topics that would particularly benefit from a joint evaluation. The five
thematic evaluation are all independent, and were carried out by independent consultants.

The five thematic evaluations carried out field work in Indonesia

Indonesia

Indonesia , officially the Republic of Indonesia , is a country in Southeast Asia and Oceania. Indonesia is an archipelago comprising approximately 13,000 islands. It has 33 provinces with over 238 million people, and is the world's fourth most populous country. Indonesia is a republic, with an...

, Sri Lanka

Sri Lanka

Sri Lanka, officially the Democratic Socialist Republic of Sri Lanka is a country off the southern coast of the Indian subcontinent. Known until 1972 as Ceylon , Sri Lanka is an island surrounded by the Indian Ocean, the Gulf of Mannar and the Palk Strait, and lies in the vicinity of India and the...

, Thailand

Thailand

Thailand , officially the Kingdom of Thailand , formerly known as Siam , is a country located at the centre of the Indochina peninsula and Southeast Asia. It is bordered to the north by Burma and Laos, to the east by Laos and Cambodia, to the south by the Gulf of Thailand and Malaysia, and to the...

, India

India

India , officially the Republic of India , is a country in South Asia. It is the seventh-largest country by geographical area, the second-most populous country with over 1.2 billion people, and the most populous democracy in the world...

, the Maldives

Maldives

The Maldives , , officially Republic of Maldives , also referred to as the Maldive Islands, is an island nation in the Indian Ocean formed by a double chain of twenty-six atolls oriented north-south off India's Lakshadweep islands, between Minicoy Island and...

, Somalia

Somalia

Somalia , officially the Somali Republic and formerly known as the Somali Democratic Republic under Socialist rule, is a country located in the Horn of Africa. Since the outbreak of the Somali Civil War in 1991 there has been no central government control over most of the country's territory...

, and Donor capitals from September to November 2005. Their reports were published together with the main synthesis report in July 2006. These five thematic reports cover:

Needs Assessment
The Impact on Local and National Capacities
The Linkages with Relief, Rehabilitation, and Development
Coordination
The Donor Response

The TEC products=
The TEC produced a series of reports:

An initial findings report in December 2005.
The main synthesis report, the five thematic reports, and the underlying country studies and other subsidiary reports in July 2006.
An expanded summary of the synthesis report in January 2007.

All the TEC reports can be found on the TEC website.

The six initial findings

The TEC published an initial findings report in December 2005. These preliminary findings were based on initial reports from the more that fifty consultants involved in the field-work.

Relief was effective

The relief phase was effective in ensuring that the immediate survival needs were met, through a mixture of local assistance in the immediate aftermath and international assistance in the first weeks after the disaster. However, these relief responses were generally not based on joint needs assessments and were not well coordinated, leading to an excess of some interventions such as medical teams, alongside shortages in less accessible areas or less popular sectors such as water supply.

Unprecedented response

The scale of the generous public response was unprecedented, not only in the amount of money raised (about $14 billion internationally) but also in the proportion of funding from the general public, and the speed with which money was pledged or donated. The scale of the funding allowed an early shift to rehabilitation and the use of cash assistance programmes. It also acted as a giant lens, highlighting many of the existing problems in humanitarian response systems. The scale of funding also created coordination problems as it increased the number of agencies while removing some of the normal incentives for agencies to engage with coordination mechanisms.

Local capacity underestimated

Although local capacity is key to saving lives, this capacity is underestimated and undervalued by the international aid community as well as being overlooked by the international media. International agencies did not engage sufficiently with local actors, and assessed the skills of local actors relative to those of their own agency rather than in terms of skills appropriate to the local context.

Capacity of the humanitarian system is limited

The capacity of the international humanitarian system is not infinitely elastic. Despite the generous response to the tsunami, the appeals-based system for funding humanitarian emergencies is flawed, with a pattern of under-funding humanitarian response in general. This pattern of low funding for most emergencies limits the development of capacity within the international aid system, and makes it difficult for the system to scale-up to respond appropriately to a large emergency such as this.

Agencies focus too much on "brand" promotion

Agencies focus too much on promoting their brand and not enough on the needs of the affected populations. Agencies are still not transparent or accountable enough to the people they are trying to assist. In some cases agencies are also not sufficiently accountable to those providing the funding.

Recovery is proving far more difficult than relief

The recovery phase is proving a far bigger challenge than the relief phase. This is due in part to the greater complexity of recovery and to the demands that such complexity places on the aid agencies.

The main synthesis report

This report synthesised the whole TEC evaluation effort. The foreword of the report was written by former US President Bill Clinton

Bill Clinton

William Jefferson "Bill" Clinton is an American politician who served as the 42nd President of the United States from 1993 to 2001. Inaugurated at age 46, he was the third-youngest president. He took office at the end of the Cold War, and was the first president of the baby boomer generation...

in his capacity as the United Nations Secretary-General’s Special Envoy for Tsunami Recovery.

The four main findings dealt with:

Local capacities.
International support for local actors.
The quality of interventions.
The unpredictable funding system.

Local capacities determine how many survive

It was local people themselves who provided almost all immediate life-saving action and the early emergency support, as is commonly the case in disasters. Thus, it is often local capacities that determine how many survive in the immediate aftermath of a sudden onset natural disaster. The TEC studies found that international agencies experienced major problems in scaling up their own responses. Those agencies that had invested (before the disaster) in developing their emergency response capacity had the potential to be more effective. Pre-existing links, and mutual respect, between international agencies and local partners also led to better use of both international and local capacities.

International action in support of local actors

International action was most effective when enabling, facilitating and supporting local actors. International agencies often brushed local capacities aside, even though they subscribe to norms and standards that call for engagement with and accountability to local actors such as governments, communities and local NGOs. International agencies often ignored local structures and did not communicate well with local communities nor hold themselves accountable to them.

Many examples of poor quality work

There were many examples of poor quality work in the response to the tsunami, not only in the relief phase (largely from inexperienced agencies) but also in the recovery phase. Different parts of the international humanitarian response community have, over the last decade, launched several initiatives to improve the quality of humanitarian work. These initiatives typically set up norms or standards, but none of them has an effective mechanism to sanction agencies for failing to meet them.

Arbitrary funding

The tsunami highlighted the arbitrary nature of the current funding system for humanitarian emergencies. This system produces an uneven and unfair flow of funds for emergencies that neither encourages investment in capacity nor responses that are proportionate to need. Despite the commitment to Principles of Good Humanitarian Donorship (GHD) by some donors, the TEC studies found that donors often took decisions on funding the response based on political calculation and media pressure.