Entries tagged with “development policy”.
Did you find what you wanted?
Wed 13 Jan 2016
Posted by Ed under development, Development Institutions, Humanitarian Assistance, Random Musing
Comments Off on Of Death Stars and Development
Look, I know there have been lots of Star Wars and development posts/tweets (here, here, here), so I won’t belabor things. But forgive me a quick observation after seeing the most recent Star Wars: isn’t the continual construction of bigger and more powerful flying orbs of death by the bad guys (the Empire, then the First Order) a perfect metaphor for the sort of thinking that gave us the Millennium Villages?
Goal: Galactic Domination
Project 1: Star Wars: A New Hope
Logframe: Build giant Death Star space station, blow up a representative planet, watch galaxy cower in fear => Galactic Domination
Evaluation: Failure to address single design flaw results in giant space station destroyed
Outcome: Lack of Domination
Project 2: Star Wars: Return of the Jedi
Logframe: Build bigger, better Death Star space station, everyone will remember the last one blew up a planet, and because this one is even bigger the galaxy will cower in fear => Galactic Domination
Evaluation: Fixed previous design flaw, overconfidence in tactics and shields failed to account for another fatal flaw, giant space station destroyed
Outcome: Catastrophe, Complete collapse of the Empire
Project 3: Star Wars: The Force Awakens
Logframe: F*ck it, we’re making an actual moon/planet into an absolutely massive, sun-powered Starkiller base (rebranded to avoid stigma of previous Death Stars), blow up the entire Federation home system, watch galaxy cower in fear=> Galactic Domination
Evaluation: Pretty much the same flaw as with the second Death Star, with pretty much the same result: Starkiller base destroyed
Outcome: Still no domination
So, to summarize: we have a problem, we can’t seem to solve it, so we will keep plowing ahead with the same approach, but bigger and more expensive, because clearly it isn’t the concept that’s flawed, we just haven’t gone big enough!
Yep, sounds like a lot of development.
Mon 28 Sep 2015
Last week, I published a short editorial in Scientific American’s SA Forum online that decried the near-total lack of organization or prioritization in the Sustainable Development Goals/Global Goals/whatever they are called this week. My argument was simple: by not ordering or prioritizing goals, the SDGs
risk becoming an empty exercise that empowers business as usual in the field of global development.
At the conclusion of that piece, I suggested that the only way to avoid this outcome was to find actors who were able to demand organization and prioritization among these goals – principally the big bilateral donors like USAID and DfID, or perhaps the Gates foundation (which, on expenditures, comes in around the world’s sixth-largest donor organization).
I’ve been taken to task a few times by colleagues for this suggestion. These rather polite and professional interventions (I know, not at all like the internet I’ve come to expect) pointed out that I’d empowered the big donors, with their problematic, often Eurocentric framings of development and how to achieve it, to act as the saviors of development via the SDGs. Given my rather clear critical stance with regard to these framings of development (most clearly articulated in Delivering Development, but generally present in most of the stuff I write), I think some folks were mystified by my logic. So allow me to clarify:
When we refuse to define terms, organize concepts or efforts, or engage in the politics necessary to set priorities, we are not apolitical: we are empowering other political agendas. The basic argument of my op-ed was simple: by not making hard decisions, we have empowered a particular political agenda, one that leaves development in a business-as-usual situation. Therefore, I see nearly any effort at locking down priorities and organizing efforts as superior to no prioritization at all, because any effort to set priorities will accomplish two things:
First, it will bring politics to the fore, and we will all be forced to wrestle with what we want to prioritize and why.
Second, it will lock down the meanings of the different terms we use (i.e. sustainable, well-being, secure) in such a way that they can become sites where politics can happen.
What do I mean by this? If, as we have done to this point, we refuse to define what we mean by sustainable (for example), we create a conceptual container that can be filled by nearly any definition, policy, program, project, or activity. It allows completely contradictory efforts to coexist and cancel each other out, without providing a base from which to contest any or all of these efforts. When there are no definitions, everything using a given term can be seen as equally valid. Similarly, if we refuse to prioritize our efforts, organizations can fill their efforts to meet the SDGs with almost any hodgepodge of policies, programs, projects, or activities…and will likely do so in a manner that mirrors their current emphases, funding, and staffing structures. Thus, organizations could set up completely contradictory agendas, with associated material efforts, and be seen as making equally valid efforts to address the SDGs in the eyes of the donors and the public. There is no way to contest the way one organization or another does its business if there are no definitions or priorities from which to work.
This does not mean that I think any particular donor organization will save the SDGs by setting the agenda we need to move forward. All are mired in their own internal and/or national politics, and therefore will push for agendas that most clearly reflect their own strengths and priorities. Further, most donor organizations do, in fact, operate from rather problematic, Eurocentric framings of the world, for example in their continuing inability to recognize the genius of small farmers who already negotiate uncertain environments and economies. As I have written about at length, in the eyes of most donor organizations these farmers are poor and helpless in the face of these large forces, and in need of help/saving/education. As a result, the donors cannot identify the things that these farmers really need (which are often a lot more narrow than a total reworking of their agricultural systems) and, even worse, they cannot learn from the things these farmers already know about how to best manage their agricultural, economic, and social environments.
So no, I don’t think the donors will save us…directly. But if one or more are willing to step up and impose politics on this process, they will create a process by which terms gain definition, and efforts are prioritized. When these meanings become fixed, it becomes possible to engage them and contest them, to actually have a conversation about what development is, and what it should be. Right now, we can just hold hands, say words like sustainability, and watch a nice concert together, all the while operating under the illusion that we have the same goals, and that we are working toward those goals in the same ways. That gets us nowhere. I want a development world where we are forced to recognize that different organizations and individuals prioritize different things, have different visions of the future, and different means of moving us toward those visions. Further, I want a development world where we have to struggle with the fact that what organizations want may have little to do with what the global poor want. That is what the SDGs could have given us.
It is too late to make the SDGs’ 17 goals and 169 targets a site of real development politics. But all is not lost: over one thousand initiatives have been set up to meet these targets and achieve these goals, and many more are coming. This is where the goals will become impacts on the ground. If we can create a real politics of development around these initiatives by organizing and prioritizing them, perhaps we can recover the SDGs as a site from which we can build a truly transformative agenda for development.
Sun 28 Dec 2014
Raj Shah has announced his departure from USAID. Honestly, this surprises nobody at the Agency, or anyone in the development world who’s been paying attention. If anything, folks are surprised he is still around – it is well-known (or at least well-gossiped) that he was looking for the door, and at any number of opportunities, at least since the spring of 2012. There are plenty of reviews of Shah’s tenure posted around the web, and I will not rehash them. While I have plenty of opinions of the various initiatives that Shah oversaw/claims credit for (and these are not always the same, by the way), gauging what did and did not work under a particular administrator is usually a question for history, and it will take a bit of space and time before anyone should feel comfortable offering a full review of this administrator’s work.
I will say that I hope much of what Shah pushed for under USAID Forward, especially the rebuilding of the technical capacity of USAID staff, the emphasis on local procurement, and the strengthening of evaluation, becomes entrenched at the agency. Technical capacity is critical – not because USAID is ever going to implement its own work. That would require staffing the Agency at something like three or four times current levels, and nobody is ever going to approve that. Instead, it is critical for better monitoring and evaluating the work of the Agency’s implementing partners. In my time at USAID, I saw implementer work and reports that ran the gamut from “truly outstanding” to “dumpster fire”. The problem is that there are many cases where work that falls on the dumpster fire end of the spectrum is accepted because Agency staff lack the technical expertise to recognize the hot mess they’ve been handed. This is going to be less of a problem going forward, as long as the Agency continues to staff up on the technical side.
Local procurement is huge for both the humanitarian assistance and development missions of USAID. For example, there is plenty of evidence supporting the cost/time effectiveness of procuring emergency food aid in or near regions of food crisis. Further, mandates that push more USAID funding to local organizations and implementers will create incentives to truly build local capacity to manage these funds and design/implement projects, as it will be difficult for prime contractors to meet target indicators and other goals without high-capacity local partners.
A strong evaluation policy will be huge for the Agency…if it ever really comes to pass. While I have seen real signs of Agency staff struggling with how to meaningfully evaluate the impact of their programs, the overall state of evaluation at the Agency remains in flux. The Evaluation Policy was never really implementable, for example because it seems nobody actually considered who would do the evaluations. USAID staff generally lack the time and/or expertise to conduct these evaluations, and the usual implementing partners suffer from a material conflict of interest – very often, they would have to evaluate programs and projects implemented by their competitors…even projects where they had lost the bid to a competitor. Further, the organizations I have seen/interacted with that focus on evaluation remain preoccupied with quantitative approaches to evaluation that, while perhaps drawing on Shah’s interest in the now-fading RCT craze in development, really cannot identify or measure the sorts of causal processes that connect development interventions and outcomes. Finally, despite the nice words to the contrary, the culture at USAID remains intolerant of project failure, and the leadership of the Agency never mounted the strong defense of this culture change to the White House or Congress needed to create the space for a new understanding of evaluation, nor did it ever really convey a message of culture change that the staff of USAID found convincing across the board. There are some groups/offices at USAID (for example, in the ever-growing Global Development Lab) where this culture is fully in bloom, but these are small offices with small budgets. Most everyone else remains mired in very old thinking on evaluation.
At least from an incrementalist perspective, entrenching and building on these aspects of USAID Forward would be a major accomplishment for Shah’s successor. Whoever comes next will not simply run out the clock of the Obama Administration – there are two years left. I therefore expect the administration to appoint an administrator (rather than promote a career USAID staff caretaker with no political mandate) to the position. In a perfect world, this would be a person who understands development as a discipline, but also has the government and implementing experience to understand how development thought intersects with development practice in the real world. Someone with a real understanding of development and humanitarian assistance as a body of thought and practice with a long history that can be learned from and built upon would be able to parse the critical parts of USAID Forward from the fluff, could prevent the design and implementation of projects that merely repeat the efforts (and often failures) of decades ago, and could perhaps reverse the disturbing trend at USAID to view development challenges as technical challenges akin to those informed by X-Prizes – a trend that has shoved the social aspects of development to the back seat at the Agency. At the same time, someone with implementing and government experience would understand what is possible within the current structure, thus understanding where incremental victories might push the Agency in important and productive directions that move toward the achievement of more ideal, long-term goals
There are very, very few people out there who meet these criteria. Steve Radelet does, and he served as the Chief Economist at USAID while I was there, but I have no idea if he is interested or, more importantly, if anyone is interested in him. Much the pity if not. More likely, the administration is going to go with the relatively new Deputy Administrator Alfonso Lenhardt. Looking at his background, he’s already been vetted by the Senate for his current position, has foreign service experience, time in various implementer-oriented positions, and he is well-positioned to avoid a long confirmation process as a former lobbyist and from his time as House Sergeant-at-Arms, which likely give him deep networks on both sides of the aisle. In his background, I see no evidence of a long engagement with development as a discipline, and I wonder how reform-minded a former Senior Vice President for Government Relations at an implementer can be. I do not know Deputy Administrator Lenhardt at all, and so I cannot speak to where he might fall on any or all of the issues above. According to Devex, he says his goal is to “improve management processes and institutionalize the reforms and initiatives that Shah’s administration has put in place.” I have no objection to either of these goals – they are both important. But what this means in practice, should Lenhardt be promoted, is an open question that will have great impact on the future direction of the Agency.
Sun 21 Dec 2014
Five and half years ago, at the end of the spring semester of 2009, I sat down and over the course of 30 days drafted my book Delivering Development. The book was, for me, many things: an effort to impose a sort of narrative on the work I’d been doing for 12 years in Ghana and other parts of Africa; an effort to escape the increasingly claustrophobic confines of academic writing and debates; and an effort to exorcise the growing frustration and isolation I felt as an academic working on international development in a changing climate, but without a meaningful network into any development donors. Most importantly, however, it was a 90,000 word scream at the field that could be summarized in three sentences:
- Most of the time, we have no idea what the global poor are doing or why they are doing it.
- Because of this, most of our projects are designed for what we think is going on, which rarely aligns with reality
- This is why so many development projects fail, and if we keep doing this, the consequences will get dire
The book had a generous reception, received very fair (if sometimes a bit harsh) reviews, and actually sold a decent number of copies (at least by the standards of the modern publishing industry, which was in full collapse by the time the book appeared in January 2011). Maybe most gratifying, I heard from a lot of people who read the book and who heard the message, or for whom the book articulated concerns they had felt in their jobs.
This is not to say the book is without flaws. For example, the second half of the book, the part addressing the implications of being wrong about the global poor, was weaker than the first – and this is very clear to me now, as the former employee of a development donor. Were I writing the book now, I would do practically nothing to the first half, but I would revise several parts of the second half (and the very dated scenarios chapter really needs revision at this point, anyway). But, five and a half years after I drafted it, I can still say one thing clearly.
I WAS RIGHT.
Well, I was right about point #1 above, anyway. The newest World Development Report from the World Bank has empirically demonstrated what was so clear to me and many others, and what I think I did a very nice job of illustrating in Delivering Development: most people engaged in the modern development industry have very little understanding of the lives and thought processes of the global poor, the very people that industry is meant to serve. Chapter 10 is perfectly titled: “The biases of development professionals.” All credit to the authors of the report for finally turning the analytic lens on development itself, as it would have been all too easy to simply talk about the global poor through the lens of perception and bias. And when the report turns to development professionals’ perceptions…for the love of God. Just look at the findings on page 188. No, wait, let me show you some here:
For those who are chart-challenged, let me walk you through this. In three settings, the survey asked development professionals what percentage of their beneficiaries thought “what happens in the future depends on me.” For the bottom third, the professionals assumed very few people would say this. Except that a huge number of very poor people said this, in all settings. In short, the development professionals were totally wrong about what these people thought, which means they don’t understand their mindsets, motivations, etc. Holy crap, folks. This isn’t a near miss. This is I-have-no-idea-what-I-am-talking-about stuff here. These are the error bars on the initial ideas that lead to projects and programs at development donors.
WDR’s frames these findings in pretty stark terms (page 180):
Perhaps the most pressing concern is whether development professionals understand the circumstances in which the beneficiaries of their policies actually live and the beliefs and attitudes that shape their lives.
And their proposed solution is equally pointed (page 190):
For project and program design, development professionals should “eat their own dog food”: that is, they should try to experience firsthand the programs and projects they design.
Yes. Or failing that, they should really start either reading the work of people who can provide that experience for them, or start funding the people who can generate the data that allows for this experience (metaphorically).
On one hand, I am thrilled to see this point in mainstream development conversation. On the other…I said this five years ago, and not that many people cared. Now the World Bank says it…or maybe more to the point, the World Bank says it in terms of behavioral economics, and everyone gets excited. Well, my feelings on this are pretty clear:
- Just putting this in terms of behavioral economics is actually putting the argument out there in the least threatening manner possible, as it is still an argument from economics that preserves that disciplinary perspective’s position of superiority in development
- The things that behavioral economics have been “discovering” about the global poor that anthropology, geography, sociology, and social history have been saying for decades. Further, their analyses generally lack explanatory rigor or anything resembling external validity – see my posts here, here, and here.
Also, the WDR never makes a case for why we should care that we are probably misunderstanding/ misrepresenting the global poor. As a result, this just reads as an extended “oopsie!” piece that needs not be seriously addressed as long as we look a little sheepish – then we can get back to work. But getting this stuff wrong is really, really important – this was the central point of the second half of Delivering Development (a point that Duncan Green unfortunately missed in his review). We can design projects that not only fail to make things better, we can actually make things much worse: we can kill people by accident. We can gum up the global environment, which is not going to only hurt some distant, abstract global poor person – it will hit those in the richest countries, too. We can screw up the global economy, another entity that knows few borders and over which nobody has complete control. This is not “oopsie!” This is a disaster that requires serious attention and redress.
So, good first step World Bank, but not far enough. Delivering Development still goes a lot further than you are willing to now. Delivering Development goes much further than behavioral development economics has gone, or really can go. Time to catch up to the real nature of this problem, and the real challenges it presents. Time to catch up to things I was writing five years ago, before it’s too late.
Wed 11 Jun 2014
So, DfID paid London’s School of Oriental and African Studies (SOAS) more than $1 million to answer a pretty important question: Whether or not Fairtrade certification improves growers’ lives. As has shown up in the media (see here and here)
and around the development blogosphere (here), the headline finding of the report was unexpected: wage workers on Fairtrade-certified sites made less than those working on regular farms. Admittedly, this is a pretty shocking finding, as it undermines the basic premise of Fairtrade.
Edit 12 June: As Matt Collin notes in a comment below, this reading of the study is flawed, as it was not set up to capture the wage effects of Fairtrade. There were no baselines, and without baselines it is impossible to tell if there were improvements in Fairtrade sites – in short, the differences seen in the report could just be pre-existing differences, not a failure of Fairtrade. See the CGDev blog post on this here. So the press’ reading of this report is pretty problematic.
At the same time, this whole discussion completely misses the point. Fairtrade doesn’t work as a development tool because, in the end, Fairtrade does absolutely nothing to address the structural inequalities faced by those in the primary sector of the global economy relative to basically everyone else. Paying an African farmer a higher wage/better price means they are now a slightly wealthier farmer. They are still exposed to environmental shocks like drought and flooding, still tied to shocks and trends in global commodities markets over which they have almost no leverage at all, often still producing commodities (like coffee and cocoa) for which demand is very, very elastic, and in the end still living in states without safety nets to help them weather these economic and environmental shocks. Yes, I think African farmers are stunningly resilient, intelligent people (I write about this a lot). But the convergence of the challenges I just listed means that most farmers in the Global South are addressing one or more of them almost all the time, and the cost of managing these challenges is high (both in terms of hedging and coping). Incremental changes in agricultural incomes will be absorbed, by and large, by these costs – this is not a transformative development pathway.
So why is everyone freaking out at the $1 million dollar finding – even if that finding misrepresents the actual findings of the report? Because it brutally rips the Fairtrade band-aid off the global economy, and strips away any feeling of “doing our part” from those who purchase Fairtrade products. But of course, those of us who purchase Fairtrade products were never doing our part. If anything, we were allowing the shiny idea of better incomes and prices to obscure the structural problems that would always limit the impact of Fairtrade in the lives of the poor.
Wed 26 Mar 2014
Two days ago, World Vision USA announced its willingness to hire LGBT employees who were married. To insiders in the aid and development world, this was a stunning reversal, as World Vision USA’s (legal but problematic) resistance to hiring LGBT employees is well-known in the aid world. Therefore, the decision to openly hire married LGBT staff seemed to signal an important new direction for World Vision…and then today, they reversed themselves.
Jim Beré, Chairman of the World Vision Board, wrote a letter on the reversal.
Today, the World Vision U.S. board publicly reversed its recent decision to change our employment conduct policy. The board acknowledged they made a mistake and chose to revert to our longstanding conduct policy requiring sexual abstinence for all single employees and faithfulness within the Biblical covenant of marriage between a man and a woman.
I have no doubt this change of course is technically legal. World Vision has lawyers, and I’m sure those lawyers were consulted on this reversal. But this public reversal lays bare World Vision USA’s view of the LGBT community, and its hiring practices with regard to that community. Sure, Beré offered the usual, pro-forma support for the LGBT community in his letter:
While World Vision U.S. stands firmly on the biblical view of marriage, we strongly affirm that all people, regardless of their sexual orientation, are created by God and are to be loved and treated with dignity and respect.
However, it is difficult to overlook the fact that this dignity and respect should be extended to everyone except those qualified LGBT individuals who might seek employment at World Vision.
This country was founded on the idea that people are entitled to their religious beliefs. However, it is not OK (morally or legally) to use federal dollars to push one’s religious beliefs on others, or to discriminate against anyone on the basis of that faith. World Vision is one of USAID’s largest cooperators – in simple terms, they implement a hell of a lot of federal money in the context of humanitarian assistance and development programs. Shadrock Roberts, using data from foreignassistance.gov, managed to identify nearly $145 million in money obligated to World Vision in fiscal year 2013. This should be read as an absolute minimum measure of federal money going through World Vision – there are other flows of US dollars that reach World Vision projects indirectly, and I seriously doubt that foreignassistance.gov captures all of the money directly obligated to them.
Let me be clear: in fiscal year 2013, there were at least $145 million taxpayer dollars going to an organization that just openly told the world it will not hire LGBT staff.
While I personally believe that World Vision USA is on the wrong side of history with regard to the issue of LGBT hiring and staff, my (or indeed anyone’s) personal politics are not the big issue here. The Government of the United States implements development projects and delivers humanitarian assistance through “implementers” like World Vision. USAID, USDA, the State Department, etc., do not have enough staff to actually build bridges, dig boreholes, or deliver food aid themselves. Instead, they pay others to do the work. In most places where American development aid and humanitarian assistance is delivered, these actors are effectively the face of the United States.
In the face of this decision on LGBT staff, World Vision USA may no longer be able to credibly act in this capacity. In 2011, the White House issued a Memorandum for the Heads of Executive Departments and Agencies on the subject of “International Initiatives to Advance the Human Rights of Lesbian, Gay, Bisexual, and Transgender Persons.” In that memorandum, President Obama directed “all agencies engaged abroad to ensure that U.S. diplomacy and foreign assistance promote and protect the human rights of LGBT persons.”
How, exactly, is World Vision to credibly support this memorandum after this particular statement about its own hiring?
The short answer: It cannot. The actions of the World Vision USA board speak much, much louder than the very weak claim that the organization feels that the LGBT community should be treated with dignity and respect.
This has real-world implications right now. For example, World Vision has a project, “SPEAR-Incremental funding using FY2012 PEPFAR $2,383,490” (just check Shadrock Roberts’ “USAID Spending on World Vision & World Vision Inc: Fiscal Year 2013” fusion table here). Let’s all remember that Uganda is a country that just last month criminalized homosexuality (those convicted face life in prison), an act that the Obama Administration has punished through shifts in foreign aid away from the Ugandan government and organizations that pushed for this law. Yet we have World Vision, with its clear stance on LGBT hiring, spending $4.8 million federal dollars (some from FY 12, some from FY 13) on an HIV/AIDS project in this country? It seems to me that this muddies the message that the Obama Administration was trying to send.
Legal or not, World Vision’s actions with regard to the hiring of those in the LGBT community have damaged their credibility as an implementer for the government of the United States in any context where the rights of the LGBT community are in question (basically most of the world where development aid and humanitarian assistance is delivered). Further, for USAID and the State Department to continue working with World Vision under these circumstances sends the message that implementers can tap dance around White House directives they might not like or agree with. While World Vision has the right to choose to ignore such directives on the basis of the organization’s religious beliefs, it should not have the right to do so and continue to work with federal dollars.
If the Obama administration is serious about maintaining order among those who work for it, and are serious about furthering the rights of the LGBT community globally, the recent actions of World Vision cannot pass without comment or action. And they do not have to. It’s simple, really: make World Vision choose between the $145 million dollars of taxpayer money that fund its work each year and the individual and organizational donations of those who cannot tolerate or accept the LGBT community.
Thu 6 Mar 2014
Andy Sumner was kind enough to invite me to provide a blog entry/chapter for his forthcoming e-book The Donors’ Dilemma: Emergence, Convergence and the Future of Aid. I decided to use the platform as an opportunity to expand on some of my thoughts on the future of food aid and food security in the context of a changing climate.
My central point:
By failing to understand existing agricultural practices as time-tested parts of complex structures of risk management that include concerns for climate variability, we overestimate the current vulnerability of many agricultural systems to the impacts of climate change, and underestimate the risks we create when we wipe these systems away in favor of “more efficient”, more productive systems meant to address this looming global food crisis.
Why does this matter?
In ignoring existing systems and their logic in the name of addressing a crisis that has not yet arrived, development aid runs a significant risk of undermining the nascent turn toward addressing vulnerability, and building resilience, in the policy and implementation world by unnecessarily increasing the vulnerability of the poorest populations.
The whole post is here, along with a number of other really interesting posts on the future of aid here. Head over and offer your thoughts…
Wed 12 Feb 2014
I just finished reading Geoff Dabelko’s “The Periphery isn’t Peripheral” on Ensia. In this piece, Geoff diagnoses the problems that beset efforts to address linked environmental and development problems, and offers some thoughts on how to address them. I love his typology of tyrannies that beset efforts to build and implement good, integrative (i.e. cross-sectoral) programs. I agreed with his suggestions on how to make integrative work more acceptable/mainstream in development. And by the end, I was worried about how to make his suggestions reality within the donors and implementers that really need to take on this message.
Geoff’s four tyrannies (Tyranny of the Inbox; Tyranny of Immediate Results; Tyranny of the Single Sector; Tyranny of the Unidimensional Measurement of Success) that he sees crippling environment-and-development programming are dead on. Those of us working in climate change are especially sensitive to tyranny #2, the Tyranny of Immediate Results. How the hell are we supposed to demonstrate results on an adaptation program that is meant to address challenges that are not just happening now, but will intensify over a 30 year horizon? Does our inability to see the future mean that this programming is inherently useless or inefficient? No. But because it is impossible to measure future impact now, adaptation programs are easy to attack…
As a geographer, I love Geoff’s “Tyranny of the Single Sector” – geographers generally cannot help but start integrating things across sectors (that’s what our discipline does, really). In my experiences in the classroom and the donor world, integrative thinking eludes a lot more people than I ever thought possible. Our absurd system of performance measurement in public education is not helping – trust me. But even when you find an integrative thinker, they may not be doing much integrative work. Sometimes people simply can’t see outside their own training and expertise. Sometimes they are victims of tyranny #1 (Tyranny of the Inbox), where they are too busy dealing with immediate challenges within their sector to think across sectors – lord knows, that defined the last 6 months of my life at USAID.
And Geoff’s fourth tyranny speaks right to my post from the other day – the Tyranny of the Unidimensional Measurement of Success. Read Geoff, and then read my post, and you will see why he and I get along so well.
Now, Geoff does not stop with a diagnosis – he suggests that integrative thinking in development will require some changes to how we do our jobs, and provides some illustrations of integrative projects that have produced better results to bolster his argument. While I like all of his suggestions, what concerns me is that these suggestions are easier said than done. For example, Geoff is dead right when he says that:
We must reward, rather than punish, cross-disciplinary or cross-sectoral approaches; define success in a way that encourages, rather than discourages, positive outcomes in multiple arenas; and foster monitoring and evaluation plans that embrace, rather than ignore, different timescales and multiple indicators.”
But how, exactly, are we to do this? What HR levers exist that we can use to make this happen? How much leeway do appointees and other executive-level donor staff have with regard to changing rewards and evaluations? And are the right people in charge to make such changes possible? A lot of people rise through donor organizations by being very good at sectoral work. Why would they reward people for doing things differently?
Similarly, I wonder how we can actually get more long-term thinking built into the practice and implementation of development. How do we really overcome the Tyranny of the Inbox, and the Tyranny of Immediate Results? This is not merely a mindset problem, this is a problem of budget justifications to an often-hostile congress that wants to know what you have done for them lately. Where are our congressional champions to make this sort of change possible?
Asking Geoff to fix all our problems in a single bit of writing is completely unfair. That is the Tyranny of What do We do Now? In the best tradition of academic/policy writing, his piece got me thinking (constructively) about what needs to happen if we are to do a better job of achieving something that looks like sustainable development going forward. For that reason alone it is well worth your time. Go read.
Mon 10 Feb 2014
I’m a big fan of accountability when it comes to aid and development. We should be asking if our interventions have impact, and identifying interventions that are effective means of addressing particular development challenges. Of course, this is a bit like arguing for clean air and clean water. Seriously, who’s going to argue for dirtier water or air. Who really argues for ineffective aid and development spending?
More often than not, discussions of accountability and impact serve only to inflate narrow differences in approach, emphasis, or opinion into full on “good guys”/ “bad guys” arguments, where the “bad guys” are somehow against evaluation, hostile to the effective use of aid dollars, and indeed actively out to hurt the global poor. This serves nothing but particular cults of personality and, in my opinion, serves to squash out really important problems with the accountability/impact agenda in development. And there are major problems with this agenda as it is currently framed – around the belief that we have proven means of measuring what works and how, if only we would just apply those tools.
When we start from this as a foundation, the accountability discussion is narrowed to a rather tepid debate about the application of the right tools to select the right programs. If all we are really talking about are tools, any skepticism toward efforts to account for the impact of aid projects and dollars is easily labeled an exercise in obfuscation, a refusal to “learn what works,” or an example of organizations and individuals captured by their own intellectual inertia. In narrowing the debate to an argument about the willingness of individuals and organizations to apply these tools to their projects, we are closing off discussion of a critical problem in development: we don’t actually know exactly what we are trying to measure.
Look, you can (fairly easily) measure the intended impact of a given project or program if you set things up for monitoring and evaluation at the outset. Hell, with enough time and money, we can often piece enough data together to do a decent post-hoc evaluation. But both cases assume two things:
1) The project correctly identified the challenge at hand, and the intervention was actually foundational/central to the needs of the people at hand.
This is a pretty weak assumption. I filled up a book arguing that a lot of the things that we assume about life for the global poor are incorrect, and therefore that many of our fundamental assumptions about how to address the needs of the global poor are incorrect. And when much of what we do in development is based on assumptions about people we’ve never met and places we’ve never visited, it is likely that many projects which achieve their intended outcomes are actually doing relatively little for their target populations.
Bad news: this is pretty consistent with the findings of a really large academic literature on development. This is why HURDL focuses so heavily on the implementation of a research approach that defines the challenges of the population as part of its initial fieldwork, and continually revisits and revises those challenges as it sorts out the distinct and differentiated vulnerabilities (for explanation of those terms, see page one of here or here) experienced by various segments of the population.
Simply evaluating a portfolio of projects in terms of their stated goals serves to close off the project cycle into an ever more hermetically-sealed, self-referential world in which the needs of the target population recede ever further from design, monitoring, and evaluation. Sure, by introducing that drought-tolerant strain of millet to the region, you helped create a stable source of household food that guards against the impact of climate variability. This project could record high levels of variety uptake, large numbers of farmers trained on the growth of that variety, and even improved annual yields during slight downturns in rain. By all normal project metrics, it would be a success. But if the biggest problem in the area was finding adequate water for household livestock, that millet crop isn’t much good, and may well fail in the first truly dry season because men cannot tend their fields when they have to migrate with their animals in search of water. Thus, the project achieved its goal of making agriculture more “climate smart,” but failed to actually address the main problem in the area. Project indicators will likely capture the first half of the previous scenario, and totally miss the second half (especially if that really dry year comes after the project cycle is over).
2) The intended impact was the only impact of the intervention.
If all that we are evaluating is the achievement of the expected goals of a project, we fail to capture the wider set of impacts that any intervention into a complex system will produce. So, for example, an organization might install a borehole in a village in an effort to introduce safe drinking water and therefore lower rates of morbidity associated with water-borne illness. Because this is the goal of the project, monitoring and evaluation will center on identifying who uses the borehole, and their water-borne illness outcomes. And if this intervention fails to lower rates of water-borne illness among borehole users, perhaps because post-pump sanitation issues remain unresolved by this intervention, monitoring and evaluation efforts will likely grade the intervention a failure.
Sure, that new borehole might not have resulted in lowered morbidity from water-borne illness. But what if it radically reduced the amount of time women spent gathering water, time they now spend on their own economic activities and education…efforts that, in the long term, produced improved household sanitation practices that ended up achieving the original goal of the borehole in an indirect manner? In this case, is the borehole a failure? Well, in one sense, yes – it did not produce the intended outcome in the intended timeframe. But in another sense, it had a constructive impact on the community that, in the much longer term, produced the desired outcome in a manner that is no longer dependent on infrastructure. Calling that a failure is nonsensical.
Nearly every conversation I see about aid accountability and impact suffers from one or both of these problems. These are easy mistakes to make if we assume that we have 1) correctly identified the challenges that we should address and 2) we know how best to address those challenges. When these assumptions don’t hold up under scrutiny (which is often), we need to rethink what it means to be accountable with aid dollars, and how we identify the impact we do (or do not) have.
What am I getting at? I think we are at a point where we must reframe development interventions away from known technical or social “fixes” for known problems to catalysts for change that populations can build upon in locally appropriate, but often unpredictable, ways. The former framing of development is the technocrats’ dream, beautifully embodied in the (failing) Millennium Village Project, just the latest incarnation of Mitchell’s Rule of Experts or Easterly’s White Man’s Burden. The latter requires a radical embrace of complexity and uncertainty that I suspect Ben Ramalingan might support (I’m not sure how Owen Barder would feel about this). I think the real conversation in aid/development accountability and impact is about how to think about these concepts in the context of chaotic, complex systems.
Tue 4 Feb 2014
Since returning to academia in August of 2012, I’ve been pretty swamped. Those who follow this blog, or my twitter feed, know that my rate of posting has been way, way down. It’s not that I got bored with social media, or tired of talking about development, humanitarian assistance, and environmental change. I’ve just been swamped. The transition back to academia took much more out of me than I expected, and I took on far, far too much work. The result – a lot of lost sleep, and a lapsed social media profile in the virtual world, and a lapsed social life in the real world.
One of the things I’ve been working on is getting and organizing enough support around here to do everything I’m supposed to be doing – that means getting grad students and (coming soon) a research associate/postdoc to help out. Well, we’re about 75% of the way there, and if I wait for 100% I’ll probably never get to introduce you all to HURDL…
HURDL is the Humanitarian Response and Development Lab here at the Department of Geography at the University of South Carolina. It’s also a less-than-subtle wink at my previous career in track and field. HURDL is the academic home for me and several (very smart) grad students, and the institution managing about five different workflows for different donors and implementers. Basically, we are the qualitative/social science research team for a series of different projects that range from policy development to project design and implementation. Sometimes we are doing traditional academic research. Mostly, we do hybrid work that combines primary research with policy and/or implementation needs. I’m not going to go into huge detail here, because we finally have a lab website up. The site includes pages for our personnel, our projects, our lab-related publications, and some media (still under development). We’ll need to put up a news feed and likely a listing of the talks we give in different places.
Have a look around. I think you’ll have a sense of why I’ve been in a social media cave for a while. Luckily, I am surrounded by really smart, dedicated people, and am in a position to add at least one more staff position soon, so I might actually be back on the blog (and sleeping more than 6 hours a night) again soon!
Let us know what you think – this is just a first cut at the page. We’d love suggestions, comments, whatever you have – we want this to be an effective page, and a digital ambassador for our work…