SDGs in need of rescue: so, what do we do?

If you’ve been following my SDG posts (here and here), you are probably at the point of asking what exactly we should be doing about them. Fair enough. I’ve burned two blog posts and about 2000 words on the problems I see with the new SDGs. As I tell my students, it doesn’t take a lot of talent to dismantle something. You have to tear it down and put something new in its place. So, in this spirit, my suggestions for how to get out of the ditch that the SDGs appear to currently occupy are threefold:

  1. Engage the donors now, not later. Start this process by narrowing the indicators, targets, and goals, and ensuring that the goals are actually achievable
  2. Engage the climate negotiations. The flows of money under the likely climate agreement are huge, and will impact all development goals, therefore impacting the achievement of the SDGs. Further, donors are already engaged on the climate negotiations, so linking the SDGs to those negotiations will likely increase donor interest in the SDG process.
  3. Engage the implementers. If you want to productively reduce the number of indicators, targets, and goals, talk to the people who will have to take the money and achieve those goals. By working with implementers, the SDG process could reduce all of these indicators, targets, and goals (thus driving donors to the table) while ensuring that whatever emerges from the process is actually achievable

1. Engage the donors:

A few caveats from my Wilton Park experience:

1) I know that if we are going to get “beyond aid” and start thinking about innovative partnerships for development, we are going to have to get past the donor-recipient binary. However, refusing to call a spade a spade doesn’t make change happen. The fact is that USAID, DfID, GIZ, JICA, and all the other bilateral organizations are, more or less, donors. So is the World Bank. So we can call them “development partners” all we want, but they will still behave like donors (making plans, issuing edicts, programming on institutional/national interests instead of beneficiary interests, etc.) – behavior change takes a long time. Remember, many bilateral donors already call themselves “Cooperation” organizations (e.g. Spanish Cooperation, Swiss Cooperation)…but they still behave like donors.

2) The flows of development aid are, in many places, already dwarfed by flows of foreign direct investment and other flows of money. In some contexts, remittances may well be as important as formal aid. So we shouldn’t over-privilege donors or their aid funds in this conversation. Indeed, it is the declining power of aid dollars that has spurred the “beyond aid” conversation in the post-2015 agenda.

All that said, much of the politics of development still flow through development donors/partners, and this is not going to change before the SDGs are formalized. I’ve heard a bit of grumbling about traditional donor organizations’ lack of serious engagement with the SDG process. I have little time for this, as nobody should find this lack of engagement surprising. As I said in my first post, a set of goals that allows everyone to evade responsibility, and enables practically everything currently implemented under the heading “development”, is not going to get a response from the donors. If the process won’t have any effect on what they do, why should they care?

Some might see this lack of engagement as a good thing, an opportunity to craft a development agenda outside the agendas of the donors. I disagree with this strongly. The donors will eventually engage, especially if the SDGs move toward formal commitments. Such commitments might create responsibilities and constraints on actions and agendas – at which point, the donors will engage to shape the agenda to their interests. Because the SDG process has churned along without the donors to this point, the current indicators, targets, and goals are likely not well-aligned with donor interests. Without suggesting that donor interests are necessarily good, remember that the politics of development and aid still flow through these organizations, and when they engage they will have one of two effects: they will either heavily reshape the SDGs to their interests, or they will marginalize the entire process to the point of irrelevance. In either case, those running the SDG process will find themselves in a reactive position, and will lose control of the process. If the SDGs are to be more than what donors already want and do, the process must engage the donors now.

How do we engage the donors? One way is to reduce the absurd number of indicators, targets, and goals. Once you start taking away the ability to justify everything, donors are going to have to start looking at these goals and their own portfolios. Where there are mismatches, the donors are likely to engage. Another way is to carefully review the targets and goals and ensure that all could be achieved in the next 15 years with reasonable ambition. This will create a situation where accountability for their achievement becomes important, which likely drives the donors to the table. Getting the donors to the table now means there will be time to negotiate with them to develop a set of workable SDGs. Waiting until the last minute will either subvert what has, to this point, been a very open process as the SDGs are heavily reworked or even shunted into irrelevance at the 11th hour in negotiations.

2. Engage the UNFCCC negotiation process

While the development community has two big processes coming to the fore this year (the Third Conference on Financing for Development and the SDGs), there is a third, and arguably far more important, process coming to a head: the climate negotiations under the UNFCCC. By the Paris Conference of the Parties in December, I fully expect that there will be a deal on the table that discusses transfers of funds from rich to poor countries that will broadly 1) enable adaptation to ongoing climate change impacts and 2) facilitate the development of these countries through low-greenhouse emission pathways. The amounts of money on the table are likely to rival, if not displace, formal development aid, and they will be used to address issues that development aid traditionally covered. Yet the SDGs do not meaningfully engage with the likely outcomes of this process. Yes, proposed SDG 13 demands we “Tackle climate change and its impacts” and that goal recognizes the size of financial flows likely to emerge from the upcoming climate deal ($100 billion per year at a minimum, which would rival all of formal development aid). But simply acknowledging that there will be a climate deal with a lot of money attached doesn’t align the SDGs with that money. These flows of money will likely impact every SDG – indeed, we should expect them to. A climate deal that moves funds to the poorer countries is two things: an acknowledgement that climate change impacts will likely inhibit their efforts to improve the quality of life of their citizens and residents, and a recognition that the climate change impacts of their development could become problems for even the wealthy countries.

Because climate funds will engage development issues and goals, they are going to create attribution problems and therefore further responsibility problems for the SDGs. For example, if exposure to increasingly variable precipitation is a significant challenge for a group of rain-fed agriculturalists who find themselves in a challenging financial situation, and the funds from the climate deal help to provide seasonal forecasts that alleviate some of this stress, will the SDGs get to claim victory for the increased yields and incomes that result? Or will the climate negotiators get to use this case as an example of why a climate deal was a good idea? Worse, if these funds don’t actually result in constructive changes to the lives of the poorest and most vulnerable, who will be to blame?

Engaging the climate negotiations would also help to bring the donors to the table, as the donors and their national governments are already engaged on the climate negotiation process. Linking the SDGs to this process 1) creates a more realistic view of how these goals will be funded and achieved and 2) will likely drive the donors to the SDG table to ensure the SDGs are aligned with the climate agreement.

3. Engage the implementation community:

It is pretty obvious that these goals were written in a policy context that lacked significant input from anyone who would have to achieve these goals. Nearly all of my critiques in the previous two posts were based in the practical challenges these goals would present for implementation: the lack of responsibility for their achievement, the enabling of a huge range of actions under what masquerades as a focused set of goals, and the creation of goals that potentially undermine each other are all apparent when you’ve spent time building programs to actually achieve these goals, or had to execute the work under those programs. If you want goals that are either aspirational or focusing, you need to incorporate a lot of feedback from the implementation community.

Engaging the implementation community could serve as a means of narrowing the indicators, targets, and goals as I suggested is necessary to get donors to the table. It would kill two birds with one stone – it would get us a set of achievable, interesting SDGs while forcing donors to engage with the process before the 11th hour.

Save the SDGs!

There is still time to break the SDGs out of the multilateral bubble in which they were constructed and make this a proactive process that can bring together the many important trends reshaping development today (climate change negotiations, new flows of investment, etc.) into a coherent program that gives us targets to aim for, and a reasonable focus for development going forward. The three steps above would go a long way toward this end. I hope to see something like this start very soon.

SDGs in need of rescue: Part 2

In my last post, I laid out the first of my concerns with the evolving Sustainable Development Goals. As I said, I think most of these goals fall into one of three categories: the impossible, the vague, and the “sounds good, but on second thought”. Having covered the impossible, I now turn my attention to the remaining two categories and why they are problematic:

The vague:

Goal 6. Ensure availability and sustainable management of water and sanitation for all

Goal 12. Ensure sustainable consumption and production patterns

What does it mean to ensure the availability of water and sanitation? That everyone actually gets to use it, or just that the facilities are available where you live? This is an open question, because Goal 6 says availability (water and sanitation is present), not access (you can get water and adequate sanitation, no matter your circumstances). The former requires one set of values with regard to public services (i.e. water as a privatizable commodity that might be subject to efficiency gains if privatized), while the latter evokes a completely different set of concerns (i.e. water as a human right). By using the word availability, Goal 6 enables everything from the free delivery of water to all citizens to the complete privatization of a water system, as long as under both scenarios some form of water delivery is present for all users. Achievement of availability doesn’t speak to pricing or other factors that might enable or constrain the ability to access water. Basically, you can justify both actions as ensuring availability and therefore meeting an SDG even though these actions would likely result in wildly disparate outcomes for the affected population – including reduced access to water, even as it becomes more available.

How, under Goal 12, will we ensure sustainable consumption patterns? For example, are we promoting revolutions in energy production that will lower the cost of recycling, or are we arguing for massive social change in the wealthiest countries that would result in reduced consumption among the world’s rich populations? None of the proposed indicators suggest the latter, but simply cleaning up our energy supply is not going to create a sustainable pattern of consumption in a world that may well already be in ecological overshoot due to a wide range of resource consumption issues.

Vague goals that enable virtually all possible actions, or actions that really don’t do much to address the real problem the goal is meant to address (i.e. ecological overshoot under Goal 12) are not goals. They are slogans that neither motivate action nor focus effort, making the outcomes we want (greater access to necessary water, a planet we can live on indefinitely but in greater prosperity) disappear. This is worse than no goal at all.

 

The “Sounds good, but on second thought…”

Goal 8. Promote sustained, inclusive and sustainable economic growth, full and productive employment and decent work for all

Goal 10. Reduce inequality within and among countries

Reading that I have objections to Goals like 8 and 10, you can be forgiven if (at least momentarily) you think that I am a huge jerk, but hear me out. Personally, I think that promoting decent and productive livelihoods is a critical part of improving the quality of life for people, whether they live in rich or poor countries. And there can be little doubt that high levels of inequality have deleterious effects on economic growth, and raise major issues of justice. But this does not mean that these goals are necessarily great ideas.

First, promoting sustained, inclusive, and sustainable economic growth…is basically impossible under existing energy and resource regimes. As the global economy has grown over the past few decades, and growth has taken off in a number of formerly low-income countries, we’ve seen a colossal expansion in consumption that strains our climate and our resource base. Continued economic growth, at least in the near future, will drive greater greenhouse emissions and increased drawdowns of non-renewable natural resources. In short, Goal 8 sort of fits into my first grouping of SDGs (“the impossible”) but is in some ways even more dangerous because its framing suggests that we can have our cake (economic growth) and eat it too (sustainability). We cannot, at least not right now. Instead, pushing for sustained economic growth that brings full and productive employment and decent work for all will make the achievement of Goal 6 (Ensure availability and sustainable management of water and sanitation for all), Goal 11 (Make cities and human settlements inclusive, safe, resilient and sustainable), Goal 12 (Ensure sustainable consumption and production patterns), Goal 13 (Take urgent action to combat climate change and its impacts), Goal 14 (Conserve and sustainably use the oceans, seas and marine resources for sustainable development), and Goal 15 (Protect, restore and promote sustainable use of terrestrial ecosystems, sustainably manage forests, combat desertification, and halt and reverse land degradation and halt biodiversity loss) very difficult, if not impossible.

And what of Goal 10? Well, there is a real question to be asked here: when is inequality bad, and when might it help us achieve development goals? At the national scale, it does appear that inequality can become a drag on economic growth (see Piketty’s Capital in the Twenty-First Century – and before you ask, yes, I actually read the damn thing). But what of situations at different scales, where inequality might present a temporary path to economic improvement for many? For example, at the scale of a very poor community in the Sahel, actions that enrich a relatively small, already rich portion of the population might enhance inequality in the village. However, if those wealthy members of the community accumulate assets that they are obligated to share under local social expectations (for example, cattle that can be used as traction in farming), such accumulation might improve the agricultural productivity and incomes of many in the community (by enhancing access to animal traction) until such time as those poorer members of the community can accumulate their own assets. If such a pattern were to take hold across a relatively poor country such as Mali or Burkina Faso, it could manifest in national statistics as an increase in economic inequality that, under this goal, should be ended. Until we understand the different causes of inequality, and their consequences, perhaps we should wait to see what it is we are trying to address and when it is appropriate to do so.

In short, the achievement of this last group of goals might serve to blow up our efforts to achieve other goals. Development has a penchant for stovepiping activities into sectors and goals. Further, there is no way any single donor/partner is going to cover all 17 goals under their portfolio. What this means is that individuals working on one goal may not have any idea what their efforts are doing to other goals. Further, if those other goals are owned by different organizations, there may not be any means for or incentives that lead to coordination across these goals. Organizations and individuals will respond to the tasks and measures in front of them first, and worry about the collateral damage later.

In summary, proposing goals that are so vague as to encompass every possible outcome of activities under a broad heading, or creating goals that might, if achieved, undermine other goals, is not moving us into a “beyond aid” world. They are not moving us anywhere except to more of the same work that development and aid have been doing for decades, and which has given us little we might call transformational.

 

But it doesn’t have to be this way.

 

Next: What is the way forward?

SDGs in need of rescue: Part 1

Last week I was fortunate enough to spend a few days at Wisford House for a Wilton Park conference “Beyond aid: innovative governance, financing and partnerships for the post-2015 agenda.” The meeting emphasized thinking beyond aid, to the ways in which aid funds can leverage other, larger flows of money (i.e. private capital) in manners that speed or transform ongoing changes among the world’s poor. In short, it was a meeting that embraced a shift from aid as “fixing things for poor people” to aid as “catalyzing and accelerating what people are already doing to create faster, more impactful outcomes.” The question, of course, is exactly how to shift aid fully into the latter role in the context of the third Conference on Financing for Development coming up in July, and the ongoing development of Sustainable Development Goals that should conclude in 2015.

As the conference kicked off with a discussion of the new SDGs, Charles Kenny serendipitously tweeted out their current structure:

Kenny tweet

Just as I started to freak out (as did Simon Maxwell, who was seated next to me and saw the tweet at about the same time), Charles followed up:

Gross national happiness

So, 303 indicators (several of which are actually unmeasurable in the usual indicator sense) feeding into 169 targets which speak to progress toward 17 goals (Charles was off by one). My first reaction, which I shared with the conference, was that this structure was useless, either as a set of focusing goals or as a set of aspirational targets.

First, these do nothing to focus us. With 303 indicators aimed at 169 targets, any reasonably talented program officer should be able to reverse justify any and all existing programming under this structure. Were I still advising a presidential appointee at USAID, and they asked me about the SDGs, I would tell them not to worry about it as there is nothing in this structure that constrains anything that the Agency does.

Second, these goals don’t feel aspirational – but this is for a variety of reasons that I can lump into three categories: the impossible, the vague, and the “sounds good, but on second thought”. Over the next few posts, I will lay out what I mean with examples of each category. Today, I focus on…

The impossible

Goal 1. End poverty in all its forms everywhere

Goal 2. End hunger, achieve food security and improved nutrition, and promote sustainable agriculture

Goal 5. Achieve gender equality and empower all women and girls

Let’s just get something on the table right away: None of these goals is going to be achieved by 2030. First, “poverty” is a pretty vague term that means much more than income. While the indicators proposed under Goal 1 certainly recognize a complex understanding of poverty, including income, access to productive resources, social protection, and exposure to shocks and stresses, the ways in which these different factors align to produce “poverty” depends greatly on where you are. As a result, there are many “poverties” in many places. Therefore, it is not clear to me how a broad set of indicators will tell us if we have succeeded in eradicating poverty in a particular place.

Goal 2, ending hunger, is easier to measure as an outcome, but very difficult to measure as a process (as most determinants of food security are social, and we have very weak data on these processes in most parts of the world). The indicators don’t tell us where to intervene, or how we will know when “hunger” has been ended. Given 49.1 million Americans lived in food insecure households in 2013, it seems extraordinarily unlikely we will be able to meet this goal globally.

And Goal 5… we’re not even close to gender equity here in the United States, but somehow we are going to fix this globally in 15 years? Folks, gender relations and equality are issues that take a minimum of three generations to address – and that would be extraordinarily rapid change. 15 years is about one generation.

It is not that I hate (or even dislike) aspirational goals. However, goals should be achievable and actionable so we can hold people accountable for their achievement. None of these three goals meets either criteria. Can we make significant progress on addressing some components of poverty in the next 15 years? Yes. Can we reduce food insecurity in both rich and poor countries? Yes. Can we make some movement on the status of women and girls in both rich and poor countries? Yes. And we should work toward all three, but with ambitious but achievable targets. If the goals are achievable, then we can hold someone accountable for any shortfalls in 2030. Accountability fosters action. Right now, nobody will be held accountable when we fall short, because in 2030 whoever is still around will (rightly) point out that these were always unachievable, and therefore it is nobody’s fault that we did not meet these goals.

So, I dislike impossible goals because they strip away responsibility for their achievement. If these were ambitious but achievable, it might force those of us in the aid world to think more carefully about how we are going to leverage other sources of funding, other trends already taking place in many parts of the world (declining fertility, rising incomes, etc.), and build on existing knowledge and capacity among the global poor to ensure we reached these goals. In short, impossible goals do nothing to move us beyond aid – they just maintain the status quo.

Co-production: The next “participation”?

Those of you who’ve read this blog before know that I have a lot of issues with “technology-will-fix-it” approaches to development program and project design (what Evgeny Morozov calls “solutionism”). My main issue is that such approaches generally don’t work. Despite a very, very long history of such interventions and their outcomes demonstrating this point, the solutionist camp in development seems to grow stronger all the time. If I hear one more person tell me that mobile phones are going to fix [insert development challenge here], I am going to scream. And don’t even get me started about “apps for development,” which is really just a modified incarnation of “mobile phones will fix it” predicated on the proliferation of smartphones around the world. Both arguments, by the way, were on full display at the Conference on the Gender Dimensions of Weather and Climate Services I attended at the WMO last month. Then again, so were really outdated framings of gender. Perhaps this convergence of solutionism and reductionist framings of social difference means something about both sets of ideas, no?

At the moment I’m particularly concerned about the solutionist tendency in weather and climate services for development. At this point, I don’t think there is anything controversial in arguing that the bulk of services in play today were designed by climate scientists/information providers who operated with the assumption that information – any information – is at least somewhat useful to whoever gets it, and must be better than leaving people without any information. With this sort of an assumption guiding service development, it is understandable that nobody would have thought to engage the presumptive users of the service. First, it’s easy to see how some might have argued that the science of the climate is the science of the climate – so citizen engagement cannot contribute much to that. Second, while few people might want to admit this openly, the fact is that climate-related work in the Global South, like much development work, carries with it an implicit bias against the capabilities and intelligence of the (often rural and poor) populations they are meant to serve. The good news is that I have seen a major turn in this field over the past four years, as more and more people working in this area have come to realize that the simple creation and provision of information is not enough to ensure any sort of impact on the lives of presumptive end-users of the information – the report I edited on the Mali Meteorological Service’s Agrometeorological Advisory Program is Exhibit A at the moment.

So, for the first time, I see climate service providers trying to pay serious attention to the needs of the populations they are targeting with their programs. One of the potentially important ideas I see emerging in this vein is that of “co-production”: the design and implementation of climate services that involves the engagement of both providers and a wide range of users, including the presumptive end users of the services. The idea is simple: if a meteorological service wants to provide information that might meet the needs of some/all of the citizens it serves, that service should engage those citizens – both as individuals and via the various civil society organizations to which they might belong – in the process of identifying what information is needed, and how it might best be delivered.

So what’s the problem? Simple: While I think that most people calling for the co-production of climate services recognize that this will be a complex, fraught process, there is a serious risk that co-production could be picked up by less-informed actors and used as a means of pushing aside the need for serious social scientific work on the presumptive users of these services. It’s pretty easy to argue that if we are incorporating their views and ideas into the design of climate services, there is really no need for serious social scientific engagement with these populations, as co-production cuts out the social-science middleman and gets us the unmitigated, unfiltered voice of the user.

If this sounds insanely naïve to you, it is*. But it is also going to be very, very attractive to at least some in the climate services world. Good social science takes time and money (though nowhere near as much time or money as most people think). And cutting time and cost out of project design, including M&E design, speeds implementation. The pressure to cut out serious field research is, and will remain, strong. Further, the bulk of the climate services community is on the provider side. They’ve not spent much, if any, time engaging with end users, and generally have no training at all in social science. All of those lessons that the social sciences have learned about participatory development and its pitfalls (for a fantastic overview, read this) have not yet become common conversation in climate services. Instead, co-production sounds like a wonderful tweak to the solutionist mentality that dominates climate services, a change that does not challenge the current framings of the use and utility of information, or the ways in which most providers do business. Instead, you keep doing what you do, but you talk to the end users while you do it, which will result in better project outcomes.

But for co-production to replace the need for deep social scientific engagement with the users of climate services, certain conditions must be met. First of all, you have to figure out how, exactly you are going to actually incorporate user information, knowledge, and needs into the design and delivery of a climate service. This isn’t just a matter of a few workshops – how, exactly, are those operating in a nomothetic scientific paradigm supposed to engage and meaningfully incorporate knowledge from very different epistemological framings of the world? This issue, by itself, is generating significant literature…which mostly suggests this sort of engagement is really hard. So, until we’ve worked out that issue, co-production looks a bit like this:

Climate science + end user input => Then a miracle happens => successful project

That, folks, is no way to design a project. Oh, but it gets better. You see, the equation above presumes there is a “generic user” out there that can be engaged in a straightforward manner, and for whom information works in the same manner. Of course, there is no such thing – even within a household, there are often many potential users of climate information in their decision-making. They may undertake different livelihoods activities that are differently vulnerable to particular impacts of climate variability and change. They may have very different capacities to act on information – after all, when you don’t own a plow or have the right to use the family plow, it is very difficult to act on a seasonal agricultural advisory that tells you to plant right away. Climate services need serious social science, and social scientists, to figure out who the end users are – to move past presumption to empirical analysis – and what their different needs might be. Without such work, the above equation really looks more like:

Climate science => Then a miracle happens => you identify appropriate end users => end user input => Then another miracle happens => successful project

Yep, two miracles have to happen if you want to use co-production to replace serious social scientific engagement with the intended users of climate services. So, who wants to take a flyer with some funding and see how that goes? Feel free to read the Mali report referenced above if you’d like to find out**.

Co-production is a great idea – and one I strongly support. But it will be very hard, and it will not speed up the process of climate service design or implementation, nor will it allow for the cutting of corners in other parts of the design process. Co-production will only work in the context of deep understandings of the targeted users of a given service, to understand who we should be co-producing with, and for what purpose. HURDL continues to work on this issue in Mali, Senegal, and Zambia – watch this space in the months ahead.

 

 

*Actually, it doesn’t matter how it sounds: this is a very naïve assumption regardless.

** Spoiler: not so well. To be fair to the folks in Mali, their program was designed as an emergency measure, not a research or development program, and so they rushed things out to the field making a lot of assumptions under pressure.

Letters Left Unsent: Prospective Aidworkers Must-Read

A very long time ago, J asked me to review his book Letters Left Unsent. I’ve long been a fan of J’s writing on his blog Tales from the Hood, and have had the fortune to meet him, hang out, and develop what passes for a friendship in an era where people living on different coasts, and constantly on the move, can stay in touch through various electronic means. All this by way of saying that this will hardly be an impartial review.

So, here is my one sentence review: If you are interested in going into development/humanitarian work, or know someone who is, you need to get a copy of this book and read it/give it to them.

This is not to say that you will enjoy every message in the book – actually, you or your prospective aidworker will likely hate whole chunks of it. The reason for this is simple: the book is hard – really hard. It’s not the prose, which is actually quite fluid. It is the content. The book contains some of J’s most unvarnished stories and writing, work that strips away the romance of the job, exposing it as just that: a job. In chapter after chapter, J demonstrates that development and relief work is a very important, rewarding job, but sometimes a job where the biggest impacts come not from handing some poor soul food, but in getting a spreadsheet right or from attending the right meeting. Further, these lessons are not delivered in a detached, objective manner that can be easily forgotten, but through personal stories that emerge as J points the keyboard at himself and his own experiences. This is no casting of stones at unnamed, straw-man others (something the world could use much less of). It is, at times, a brutal first-person account of the compromises, decisions, crises, frustrations, and rewards that this career brings.

To be fair, there are personal reasons why this book challenged me. First, I know J personally. This means that I know how seriously he takes this job, how hard he works, and how much he believes in what he does. This means I cannot dismiss this book as the work of a cynic or an anti-aid crank, and therefore when the stories and their lessons hurt, there is no easy escape route. Second, some of these stories hit pretty close to home. J and I live in pretty different parts of the aid world. I’ve spent the bulk of my career as an academic, with a brief stint as the employee of a donor. I don’t live for or between deployments, and I never really have. But I’ve been in donor coordination meetings for a major crisis (the 2011 Horn of Africa famine), and in reading this book, I was transported to days of watching terribly difficult decisions get made, measuring the toll the crisis took on people around me – and I still consider those experiences to be some of the tougher ones in my career. At the same time, I’ve spent an awful lot of time conducting fieldwork. In my early days as an academic, I would disappear into villages for months on end. In the pre-cellphone era, this tended to have a deleterious effect on my personal life. Some of the collateral damage from such travel that J describes marks my own personal history. In this book, I heard the echoes of some my own decisions, and my own consequences…

So, I am not J. But I know J, both in the sense that I know the author, and I know many of those in this field for whom he writes. From my perspective, his stories ring true, and the lessons they present are real. And I have my own reasons for feeling challenged by this book, but I suspect most aidworkers would experience similar feelings as they recognize themselves in this book. In the end, my personal biases and feelings don’t change what I think is the value of this book. It is an important illustration of the development/aid worker’s life that does not resort to pieties or broad brushes. Instead, it wrestles with the ambiguities of live in this career. Development work is hard. Humanitarian assistance is hard. It is thrilling and appallingly mundane. It’s malaria and spreadsheets. Mostly spreadsheets. We succeed. We fail. We keep going, trying to learn from both. But if you are headed into this field, into this career, you are headed where J has been. Only fools ignore history, even if it is not their own. Only a very foolish prospective aidworker will ignore this book.

Fairtrade never worked. Why is everyone so excited now?

So, DfID paid London’s School of Oriental and African Studies (SOAS) more than $1 million to answer a pretty important question: Whether or not Fairtrade certification improves growers’ lives. As has shown up in the media (see here and hereand around the development blogosphere (here), the headline finding of the report was unexpected: wage workers on Fairtrade-certified sites made less than those working on regular farms. Admittedly, this is a pretty shocking finding, as it undermines the basic premise of Fairtrade.

Edit 12 June: As Matt Collin notes in a comment below, this reading of the study is flawed, as it was not set up to capture the wage effects of Fairtrade. There were no baselines, and without baselines it is impossible to tell if there were improvements in Fairtrade sites – in short, the differences seen in the report could just be pre-existing differences, not a failure of Fairtrade. See the CGDev blog post on this here. So the press’ reading of this report is pretty problematic.

At the same time, this whole discussion completely misses the point. Fairtrade doesn’t work as a development tool because, in the end, Fairtrade does absolutely nothing to address the structural inequalities faced by those in the primary sector of the global economy relative to basically everyone else. Paying an African farmer a higher wage/better price means they are now a slightly wealthier farmer. They are still exposed to environmental shocks like drought and flooding, still tied to shocks and trends in global commodities markets over which they have almost no leverage at all, often still producing commodities (like coffee and cocoa) for which demand is very, very elastic, and in the end still living in states without safety nets to help them weather these economic and environmental shocks. Yes, I think African farmers are stunningly resilient, intelligent people (I write about this a lot). But the convergence of the challenges I just listed means that most farmers in the Global South are addressing one or more of them almost all the time, and the cost of managing these challenges is high (both in terms of hedging and coping). Incremental changes in agricultural incomes will be absorbed, by and large, by these costs – this is not a transformative development pathway.

So why is everyone freaking out at the $1 million dollar finding – even if that finding misrepresents the actual findings of the report? Because it brutally rips the Fairtrade band-aid off the global economy, and strips away any feeling of “doing our part” from those who purchase Fairtrade products. But of course, those of us who purchase Fairtrade products were never doing our part. If anything, we were allowing the shiny idea of better incomes and prices to obscure the structural problems that would always limit the impact of Fairtrade in the lives of the poor.

Is Bill Gates missing his own point?

Bill Gates has a Project Syndicate piece up that, in the context of discussing Nina Munk’s book The Idealist, argues in favor of Jeffrey Sachs’ importance and relevance to contemporary development.

I’m going to leave aside the overarching argument of the piece. Instead, I want to focus on a small passage that, while perhaps a secondary point to Gates, strikes me as a very important lesson that he fails to apply to his own foundation (though to be fair, this is true of most people working in development).

Gates begins by noting that Sachs came to the Gates Foundation to ask for MVP funding, and lays out the fundamental MVP pitch for a “big push” of integrated interventions that crossed health, agriculture, and education sectors that Sachs was selling:

[Sachs’] hypothesis was that these interventions would be so synergistic that they would start a virtuous upward cycle and lift the villages out of poverty for good. He felt that if you focus just on fertilizer without also addressing health, or if you just go in and provide vaccinations without doing anything to help improve education, then progress won’t be sustained without an endless supply of aid.

This is nothing more than integrated development, and it makes sense. But, as was predicted, and as some are now demonstrating, it did not work. In reviewing what happened in the Millennium Villages that led them to come up short of expectations, Gates notes

MVP leaders encouraged farmers to switch to a series of new crops that were in demand in richer countries – and experts on the ground did a good job of helping farmers to produce good crop yields by using fertilizer, irrigation, and better seeds. But the MVP didn’t simultaneously invest in developing markets for these crops. According to Munk, “Pineapple couldn’t be exported after all, because the cost of transport was far too high. There was no market for ginger, apparently. And despite some early interest from buyers in Japan, no one wanted banana flour.” The farmers grew the crops, but the buyers didn’t come.

But then Gates seems to glide over a really key question: how could a smart, well-intentioned man miss the mark like this? Worse, how could a leading economist’s project blow market engagement so badly? Gates’ throwaway argument is “Of course, Sachs knows that it’s critical to understand market dynamics; he’s one of the world’s smartest economists. But in the villages Munk profiled, Sachs seems to be wearing blinders.” This is not an explanation for what happened, as telling us Sachs suffered from blinders is simply restating the obvious. The real issue is the source of these blinders.

The answer is, to me, blindingly obvious. The MVP, like most development interventions, really never understood what was going on in the villages targeted for intervention. Sure, they catalogued behaviors, activities, and outcomes…but there was never any serious investigation into the logic of observed behaviors. Instead, the MVP, like most development interventions, was rife with assumptions about the motivations of those living in Millennium Villages that produced these observed activities and outcomes, assumptions that had little to do with the actual logic of behavior. The result was interventions that implicitly infantilized the Millennium villagers by providing interventions that implicitly assumed, for example, that the villagers had not considered the potential markets for new and different crops/products. Such interventions assume ignorance as the driver of observed behaviors, instead of the enormously complex decision-making that underlies everyday lives and livelihoods in even the smallest village.

To give you an idea of what I mean, take a look at the following illustrations of the complexity of livelihoods decision-making (these are from my forthcoming article on applying the Livelihoods as Intimate Government approach in Applied Geography – a preprint is here).

First, we have #1, which illustrates the causes behind observed decisions captured by most livelihoods frameworks. In short, this is what most contemporary development planning gets to, at best.

Figure 1

However, this is a very incomplete version of any individual’s decision-making reality. #2 illustrates the wider range of factors shaping observed decisions that become visible through multiscalar analysis that nests particular places in wider networks of economic, environment, and politics. Relatively few applications of livelihoods frameworks approach this level of complexity, and those that do tend to consider the impacts of markets on particular livelihoods and places.

Figure 2

While this is better than the overly-simplistic framing of decisions in #1, it is still incomplete because motivations are not, themselves, discrete. #3 illustrates the complex web of factors, local and extralocal, and the ways in which these factors play off of one another at multiple scales, different times, and in different situations.

Figure 3

When we seek to understand why people do what they do (and do not do other things), this is the complexity with which we must engage.

This is important, because were Gates to realize that this was the relevant point of both Munk’s book and his own op-ed, he might better understand why his own foundation has

many projects…that have come up short. It’s hard to deliver effective solutions, even when you plan for every potential contingency and unintended consequence. There is a natural tendency in almost any kind of investment – business, philanthropic, or otherwise – to double down in the face of difficulty. I’ve done it, and I think most other people have too.

So, what do you do? Well, we have an answer: The Livelihoods as Intimate Government approach we use at HURDL (publications here and here, with guidance documents coming later in the summer) charts an analytic path through this level of complexity. Before the usual objections start.

1) We can train people to do it (we are doing so in Mali as I write this). You don’t need a Ph.D. in anthropology to use our approach.

2) It does not take too much time. We can implement at least as fast as any survey process, and depending on spatial focus and resources, can move on a timeframe from weeks to two months.

3) It is not too expensive – qualitative researchers are not expensive, and we do not require high-end equipment to do our work.

The proof is in the reactions we are getting from our colleagues. Here in Mali, I now have colleagues from IER and agricultural extension getting fired up about our approach as they watch the data coming in during our pilot phase. They are stunned by how much data we can collect in a short period of time, and how relevant the data is to the questions at hand because we understand what people are already doing, and why they are doing it. By using this approach, and starting from the assumption that we must understand what people are doing and why before we move to interventions, we are going to lay the foundation for more productive interventions that minimize the sorts of “surprise” outcomes that Gates references as an explanation for project failure.

There are no more excuses for program and project design processes that employ the same limited methods and work from the same problematic assumptions – there are ways to do it differently. But until people like Gates and Sachs reframe their understanding of how development should work, development will continue to be plagued by surprises that aren’t all that surprising.

The disappearing politics and ethics of behavior change

While development – thought broadly as social/economic/political change that somehow brings about a change in peoples’ quality of life – generally entails changes in behavior, conversations about “behavior change” in development obscure important political and ethical issues around this subject, putting development programs and projects, and worse the people those programs and projects are meant to help, at risk.

We need to return to a long standing conversation about who gets to decide what behaviors need changing.  Most contemporary conversations about behavior change invoke simple public health examples that obscure the politics of behavior change (such as this recent New York Times Opinionator Piece). This piece appears to address the community and household politics of change (via peer pressure), but completely ignores the fact that every intervention mentioned was introduced by someone outside these communities. This is easy to ignore because handwashing or the use of chlorine in drinking water clearly reduces morbidity, nobody benefits from such morbidity, and addressing the causes of that morbidity requires interventions that engage knowledge and technology that, while well-established, were created someplace else.

But if we open up this conversation to other sorts of examples, the picture gets much more complicated. Take, for example, agricultural behaviors. An awful lot of food security/agricultural development programming these days discusses behavior change, ranging from what crops are grown to how farmers engage with markets. Here, the benefits of this behavior change are less clear, and less evenly-distributed through the population. Who decides what should be grown, and on what basis? Is improved yield or increased incomes enough justification to “change behaviors”? Such arguments presume shockingly simple rationales for observed behaviors, such as yield maximization, and often implicitly assume that peasant farmers in the Global South lack information and understandings that would produce such yields, thus requiring “education” to make better decisions. As I’ve argued time and again, and demonstrated empirically several times, most livelihoods decisions are a complex mix of politics, local environment, economy, and social issues that these farmers weigh in the context of surprisingly detailed information (see this post or my book for a discussion of farm allocation in Ghanaian households that illustrates this point). In short, when we start to talk about changing peoples’ behaviors, we often have no idea what it is that we are changing.

The fact we have little to no understanding of the basis on which observed decisions are made is a big, totally undiscussed problem for anyone interested in behavior change. In development, we design programs and projects based on presumptions about people’s motivations, but those presumptions are usually anchored in our own experiences and perceptions – which are quite often different from those with whom we work in the Global South (see the discussion of WEIRD data in psychology, for example here). When we don’t know why people are doing the things we do, we cannot understand the opportunities and challenges that come with those activities/behaviors. This allows an unexamined bias against the intelligence and experience of the global poor to enter and lurk behind this conversation.

Such bias isn’t just politically/ethically problematic – it risks real programmatic disasters. For example, when we perceive “inefficiency” on many African farms, we are often misinterpreting hedging behaviors necessary to manage worst-case scenarios in a setting where there are no safety nets. Erasing such behaviors in the name of efficiency (which will increase yields or incomes) can produce better outcomes…until the situation against which the farmers were hedged arises. Then, without the hedge, all hell can break loose. Among the rural agricultural communities in which I have been working for more than 15 years, such hedges typically address climate and/or market variability, which produce extremes at frequent, if irregular, intervals. Stripping the hedges from these systems presumes that the good years will at least compensate for the bad…a dangerous assumption based far more on hope or optimism than evidence in most places where these projects are designed and implemented. James Scott’s book The Art of Not Being Governed provides examples of agrarian populations that fled the state in the face of “modernization” efforts not because they were foolish or backward, but because they saw such programs as introducing unacceptable risks into their lives (see also this post for a similar discussion in the context of food security).

This is why my lab uses an approach (on a number of projects ranging from climate services evaluation and design to disaster risk reduction) that starts from the other direction – we begin by identifying and explaining particular behaviors relevant to the challenge, issue, or intervention at hand, and then start thinking about what kinds of behavioral change are possible and acceptable to the people with whom we work. We believe that this is both more effective (as we actually identify the rationales for observed behaviors before intervening) and safer (as we are less likely to design/condone interventions that increase vulnerability) than development programming based on presumption.

This is not to say that we should simply valorize all existing behaviors in the Global South. There are inefficiencies out there that could be reduced. There are things like handwashing that are simple and important. Sometimes farmers can change their practices in small ways that do not entail big shifts in risk or vulnerability. Our approach to project design and assessment helps to identify just such situations. But on the whole, we need to think much more critically about what we are assuming when we insist on a particular behavior change, and then replace those assumptions with information. Until we do, behavior change discussions will run the risk of uncritically imposing external values and assumptions on otherwise coherent systems, producing greater risk and vulnerability than existed before. Nobody could call that development.

World Vision’s LGBT Problem Comes Out of the Closet

Two days ago, World Vision USA announced its willingness to hire LGBT employees who were married. To insiders in the aid and development world, this was a stunning reversal, as World Vision USA’s (legal but problematic) resistance to hiring LGBT employees is well-known in the aid world. Therefore, the decision to openly hire married LGBT staff seemed to signal an important new direction for World Vision…and then today, they reversed themselves.

Jim Beré, Chairman of the World Vision Board, wrote a letter on the reversal.

Today, the World Vision U.S. board publicly reversed its recent decision to change our employment conduct policy. The board acknowledged they made a mistake and chose to revert to our longstanding conduct policy requiring sexual abstinence for all single employees and faithfulness within the Biblical covenant of marriage between a man and a woman.

I have no doubt this change of course is technically legal. World Vision has lawyers, and I’m sure those lawyers were consulted on this reversal. But this public reversal lays bare World Vision USA’s view of the LGBT community, and its hiring practices with regard to that community. Sure, Beré offered the usual, pro-forma support for the LGBT community in his letter:

While World Vision U.S. stands firmly on the biblical view of marriage, we strongly affirm that all people, regardless of their sexual orientation, are created by God and are to be loved and treated with dignity and respect.

However, it is difficult to overlook the fact that this dignity and respect should be extended to everyone except those qualified LGBT individuals who might seek employment at World Vision.

This country was founded on the idea that people are entitled to their religious beliefs. However, it is not OK (morally or legally) to use federal dollars to push one’s religious beliefs on others, or to discriminate against anyone on the basis of that faith. World Vision is one of USAID’s largest cooperators – in simple terms, they implement a hell of a lot of federal money in the context of humanitarian assistance and development programs. Shadrock Roberts, using data from foreignassistance.gov, managed to identify nearly $145 million in money obligated to World Vision in fiscal year 2013. This should be read as an absolute minimum measure of federal money going through World Vision – there are other flows of US dollars that reach World Vision projects indirectly, and I seriously doubt that foreignassistance.gov captures all of the money directly obligated to them.

Let me be clear: in fiscal year 2013, there were at least $145 million taxpayer dollars going to an organization that just openly told the world it will not hire LGBT staff.

While I personally believe that World Vision USA is on the wrong side of history with regard to the issue of LGBT hiring and staff, my (or indeed anyone’s) personal politics are not the big issue here. The Government of the United States implements development projects and delivers humanitarian assistance through “implementers” like World Vision. USAID, USDA, the State Department, etc., do not have enough staff to actually build bridges, dig boreholes, or deliver food aid themselves. Instead, they pay others to do the work. In most places where American development aid and humanitarian assistance is delivered, these actors are effectively the face of the United States.

In the face of this decision on LGBT staff, World Vision USA may no longer be able to credibly act in this capacity. In 2011, the White House issued a Memorandum for the Heads of Executive Departments and Agencies on the subject of “International Initiatives to Advance the Human Rights of Lesbian, Gay, Bisexual, and Transgender Persons.” In that memorandum, President Obama directed “all agencies engaged abroad to ensure that U.S. diplomacy and foreign assistance promote and protect the human rights of LGBT persons.”

How, exactly, is World Vision to credibly support this memorandum after this particular statement about its own hiring?

The short answer: It cannot. The actions of the World Vision USA board speak much, much louder than the very weak claim that the organization feels that the LGBT community should be treated with dignity and respect.

This has real-world implications right now. For example, World Vision has a project, “SPEAR-Incremental funding using FY2012 PEPFAR $2,383,490” (just check Shadrock Roberts’ “USAID Spending on World Vision & World Vision Inc: Fiscal Year 2013” fusion table here). Let’s all remember that Uganda is a country that just last month criminalized homosexuality (those convicted face life in prison), an act that the Obama Administration has punished through shifts in foreign aid away from the Ugandan government and organizations that pushed for this law. Yet we have World Vision, with its clear stance on LGBT hiring, spending $4.8 million federal dollars (some from FY 12, some from FY 13) on an HIV/AIDS project in this country? It seems to me that this muddies the message that the Obama Administration was trying to send.

Legal or not, World Vision’s actions with regard to the hiring of those in the LGBT community have damaged their credibility as an implementer for the government of the United States in any context where the rights of the LGBT community are in question (basically most of the world where development aid and humanitarian assistance is delivered). Further, for USAID and the State Department to continue working with World Vision under these circumstances sends the message that implementers can tap dance around White House directives they might not like or agree with. While World Vision has the right to choose to ignore such directives on the basis of the organization’s religious beliefs, it should not have the right to do so and continue to work with federal dollars.

If the Obama administration is serious about maintaining order among those who work for it, and are serious about furthering the rights of the LGBT community globally, the recent actions of World Vision cannot pass without comment or action. And they do not have to. It’s simple, really:  make World Vision choose between the $145 million dollars of taxpayer money that fund its work each year and the individual and organizational donations of those who cannot tolerate or accept the LGBT community.

A suggestion for constructively redirecting Mr. Kristof

Nick Kristof’s piece decrying the distance between academia and the rest of society has, predictably, triggered a screaming firestorm in academia. That’s what you get when you poke the (over)educated, seriously literate beast. A lot of the criticism is very well written and thought out (outstanding examples here and here). But I fear that Kristof’s central message, that society needs a more engaged academia, is getting lost here. My main problem was not that Kristof was arguing for a more engaged academy, but that his prescriptions for how to bring about that engagement did not address the real incentives and barriers that academics negotiate when they try to engage with public debate.

So, in the interest of constructive criticism, I have some suggestions for things that Mr. Kristof might consider looking into – throwing a light on these challenges would actually serve to highlight the real, and often absurdly unnecessary, barriers between the academy and society. This is obviously just a tiny sample of potential topics, drawn from my own experiences in a top-tier department in a large, Research-1 state institution.

  1. Examine the system by which departments are “ranked” in the United States: The National Research Council (NRC) ranks departments at (not so) regular intervals, creating a sort of BCS ranking of departments, with about the same amount of accuracy and certainty. By and large, academics know these rankings are garbage, but administrations love to trot them out to demonstrate the excellence of their institution, and therefore justify the institutional budget/tuition/etc. But here’s a fun fact: if you dig into what counts in the rankings, you can quickly see why university administrations don’t necessarily care for academic outreach. For example, did you know that authoring an NRC report (which is seriously prestigious) DOES NOT COUNT AS A MEASURABLE PUBLICATION IN THE NRC RANKINGS? I know this because my department ran into this problem the last time around, with at least three members of our faculty losing multiple publications because the NRC did not count ITS OWN PUBLICATIONS. If those pubs were excluded, you can imagine that basically all reports in all contexts were excluded. So if administrations love rankings, and rankings hate outreach, you’re not going to get much outreach.
  2. Consider how academic evaluation’s over-focus on the number of articles produced creates less interesting, more arcane academic outputs: The production of knowledge in academia has, for some time, been driven by expectations of ever-greater output (as measured in research dollars and publications) with less input (fewer faculty members). These expectations govern everything from the evaluation of departments to individual tenure decisions. As a result, the publication requirements for tenure have become ever-more challenging, with expectations for the number of publications produced rising so steeply that many who recently got tenure might have published more articles than their very senior colleagues published to become full professors even two decades ago. This is driven by everything from departmental-level politics to the NRC rankings themselves, though I suspect a strong trickle-down effect here. In any case, this has created a crisis of knowledge production in which professors are incentivized to produce what my colleague Carl Dahlman once called the minimum publishable unit (MPU). Because expectations of performance are more and more heavily based on quantitative output (thanks, NRC!), as opposed to the quality of that output, it makes sense for faculty to shy away from “big question” articles that might chew up a lot of their data and interesting ideas, and instead package that same set of ideas as two or three smaller, much more arcane publications. This is a very real pressure: when I put out my retheorization of livelihoods approaches a year ago, more than one colleague suggested that I would have been better cutting its 15000 words into two 8500 word pieces, as it would have counted for more in my annual evaluation. Nothing has driven us toward a proliferation of small, specialized journals carrying tiny, arcane articles quite like this drive for quantification and greater production. Undoing this really awful trend would help a lot, as academics would be freed up to think big thoughts again, both in journals and in other fora. One way to help: publicize the alt-metrics movement (start at the LSE Impact Blog and work from there) that attempts to move beyond a system of academic assessment that reflects a long-dead era of publication and communication.
  3. Focus on how for-profit academic publishers wall off knowledge from the public: Academics must publish to survive professionally, and the best journals in nearly every field are the last profitable properties for a number of publishing houses. These publishers benefit from free labor on the part of authors, reviewers, and the nearly-free labor of editors, and often the subsidy of taxpayer-funded research, yet charge exorbitant amounts for subscriptions to their journals – in the case of public universities, bleeding the taxpayer once again. Academics are absolutely responsible for this situation – after all, we collectively define what the good journals are, and as I’ve argued before we could change our minds if we wanted to. But academia takes time to change, and could use a push. Where is the push from the federal government to demand that the results of taxpayer-funded research be made available to the taxpayers immediately? What happened to the initial push from the Obama White House on this issue? It seems to be a topic ripe for a good investigative journalist.

And, for good measure, an interesting trend that will likely lead to a more engaged academia:

  1. The shift in acceptable academic funding: Until very recently, academic grants from traditional agencies like the National Science Foundation or the National Institutes of Health were given exalted status, with all other forms of funding occupying lesser rungs on the great chain of funding. Thus, to get tenure, many (biophysical science/social science) academics really had to land one of these grants. The programs associated with these grants very often rewarded pure research and actively discouraged “applied” work, and even today the NSF’s requirements for “impact” are fairly surficial. Contracts were very second-tier, and often not taken seriously in one’s academic review. Now, thanks to funding crunches in both universities and the funding agencies, any research-looking dollars have started looking good to university administrations, and contracts are more and more being evaluated alongside more traditional academic grants. There is a tremendous opportunity here to engage academia through this mechanism. [Full disclosure: I’ve been funded in the past by NSF and by the National Geographic Society, but today roughly 90% of my funding comes directly or indirectly from development donors like USAID in the form of contracts or grants]

This is hardly a comprehensive list of things into which a serious journalist could shed light on, and perhaps help leverage change. I’m just typing quickly here. If you have other ideas for things that journalists should be examining, please leave them in the comments or email them to me: ed at edwardrcarr.com   I will append them to this post as they come in, attributing them (or not, depending on the wishes of contributors) in the post.