Wed 21 Dec 2011
Only the senior faculty can save us…
Posted by Ed under Academia, research
[13] Comments
Been a while . . . been busy. And yes, I stole that post title from Ralph Nader . . .
As those who follow this blog know, one of my big concerns is with the walls that academia is building around itself through practices like the current incarnation of peer review in specialist journals. It’s not that I have a problem with peer review at all – I think it is an important tool through which we improve and vet academic work. Anything that survives peer review is by and large more reliable than an unvetted website (like this one, for example).
But the practice of peer review in contemporary academia has turned really problematic. Most respected journals are more expensive than ever, making access to them the near-sole province of academics with access to libraries willing to purchase such journals. The pressure to publish increases all the time, both in rising demands on individual researchers (my requirements for tenure were much tougher than most requirements from a generation before) and in terms of an ever-expanding academic community. The proliferation of published work that has emerged from these two trends has not really improved the quality of information or the pace of advances – there is still a lot of good work out there, but it is harder and harder to find in an ever-growing pile of average and even not-so-good work. And I have found peer review to often function as a means of policing new ideas, slowing the flow of innovative ideas into academia not because the ideas are unsupported, but because these ideas and findings run contrary to previously-accepted ideas upon which many reviewers might have done their work. This byzantine politics of peer review is not well-understood by those outside the academic tent, and does little to improve our public image.
So I am wondering where the tipping point is that might bring about something new. Social media is nice, but it is not peer-reviewed. I tend to think about it as advertizing that points me to useful content, but not as content itself (I have a post on this coming next). I still want peer-review, or something like it. So, a modest proposal: senior colleagues of mine in Geography – yes, those of you who are full professors at the top of the profession, who have nothing to lose from a change in the status quo at this point – who will get together and identify a couple of open-access, very low-cost journals and more or less pronounce them valid (probably in part by blessing them with a few of your own papers to start). Don’t pick the ones that want to charge $1500 in publishing fees – those are absurd. But pick something different . . .
This, I think, is all it would take to start a real movement in my discipline – admittedly, a small discipline, so maybe easier to move. Just making our publications open to all is a tiny first step, but an important one – once a wider community has access to our ideas, they can respond and prompt us for new ones. Collaborations can emerge that should have emerged long ago. Colleagues (and research subjects) in the Global South will be able to read what is written about their environments, economies and homes, improving our responsiveness to those with whom, and hopefully for whom, we work. First steps can be catalytic . . .
13 Responses to “ Only the senior faculty can save us… ”
Trackbacks & Pingbacks:
-
[...] naturally when I saw this post come up on Twitter, it got me thinking even more about the state of the graduate political science [...]
-
[...] on my previous post, another thought that springs from personal experience and its convergence with someone’s [...]
-
[...] Minds reminds me of Ed Carr’s commentary on peer review from late December. (Carr is a geographer who I interviewed recently for Yale [...]
-
[...] of publishing and peer review, geographer Ed Carr over at Open the Echo Chamber makes the case that escape and salvation from may lie in the hands of senior faculty. Is he right? He might [...]

Hey Ed,
I’m down with questioning the current peer review process for the reasons you describe above. I have perhaps another angle to add, maybe related, maybe not, maybe totally off-base. Your thoughts one way or the other are welcome.
With my work (and not just mine, I’m hearing this from others as well) I’m getting the feeling that validation of one’s idea/theory/etc. matters more than practical concerns when it comes to getting published. I’ve gotten enough “where’s the theory?” feedback to start thinking that the point of publishing is to try to show off how wonderful one’s ideas are, and that the only point of empirics is to enlist them in support of championing one’s wondrous theorizing.
You and I both know theory is a tool, a means not an end. To come back to your post, I feel like (at least from my experience) a big part of the policing of ideas means the policing of theoretical chops. So when new findings run up against existing ideas and theories, woe unto you. You’re supposed to hang everything on your theory, not your empirics.
But aren’t our empirics what matter most, what drives everything we do? Theory helps us understand empirics, helps us understand how we understand empirics, helps us understand what we even mean by “theory” and “empirics”. But theory cannot be the be all and end all of what we do. I’m feeling like the policing of ideas has a lot to do with putting the theoretical cart before the empirical horse. Maybe not what your post was getting at, and maybe I’m just venting. But there you have it, fwiw.
I don’t know, Ed. At least in Economics, new ideas are passed around as working papers long before they are published in peer-reviewed journals, and even then working paper versions of the articles can usually still be found online.
Although I am only a lowly graduate student, I have heard that getting published is taking longer and longer, and top journals are getting more and more selective. That being so, I wonder if peer-review isn’t morphing into a validation needed for promotion through the academic ranks rather than a true vetting of ideas. Working papers are often cited, and you can tell which papers the field thinks are exciting by looking at the number of citations.
You make the appropriate qualification of being anecdotal here – but I think that in the end such a statement is insufficient. Do you have some data to support your assertion?
I think that the phenomenon you describe can be found – but I would say that the high level of emphasis placed on “publish or perish” works in the opposite direction. I think it’s hard to say where that leaves the process of peer review overall in balance, and that making overly-broad generalizations feeds negativity and anti-academic sentiments more than it contributes to finding solutions.
Regardless, IMO – the real engine that is driving the most important problems with academic research is the obsession with publishing, and the bottom-line focus on economics that drives academia more generally, and not just academic research.
Joshua:
My own website rejected my comment! Let’s try this again . . .
I have a lot of evidence to support my contentions, but I think it is obvious that it is not really in my interest to name journals, editors or reviewers – not until publishing has really changed, anyway. I will note, though, that I say this from the perspective of a qualitative social scientist working mostly in the area of social theory. In this area, we have a lot of theoretical debate that is not easily resolved via reference to empirical evidence, and so review can get quite political (see the comment from Jim on this post).
My intent is not to push anti-academic thought (I am, after all, tenured!) but to argue that what we are doing, and the way we are doing it, could probably use a change. Not to get rid of peer review, but to do it differently – quicker, more transparently, and perhaps even continue the process long after publication so that pieces get updated as time goes on. If saying that stirs the pot, so be it!
“Don’t pick the ones that want to charge $1500 in publishing fees – those are absurd.”
Why is that absurd?
Well, simply put, those are hardly open access. The vast majority of faculty lack the grant funding to support those kind of publication fees, which creates a barrier to access from the knowledge production side. Second, these journals run on more or less the same model as any other – authors and reviewers are unpaid, and editors paid only a little. There is no justification for charging $1500/article in fees for an electronic publication without those costs. Open access means open access – from all sides. There are journals out there that do this without the fees – for example, Human Geography: A New Radical Journal. If they can do it, what exactly is the barrier for everyone else?
You have an idiosyncratic definition of open access. That’s fine, but be aware of the potential confusion when talking to others.
I think the barrier is that there are going to be costs to running a journal. I am hoping others who know those costs will comment. I have heard estimates that for major journals, costs of publishing a paper are about $3,000 (production staff, server costs, etc.). Very small journals may be able to keep costs down by being small volunteer efforts, but there’s a real discussion to be had about their long term viability.
I agree that it would be very useful to see what the breakdown of costs is. Just offhand, in terms of direct production costs, there is a very minimal amount per article for the editor(s), certainly real costs for the layout team, I know that some journals proof (but I wish they wouldn’t – I often have to correct their mistakes!), and then there are printing costs. It is possible that $3k per article is in there, though it seems to me that is very, very high (perhaps a lot of overhead in the form of executive salaries?).
Of course, nobody is going to tell us what the breakdown of costs is, as it is now well-documented that there are huge profit margins in the journals (if only because the big publishers are now the only growing part of the publishing sector) – in short, they probably cannot justify the insanely high subscription rates without revealing the size of their profit margin, which would trigger a serious revolt among libraries and academics. That said, it may be that low-cost, truly open-access publishing is simply infeasible in the context of publishing as we understand it . . . which should not be reassuring to publishers – instead, they should probably be worried about what academia might switch to if continued budget cuts make these subscriptions unsustainable.
Happy to tell you costs. The Journal of Political Ecology charges $0 to authors, and costs $0 to access free online. I believe ACME the journal of critical geography works the same. The site is hosted for free by the University of Arizona. I spend about 5 hours on each article. The referees work for free, unfortunately. My salry cost is the only real expense. So that’s $185 per article. Call it $200 to be generous (a librarian posts up the articles). The journal is listed on Scopus, awaiting ISI, and is cited more than many others in its field. I reckon $3000 is daylight robbery, even if they have to pay for a server. Those sorts of charges are listed on the list of shonky journals and are to be avoided – see Beall’s list http://metadata.posterous.com/83235355
PS the major publishers are going to have to change. It is a no brainer.