tag:blogger.com,1999:blog-21165575.post677621850904697038..comments2024-03-10T20:46:19.274-04:00Comments on In the Middle: The Place of Peer ReviewCord J. Whitakerhttp://www.blogger.com/profile/06224143153295429986noreply@blogger.comBlogger15125tag:blogger.com,1999:blog-21165575.post-79288826353775896442010-12-10T17:19:01.141-05:002010-12-10T17:19:01.141-05:00I am so grateful to Jeffrey for posting my piece-i...I am so grateful to Jeffrey for posting my piece-in-progress. I wrote it almost a year ago but it is only now going to press. Your posting saved me from being utterly out of date: I have revised to take account of the snowball-effect of Kathleen Fitzpatrick's PLANNED OBSOLESCENCE and some other concerns. This is such a generous forum. Bonnie WheelerBonnie Wnoreply@blogger.comtag:blogger.com,1999:blog-21165575.post-11884502991633233852010-12-03T11:40:39.896-05:002010-12-03T11:40:39.896-05:00I'm really enjoying this thoughtful exchange a...I'm really enjoying this thoughtful exchange and looking forward to the whole article, Bonnie. <br /><br />I wanted to underscore something that's happening here, implicitly, that strikes me as important to the viability of our scholarly processes over the long term: which is that we now have multiple humanities disciplines engaged in thinking about how peer review can and should evolve, and that seems to me a crucial condition for effective experimentation and for validating what works (outside of the alchemy of a single experiment or field).<br /><br />Bonnie, I don't know if your article will map some of this evolving conversation among different humanities fields. But precisely because this thinking is being tested in a distributed way, it would be tremendously helpful to have some kind of starting place, annotated bibliography, etc. So far I count this ongoing conversation at In the Middle; Bonnie's essay; Kathleen's book; SQ's pages; Larry Cebula over at Northwest Historian peer-reviewing the SQ process itself; the next SQ special issue on performance... What should be added to this list?<br /><br />(Here's Larry's blog post, for reference:<br />http://northwesthistory.blogspot.com/2010/09/peer-review-20.html)Katherine Rowenoreply@blogger.comtag:blogger.com,1999:blog-21165575.post-88017420879570016022010-11-23T08:30:58.365-05:002010-11-23T08:30:58.365-05:00... if we can conceive of our work as more pleasur...<i>... if we can conceive of our work as more pleasurable, more exciting, more personally fulfilling, more conducive to individual and collective happiness, then the question of labor in mitigated somewhat in relation to these dispositions and affects...</i><br /><br />We're all in trouble when our work starts to feel like work, surely. At that rate we could be earning better elsewhere, the love is what covers the gap. I think one of the last posts at Acadamnit had the right approach: <a href="http://acadamnit.blogspot.com/2010/10/tripping-scale.html" rel="nofollow">witness here</a>. It speaks to a sense of defeat but surely the writer ultimately has the Right Idea.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-21165575.post-44885423568252641332010-11-22T20:57:21.130-05:002010-11-22T20:57:21.130-05:00Oh -- two more things: as a person who has so litt...Oh -- two more things: as a person who has so little time to do my own writing, I actually love reviewing my friends' and colleagues' work, formally and informally. This is because it gives me a "legitimate" excuse to work on something in my field and short-term. It's a great way to keep my head in the game when teaching four courses in a semester. <br /><br />Also, though, I wonder... if you're like me and have already had friends look at your ms, and your field is fairly small, how does one find a peer reviewer who is appropriate?Another Damned Medievalisthttps://www.blogger.com/profile/05231085915472400163noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-9357306031626714442010-11-22T20:51:49.059-05:002010-11-22T20:51:49.059-05:00jeebus, EIleen!
I think that one thing that coul...jeebus, EIleen!<br /><br /> I think that one thing that could help, at least at SLACs like mine where service both on campus and to the profession count, is a regularization of commission- and thank-you letters from editors that could be placed in one's files. Peer review of articles might not count any more than book reviews, but they might count abou the same ...Another Damned Medievalisthttps://www.blogger.com/profile/05231085915472400163noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-35727590994041994132010-11-22T19:16:22.840-05:002010-11-22T19:16:22.840-05:00No problem, of course! One thing that this does po...No problem, of course! One thing that this does point to is, with a text the size of a book manuscript, how difficult it is for a discussion to <i>feel</i> as though it's attained a kind of critical mass -- and now if we multiply that by <i>everyone</i> putting drafts online in this fashion... well, it's clear that we're going to have to find new ways to reward active reviewing, as there's going to be a lot of work to do.<br /><br />Thanks for mentioning the BABEL roundtable; I hope that it was fruitful -- the entire conference sounded fantastic, from what I was catching over Twitter. I'll look forward to following more of how things develop here.KFhttps://www.blogger.com/profile/14744032982329173041noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-37770913388544145722010-11-22T19:11:44.948-05:002010-11-22T19:11:44.948-05:00I'd be interested in hearing what Bonnie and o...I'd be interested in hearing what Bonnie and others like her think of legitimate reasons for declining to do a peer review (other than being frightfully overextended, which is a perennial problem). I've declined to review article MSS on topics that I'm an "expert" in because I knew the person involved and more or less knew their work (though perhaps not the particular article under review). When this has happened, I've generally declined, stated my reasons, and suggested alternate possibilities. But as our "specialty" fields are always smallish, that might pose a problem: if I receive a request to review, say, an article on monastic architecture in the low countries, chances are that the community of potential experts is quite small, and eventually we're all going to know each other, for good or for ill.<br /><br />So the question: where do we find a balance between impartial review and review done by experts in a particular area?Notorious Ph.D.https://www.blogger.com/profile/08700875559325201086noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-22076728015437211832010-11-22T19:09:52.562-05:002010-11-22T19:09:52.562-05:00I also want to second something Kathleen highlight...I also want to second something Kathleen highlights here, which has to do with readership and the ways in which electronic and digital media have increased the traffic of those who read our work, which can also be brought to a "mixed" [academic and non-academic] audience much faster in a myriad of ways not afforded by traditional scholarly publishing. I will take the daily readership of this weblog, for instance, over the #s of people who will likely read my article on the Old English "Seven Sleepers," which I think is the bets thing I have ever written, and which I am still waiting, almost 4 years after completing it, to see come into print. That is why I also regularly flout copyright laws and self-publish/pre-print + re-print everything I write on my website. I want readers more than I want traditional "publication."Eileen Joyhttps://www.blogger.com/profile/13756965845120441308noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-8415994190689301832010-11-22T19:05:55.047-05:002010-11-22T19:05:55.047-05:00OOPS! Kathleen: please accept my deepest apologies...OOPS! Kathleen: please accept my deepest apologies, as I did not check my facts! You might like to know that, at BABEL's inaugural conference, held at the Univ. of Texas at Austin a few weeks ago, that we had a round-table session on the future of scholarly/digital publishing in which your chapter on Authorship was one of our "core" discussion texts, and I've visited your site more than once, so again, my apologies!Eileen Joyhttps://www.blogger.com/profile/13756965845120441308noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-9415336163832790482010-11-22T19:02:54.254-05:002010-11-22T19:02:54.254-05:00Thanks so much to you, and to Bonnie, for this tho...Thanks so much to you, and to Bonnie, for this thoughtful post and discussion. I do however want to raise a slight objection to the characterization of the review process of my book manuscript as either having received too-few comments or having low traffic. In the nine months after the manuscript was posted, I had over 31,000 pageloads, with over 12,700 unique visitors, over 3370 of whom made multiple return visits. 44 unique commenters left a total of 295 comments. On the one side, hold that up alongside the fact that the average scholarly press monograph in the humanities sells well fewer than 400 copies <i>over its lifetime</i>; on the other side, compare it with the usual two or three anonymous outside reviewers' reports, reports that neither respond to one another nor are in dialogue with the author. Given both the quantity and the quality of dialogue held in the margins of my manuscript, I do not understand how it can come to be characterized as under-visited or under-commented. Perhaps the comments might be worth another look.<br /><br />Eileen Joy, your point about the SQ open review's advance management is well to the point; that decision came both from the SQ board's desire to ensure that the same folks who would have been anonymous reviewers participated in the open review process, and from the lessons that we learned from my own review. Which is to say that facilitating discussion requires real work. But that work paid off, both for the SQ issue and for my own book. Take another look -- and perhaps, next year, look at how the final print version has been influenced by the open review process.KFhttps://www.blogger.com/profile/14744032982329173041noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-67224701676941917372010-11-22T19:01:59.085-05:002010-11-22T19:01:59.085-05:00Thanks so much to you, and to Bonnie, for this tho...Thanks so much to you, and to Bonnie, for this thoughtful post and discussion. I do however want to raise a slight objection to the characterization of the review process of my book manuscript as either having received too-few comments or having low traffic. In the nine months after the manuscript was posted, I had over 31,000 pageloads, with over 12,700 unique visitors, over 3370 of whom made multiple return visits. 44 unique commenters left a total of 295 comments. On the one side, hold that up alongside the fact that the average scholarly press monograph in the humanities sells well fewer than 400 copies <i>over its lifetime</i>; on the other side, compare it with the usual two or three anonymous outside reviewers' reports, reports that neither respond to one another nor are in dialogue with the author. Given both the quantity and the quality of dialogue held in the margins of my manuscript, I do not understand how it can come to be characterized as under-visited or under-commented. Perhaps the comments might be worth another look.<br /><br />Eileen Joy, your point about the SQ open review's advance management is well to the point; that decision came both from the SQ board's desire to ensure that the same folks who would have been anonymous reviewers participated in the open review process, and from the lessons that we learned from my own review. Which is to say that facilitating discussion requires real work. But that work paid off, both for the SQ issue and for my own book. Take another look -- and perhaps, next year, look at how the final print version has been influenced by the open review process.KFhttps://www.blogger.com/profile/14744032982329173041noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-59048567423322115712010-11-22T17:28:52.623-05:002010-11-22T17:28:52.623-05:00[continuing]
Perhaps it goes without saying, then...[continuing]<br /><br />Perhaps it goes without saying, then, that I am in favor of more open review processes and even more *collective* review processes whereby the burden(s) on each individual reviewers can be lessened somewhat [and where we can still provide various channels for those who might want to remain "anonymous"--on both sides of the equation] and where the communal nature/gift-exchange economy of our profession that Elden is at pains to remind us of is made more clear and transparent. There are ethical considerations at stake here as well, and I've always been struck by Jane Bennett's argument, in "The Enchantment of Modern Life," that ethical actions require affective propulsions: we must be enchanted with the world [a little in love with it, struck by wonder at it] in order to want to act on its behalf. I think the same can be argued for a profession, such as medieval studies. Of course we're all a little "in love" with our field [however we want to describe or characterize our dispositions toward our field of study], while we all have very different and I'm sure complicated reasons as to why we work on the subjects we do, and these reasons will always impel us, regardless of the economies of surplus or scarcity within which we work [and regardless of whether or not some of us would say "I *love* what I do"], but again, I would just ask us to consider how we might "open up" not only the avenues through which we develop and seek professional legitimation for our scholarship, but also how we might diversify and "open up" the types and genres of work that is possible and the spaces [virtual, digital, and otherwise] within which it is permissible to "play/work," alone and together. There are issues of "control" with the way our scholarship is authorized/legitimated, which I feel strongly blind peer-review has [wittingly or unwittingly] contributed to and which has possibly narrowed the horizons for what is permissible to conceptualize/execute in our work, and I think the time has come for some serious dismantling of these traditional systems in favor of some wild experimentations that would be both productive *and* enjoyable. I will also always side with the idea that more of everything is never a bad thing: despite all the bad news regarding publishing profits, the end of the book/reading, an over-stretched academic labor base, and the like, we should be working toward more journals, more book series, and even short-term publishing ventures that would exist to fill a certain niche/void, then disband as soon as certain objectives were accomplished. The trick, of course, would also be in getting "points" on one's c.v. for participating in all of these ventures. But just look at entities like Open Humanities Press--the thing is, I'm really not worried at all. Indeed, I'll be traveling to NYC the first week of December to draw up plans for a new *print* and e-book series for BABEL. Stay tuned.Eileen Joyhttps://www.blogger.com/profile/13756965845120441308noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-33680627602120748512010-11-22T17:02:02.252-05:002010-11-22T17:02:02.252-05:00[continuing]
I also think it is a little misleadi...[continuing]<br /><br />I also think it is a little misleading, from a historical perspective, to believe [as some do and say often] that our current digital age brings with it an information overload that has heretofore never existed and which overwhelms our waking senses to the point where we're all exhausted before we can even begin leading to various states of emotional and labor entropy and "giving up"]. As any scholar of bibliography studies knows, starting with the ancient Library [Museum] at Alexandria, when it comes to books and manuscripts and the scholarship attendant thereupon, information overload has always been the problem--just ask Callimachus, one of the first bibliographer-cataloguers at Alexandria. So, we'll admit up front that information overload has always been a problem, while at the same time, there have never been more economic threats to what might be called the "business" of the university library and academic publishing, which I think also calls for more collective and creative labors on the part of the intelligentsia, situated both within and outside of the university proper. And let's reflect, too, that academic publishing does not *have* to be undertaken at a financial loss [it turns out that medievalists actually buy a lot of books], while at the same we have to continue to convince university administrators that supporting university presses at break-even returns is a critical part of their mission.<br /><br />Information overload has always been a problem--okay--and there is the question of faculty in the current moment perhaps being squeezed to the nth degree [while also watching in horror as some humanities programs at more than several schools are being "de-funded"--something we should not neglect to see as a *common* concern, no matter our particular specialty, period, or language], and this is why I think we need to especially concentrate our efforts now on more collective labors pointed toward the realm of what I would call the enlargement ans re-tooling of the domains of our scholarly development [and if the digital age is also the age of information overload--which is not new--at the very least, it provides us with more avenues of dissemination of information that are, let's say, "easier" to get to than a hard-structure library in Turin or Paris]. I also think it will be important to open up more than just "review"--meaning, I think we have to diversify the modes and genres that are available and *possible* for our work in order to [pleasurably] re-wire our dispositions and affects *toward* our work: in other words, if we can conceive of our work as more pleasurable, more exciting, more personally fulfilling, more conducive to individual and collective happiness, then the question of labor in mitigated somewhat in relation to these dispositions and affects. This is also something we have to work at collectively.<br /><br />[to be continued]Eileen Joyhttps://www.blogger.com/profile/13756965845120441308noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-84962167033761683562010-11-22T16:41:11.593-05:002010-11-22T16:41:11.593-05:00Per your link, Jeffrey, to the comments at the &qu...Per your link, Jeffrey, to the comments at the "Progressive Geographies" weblog, I agree with Stuart Elden that peer-reviewing is essentially an exchange economy, and while I think I understand Bonnie W.'s concerns about younger faculty not being as willing as their predecessors to always assent to reviewing their peers' scholarship [and I think this simply has a lot to do with what I don't think is an arguable point: that internal institutional pressures--in the form of more and more demands for self-assessment, participation in institutional governance, increasing expectations for spending more time on campus, and the like--as well as various forms of hyper-professionalization, has led to a state of affairs where faculty find they have less and less time to do everything they need to do just to keep their heads above water, get tenure, etc.], BUT: Elden's point is still an important one to reflect on further here: aside from the salaries we receive from our institutions [and the extra monies that some of us might luckily receive in the way of grants and fellowships, guest-speaking engagements, guest-teaching, consulting, and the like], there will simply be no advancement in ANY of our research agendas if we do not all tacitly agree that we are obligated to review each other's work [otherwise, how would our own work ever get reviewed and published and thereby have a chance of actually influencing the field?].<br /><br />There is still, and always will be, a question of information or work overload, as Bonnie aptly points to with the example of the low web-traffic at Kathleen Fitzpatrick's website where she has made her book manuscript fully open for review by any and all comers [and yet, where are they?]. This is partly why I favor the *partial*/HYBRID peer review experiment recently engaged in by The Shakespeare Quarterly because in order for any structure of so-called "open" review to work, it has to be initiated and managed/curated by an editorial team that would work, ahead of time, to bring a certain number of "experts" and other interested parties on board and to keep them there for a certain sustained period of time. The "crowds" will vary in size from piece to piece, and special issue to special issue, and book to book, but this again goes back to Elden's point that we have to all kind of agree up front that engaging in this process, whether closed and blind, or open and "crowded," is part and parcel of our professional obligations and this is not necessarily *only* pro bono work, because we have the hope/right to expect reviews in return for our own reviewing [and editing] labors. <br /><br />[to be continued]Eileen Joyhttps://www.blogger.com/profile/13756965845120441308noreply@blogger.comtag:blogger.com,1999:blog-21165575.post-15861486599008375862010-11-22T14:46:20.085-05:002010-11-22T14:46:20.085-05:00A response worth reading here.A response worth reading <a href="http://progressivegeographies.wordpress.com/2010/11/22/the-values-of-peer-review/" rel="nofollow">here</a>.Jeffrey Cohenhttps://www.blogger.com/profile/17346504393740520542noreply@blogger.com