Open peer review
Encyclopedia
Open peer review describes a scientific literature
concept and process, central to which is the various transparency and disclosure of the identities of those reviewing scientific publications. The concept thus represents a departure from, and an alternative to, the incumbent anonymous peer review process, in which non-disclosure of these identities toward the public - and toward the authors of the work under review - is default practice. The open peer review concept appears to constitute a response to modern criticisms of the incumbent system; ergo, its emergence may be partially attributed to these phenomena.
Both processes are intended to subject scholarly publications to the scrutiny of others who are experts in the same field.
The evidence of the effect of open peer review upon the quality of reviews, the tone and the time spent on reviewing is mixed, although it does seem that under open peer review, more of those who are invited to review decline to do so.
In 1997, the Electronic Transactions on Artificial Intelligence, http://www.etaij.org, was launched as an open access journal by the European Coordinating Committee on Artificial Intelligence. This journal used a two-stage review process. In the first stage, papers that passed a quick screen by the editors were immediately published on the Transaction's discussion website fpr the purpose of on-line public discussion during a period of at least three months, where the contributors' names were made public except in exceptional cases. At the end of the discussion period, the authors were invited to submit a revised version of the article, and anonymous referees decided whether the revised manuscript would be accepted to the journal or not, but without any option for the referees to propose further changes. The last issue of this journal appeared in 2001.
In 1999, the open access journal Journal of Medical Internet Research
was launched, which from its inception decided to publish the names of the reviewers at the bottom of each published article. Also in 1999, the British Medical Journal
moved to an open peer review system, revealing reviewers' identities to the authors (but not the readers), and in 2000, the medical journals in the open access BMC series published by BioMed Central
, launched using open peer review. As with the BMJ
, the reviewers' names are included on the peer review reports. In addition, if the article is published the reports are made available online as part of the 'pre-publication history'.
Several of the other journals published by the BMJ Group allow optional open peer review, as do PLoS Medicine
, published by the Public Library of Science
. The BMJ
s Rapid Responses allow ongoing debate and criticism following publication. By 2005, the editors found it necessary to more rigorously enforce the criteria for acceptance of Rapid Responses, to weed out the "bores".
, an open access journal launched in 2001 by the European Geosciences Union
, has a two-stage publication process. In the first stage, papers that pass a quick screen by the editors are immediately published on the Atmospheric Chemistry and Physics Discussions website. They are then subject to interactive public discussion alongside formal peer review. Referees' comments (either anonymous or attributed), additional short comments by other members of the scientific community (which must be attributed) and the authors' replies are also published in ACPD. In the second stage, the peer-review process is completed and, if the article is formally accepted by the editors, the final revised papers are published in ACP. The success of this approach is shown by the ranking by Thomson Reuters
of ACP as the top journal in the field of Meteorology & Atmospheric Sciences
In June 2006, Nature
launched an experiment in parallel open peer review — some articles that had been submitted to the regular anonymous process were also available online for open, identified public comment. The results were less than encouraging — only 5% of authors agreed to participate in the experiment, and only 54% of those articles received comments. The editors have suggested that researchers may have been too busy to take part and were reluctant to make their names public. The knowledge that articles were simultaneously being subjected to anonymous peer review may also have affected the uptake.
In 2006, a group of UK academics launched the online journal Philica
, which tries to redress many of the problems of traditional peer review. Unlike in a normal journal, all articles submitted to Philica are published immediately and the review process takes place afterwards. Reviews are still anonymous, but instead of reviewers being chosen by an editor, any researcher who wishes to review an article can do so. Reviews are displayed at the end of each article, and so are used to give the reader criticism or guidance about the work, rather than to decide whether it is published or not. This means that reviewers cannot suppress ideas if they disagree with them. Readers use reviews to guide what they read, and particularly popular or unpopular work is easy to identify.
Another approach that is similar in spirit to Philica is that of a dynamical peer review site, Naboj. Unlike Philica, Naboj is not a full-fledged online journal, but rather it provides an opportunity for users to write peer reviews of preprints at arXiv.org. The review system is modeled on Amazon
and users have an opportunity to evaluate the reviews as well as the articles. That way, with a sufficient number of users and reviewers, there should be a convergence towards a higher quality review process.
In February 2006, the journal Biology Direct
was launched by BioMed Central
, providing another alternative to the traditional model of peer review. If authors can find three members of the Editorial Board who will each return a report or will themselves solicit an external review, then the article will be published. As with Philica
, reviewers cannot suppress publication, but in contrast to Philica, no reviews are anonymous and no article is published without being reviewed. Authors have the opportunity to withdraw their article, to revise it in response to the reviews, or to publish it without revision. If the authors proceed with publication of their article despite critical comments, readers can clearly see any negative comments along with the names of the reviewers.
An extension of peer review beyond the date of publication is Open Peer Commentary
, whereby expert commentaries are solicited on published articles, and the authors are encouraged to respond. In the summer of 2009, American academic Kathleen Fitzpatrick explored open peer review and commentary in her book, Planned Obsolescence, which was published by MediaCommons
using Commentpress, a Wordpress
plugin that enables readers to comment on and annotate book-length texts.
Scientific literature
Scientific literature comprises scientific publications that report original empirical and theoretical work in the natural and social sciences, and within a scientific field is often abbreviated as the literature. Academic publishing is the process of placing the results of one's research into the...
concept and process, central to which is the various transparency and disclosure of the identities of those reviewing scientific publications. The concept thus represents a departure from, and an alternative to, the incumbent anonymous peer review process, in which non-disclosure of these identities toward the public - and toward the authors of the work under review - is default practice. The open peer review concept appears to constitute a response to modern criticisms of the incumbent system; ergo, its emergence may be partially attributed to these phenomena.
Rationale
The traditional anonymous peer review has been criticized for its lack of accountability, possibility of abuse by reviewers, its possible bias and inconsistency, alongside other flaws.Both processes are intended to subject scholarly publications to the scrutiny of others who are experts in the same field.
The evidence of the effect of open peer review upon the quality of reviews, the tone and the time spent on reviewing is mixed, although it does seem that under open peer review, more of those who are invited to review decline to do so.
History
A number of reputable medical publishers have trialed the Open Peer Review concept, with many organizations making subsequent advances to the concept proper since its inception in c. ~1996.Early era: 1996-2000
In 1996, the Journal of Interactive Media in Education launched using open peer review. Reviewers' names are made public and they are therefore accountable for their review, but they also have their contribution acknowledged. Authors have the right of reply, and other researchers have the chance to comment prior to publication.In 1997, the Electronic Transactions on Artificial Intelligence, http://www.etaij.org, was launched as an open access journal by the European Coordinating Committee on Artificial Intelligence. This journal used a two-stage review process. In the first stage, papers that passed a quick screen by the editors were immediately published on the Transaction's discussion website fpr the purpose of on-line public discussion during a period of at least three months, where the contributors' names were made public except in exceptional cases. At the end of the discussion period, the authors were invited to submit a revised version of the article, and anonymous referees decided whether the revised manuscript would be accepted to the journal or not, but without any option for the referees to propose further changes. The last issue of this journal appeared in 2001.
In 1999, the open access journal Journal of Medical Internet Research
Journal of Medical Internet Research
The Journal of Medical Internet Research is a peer-reviewed open-access medical journal established in 1999 covering eHealth and "healthcare in the Internet age". It is edited and published by Gunther Eysenbach. The journal is widely regarded as one of the pioneers in open access publishing...
was launched, which from its inception decided to publish the names of the reviewers at the bottom of each published article. Also in 1999, the British Medical Journal
British Medical Journal
BMJ is a partially open-access peer-reviewed medical journal. Originally called the British Medical Journal, the title was officially shortened to BMJ in 1988. The journal is published by the BMJ Group, a wholly owned subsidiary of the British Medical Association...
moved to an open peer review system, revealing reviewers' identities to the authors (but not the readers), and in 2000, the medical journals in the open access BMC series published by BioMed Central
BioMed Central
BioMed Central is a UK-based, for-profit scientific publisher specialising in open access journal publication. BMC, and its sister companies Chemistry Central and PhysMath Central, publish over 200 scientific journals. Most BMC journals are now published only online. BMC describes itself as the...
, launched using open peer review. As with the BMJ
British Medical Journal
BMJ is a partially open-access peer-reviewed medical journal. Originally called the British Medical Journal, the title was officially shortened to BMJ in 1988. The journal is published by the BMJ Group, a wholly owned subsidiary of the British Medical Association...
, the reviewers' names are included on the peer review reports. In addition, if the article is published the reports are made available online as part of the 'pre-publication history'.
Several of the other journals published by the BMJ Group allow optional open peer review, as do PLoS Medicine
PLoS Medicine
PLoS Medicine is a peer-reviewed medical journal covering the full spectrum of the medical sciences. It began operation on October 19, 2004. It was the second journal of the Public Library of Science , a non-profit open-access publisher. All content in PLoS Medicine is published under the Creative...
, published by the Public Library of Science
Public Library of Science
The Public Library of Science is a nonprofit open-access scientific publishing project aimed at creating a library of open access journals and other scientific literature under an open content license...
. The BMJ
British Medical Journal
BMJ is a partially open-access peer-reviewed medical journal. Originally called the British Medical Journal, the title was officially shortened to BMJ in 1988. The journal is published by the BMJ Group, a wholly owned subsidiary of the British Medical Association...
s Rapid Responses allow ongoing debate and criticism following publication. By 2005, the editors found it necessary to more rigorously enforce the criteria for acceptance of Rapid Responses, to weed out the "bores".
Recent era: 2001-present
Atmospheric Chemistry and PhysicsAtmospheric Chemistry and Physics
Atmospheric Chemistry and Physics is an open access publication of the European Geosciences Union. It is a peer-reviewed scientific journal publishing studies investigating the Earth's atmosphere and the underlying chemical and physical processes. It covers the altitude range from the land and...
, an open access journal launched in 2001 by the European Geosciences Union
European Geosciences Union
The European Geosciences Union is an interdisciplinary non-profit learned society open to individuals who are professionally engaged in or associated with geosciences, planetary and space sciences, and related studies.The mission statement of the EGU is "Dedicated to the pursuit of excellence in...
, has a two-stage publication process. In the first stage, papers that pass a quick screen by the editors are immediately published on the Atmospheric Chemistry and Physics Discussions website. They are then subject to interactive public discussion alongside formal peer review. Referees' comments (either anonymous or attributed), additional short comments by other members of the scientific community (which must be attributed) and the authors' replies are also published in ACPD. In the second stage, the peer-review process is completed and, if the article is formally accepted by the editors, the final revised papers are published in ACP. The success of this approach is shown by the ranking by Thomson Reuters
Thomson Reuters
Thomson Reuters Corporation is a provider of information for the world's businesses and professionals and is created by the Thomson Corporation's purchase of Reuters Group on 17 April 2008. Thomson Reuters is headquartered at 3 Times Square, New York City, USA...
of ACP as the top journal in the field of Meteorology & Atmospheric Sciences
In June 2006, Nature
Nature (journal)
Nature, first published on 4 November 1869, is ranked the world's most cited interdisciplinary scientific journal by the Science Edition of the 2010 Journal Citation Reports...
launched an experiment in parallel open peer review — some articles that had been submitted to the regular anonymous process were also available online for open, identified public comment. The results were less than encouraging — only 5% of authors agreed to participate in the experiment, and only 54% of those articles received comments. The editors have suggested that researchers may have been too busy to take part and were reluctant to make their names public. The knowledge that articles were simultaneously being subjected to anonymous peer review may also have affected the uptake.
In 2006, a group of UK academics launched the online journal Philica
Philica
Philica is an online open access academic journal, which publishes articles on any subject.-History:Philica was founded in March 2006 by Ian Walker and Nigel Holt...
, which tries to redress many of the problems of traditional peer review. Unlike in a normal journal, all articles submitted to Philica are published immediately and the review process takes place afterwards. Reviews are still anonymous, but instead of reviewers being chosen by an editor, any researcher who wishes to review an article can do so. Reviews are displayed at the end of each article, and so are used to give the reader criticism or guidance about the work, rather than to decide whether it is published or not. This means that reviewers cannot suppress ideas if they disagree with them. Readers use reviews to guide what they read, and particularly popular or unpopular work is easy to identify.
Another approach that is similar in spirit to Philica is that of a dynamical peer review site, Naboj. Unlike Philica, Naboj is not a full-fledged online journal, but rather it provides an opportunity for users to write peer reviews of preprints at arXiv.org. The review system is modeled on Amazon
Amazon.com
Amazon.com, Inc. is a multinational electronic commerce company headquartered in Seattle, Washington, United States. It is the world's largest online retailer. Amazon has separate websites for the following countries: United States, Canada, United Kingdom, Germany, France, Italy, Spain, Japan, and...
and users have an opportunity to evaluate the reviews as well as the articles. That way, with a sufficient number of users and reviewers, there should be a convergence towards a higher quality review process.
In February 2006, the journal Biology Direct
Biology Direct
Biology Direct is an online open access scientific journal that publishes original, peer-reviewed research papers and hypotheses in biology. The journal is published by BioMed Central....
was launched by BioMed Central
BioMed Central
BioMed Central is a UK-based, for-profit scientific publisher specialising in open access journal publication. BMC, and its sister companies Chemistry Central and PhysMath Central, publish over 200 scientific journals. Most BMC journals are now published only online. BMC describes itself as the...
, providing another alternative to the traditional model of peer review. If authors can find three members of the Editorial Board who will each return a report or will themselves solicit an external review, then the article will be published. As with Philica
Philica
Philica is an online open access academic journal, which publishes articles on any subject.-History:Philica was founded in March 2006 by Ian Walker and Nigel Holt...
, reviewers cannot suppress publication, but in contrast to Philica, no reviews are anonymous and no article is published without being reviewed. Authors have the opportunity to withdraw their article, to revise it in response to the reviews, or to publish it without revision. If the authors proceed with publication of their article despite critical comments, readers can clearly see any negative comments along with the names of the reviewers.
An extension of peer review beyond the date of publication is Open Peer Commentary
Open Peer Commentary
Open peer commentary consists of eliciting non-anonymous commentary on a peer-reviewed "target article" from a dozen or more specialists across disciplines, co-published with the author's response. It was first implemented by the anthropologist Sol Tax, who founded the journal Current...
, whereby expert commentaries are solicited on published articles, and the authors are encouraged to respond. In the summer of 2009, American academic Kathleen Fitzpatrick explored open peer review and commentary in her book, Planned Obsolescence, which was published by MediaCommons
MediaCommons
MediaCommons is an in-development all-electronic scholarly publishing network in media studies, being created in partnership with the Institute for the Future of the Book and with the support of New York University and the National Endowment for the Humanities...
using Commentpress, a Wordpress
WordPress
WordPress is a free and open source blogging tool and publishing platform powered by PHP and MySQL. It is often customized into a content management system . It has many features including a plug-in architecture and a template system. WordPress is used by over 14.7% of Alexa Internet's "top 1...
plugin that enables readers to comment on and annotate book-length texts.