Weighing Articles/Authors Instead of Journals
in Research Assessment
The United Kingdom ranks and rewards the research productivity of all
its universities through a national Research Assessment Exercise (RAE)
http://www.rae.ac.uk/ conducted every four years.
If, as lately proposed, the "RAE shifts focus from prestige journals"
http://www.thes.co.uk/current_edition/story.aspx?story_id=2023494
(THS, 22 July 2005) as a basis for its ranking, what will it shift focus
to?
An established journal's prestige and track-record are
correlated with its selectivity and peer-review standards,
http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/4075.html
hence its quality level, and often also its citation impact.
http://opcit.eprints.org/oacitation-biblio.html
What would it mean to ignore or de-emphasise that? The correlations will
be ignored, all articles will be given equal weight -- and then what?
What gain in accuracy and fairness of research assessment is to be
expected from ignoring the known predictors -- for correlation is
predictive -- of research quality? Are all articles to be
re-peer-reviewed by the RAE itself, bottom-up? Is that efficient,
desirable, realistic? The most prestigious international journals draw
upon international expertise in their peer review: Is the UK to
reduplicate all this effort in-house every 4 years? Why? Isn't our time
better spent getting the peer-reviewing done right the first time, and
then getting on with our research?
Research assessment used to be publish-or-perish bean-counting; it is
now weighted by the quality level of the journal in which the bean is
planted. RAE outcome is already highly correlated with counts of the
citations that articles sprout, even though the RAE never actually
counts citations directly. That's because a journal's prestige is
correlated with its articles' citation counts.
http://www.ariadne.ac.uk/issue35/harnad/
So if we're going to start ignoring journal prestige, shouldn't we begin
to count article (and author) citations directly in its place?
http://citebase.eprints.org/
Stevan Harnad
AMERICAN SCIENTIST OPEN ACCESS FORUM:
A complete Hypermail archive of the ongoing discussion of providing
open access to the peer-reviewed research literature online (1998-2005)
is available at:
http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/
To join or leave the Forum or change your subscription address:
http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-Forum.html
Post discussion to:
american-scientist-open-access-forum_at_amsci.org
UNIVERSITIES: If you have adopted or plan to adopt an institutional
policy of providing Open Access to your own research article output,
please describe your policy at:
http://www.eprints.org/signup/sign.php
UNIFIED DUAL OPEN-ACCESS-PROVISION POLICY:
BOAI-1 ("green"): Publish your article in a suitable toll-access journal
http://romeo.eprints.org/
OR
BOAI-2 ("gold"): Publish your article in a open-access journal if/when
a suitable one exists.
http://www.doaj.org/
AND
in BOTH cases self-archive a supplementary version of your article
in your institutional repository.
http://www.eprints.org/self-faq/
http://archives.eprints.org/
Received on Wed Jul 27 2005 - 19:55:55 BST