Re: "Bibliometric Distortion": The Babblarazzi Are At It Again...

From: Donald MacLeod <donald.macleod_at_GUARDIAN.CO.UK>
Date: Fri, 9 Nov 2007 12:41:47 +0000

http://blogs.guardian.co.uk/mortarboard/2007/11/british_academics_favourite_
bl.html
Airing this discussion on EducationGuardian.co.uk
Donald
=====================
Donald MacLeod
editor EducationGuardian.co.uk
and     SocietyGuardian.co.uk
020 7239 9913


Stevan Harnad <harnad_at_ECS.SOTON.AC.UK>
Sent by: American Scientist Open Access Forum
<AMERICAN-SCIENTIST-OPEN-ACCESS-FORUM_at_LISTSERVER.SIGMAXI.ORG>

09/11/07 11:11
                             Please respond to
              American Scientist Open Access Forum            
        <AMERICAN-SCIENTIST-OPEN-ACCESS-FORUM_at_LISTSERVER.SIGMAXI.ORG>


To
AMERICAN-SCIENTIST-OPEN-ACCESS-FORUM_at_LISTSERVER.SIGMAXI.ORG
cc
Subject
"Bibliometric Distortion": The Babblarazzi Are At It Again...




     Comment on: "Bibliometrics could distort research assessment"
    Guardian Education, Friday  9 November 2007
    http://education.guardian.co.uk/RAE/story/0,,2207678,00.html

Yes, any system (including democracy, health care, welfare, taxation,
market economics, justice, education and the Internet) can be abused.
But
abuses can be detected, exposed and punished, and this is especially
true in the case of scholarly/scientific research, where "peer
review"
does not stop with publication, but continues for as long as research
findings are read and used. And it's truer still if it is all online
and
openly accessible.

The researcher who thinks his research impact can be spuriously
enhanced
by producing many small, "salami-sliced" publications instead of
fewer
substantial ones will stand out against peers who publish fewer, more
substantial papers. Paper lengths and numbers are metrics too, hence
they too can be part of the metric equation. And if most or all peers
do
salami-slicing, then it becomes a scale factor that can be factored
out
(and the metric equation and its payoffs can be adjusted to
discourage it).

Citations inflated by self-citations or co-author group citations can
also be detected and weighted accordingly. Robotically inflated
download
metrics are also detectable, nameable and shameable. Plagiarism is
detectable too, when all full-text content is accessible online.

The important thing is to get all these publications as well as their
metrics out in the open for scrutiny by making them Open Access. Then
peer and public scrutiny -- plus the analytic power of the algorithms
and the Internet -- can collaborate to keep them honest.

    Harnad, S. (2007) Open Access Scientometrics and the UK Research
    Assessment Exercise. In Proceedings of 11th Annual Meeting of the
    International Society for Scientometrics and Informetrics 11(1),
pp.
    27-33, Madrid, Spain. Torres-Salinas, D. and Moed, H. F., Eds.
    http://eprints.ecs.soton.ac.uk/13804/

Stevan Harnad
AMERICAN SCIENTIST OPEN ACCESS FORUM:
http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-Forum.h
tml
    http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/

UNIVERSITIES and RESEARCH FUNDERS:
If you have adopted or plan to adopt a policy of providing Open
Access
to your own research article output, please describe your policy at:
    http://www.eprints.org/signup/sign.php
    http://openaccess.eprints.org/index.php?/archives/71-guid.html
    http://openaccess.eprints.org/index.php?/archives/136-guid.html

OPEN-ACCESS-PROVISION POLICY:
    BOAI-1 ("Green"): Publish your article in a suitable toll-access
journal
    http://romeo.eprints.org/
OR
    BOAI-2 ("Gold"): Publish your article in an open-access journal
if/when
    a suitable one exists.
    http://www.doaj.org/
AND
    in BOTH cases self-archive a supplementary version of your
article
    in your own institutional repository.
    http://www.eprints.org/self-faq/
    http://archives.eprints.org/
    http://openaccess.eprints.org/

------------------------------------------------------------------
Visit Guardian Unlimited - the UK's most popular newspaper website
http://guardian.co.uk http://observer.co.uk
------------------------------------------------------------------
The Newspaper Marketing Agency
Opening Up Newspapers
http://www.nmauk.co.uk
------------------------------------------------------------------

This e-mail and all attachments are confidential and may also
be privileged. If you are not the named recipient, please notify
the sender and delete the e-mail and all attachments immediately.
Do not disclose the contents to another person. You may not use
the information for any purpose, or store, or copy, it in any way.

Guardian News & Media Limited is not liable for any computer
viruses or other material transmitted with or as part of this
e-mail. You should employ virus checking software.

Guardian News & Media Limited
A member of Guardian Media Group PLC
Registered Office
Number 1 Scott Place, Manchester M3 3GG
Registered in England Number 908396
Received on Fri Nov 09 2007 - 13:08:11 GMT

This archive was generated by hypermail 2.3.0 : Fri Dec 10 2010 - 19:49:06 GMT