Re: Future UK RAEs to be Metrics-Based

From: Stevan Harnad <harnad_at_ecs.soton.ac.uk>
Date: Fri, 29 Sep 2006 14:51:50 +0100

    Prior Amsci Topic Threads:

    "UK Research Assessment Exercise (RAE) review" (Oct 2002)
    http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/subject.html#2326

    "Future UK RAEs to be Metrics-Based" (Mar 2006)
    http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/subject.html#5251

    "Let 1000 RAE Metric Flowers Bloom: Avoid Matthew Effect as
    Self-Fulfilling Prophecy" (June 2006)
    http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/5418.html

Re:
    http://www.universitiesuk.ac.uk/mediareleases/show.asp?MR=469
    http://www.russellgroup.ac.uk/news.html
    http://education.guardian.co.uk/RAE/story/0,,1882755,00.html
    http://www.egovmonitor.com/node/7841
    http://www.ucl.ac.uk/news/news-articles/0609/06092604

The UUK and the universities are spot-on in their criticism of the replacement of
the old panel RAE by *one metric* (prior research funding). That would be
*absurd* and extremely unfair, counterproductive and arbitrary.

But that has next to nothing to do with replacing the RAE's tremendously
wasteful panel-based exercise by *metricS* (plural), which include a
rich array of objective performance indicators rather than just one
self-fulfilling prophecy (prior funding).

UUK and the universities are also quite right that the metrics need to be
tested and validated, field by field (some already have been), and that the
metric formula and the weights for each of the metrics have to be adjusted
to each discipline. Whether, and if so how much, panel review will still
be needed in some disciplines once the metric formula has been tested
and optimised is an empirical question (but my own guess is: not much).

Stevan Harnad
http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-Forum.html
Received on Sat Sep 30 2006 - 21:45:59 BST

This archive was generated by hypermail 2.3.0 : Fri Dec 10 2010 - 19:48:31 GMT