There’s some really interesting discussion starting to take place about the pros and cons of various kinds of ranking systems for philosophy. A couple of years ago I wrote a paper on the potential for implicit bias in both the PGR and the REF. I thought it might be useful for that paper to be a part of these discussions, so I’m posting the penultimate draft of it here. (Also, I can’t figure out how to use my university’s newly updated CMS. Grr!)
The paper is “Ranking Exercises in Philosophy and Implicit Bias”, in Journal of Social Philosophy, 43:3, 2012.
It was only after publishing the paper that I noticed another interesting difference between REF and PGR. I’m no great fan of the REF– it has lots of problems, but it does have the nice feature of not weighting an areas of philosophy more heavily than any others. Whatever area your work is in, it’s only ranked by people in your area, and there’s no overall ranking of departments, except in so far as various competing ones can be (and are) arrived at through the rankings of work, impact, etc. So there’s no case to be made that a department will do better in the REF by hiring an analytic metaphysician than a pragmatist. Departments are free to just go by quality and teaching/supervising needs, without worrying that they should favour particular areas for the sake of the rankings.