The Necessity of Commensuration Bias in Grant Peer Review
The Necessity of Commensuration Bias in Grant Peer Review
Blog Article
Peer reviewers at many funding agencies and scientific journals are asked to score submissions both on individual criteria and overall.The overall scores should be some kind of aggregate of the criteria scores.Carole Lee identifies this as a potential B CALM locus for bias to enter the peer review process, which she calls commensuration bias.Here I view the aggregation of scores through the lens of social choice theory.I argue that, when Arthritis Pain Relief reviewing grant proposals, it is in many cases impossible to avoid commensuration bias.