28 May 2013 4 Comments
People seem to be talking about how the peer review funding system is in crisis – more applications, less funding, not enough reviewers, etc. Always eager to help, here’s this Research Whisperer’s Top Five ideas on how funding organizations can reduce their workloads.
My examples are based upon the Australian Research Council (ARC), as this is the system I know best. However, these ideas can adopted by any funding agency. After all, I pinched three of them from existing funding schemes.
1. Review a set number of applications
One of the fears seems to be that a rising number of applications is forcing the quality of peer review down. The thinking goes like this: more applications means more reviews required. More reviews means more applications per reviewer (on average). Reviewers, therefore, may be spending less time on each review, or even be refusing to review applications. Without suitable reviews, the system of peer review falls over, catastrophically.
If this fear is justified, one response could be to cap the number of applications accepted. This process is known as ‘demand management’ in the UK context. The ARC knows how many admin people it has, how many people it has on the College of Experts, how many assessors it sends applications to, how many reply, how long the average application is for each scheme. These figures could be munged together to provide an upper limit of applications that the ARC would accept for each funding scheme that it runs.
If they know their capacity, the question then becomes how to make sure that only that number of applications are presented each round.