[kippesp]

I prefer 5-point scales where 3 is average, 4 is above average, and 5 is well above average. (And if it is decided to have a 10-point scale, I'll just give ratings of 1, 3, 5, 7, 10.) Having an example of what qualifies would be helpful.

It'd also be nice to separate the criteria. So have a rating for documentation & implementation. But don't go overboard on this and have an "ease of installation" rating--otherwise the complex hacks would, by definition, have a lower rating. And who really cares about something subjective like that--what is trivial to one person may be confusing to another.