@HoboZero said:
If you are a 'trusted' review site on an aggregator like metacritic, do you think you have some responsibility to calibrate your scoring with other submitters? I'm of the ilk that would LOVE to see all review scores simply go away, to be sure, but shouldn't any site that submits to metacritic for the pageviews (and really, that is the ONLY reason a review site participates in metacritic aggregation, for the linkbacks) have a responsibility to score even remotely similar to other sites?
For example, what if my scoring range is 1-5. 1 for every game that runs without exploding, 2-4 for revolutionary, life-altering experiences, and 5 for Resident Evil games, regardless of quality. I mean, just like Tom Chick, these are my Honest Opinions, and I am being up front about them - but they're also not what ANYONE ELSE on the aggregtor uses when scoring, and adding my data will just muddle and already obfuscated system.
I guess what I'm saying is: when you submit to an aggregator you're really saying "My score is as accurate as everyone elses"... well, maybe not 'saying'... 'inferring'? Seems like there's an ethical responsibility to calibrate with the consesus. Or not, that's just, like, my opinion, man.
Score Halo 4 One Potato out of Five Watermelon Starbursts for all I care, but don't submit it to metacritic. Problem solved. Whole issue feels like a case of 1st Degree Sh*t-Stirring.
I give this comment 1/5 stars
No, I don't think you have that sort of responsibility to calibrate with others. I think it's valid for reviewers to use different criteria from each other to review games; I think their only responsibility is to stay calibrated within what they have stated as their own criteria for reviewing games, so you have a good idea that each score means for that reviewer. If reviewers submitting to Metacritic are obligated to calibrate their scores with other sites, that would be promoting groupthink, which is definitely not desired in a field that primarily relies on opinion. Reviewers' review scores should be evaluated in the context of the content of the review as well as the context of the general tendencies of each reviewer, which of course, makes the overall Metacritic score not very informative beyond a very general sense of a game (which is all it should be used for).
Log in to comment