Power to the People, Until the Power's Out of Control

Avatar image for patrickklepek
patrickklepek

6833

Forum Posts

1300

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Edited By patrickklepek
Signal Games is not the only developer to experience a rash of strange, out-of-nowhere negative reviews on Metacritic.
Signal Games is not the only developer to experience a rash of strange, out-of-nowhere negative reviews on Metacritic.

Signal Studios had a problem last week.

The tiny developer of Toy Soldiers: Cold War discovered its game had been hit with a series of negative, score-only (meaning no text) user reviews on Metacritic overnight, dragging its overall user rating down. While the scores assigned by critics are important, so are user reviews--anyone visting Metacritic is free to sort games by user reviews, too.

Metacritic has been a lightning rod of criticism over the years, due to its ties to developer pay.
Metacritic has been a lightning rod of criticism over the years, due to its ties to developer pay.

"There is a rash of fake negative user scores going about Metacritic and it hit TS:CW (and other games)," said Signal Studios community manager Logan DeMelt last week. "This means we need to hear your voice!"

DeMelt started mobilizing fans to add more reviews to the pile, incentivizing them with free download codes for Toy Soldiers: Cold War.

"If you write a user review," he said, "just being honest (we aren't bribing for positive) we will do the following: You write a review & post it, and we will put your name in for a chance for a prize on Friday. Every 10 new posts, we will drop a code out."

Of course, there are problems with this approach, especially in terms of the perception of a developer asking people to write reviews, albeit not advocating positive or negative, by dangling prizes around. DeMelt even got some Twitter flack about the concept from a friend, Sucker Punch community manager Colin Moore.

When I talked to Signal Studios president and creative director Douglas Robert Albright III on the phone last week, he told me he'd asked DeMelt to stop the promotion, understanding how people might interpret it.

"It doesn't matter what your intentions are, it's what the perception is," said Albright. "If that's the perception, then we'll just stop doing it. Because, honestly, he [DeMelt] had no intention of bribing people to get good scores."

"It was actually my fault," he continued. "I looked at the Metacritic and contacted them and told them 'This has been spammed.' We're not a bunch of dudes with a bunch of money laying around or whatever. It affects us, right? You can search by user scores and stuff like that. It's clearly spam. Metacritic just responded with this generic thing. All the intent was 'Well, this isn't our fault, we're just going to go on Metacritic and [ask users to] review the game.'"

Signal Studios noticed a spike in negative reviews overnight, without review text to accompany it.
Signal Studios noticed a spike in negative reviews overnight, without review text to accompany it.

Like it or not, Metacritic has become important to the games industry. It's a system with faults, and one that's come under enormous criticism over the years. But game publishers have few ways to determine success outside of sales--so they turn to Metacritic. Metacritic determines bonuses and royalty payouts for many. Thus, developers have reason to pay close attention.

The situation prompts hard questions for developers, especially small ones with financial destinies tied to something partially out of its control. There are few options. Asking for reviews could be perceived wrong, but what do you do if the negative reviews seem fake? How do you prove that? If you can't prove it but know you're right, do you gamble the possible backlash?

The motivations behind the user or users spamming Metatritic with negative reviews are unknown. Blind Internet rage? Sheer boredom? A new form of spam?

"I don't imagine there is some conspiracy," said Albright. "I think some folks just do annoying crap because they can. Like the kids who hack the leaderboards or idiots who deploy viruses. Ever play mailbox baseball?"

...no comment.

In any case, Albright hasn't received any evidence worth acting on--and neither has another studio.

The only reason Signal Studios even realized something was goofy on its Metacritic page was thanks to Supergiant Games noticing a similar explosion of negative user reviews overnight for Bastion in early September.

Signal Studios was tipped off to the Metacritic issue by Supergiant Games.
Signal Studios was tipped off to the Metacritic issue by Supergiant Games.

"I think it was sitting at around a mid-8 on Xbox 360 and at a 9 on PC, but on September 2 it had dropped into the 6s," said Supergiant Games creative director Greg Kasavin to me over email. "No additional user reviews were posted on that day (or at least no new negative reviews were posted), but I noticed that we had 20 new 'negative' user ratings that were entered for both versions of the game. This struck me and the rest of us as highly suspicious, because we were gathering new user ratings at a much slower rate than that in previous days. The idea that all of a sudden we would get 40 extremely disappointed people come and give us a 0 out of 10 rating all at the same time seemed very dubious."

Supergiant Games mentioned the bizarre nature of the user reviews over its Twitter and Facebook accounts and left it at that.

"It's the first time we've ever complained about something via our Facebook and Twitter so I didn't do it lightly," said Kasavin.

Bastion's user review score went up as a result--7.7 on Xbox 360, 8.0 on PC--but the damage was done. Kasavin flagged the issue with Metacritic but was told little could be done. Metacritic said it's very careful with user reviews, especially so if the user doesn't actually write a review. On Metacritic, it's possible to submit a "review" with only a score, making it difficult to determine whether someone simply registered an account and their negative review was their first submission--or spam.

Supergiant mentioned the Metacritic issue and users responded with positive reviews.
Supergiant mentioned the Metacritic issue and users responded with positive reviews.

"We just had to let it go," he said. "We value Metacritic as a service and are the highest rated XBLA [Xbox Live Arcade] game released so far this year according to them. There are some really great user reviews of our game on there, and if ratings-bombing continues to be an issue for other products, I trust it's something that the team there will investigate a solution more closely."

I contacted Metacritic about this pattern of issues. Metacritic told me each review has a "report abuse" option, which sends the review to Metacritic's team to possibly delete the review or ban the user.

"If any interested party feels that there has been a group of illegitimate user ratings (score only) entered for its game, they can contact me through the website and we'll investigate the issue," explained co-founder Marc Doyle. "We track each rating and can delete any that appear to be illegitimate or suspicious to us after a staff review of the rating data in question."

For now, for better or worse, that's the way the system works.

"The way to fix Metacritic user reviews is to simply require a written review and verify user accounts," said Albright. "If it was just some random blog I'd say whatever. But this is a major news review aggregator that should have better oversight and some standards."

Avatar image for patrickklepek
patrickklepek

6833

Forum Posts

1300

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#1  Edited By patrickklepek
Signal Games is not the only developer to experience a rash of strange, out-of-nowhere negative reviews on Metacritic.
Signal Games is not the only developer to experience a rash of strange, out-of-nowhere negative reviews on Metacritic.

Signal Studios had a problem last week.

The tiny developer of Toy Soldiers: Cold War discovered its game had been hit with a series of negative, score-only (meaning no text) user reviews on Metacritic overnight, dragging its overall user rating down. While the scores assigned by critics are important, so are user reviews--anyone visting Metacritic is free to sort games by user reviews, too.

Metacritic has been a lightning rod of criticism over the years, due to its ties to developer pay.
Metacritic has been a lightning rod of criticism over the years, due to its ties to developer pay.

"There is a rash of fake negative user scores going about Metacritic and it hit TS:CW (and other games)," said Signal Studios community manager Logan DeMelt last week. "This means we need to hear your voice!"

DeMelt started mobilizing fans to add more reviews to the pile, incentivizing them with free download codes for Toy Soldiers: Cold War.

"If you write a user review," he said, "just being honest (we aren't bribing for positive) we will do the following: You write a review & post it, and we will put your name in for a chance for a prize on Friday. Every 10 new posts, we will drop a code out."

Of course, there are problems with this approach, especially in terms of the perception of a developer asking people to write reviews, albeit not advocating positive or negative, by dangling prizes around. DeMelt even got some Twitter flack about the concept from a friend, Sucker Punch community manager Colin Moore.

When I talked to Signal Studios president and creative director Douglas Robert Albright III on the phone last week, he told me he'd asked DeMelt to stop the promotion, understanding how people might interpret it.

"It doesn't matter what your intentions are, it's what the perception is," said Albright. "If that's the perception, then we'll just stop doing it. Because, honestly, he [DeMelt] had no intention of bribing people to get good scores."

"It was actually my fault," he continued. "I looked at the Metacritic and contacted them and told them 'This has been spammed.' We're not a bunch of dudes with a bunch of money laying around or whatever. It affects us, right? You can search by user scores and stuff like that. It's clearly spam. Metacritic just responded with this generic thing. All the intent was 'Well, this isn't our fault, we're just going to go on Metacritic and [ask users to] review the game.'"

Signal Studios noticed a spike in negative reviews overnight, without review text to accompany it.
Signal Studios noticed a spike in negative reviews overnight, without review text to accompany it.

Like it or not, Metacritic has become important to the games industry. It's a system with faults, and one that's come under enormous criticism over the years. But game publishers have few ways to determine success outside of sales--so they turn to Metacritic. Metacritic determines bonuses and royalty payouts for many. Thus, developers have reason to pay close attention.

The situation prompts hard questions for developers, especially small ones with financial destinies tied to something partially out of its control. There are few options. Asking for reviews could be perceived wrong, but what do you do if the negative reviews seem fake? How do you prove that? If you can't prove it but know you're right, do you gamble the possible backlash?

The motivations behind the user or users spamming Metatritic with negative reviews are unknown. Blind Internet rage? Sheer boredom? A new form of spam?

"I don't imagine there is some conspiracy," said Albright. "I think some folks just do annoying crap because they can. Like the kids who hack the leaderboards or idiots who deploy viruses. Ever play mailbox baseball?"

...no comment.

In any case, Albright hasn't received any evidence worth acting on--and neither has another studio.

The only reason Signal Studios even realized something was goofy on its Metacritic page was thanks to Supergiant Games noticing a similar explosion of negative user reviews overnight for Bastion in early September.

Signal Studios was tipped off to the Metacritic issue by Supergiant Games.
Signal Studios was tipped off to the Metacritic issue by Supergiant Games.

"I think it was sitting at around a mid-8 on Xbox 360 and at a 9 on PC, but on September 2 it had dropped into the 6s," said Supergiant Games creative director Greg Kasavin to me over email. "No additional user reviews were posted on that day (or at least no new negative reviews were posted), but I noticed that we had 20 new 'negative' user ratings that were entered for both versions of the game. This struck me and the rest of us as highly suspicious, because we were gathering new user ratings at a much slower rate than that in previous days. The idea that all of a sudden we would get 40 extremely disappointed people come and give us a 0 out of 10 rating all at the same time seemed very dubious."

Supergiant Games mentioned the bizarre nature of the user reviews over its Twitter and Facebook accounts and left it at that.

"It's the first time we've ever complained about something via our Facebook and Twitter so I didn't do it lightly," said Kasavin.

Bastion's user review score went up as a result--7.7 on Xbox 360, 8.0 on PC--but the damage was done. Kasavin flagged the issue with Metacritic but was told little could be done. Metacritic said it's very careful with user reviews, especially so if the user doesn't actually write a review. On Metacritic, it's possible to submit a "review" with only a score, making it difficult to determine whether someone simply registered an account and their negative review was their first submission--or spam.

Supergiant mentioned the Metacritic issue and users responded with positive reviews.
Supergiant mentioned the Metacritic issue and users responded with positive reviews.

"We just had to let it go," he said. "We value Metacritic as a service and are the highest rated XBLA [Xbox Live Arcade] game released so far this year according to them. There are some really great user reviews of our game on there, and if ratings-bombing continues to be an issue for other products, I trust it's something that the team there will investigate a solution more closely."

I contacted Metacritic about this pattern of issues. Metacritic told me each review has a "report abuse" option, which sends the review to Metacritic's team to possibly delete the review or ban the user.

"If any interested party feels that there has been a group of illegitimate user ratings (score only) entered for its game, they can contact me through the website and we'll investigate the issue," explained co-founder Marc Doyle. "We track each rating and can delete any that appear to be illegitimate or suspicious to us after a staff review of the rating data in question."

For now, for better or worse, that's the way the system works.

"The way to fix Metacritic user reviews is to simply require a written review and verify user accounts," said Albright. "If it was just some random blog I'd say whatever. But this is a major news review aggregator that should have better oversight and some standards."

Avatar image for vinny_says
Vinny_Says

5913

Forum Posts

3345

Wiki Points

0

Followers

Reviews: 0

User Lists: 14

#2  Edited By Vinny_Says

It's sad devs put so much importance on metacritic, even sadder when they care about user reviews where anyone can write anything

Avatar image for yodzilla
yodzilla

101

Forum Posts

6

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#3  Edited By yodzilla

I didn't think anyone paid attention to the user reviews. The aggregated "real" reviews yes but the user reviews have always been garbage.

Avatar image for falling_fast
falling_fast

2905

Forum Posts

189

Wiki Points

0

Followers

Reviews: 1

User Lists: 6

#4  Edited By falling_fast

metacritic is silly

Avatar image for stormharbinger
StormHarbinger

26

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#5  Edited By StormHarbinger

Great piece Patrick. Important stuff to consider.

Avatar image for undeadpool
Undeadpool

7832

Forum Posts

10761

Wiki Points

0

Followers

Reviews: 19

User Lists: 16

#6  Edited By Undeadpool

I remember when this exact thing happened for Dragon Age II...and I'm sure it will absolutely happen for Gears of War 3. It's really said that publishers prize User Reviews this highly for this exact reason. Yeah, it wouldn't be terribly smart to just tell your user base you flat-out don't care unless they're "critics," but tying THIS much to them is just primed for this kind of random mayhem.

Avatar image for diablos1125
Diablos1125

190

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#7  Edited By Diablos1125

Man Metacritic is filthy

Avatar image for benjaebe
benjaebe

2868

Forum Posts

7204

Wiki Points

0

Followers

Reviews: 1

User Lists: 6

#8  Edited By benjaebe

@Vinny_Says said:

It's sad devs put so much importance on metacritic, even sadder when they care about user reviews where anyone can write anything

Devs don't, but publishers do because it's a quick and easy way to look at how a game is doing. It's stupid, I hate it and it's horribly inaccurate, but it's how things are right now. What's worse is when they apply a 100 point scale to every reviewer. A 4/5 on Giant Bomb becomes an 80, even if that's not the reviewers intention. And there's nothing they can do about it. Adam Sessler had a talk at GDC about it which you can watch here. He has it pretty much nailed down.

This is no surprise to see user reviews get spammed. It happens to bigger releases too - Dragon Age 2 got firebombed on Metacritic when it came out, as did Portal 2.

Avatar image for prometheum5
Prometheum5

50

Forum Posts

19

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#9  Edited By Prometheum5

Metacritic is dumb, but if you are going to pay attention to it and use its results for things as important as dev pay, why allow textless scores at all? I mean, either limit it to meaningful feedback only, or just ignore the whole thing as the sham it is.

Also- huge thanks to Patrick for writing a really interesting piece I something I didn't even know existed. Metacritic spam... what will they think of next?

Avatar image for jeffk38uk
jeffk38uk

726

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 5

#10  Edited By jeffk38uk

It wouldn't shock me if it really was a group of people spamming 0/10's simply because they can. For the lolz. Especially if it can bring a games overall scoring down. Cause if it's possible to, why wouldn't you do it?

Avatar image for craves
craves

114

Forum Posts

80

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#11  Edited By craves

Perhaps mobs of other downloadable devs submitting 0/10 user ratings for the downloadable titles that deserve praise?

I sure hope not.

Avatar image for metalsnakezero
metalsnakezero

2884

Forum Posts

113

Wiki Points

0

Followers

Reviews: 0

User Lists: 27

#12  Edited By metalsnakezero

This is a really broken system if things like this is happening.

Avatar image for raisingindiana
RaisingIndiana

85

Forum Posts

521

Wiki Points

0

Followers

Reviews: 0

User Lists: 3

#13  Edited By RaisingIndiana

It's crazy how much developers believe Metacritic influences decisions. Sure it counts to a certain degree, but to rely so heavily on it can be a crutch.

Avatar image for pr1mus
pr1mus

4158

Forum Posts

1018

Wiki Points

0

Followers

Reviews: 4

User Lists: 4

#14  Edited By pr1mus

BREAKING: people on the internet are shit!

Avatar image for prestonhedges
prestonhedges

1961

Forum Posts

42

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#15  Edited By prestonhedges

Next, video game developers will feel threatened when their YouTube videos get dislikes. Users review video games with their wallets, and if I'm trolling Metacritic looking for user review scores to make my purchasing decisions, I probably shouldn't be in charge of where my money goes in the first place.

A lot of avenues in the video game industry just seem to get a sigh of disdain and the inevitable conclusion of "Yeah, the system's fucked up, but whaddayagonnado?" Genre definitions, video game journalism, reviews, etc. Doesn't really inspire confidence.

Avatar image for knetic2341
knetic2341

255

Forum Posts

131

Wiki Points

0

Followers

Reviews: 0

User Lists: 2

#16  Edited By knetic2341

Man, I hate people who do that. These are small developers who are getting attacked for no reason. It's a shame that people have to do it to developers like Supergiant and Signal.

Avatar image for zameer
zameer

636

Forum Posts

11759

Wiki Points

0

Followers

Reviews: 7

User Lists: 3

#17  Edited By zameer

@Yodzilla said:

I didn't think anyone paid attention to the user reviews. The aggregated "real" reviews yes but the user reviews have always been garbage.

This.

Avatar image for shadow789
shadow789

8

Forum Posts

1

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#18  Edited By shadow789

I can't believe you can submit a review with only a score. Seems pretty ridiculous.

Avatar image for bybeach
bybeach

6680

Forum Posts

1

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#19  Edited By bybeach

Now metacritic is pissing me off...maybe it soesn't deserve to house the gold standard.

Avatar image for tinygallon
TinyGallon

196

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#20  Edited By TinyGallon

The surprising thing is that this isn't more common. Why aren't more people flaming between your Halos and Call of Dutys, etc.

I think the answer was mentioned in the comments already, who really cares.. Does anyone actually give a thought to the user score on metacritic? Even the critic score you have to take with a grain of salt until you can read more..

Interesting story though Pat, as usual

Avatar image for insectecutor
Insectecutor

1264

Forum Posts

217

Wiki Points

0

Followers

Reviews: 1

User Lists: 2

#21  Edited By Insectecutor
"The way to fix Metacritic user reviews is to simply require a written review and verify user accounts," said Albright.

Not sure I agree there. Forcing a written review would just make people post a bunch of bullshit, and verifying accounts is too time consuming.

What they should do is weight user reviews based on the number of other users that have tagged the review "helpful." Then if you post 20 negative reviews and nobody finds your review helpful it doesn't affect the final score.

Avatar image for joey_ravn
JoeyRavn

5290

Forum Posts

792

Wiki Points

0

Followers

Reviews: 2

User Lists: 3

#22  Edited By JoeyRavn

What worries me most is that if I sincerely dislike a game (for example, Bastion) and give it a low score, my rating will be dismissed as "spam". What an awesome tool Metacritic is.

Avatar image for benderunit22
benderunit22

1978

Forum Posts

9567

Wiki Points

0

Followers

Reviews: 6

User Lists: 1

#23  Edited By benderunit22

That's why I think anyone who tells people to go by user reviews and ignore those fake, bought site reviews are stupid. User reviews are a gathering of 10s and 1s that say absolutely nothing about a game.

Avatar image for zalera
Zalera

351

Forum Posts

4

Wiki Points

0

Followers

Reviews: 0

User Lists: -1

#24  Edited By Zalera

I fucking hate Metacritic.

Avatar image for machofantastico
MachoFantastico

6762

Forum Posts

24

Wiki Points

0

Followers

Reviews: 73

User Lists: 4

#25  Edited By MachoFantastico

From a gamers perspective, Metacritic is useless to me and it's sad that companies who actually make the games I play rely so heavily on one simple (and very flawed) site to see if the hard working men and women deserve to be paid. It's a joke really, and stinks of suited up business men and women not knowing anything about the gaming industry.

Metacritic need to really clean themselves up to, they could be doing more but they just don't seem to want to. For example, why don't they change the system so you have to leave a written review (of a specific word amount) instead of simply allowing people to change a percentage meter and click submit. Guess Metacritic like being in the news all the time, but it baffles me that companies rely on such a system whose flaws and weakness are clear to those who make games, and those who play games.

Always wondered how film studios feel about metacritic, I know they arguable look more towards ticket sales (as they should so) but it as to be a similar situation. But as for what Signal Studio did to entice user reviews... yeah I'm not cool with that even if they wanted 'honest' reviews.

Avatar image for nadafinga
Nadafinga

1044

Forum Posts

36764

Wiki Points

0

Followers

Reviews: 2

User Lists: 10

#26  Edited By Nadafinga

"...this is a major news review aggregator that should have better oversight and some standards."

Amen to that. For better or worse, metacritic has a major influence, and they really need to stop the review spamming that going on.

Avatar image for mistermouse
MisterMouse

3608

Forum Posts

272

Wiki Points

0

Followers

Reviews: 5

User Lists: 5

#27  Edited By MisterMouse

Yeah everyone else's comments is spot on...

Avatar image for zeeroid
zeeroid

6

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#28  Edited By zeeroid

I don't even know why people pay attention to the user ratings at all. They're completely useless. If you want to know what the gamers think, read some of their reviews.

Avatar image for wandrecanada
Wandrecanada

1011

Forum Posts

7

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#29  Edited By Wandrecanada

Is it possible that there is a place or places where we can review Metacritic?  I have a negative score I'd like to find a home for.

Avatar image for zelnox
Zelnox

559

Forum Posts

213

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#30  Edited By Zelnox

Oversight?

Avatar image for arker101
Arker101

1484

Forum Posts

1

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#31  Edited By Arker101

It's sad that douchebags on the internet affect good game publishers and developers like this.

Avatar image for silver-streak
Silver-Streak

2022

Forum Posts

587

Wiki Points

0

Followers

Reviews: 1

User Lists: 4

#32  Edited By Silver-Streak

I think this could likely be solved by listing review-only scores with the username that submitted them, as well as have a username related review history. You know, like the smart people at Whiskey Media have.

If a user has no other reviews, was registered within 30 seconds as the other 10 score-only-reviewers did, there's a good chance it's a sign of abuse.

Avatar image for seakae
seakae

265

Forum Posts

158

Wiki Points

0

Followers

Reviews: 0

User Lists: 8

#33  Edited By seakae

Just another reason why people shouldn't use the site.

Avatar image for mosespippy
mosespippy

4751

Forum Posts

2163

Wiki Points

0

Followers

Reviews: 4

User Lists: 8

#34  Edited By mosespippy

This is clearly the fault of John Davison.

Avatar image for foolishchaos
FoolishChaos

515

Forum Posts

2

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#35  Edited By FoolishChaos
@Vinny_Says

It's sad devs put so much importance on metacritic, even sadder when they care about user reviews where anyone can write anything

They care about metacritic because people use it. It affects game sales. Its not sad that indie developers put so much importance on making a living.
Avatar image for robin_gr
Robin_Gr

139

Forum Posts

5

Wiki Points

0

Followers

Reviews: 0

User Lists: 3

#36  Edited By Robin_Gr

User reviews don't really matter, if its perception everyone is worried about. Especially on Metacritic where the the average "official" reviews value is displayed much more prominently. It might be different on an amazon style site where user reviews are the only opinions given on products.

Avatar image for darkjester74
darkjester74

1738

Forum Posts

0

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

#37  Edited By darkjester74

Why anyone would base a buying decision on Metacritic is beyond me. Utterly useless for getting any actual reviews.

The real insanity here is publishers tying bonus and royalty payouts to Metacritic scores. Does anyone really believe that a higher Metacritic score is directly tied to higher sales?

Avatar image for ultimaxe
UltimAXE

800

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#38  Edited By UltimAXE

@JoeyRavn said:

What worries me most is that if I sincerely dislike a game (for example, Bastion) and give it a low score, my rating will be dismissed as "spam". What an awesome tool Metacritic is.

Not if you take the time to explain what your issues are. Really, though, this industry puts way too much stock in numerical scoring of its software. I've never even been to Metacritic and am not one to argue semantics over whether a game deserves an 8.5 or a 9, but when people's paychecks are revolving around that and it is fairly easy to manipulate maliciously, it does become a bit of an issue.

Avatar image for delta_ass
delta_ass

3776

Forum Posts

0

Wiki Points

0

Followers

Reviews: 36

User Lists: 7

#39  Edited By delta_ass

"Excuse me I'd like to give a user review of 1.0."

"Certainly. May I ask why?"

"For spite."

"Spite?"

"That's right. I don't care for the developer."

"I don't think you can review a game for spite."

"What do you mean?"

"Well if there was some problem with the game, if it were unsatisfactory in some way, then we could do it for you, but I'm afraid spite doesn't fit into any of our conditions for a review."

"That's ridiculous, I want to review it. What's the difference what the reason is?"

You can't review a game based purely on spite."

"Well so fine then... then I don't like it and then that's why I'm giving it a 1."

"Well you already said spite so..."

"But I changed my mind..."

"No... You said spite... Too late."

Avatar image for cretaceous_bob
Cretaceous_Bob

552

Forum Posts

3

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#40  Edited By Cretaceous_Bob
But this is a major news review aggregator that should have better oversite and some standards.

That's not a word.

Avatar image for lokilaufey
lokilaufey

305

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#41  Edited By lokilaufey

@Vinny_Says said:

It's sad devs put so much importance on metacritic, even sadder when they care about user reviews where anyone can write anything

Devs care because publishers care because some consumers care. Most people kind of admit either MetaCritic is terrible or flawed, but publishers & consumers pay attention to how things are scored on that site so devs have to pay attention to it whether they want to or not. It can actually impact sales.

Avatar image for maddprodigy
MaddProdigy

1074

Forum Posts

178

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

#42  Edited By MaddProdigy

I had no idea anyone in the games industry actually used Metacritic to determine pay! Who are they and what in the world are they smoking? Even if it wasn't an oversight-less, independent site, the entire content of the site is opinion based. Even the game critic reviews are just professional user reviews, that's totally ludicrous that someone else's opinion would decide bonuses, and not the years and years of work developers put into a product.

I would like some more details Patrick, perhaps another story about MetaCritic and which developers/studios give it such importance?

Oh and that sucks that someone is obviously review bombing developers scores but the Metacritic people are too lazy to make a fix.

Avatar image for hadestimes
HadesTimes

969

Forum Posts

13

Wiki Points

0

Followers

Reviews: 6

User Lists: 8

#43  Edited By HadesTimes

Great piece Patrick, no one else has this. I would suggest publishers begin the painful process of ignoring Metacritic and actually reading reviews again. *gasp*

Avatar image for white_silhouette
White_Silhouette

523

Forum Posts

308

Wiki Points

0

Followers

Reviews: 0

User Lists: 4

#44  Edited By White_Silhouette

Here is just another example of how user reviews are getting out of hand. A screen shot taken today.

No Caption Provided
Avatar image for alexw00d
AlexW00d

7599

Forum Posts

3686

Wiki Points

0

Followers

Reviews: 0

User Lists: 5

#45  Edited By AlexW00d

Maybe the game just sucks?

Avatar image for bhhawks78
bhhawks78

1348

Forum Posts

18

Wiki Points

0

Followers

Reviews: 0

User Lists: 2

#46  Edited By bhhawks78

@JoeyRavn said:

What worries me most is that if I sincerely dislike a game (for example, Bastion) and give it a low score, my rating will be dismissed as "spam". What an awesome tool Metacritic is.

There is a huge difference between a written review with a low score and 40 random accounts giving a 0 out of ten with no explanation.

Avatar image for om1kron
137

487

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#47  Edited By 137

the fuck is meta critic?

Avatar image for delta_ass
delta_ass

3776

Forum Posts

0

Wiki Points

0

Followers

Reviews: 36

User Lists: 7

#48  Edited By delta_ass

@White_Silhouette said:

No Caption Provided

Here is just another example of how user reviews are getting out of hand. A screen shot taken today.

Instead of stars, they use... fast forward symbols? Really? Really?

Avatar image for ollyoxenfree
OllyOxenFree

5015

Forum Posts

19

Wiki Points

0

Followers

Reviews: 0

User Lists: 9

#49  Edited By OllyOxenFree

As Adam Sessler most eloquently said:

"Fuck Metacritic."

Avatar image for zakkro
zakkro

84

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 4

#50  Edited By zakkro

I used to pay attention to Metacritic years ago, but now it's just a waste of [internet] space to me. Also, I never pay attention to user scores; only to what they actually have to say.