Log in or sign up to comment
139 Comments
  • 139 results
  • 1
  • 2
  • 3
Posted by eshchan

@patrickklepek Patrick, are you sure developers of Bastion also asked its fans to write positive review on Metacritic? I know PR for Signal Studios did it but I thought SuperGiantGames did not.

Posted by Vexxan

Great to see something was done about it.

Posted by JackG100

What kind of tards think that internetpolls give a fair picture of reality anyway?

Posted by SSully

I wonder if they banned me. I made an account and scored all the games as 10's who got hit by these guys.

Posted by Baconbot

@ZackHoagie: Probably true.

Posted by lightsoda

Good on them.

Edited by Troncek

Meta who?

I almost never use that site. If I'm interested in a game, I check out videos, interviews, articles and other stuff, so by the time the game is actually released, I have gathered more than enough information to make a decision.

I also don't read other people's reviews (including here on GB), because they usually don't tell me anything new or useful.

It's sad to see industry insiders rely so much and put weight on this stuff.

Posted by John1912

Yea WTF? I can see people being random dicks and give 0s. But a group of people actively working to do so? Why?

Posted by Jimbo

Cool, they should worry more about the 'Everything with an ad budget is amazinggg! 10/10' bullshit coming out of the reviewers. Also about their own incompetence when it comes to converting review scores, 5* scales converting 10% too high etc.

Posted by Delta_Ass

@SinisterInfant said:

If I were to put on my conspiracy theorists hat, It could be publishers themselves posting bad reviews to drive down the metacritic score. Both of those games are now several weeks past their initial release window. From a publisher view point the majority of sales have likely been made. If they owe money to the developer based on a score, they could drive the score down pay the developer for the lower score then delete their comments and restore the score. Seems like an easy way to anonymously save some funds.

Publishers don't give bonuses based on user reviews. It's based on the aggregate review scores from professional publications. What you suggest is insane.

Posted by Fobwashed

I use metacritic and before them, gamerankings not to get an aggregate review but to get a list of reviews from sites in one place with blurbs. I never paid much mind to the user reviews though. I DO check and read user reviews for purchases I make on amazon, newegg and I look at the aggregate for movies on RottenTomatoes.

Good on them for actually doing something when they could just have easily have not cared. I wonder what their barrier to entry is for the critic review section.

Posted by ZackHoagie

@Slaker117: Dude, look at these comments at a story about Sony's PSN woes or what have you and you'll realize console warriors are still fighting the stupid, stupid, stupid fucking fight.

Posted by PXAbstraction

For once, Metacritic does something useful.

Posted by ZackHoagie

@Baconbot: The weird thing is though is that they specifically targeted two Summer of Arcade games instead of say, Resistance 3 or Hard Reset or Gears 3 or what have you. As shitty and console-warsish as it sounds, I have a pretty good feeling this might of been Sony fans.

Posted by Honk

It's absolutely awesome that someone is cracking down on these shenanigans. Unacceptable behavior like this can't be allowed.

Posted by vr00m

Why would they count outliers anyway, especially ones with no written review.

Posted by Slaker117
@ZackHoagie said:

So... why exactly were they doing this? I mean, trolling is pretty unreasonable by design, but usually trolls have some sort of selection process for their targets.

Well, both games were Xbox Live titles that aren't on PSN. I'd like to believe platform fanboyism is dead, but that seems like a possible motive in this case.
Posted by Cynic04

WTF, why would they go after the little developers? Not a good way to earn sympathy.

Posted by autobzooty

metacritic slowly realizing that the service it provides makes no sense.

Posted by Baconbot

@ZackHoagie: Stupidity probably.

Good news to hear and good on Metacritic for cracking down.

Posted by DystopiaX

@SinisterInfant said:

If I were to put on my conspiracy theorists hat, It could be publishers themselves posting bad reviews to drive down the metacritic score. Both of those games are now several weeks past their initial release window. From a publisher view point the majority of sales have likely been made. If they owe money to the developer based on a score, they could drive the score down pay the developer for the lower score then delete their comments and restore the score. Seems like an easy way to anonymously save some funds.

Would be dumb, plenty of people still buy games a couple weeks after they're out, and payouts are based more on critic than user reviews.

Posted by TheOtherSuperMarioBro

I definitely approve. Metacritic user reviews are some of the biggest shams on the internet

Posted by falling_fast

while they're at it they can ban all the critics who are giving Gears of War 3 less than perfect scores *smirk*

Posted by SinisterInfant

If I were to put on my conspiracy theorists hat, It could be publishers themselves posting bad reviews to drive down the metacritic score. Both of those games are now several weeks past their initial release window. From a publisher view point the majority of sales have likely been made. If they owe money to the developer based on a score, they could drive the score down pay the developer for the lower score then delete their comments and restore the score. Seems like an easy way to anonymously save some funds.

Posted by laserbolts

Fuck metacritic.

Posted by DystopiaX

@Largo6661 said:

see this is why metacritic is bullshit. its beyond me why anyone puts any kind of value on whats posted on that abomination of a site. hope it dies in a fire!

Most devs only look at staff scores, not user ones, so that doesn't matter. It would be like saying Giantbomb should get the axe cause you disagree with the user reviews on the site.

Posted by SomeJerk

Dear Industry,

Stop taking user reviews seriously, and start taking reviews seriously. If they all say the game is shit but it sells like nude shots of the latest idol, fix it. If they all think the game is great but it sells only a few copies, learn to market properly. Holy shit.

Posted by Giantstalker

You'd think this would happen every day, considering the barrier for entry is so minimal.

Posted by Largo6661

see this is why metacritic is bullshit. its beyond me why anyone puts any kind of value on whats posted on that abomination of a site. hope it dies in a fire!

Online
Posted by CaLe

Why would they have targeted Bastion? Who did it ever hurt?

Posted by MayorFeedback

Busted.
Posted by Tesla

Well, good on Metacritic for actually doing something about this.

Posted by prestonhedges

They should just ban all user reviews below 100%. Problem solved.

Posted by BestUsernameEver

@ZackHoagie said:

So... why exactly were they doing this? I mean, trolling is pretty unreasonable by design, but usually trolls have some sort of selection process for their targets.

Yeah, metacritic is the target.

Posted by BestUsernameEver

@elcalavera said:

Very nice.

Is it?

Posted by elcalavera

Very nice.

Edited by ZackHoagie

So... why exactly were they doing this? I mean, trolling is pretty unreasonable by design, but usually trolls have some sort of selection process for their targets.

Posted by wemibelec90

Glad to hear someone is cracking down on these jerks.
Posted by patrickklepek
When things go sideways on Metacritic, developers don't have many options for appeal.

Supergiant Games and Signal Studios were in awkward positions earlier this month, after the average user review score for each game plummeted overnight and seemingly without justification.

It was unclear who was responsible for the sudden change, and there are limited tools for those affected that don't come across as...weird.

The developers of Bastion and Toy Soldiers: Cold War asked fans to submit reviews to Metacritic, which resulted in a slight bump for each but an average score ultimately much lower than it was previously.

After speaking to Supergiant and Signal, I ran a story earlier this week about the challenges the studios faced in addressing these issues.

Metacritic has since identified the users responsible, both banning the users themselves and removing their scores putting things out of balance.

The users were targeting certain games, and hitting them with zero scores without a written review, raising eyebrows.

"A publisher of a different game let us know that he noticed that his game had been 'bombed' by a bunch of zero ratings in an unusually short period of time," said Metacritic co-founder Marc Doyle in an email to me today. "While investigating those ratings, we noticed a group of user accounts and activities that were clearly illegitimate and violated our terms of use."

Doyle's team found a group of users had been coordinating similar attacks on other games within Metacritic's database, allowing Metacritic to fix the "bombings" that had been targeted at other games.

Metacritic is often used to determine royalty and bonus payouts for developers, though its exact use varies from publisher to publisher. I've never heard of a publisher leveraging user reviews as a metric for payment because of situations like this, but especially for small studios, perception is king, which is why user reviews remain very important.

Signal Studios president and creative director Douglas Robert Albright III had proposed a fix to the problem.

"The way to fix Metacritic user reviews is to simply require a written review and verify user accounts," he said. "If it was just some random blog I'd say whatever. But this is a major news review aggregator that should have better oversight and some standards."