Giant Bomb achievement tracking legal junk

Avatar image for insectecutor
Insectecutor

1264

Forum Posts

217

Wiki Points

0

Followers

Reviews: 1

User Lists: 2

#1  Edited By Insectecutor

After Sony slapped Giant Bomb on the wrist for (as far as I can tell) taking without asking first, I started to wonder about the methods behind the achievement tracking system.
 
As far as I can tell in the cases of Microsoft and Sony the tracking is done by scraping - that is, automatic downloading of the same official site pages that you or I could visit in a browser and grabbing all the relevant details out of those pages. This is a violation of their terms of service and the reason that Sony told Giant Bomb to get lost.
 
Microsoft don't offer a public API for obtaining achievement data. Two or three years ago the now-defunct Xbox Community Developer Program gave rise to sites like mygamercard.net and a few other services for getting limited public profile info but nothing like the level of detail that Giant Bomb has got. Apparently you can get some stuff out of XNA too, but this is also limited.
 
So my question is: is this all cut and dry and above board and all that crap? Both Xbox Live and Xbox.com terms of service seem to expressly forbid this kind of thing.

Avatar image for meierthered
MeierTheRed

6084

Forum Posts

1701

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#2  Edited By MeierTheRed

Interesting question.

Avatar image for mike
mike

18011

Forum Posts

23067

Wiki Points

0

Followers

Reviews: -1

User Lists: 6

#3  Edited By mike
@Insectecutor: Do you really think Microsoft would have paid for a huge ODST advertising campaign on Giant Bomb if the legality of the achievement tracking system was in question?
 
If you're that concerned about Microsoft taking action against your Xbox Live account, and I don't think any reasonable person should be, then I would advise you to unlink your gamertag from your Giant Bomb account.
Avatar image for forcen
Forcen

2746

Forum Posts

29709

Wiki Points

0

Followers

Reviews: 1

User Lists: 31

#4  Edited By Forcen

So there is no API?
 
But you are not doing anything wrong, your account is not in danger.
 
If there is no API, Giant bomb is just accessing your profile on xbox.com, which you has made publicly available.
Where in the TOS is this forbidden?

Avatar image for metalgearsunny
MetalGearSunny

7466

Forum Posts

13349

Wiki Points

0

Followers

Reviews: 2

User Lists: 3

#5  Edited By MetalGearSunny
@MB said:
" @Insectecutor: Do you really think Microsoft would have paid for a huge ODST advertising campaign on Giant Bomb if the legality of the achievement tracking system was in question? "  
This.
Avatar image for mike
mike

18011

Forum Posts

23067

Wiki Points

0

Followers

Reviews: -1

User Lists: 6

#6  Edited By mike
@Forcen: According to Jeff, there is an API.
 
"...The only reason we're able to have 360 achievements in the system is because Microsoft has built an API and a big website around that information."
Avatar image for natetodamax
natetodamax

19464

Forum Posts

65390

Wiki Points

0

Followers

Reviews: 32

User Lists: 5

#7  Edited By natetodamax

I'm pretty sure Giant Bomb isn't in trouble.

Avatar image for forcen
Forcen

2746

Forum Posts

29709

Wiki Points

0

Followers

Reviews: 1

User Lists: 31

#8  Edited By Forcen
@MB said:
" @Forcen: According to Jeff, there is an API.
 
"...The only reason we're able to have 360 achievements in the system is because Microsoft has built an API and a big website around that information." "
Well, there you go. No worries at all then.
Avatar image for mattyftm
MattyFTM

14914

Forum Posts

67415

Wiki Points

0

Followers

Reviews: 4

User Lists: 11

#9  Edited By MattyFTM  Moderator

I'm fairly sure Microsoft have an API that they only allow a select few websites use. Either way, the Xbox achievements are definitely 100% official from MS.

As for the sony issue, sony has this page: http://profiles.us.playstation.com/playstation/psn/profile/<INSERT PSN ID HERE>/get_ordered_trophies_data
 
When you visit it (obviously putting a PSN ID in where I've put "<INSERT PSN ID HERE>") it gives you an ordered trophy data in a very plain format. To me, it seems the only conceivable use for this would be for outside websites to pull data from. So I have no idea why Sony have put that in their trophy website, yet don't want outside sites using trophy data. 
 
My guess is that the GB dudes came to the same assumptions as me & went and used these pages to put trophies on GB. This is another assumption I'm making that could be just as wrong as my assumptions about the simple formatted trophy data pages, but it's a possible scenario.

Avatar image for insectecutor
Insectecutor

1264

Forum Posts

217

Wiki Points

0

Followers

Reviews: 1

User Lists: 2

#10  Edited By Insectecutor

In my travels around Google I found no evidence of any published, documented APIs other than the XNA one and the XCDP one, neither of which offer the level of detail that Giant Bomb has got. Sony now has an API (an AJAX back end to their site) but Giant Bomb are no longer allowed to use that.
 
I'm satisfied my ID is not at risk, I shouldn't have asked that question. I'm still not entirely sure how this all works on the Microsoft side. I'm guessing Giant Bomb have an agreement with Microsoft, but unlike other sites that make this agreement plain Giant Bomb does not say anything about it.
 

@MB

said:

" @Insectecutor: Do you really think Microsoft would have paid for a huge ODST advertising campaign on Giant Bomb if the legality of the achievement tracking system was in question?"

They Microsoft marketing juggernaut has done some pretty stupid things in the past. I agree it does look like that was our sign that this site has Microsoft's blessing.
 
Edit: MattyFTM: the Sony simple html you talk about is the AJAX system Sony use to build their own website. It is not intended for outside sites to use. It's there so you can sort and filter http://profiles.us.playstation.com/playstation/psn/profiles/<YOUR PSN ID> without reloading the whole page.
Avatar image for pie
Pie

7370

Forum Posts

515

Wiki Points

0

Followers

Reviews: 0

User Lists: 7

#11  Edited By Pie

The staff will probably post in this thread and explain all

Avatar image for branthog
Branthog

5777

Forum Posts

1014

Wiki Points

0

Followers

Reviews: 2

User Lists: 0

#12  Edited By Branthog

You haven't submitted your password and nobody is going to do anything to your account because someone else is accessing your information. Also, GB is only accessing public information that already exists out there and that you already (through their gamer tag APIs for both Sony and Microsoft) stick on websites and forums using their codes, anyway.
 
It is in their best interest for places like Giant Bomb to make use of this data as it certainly encourages people to play more or pay attention to their scores and trophies and achievements more, which is what both companies want. Communities like this are doing them a service by utilizing their data in compelling ways.
 
There is also nothing "legal" that they can do to giant bomb, other than ban the IP of their crawler, since they're doing nothing wrong by accessing a publicly available website's page -- and even then, only once per day per account. If they bitch about it, it's only slightly more valid of a complaint as the idiots who try to take legal action against people for linking to their website without permission.
 
If Sony really has a problem with this, then they're idiots and it's a great example of why they're so far behind. They have done a miserable job with their own community and achievement system. If you're going to be a "me too" and have yet another stupid meta-gaming system, then at least embrace it and do it well instead of half-assed and then hindering those third parties that actually add a great deal of value to your offering.

Avatar image for insectecutor
Insectecutor

1264

Forum Posts

217

Wiki Points

0

Followers

Reviews: 1

User Lists: 2

#13  Edited By Insectecutor
@Branthog: I totally agree that both Sony and Microsoft benefit from other sites making use of their data - it builds community and they would be foolish to stand in the way of that. I believe Sony's objection to Giant Bomb jumping on their AJAX is simply because they didn't capacity plan for this kind of use. Perhaps in future they will have a proper SOAP API that sites like GB can use. Thing is, who cares what you or I believe?
 
Your point about whether GB are doing anything wrong by accessing publicly available data from Microsoft's site is interesting. There is a widespread belief that anything that is published online is free for all, but that's kind of naive. Microsoft has very specific terms of service that state "Unless otherwise specified, the Xbox.com Web Site is for your personal and non-commercial use. You may not modify, copy, distribute, transmit, display, perform, reproduce, publish, license, create derivative works from, transfer, or sell any information, software, products or services obtained from the Xbox.com Web Site." Giant Bomb is a commercial venture. The achievement tracking system obviously adds value to that.
 
All I'm asking is whether MS have agreed to GB's collection of data. My guess is that they have not, because GB started grabbing Sony's data without bothering to get permission. And however much you love Giant Bomb that is not good business.
Avatar image for masterofpenguins_zell
MasterOfPenguins_Zell

2120

Forum Posts

2521

Wiki Points

0

Followers

Reviews: 1

User Lists: 9

@Insectecutor: You really think they're so stupid as to not know what they're doing? I'm sure they've checked what they can, and what they cannot do. As for Sony, from my understanding, it sounded like they used the Sony API, then later Sony decided that they didn't want to share such information with a third party, so they disallowed it. It wasn't because GB was gathering the data through illicit means.
Avatar image for poki3
Poki3

570

Forum Posts

1210

Wiki Points

0

Followers

Reviews: 1

User Lists: 12

#15  Edited By Poki3

Makes me wonder how http://ps3trophycard.com gets their info. It's not updated on the fly, it takes some time, so they probably have to run an update script, but it shows all games and even hidden Trophies. Regardless it's just going around the problem. Sony should really get together and make an API for external sites...

Avatar image for branthog
Branthog

5777

Forum Posts

1014

Wiki Points

0

Followers

Reviews: 2

User Lists: 0

#16  Edited By Branthog
@Insectecutor said:
" @Branthog: I totally agree that both Sony and Microsoft benefit from other sites making use of their data - it builds community and they would be foolish to stand in the way of that. I believe Sony's objection to Giant Bomb jumping on their AJAX is simply because they didn't capacity plan for this kind of use. Perhaps in future they will have a proper SOAP API that sites like GB can use. Thing is, who cares what you or I believe? Your point about whether GB are doing anything wrong by accessing publicly available data from Microsoft's site is interesting. There is a widespread belief that anything that is published online is free for all, but that's kind of naive. Microsoft has very specific terms of service that state "Unless otherwise specified, the Xbox.com Web Site is for your personal and non-commercial use. You may not modify, copy, distribute, transmit, display, perform, reproduce, publish, license, create derivative works from, transfer, or sell any information, software, products or services obtained from the Xbox.com Web Site." Giant Bomb is a commercial venture. The achievement tracking system obviously adds value to that.  All I'm asking is whether MS have agreed to GB's collection of data. My guess is that they have not, because GB started grabbing Sony's data without bothering to get permission. And however much you love Giant Bomb that is not good business. "
I'm not sure it could be capacity related. How many registered Giant Bomb users are there? Perhaps 100,000? And perhaps, being generous, half own a PS3 and of those half registered their PS3 ID? That's a maximum of 25,000 pulls per day. That's nothing.  Granted, proper etequitte would be to check with a site's admin to let them know what you intend to do ahead of time in case they can't handle the load and also so they don't mistake you for some sort of DoS. I suppose that legally, they could claim rights to the content  -- even though that content is merely stats (and especially since you're legally not allowed to post the scores of MLB games, which is also a bunch of bullshit). Then again, we're not debating the merits of idiotic law - just whether or not there are issues under the law here at all.
 
You're probably right that they didn't notify anyone that they were going to be doing this and that may have set off some system "DoS alerts" or something-- but I have a hard time believing that the size of the registered GB user base really caused even a blip on their server loads.
Avatar image for clubvodka
Clubvodka

470

Forum Posts

1246

Wiki Points

0

Followers

Reviews: 1

User Lists: 6

#17  Edited By Clubvodka
@MB said:
"@Insectecutor: Do you really think Microsoft would have paid for a huge ODST advertising campaign on Giant Bomb if the legality of the achievement tracking system was in question? If you're that concerned about Microsoft taking action against your Xbox Live account, and I don't think any reasonable person should be, then I would advise you to unlink your gamertag from your Giant Bomb account. "

I don't think thats what he's getting at though. I'll chalk it up as a swing and a miss
Avatar image for insectecutor
Insectecutor

1264

Forum Posts

217

Wiki Points

0

Followers

Reviews: 1

User Lists: 2

#18  Edited By Insectecutor
@MasterOfPenguins_Zell: No I don't think GB are stupid. I think they got carried away. If they read Sony's TOS (which is actually in pretty nice plain English, unlike Microsoft's) they'd have realised that Sony wasn't willing to share the data yet.
 
@Poki3: ps3trophycard have apparently had trouble with Sony in the past. The fact that they still exist bodes well for Giant Bomb. And yes, Sony should make a proper public web service API for this, which would be a big step beyond what Microsoft have done. 
 
@Branthog: GB has ~56,000 users. Whether or not it's capacity related depends on how the scraping works but the fact is if Sony give GB a free pass that sets a precedent and they clearly want to control access to this information on their own terms. I kinda wish someone from the GB staff would simply pop in and say "Dude, it's legit" and that would make me happy that Microsoft can't just decide to pull the plug one day as well.
Avatar image for jeff
jeff

6357

Forum Posts

107208

Wiki Points

0

Followers

Reviews: 0

User Lists: 20

#19  Edited By jeff

Though they don't seem to advertise its existence anymore, I wouldn't call the XCDP defunct.

Avatar image for insectecutor
Insectecutor

1264

Forum Posts

217

Wiki Points

0

Followers

Reviews: 1

User Lists: 2

#20  Edited By Insectecutor

:) thanks Jeff.