LB3PTMAN's forum posts

Avatar image for lb3ptman
LB3PTMAN

9

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Also the number after "3030-" is replaced with the next number in the sequence of course. On 27,00 at this point

Avatar image for lb3ptman
LB3PTMAN

9

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

https://www.giantbomb.com/api/game/3030-25577/?api_key=[YOUR_KEY]&format=json&field_list=name,original_release_date

is the URL, but of course in the code has my API key in it.

I would try to delay the rquests a second, but I am unsure how to do a delay in R, is anyone aware of how to so I could test it to see if that worked?

Avatar image for lb3ptman
LB3PTMAN

9

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I am trying to scrape the API for some information. I get about 300 or so in everytime I run my code before it stops with a "cannot open the connection" messagge. Was just wondering if anyone had any idea what was causing this issue and how it could be resolved?

Here is my code in R.

I have confirmed that when it is running it is gathering the data what seems to be 100% accurate

while (i < 76127) {

urltemp = paste(url1,i,url2, sep = "")

con = url(urltemp, "rb")

json = fromJSON(con)

new = tryCatch(data.frame(json), error=function(e) NULL)

data = rbind(data, new)

i = i + 1

}

Avatar image for lb3ptman
LB3PTMAN

9

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Ok got it in. Thank you. Should be able to turn it into a data frame from here!

Avatar image for lb3ptman
LB3PTMAN

9

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Attempted to use GetURL and got this Error Message :/

> page <- getURL(url)

Error in function (type, msg, asError = TRUE) :

error:1407742E:SSL routines:SSL23_GET_SERVER_HELLO:tlsv1 alert protocol version

Avatar image for lb3ptman
LB3PTMAN

9

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I attempted to use xmlToDataFrame to parse https://www.giantbomb.com/api/game/3030-76126/?api_key=[YOUR_KEY]&field_list=name,original_release_date

with my key in of course

and all I got was this error message

> result <- xmlToDataFrame(url)

Error: XML content does not seem to be XML: 'ld_list=name,original_release_date'

Avatar image for lb3ptman
LB3PTMAN

9

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Hi, I am a bit rusty in R and was wondering if I could have some assistance. I am trying to iterate through all the game pages and pull some information. I know how to get the URLs and how to handle the data once I get it into R, I just was having issues pulling the webpage into R as a JSON or XML file. Some help would be greatly appreciated.