The memoirs of a (ex) Tester - Taking The Lead

Avatar image for raiden2000
raiden2000

62

Forum Posts

180

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

Edited By raiden2000

 

No Caption Provided

Deus Ex was a masterpiece of its time and I am amazed at how well it still holds up today, the thing is that it was so under the radar that the only ones to know how good it was beforehand were the guys testing it. While we were raving about it, everyone else wasn’t paying it much attention. The press pretty much ignored it and even the Eidos marketing department didn’t really push it. The game’s success is largely due to the word of month that spread the week it was released. Something I am thankful for as it otherwise would have been a “cult classic”.

I did get to meet Warren Spector on the day of Deus Ex’s release, he was visiting the Eidos offices and he stopped by my area for a chat. He was extremely good natured and even shared a joke with me at Daikatana’s expense although he was saddened by the news that Eidos had just announced that the portion of Ion Storm (i.e. the Daikatana team) had been let go. His branch in survived the cut however and although they produced the ill received Deus Ex 2 they are now looking to make a come back with Deus Ex 3.

 As a quick note, swimming is not useless in Deus Ex at all. There are many shortcuts and hiding places that can only be reached with it. If memory serves me right you can even get an augmentation canister much earlier than land lubbers as well.

After the disappointment of Daikatana I was looking for a new team to join but I was getting worried that my six months contract was about to expire. Despite the fact that no one had shown even the slightest bit of dissatisfaction with my work I was getting worried. They had been pretty honest about the whole keeping you on a rolling monthly contract after the initial six months were done. While it was true we had a lot of turnover at the time the people were leaving of their own accord rather than being let go. Even so it was great relief when I was given another title to work on. This meant that they wanted me to stick around at least till it was done. The game was Hitman: codename 47 which was the first game made by the then completely unknown Danish outfit, Io Interactive.

Being assigned to Hitman also gave me a huge opportunity, one I grasped with both hands. The lead tester, Nick had announced his intention to leave a couple of weeks after I was assigned to the project. Being the only other person involved with it this put me in prime position to take over (muh ha ha). With that in mind I nervously emailed the producer to ask about the gig. He then blew a huge hole in my plans by announcing that too was leaving later that week. I politely waited a week before emailing the new producer, although I was half expecting him to leave the company as well. He was silent on the matter though, remaining so even after a follow up email was sent.

I decided it was time to be a bit more proactive and went up to see my boss to have a chat. As soon as I mentioned lead testing for Hitman he immediately offered me the position. I was taken aback but he explained that he had been looking for something for meto do for a while. Technically this was my first promotion in my working career.

Now that I had the lead I had work to do. I quickly found that lead testing is a whole different kettle of fish when compared to being a humble tester. You do a lot less actual testing for a start. Instead your time is filled with report writing and keeping the testers in line. Sometimes you can sneak in a bit of testing now and again but this only tends to happen towards the end of the testing phase when there is lot less micro managing to be done.

A lead tester is normally assigned before there is any actual code to test. This means writing a test plan from the design documents which can be either a laugh or nightmare depending on the developer. Pouring over the design docs does give you an excellent knowledge of the game which can come in useful when you get the playable code and you need to finalise the test plan. Once it is done you hand it out to your testers and assign them their roles. Progress is always slow to begin with as they will need to learn the game but within weeks they will be able to zip through the title at ninja speed (remember, these guys are playing the game for at least eight hours a day).

Once the test plan has all been completed and all of the sections checked off you then move onto “adhoc” testing phase, where the testers simply play the title in any manner they wish. This type of testing tends to find logical bugs such as “drinking a healing potion in the corner of this room causes your stats to triple” rather than any coding bugs which should (in theory) have been caught during the test plan phase. Previous bugs that were found and have now been fixed also need to be retested to ensure that they are fixed, you would be amazed at what developers try to get away with. This is called regression testing and as a lead you need to keep on top of this as there needs to be a balance between regression testing and spending time finding new bugs you need to maintain.
 
Towards the end of project playthroughs are started. These are to make sure that the game can be completed and that there are no nasty surprises waiting for the player from star to finish. At this point (again, in theory) there should be few new bugs found and most of the old bugs fixed. The pressure is on at this point as any new serious bug could potentially delay the shipping date. This makes the atmosphere very tense and it is not uncommon to see the lead tester and the producer locked in an argument over whether a bug is important or not.

On the last day of testing the QA manager asks you a very important question, is the game good enough for release? At this point you are an excellent position to know the answer to that question. Although in my opinion it is nothing more than a formality, I didn’t see any lead tester successfully argue against releasing in my whole time in the games industry.
 
So I had all this to look forward to while I lead tested the minefield that was Hitman: codename 47. 
 

Avatar image for raiden2000
raiden2000

62

Forum Posts

180

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#1  Edited By raiden2000

 

No Caption Provided

Deus Ex was a masterpiece of its time and I am amazed at how well it still holds up today, the thing is that it was so under the radar that the only ones to know how good it was beforehand were the guys testing it. While we were raving about it, everyone else wasn’t paying it much attention. The press pretty much ignored it and even the Eidos marketing department didn’t really push it. The game’s success is largely due to the word of month that spread the week it was released. Something I am thankful for as it otherwise would have been a “cult classic”.

I did get to meet Warren Spector on the day of Deus Ex’s release, he was visiting the Eidos offices and he stopped by my area for a chat. He was extremely good natured and even shared a joke with me at Daikatana’s expense although he was saddened by the news that Eidos had just announced that the portion of Ion Storm (i.e. the Daikatana team) had been let go. His branch in survived the cut however and although they produced the ill received Deus Ex 2 they are now looking to make a come back with Deus Ex 3.

 As a quick note, swimming is not useless in Deus Ex at all. There are many shortcuts and hiding places that can only be reached with it. If memory serves me right you can even get an augmentation canister much earlier than land lubbers as well.

After the disappointment of Daikatana I was looking for a new team to join but I was getting worried that my six months contract was about to expire. Despite the fact that no one had shown even the slightest bit of dissatisfaction with my work I was getting worried. They had been pretty honest about the whole keeping you on a rolling monthly contract after the initial six months were done. While it was true we had a lot of turnover at the time the people were leaving of their own accord rather than being let go. Even so it was great relief when I was given another title to work on. This meant that they wanted me to stick around at least till it was done. The game was Hitman: codename 47 which was the first game made by the then completely unknown Danish outfit, Io Interactive.

Being assigned to Hitman also gave me a huge opportunity, one I grasped with both hands. The lead tester, Nick had announced his intention to leave a couple of weeks after I was assigned to the project. Being the only other person involved with it this put me in prime position to take over (muh ha ha). With that in mind I nervously emailed the producer to ask about the gig. He then blew a huge hole in my plans by announcing that too was leaving later that week. I politely waited a week before emailing the new producer, although I was half expecting him to leave the company as well. He was silent on the matter though, remaining so even after a follow up email was sent.

I decided it was time to be a bit more proactive and went up to see my boss to have a chat. As soon as I mentioned lead testing for Hitman he immediately offered me the position. I was taken aback but he explained that he had been looking for something for meto do for a while. Technically this was my first promotion in my working career.

Now that I had the lead I had work to do. I quickly found that lead testing is a whole different kettle of fish when compared to being a humble tester. You do a lot less actual testing for a start. Instead your time is filled with report writing and keeping the testers in line. Sometimes you can sneak in a bit of testing now and again but this only tends to happen towards the end of the testing phase when there is lot less micro managing to be done.

A lead tester is normally assigned before there is any actual code to test. This means writing a test plan from the design documents which can be either a laugh or nightmare depending on the developer. Pouring over the design docs does give you an excellent knowledge of the game which can come in useful when you get the playable code and you need to finalise the test plan. Once it is done you hand it out to your testers and assign them their roles. Progress is always slow to begin with as they will need to learn the game but within weeks they will be able to zip through the title at ninja speed (remember, these guys are playing the game for at least eight hours a day).

Once the test plan has all been completed and all of the sections checked off you then move onto “adhoc” testing phase, where the testers simply play the title in any manner they wish. This type of testing tends to find logical bugs such as “drinking a healing potion in the corner of this room causes your stats to triple” rather than any coding bugs which should (in theory) have been caught during the test plan phase. Previous bugs that were found and have now been fixed also need to be retested to ensure that they are fixed, you would be amazed at what developers try to get away with. This is called regression testing and as a lead you need to keep on top of this as there needs to be a balance between regression testing and spending time finding new bugs you need to maintain.
 
Towards the end of project playthroughs are started. These are to make sure that the game can be completed and that there are no nasty surprises waiting for the player from star to finish. At this point (again, in theory) there should be few new bugs found and most of the old bugs fixed. The pressure is on at this point as any new serious bug could potentially delay the shipping date. This makes the atmosphere very tense and it is not uncommon to see the lead tester and the producer locked in an argument over whether a bug is important or not.

On the last day of testing the QA manager asks you a very important question, is the game good enough for release? At this point you are an excellent position to know the answer to that question. Although in my opinion it is nothing more than a formality, I didn’t see any lead tester successfully argue against releasing in my whole time in the games industry.
 
So I had all this to look forward to while I lead tested the minefield that was Hitman: codename 47. 
 

Avatar image for stillvictor
StillVictor

173

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 2

#2  Edited By StillVictor

Nicely done. It's the first time I'm reading this. Good job.

Avatar image for astras
Astras

1064

Forum Posts

1

Wiki Points

0

Followers

Reviews: 5

User Lists: 13

#3  Edited By Astras

*Yawn more The Ex tester stuff huh....

Avatar image for ferginator4k
Ferginator4k

846

Forum Posts

-1

Wiki Points

0

Followers

Reviews: 57

User Lists: 12

#4  Edited By Ferginator4k

Very interesting, I once thought about being a games tester.

Avatar image for iam3green
iam3green

14368

Forum Posts

350

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#5  Edited By iam3green

sounds interesting MOAR of this types of blogs :)

Avatar image for thecreamfilling
TheCreamFilling

1235

Forum Posts

832

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#6  Edited By TheCreamFilling

This is interesting.

Avatar image for calum_s_gunn
calum_s_gunn

80

Forum Posts

74

Wiki Points

0

Followers

Reviews: 1

User Lists: 1

#7  Edited By calum_s_gunn

This is a nice read. I used to test too, but never made it as far as a lead. It's a tough job, but someone's got to do it

Avatar image for astras
Astras

1064

Forum Posts

1

Wiki Points

0

Followers

Reviews: 5

User Lists: 13

#8  Edited By Astras

guys, this is a load of crap.. seriously!
 
The guy reckons that because he worked in the testing phase of the development lifecycle that his opinion matters about game design.. he keep trying to cash in on his limited experience within the gaming development industry.. pleaaase. My mate was a tester and what I have read from this guy is over dramatised and made up of pointless opinions.. testing is a horrible grind.. FULL STOP.  
 
Please stop posting this ex tester crap every week!

Avatar image for buzz_clik
buzz_clik

7590

Forum Posts

4259

Wiki Points

0

Followers

Reviews: 0

User Lists: 9

#9  Edited By buzz_clik
@Astras said:

" guys, this is a load of crap.. seriously!  The guy reckons that because he worked in the testing phase of the development lifecycle that his opinion matters about game design.. he keep trying to cash in on his limited experience within the gaming development industry.. pleaaase. My mate was a tester and what I have read from this guy is over dramatised and made up of pointless opinions.. testing is a horrible grind.. FULL STOP.    Please stop posting this ex tester crap every week! "

I'm not trying to sound like a bastard here, but you do seem to like tearing strips off of other people's posts with little or no constructive insight of your own. I don't see how your viewpoint on the world of testing is more valid than raiden2000's, considering yours is a second-hand source on the subject and his is a personal account.
 
Regardless of raiden2000's intent with this blog, it's got some genuinely interesting anecdotes; just because you find testing to be a boring facet of the gaming industry doesn't mean other people do. Also, some people just like writing blogs because it gives them an outlet to hone any writing skills they wish to develop - with this in mind, you seem to be saying "don't bother trying to better yourself because it annoys me when you do."
 
I don't mind a dissenting voice if it's entering into valid debate, but to me you're just coming off as a contrary lil bugger who can't help but click on blogs that he dislikes and then state opinion as fact. And feel free to convince me otherwise because, as I said, I don't mind valid debate.
Avatar image for dany
Dany

8019

Forum Posts

416

Wiki Points

0

Followers

Reviews: 0

User Lists: 4

#10  Edited By Dany
@Astras said:
" guys, this is a load of crap.. seriously!  The guy reckons that because he worked in the testing phase of the development lifecycle that his opinion matters about game design.. he keep trying to cash in on his limited experience within the gaming development industry.. pleaaase. My mate was a tester and what I have read from this guy is over dramatised and made up of pointless opinions.. testing is a horrible grind.. FULL STOP.    Please stop posting this ex tester crap every week! "
Have you even read it? It is nothing but a recount of testing from his POV, have you ever done any test work? If not and if you don't care about his opinion then don't comment. I find it interesting to see how stuff is from the 'other side'
Avatar image for armaan8014
armaan8014

6325

Forum Posts

2847

Wiki Points

0

Followers

Reviews: 11

User Lists: 17

#11  Edited By armaan8014

Hey for the people who liked his blog, check out his profile. He's got a lot of blogs which he never attached to the forums. He's even published a book on it!

Avatar image for astras
Astras

1064

Forum Posts

1

Wiki Points

0

Followers

Reviews: 5

User Lists: 13

#12  Edited By Astras
@buzz_clik: 
@Dany:
 
Whatever you say people...the reason I kept my post short and sweet was because it was too monsier ex tester himself.. because I have seen this stuff before.
The guy puts himeself over as much more involved with the gaming lifecycle than a tester really is... I think it's packed with a bit of bullshit to be fair. And is put over as more glamourous then it is, my mate used to tell me about what a horrible grind it is.. and the fact that it put him of gaming for years. 
And why does him being a tester make his opinion about game design more relevant?? In his blogs he suggests improvements to mechanics etc... bullshit if you ask me!
 
Still it's nice to make money out of something if you can...
 
The guy takes no part in the community and only seems to use giant bomb as an advertising platform to sell his book which I dont think is suitable... If giant bomb forums and pages were to turn into advertising platforms for everyone who has had some experience in the gaming industry what a shite site it would become.
 
He tries to sell his book by nuking every relevant site on the internet he can:

  •  http://en-gb.facebook.com/pages/The-ex-tester/260711396294
  •  http://www.gamasutra.com/blogs/FrancescoFraulo/20100405/4851/The_memoirs_of_a_ex_Tester__Bullfrogs_on_Parade_part_1.php 
  •  http://sony-ebook-samples.com/sample/12515/the-ex-tester-my-gaming-dream
  •  http://www.smashwords.com/extreader/read/12515/1/the-ex-tester-my-gaming-dream
 
Dude the list goes on.. 
Avatar image for raiden2000
raiden2000

62

Forum Posts

180

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#13  Edited By raiden2000

Ok, I wasn't going to respond to this but anyway.
 
I made the book primarily for friends & family to be able to get a copy and I thought that some of the people who read my bloq might want it too. It was naive of me to do this and I should have known better but I want to make it clear than it was never my intention to use Giantbomb as an advertising platform. 
 
But whatever I started this bloq to tell people what it is like to work in the games industry and thats what I am gonna do. I won't mention the book here again. I can't do much about all those links though, they were setup by the website where I made the ebook.