You need Premium to view this

Subscribe to Giant Bomb Premium to get access to this and more premium shows, live streams, and podcasts.

Get Premium Learn More

Vinny Bought Bot Colony. Now What?

PUT. THE. DAMN. PEPPER GRINDER. NEXT. TO. AHHHHHHHHHHHHHHHHHHH

Jul. 9 2014

Cast: Vinny

Posted by: Vinny

In This Episode:

Bot Colony

412 Comments

Avatar image for tydigame
tydigame

119

Forum Posts

5

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

I laughed so much! Thanks!

Avatar image for wumbo3000
wumbo3000

1324

Forum Posts

401

Wiki Points

0

Followers

Reviews: 7

User Lists: 38

This was one of the greatest premium videos of all time. Holy shit I'm dying of laughter right now.

Avatar image for vhold
vhold

577

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

Did he do all that training and then not select it as his voice profile?

Avatar image for ghostnpc
ghostNPC

803

Forum Posts

23

Wiki Points

0

Followers

Reviews: 0

User Lists: 3

Jimmy will haunt Vinny forever.

Avatar image for gnoltac
GnolTac

138

Forum Posts

287

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Speech recognition, still the weakest thing around. Not even a good one gets things right like Siri for example. Why can't they ever make those programs listen to WHAT we say instead of something like it?

Because if you analyse the actual sounds coming from us when talking, it's pretty damn hard to determine what words we are saying. In no way the sounds match 1 to 1 to the words as they are written.

So you get dozens of ambiguities in each sentence. To make a good guess as to whatis being said, you need to have an understanding of the messed up way humans use grammar and you need to have knowledge of the entire world to understand in what context something is being said in..

And that's just damn hard. Language is one of those very human things that's hard to separate and model in computer software without dragging in the whole rest of the brain and the years of experience we had to learn it.

Avatar image for icantbestopped
ICantBeStopped

523

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Edited By ICantBeStopped

So after reading a few things...

- There's no other noise in the room except Vinny. We can clearly hear him through the mic he's using with no trouble, doesn't matter that it's a boom mic.

- I don't have to make a 'voice profile' for my phone. That I would have to for 30 minutes to an hour to "play" a game like this is insanity. Furthermore, when I talk to my phone, it understands the difference between "abort" and "aborts". And the few times it is off, I never get results like "A New York pass". "Shut" seemed like another problem, and when he tried "close the drawer", Jimmy let him know that he was already in "close" proximity. Infuriating.

- When teaching Jimmy a new command, Jimmy insists you teach him based on commands he already knows, one step at a time. Jimmy fucked up simple commands already, there is no reason to assume he would be smart enough to understand a multistep process of picking up the grinders and putting them down in each other's places.

- "You can type things too!"... Um, well, yes, but the game's gimmick, and what sets it apart, as well as what you see in the videos, is the whole voice thing. Is someone going to pay $15 to play a game where you indirectly control a being, having them do mundane things, by typing in things like "pick up the vase"? What is this game without voice, really?

- The whole pepper grinder incident... even though he didn't say "Switch the salt and pepper", if one wanted to do it the way he did, it's as if the space to the right of the coffee maker does not exist. The right of the coffee maker is instead somehow past where the counter elbows to the left of the coffee maker. Even the top of the coffee maker exists, just not the space where Vinny is clicking. That's something wrong with the game itself.

Avatar image for omatictoast
omatictoast

251

Forum Posts

33

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I laughed so fucking hard!

Avatar image for omatictoast
omatictoast

251

Forum Posts

33

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I laughed so fucking hard!

Avatar image for crimsonlordofwar
crimsonlordofwar

140

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Not the ants!!

haha damn that Jimmy

Avatar image for mangachaos
mangachaos

78

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Speech recognition, still the weakest thing around. Not even a good one gets things right like Siri for example. Why can't they ever make those programs listen to WHAT we say instead of something like it? We might never know... oh, and I'm betting that was about the same as the Siri on phones, meaning a terrible one!

They should REALLY test their games more and make it more possible to say simple things. This game didn't seem to be tested at all...

Now I kind of wonder if there is a game which CAN do this without much fail.

Avatar image for slot9
slot9

154

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

so funny

Avatar image for harrypowers
HarryPowers

61

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Edited By HarryPowers

Jimmy: "That's the guy who sidelined Jimmy."

Avatar image for hassanisabbah
HassaniSabbah

128

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Edited By HassaniSabbah

@botcolony:

I really don't think Vinny is intentionally being malicious towards your game. I know you might not see it this way right now, but try to look at it from this perspective: a few thousand people who had probably never heard of Bot Colony before yesterday are now talking about Bot Colony.

"The only thing worse than being talked about is not being talked about."

Avatar image for bakermikeromeo
BakerMikeRomeo

231

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

oh my god i can't stop laughing am i going to die?

Avatar image for botcolony
BotColony

31

Forum Posts

59

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

@dewar: Actually, he does understand swap the salt with the pepper.

To look at the bright side, Vinny did teach a new command (dance as 'turn, turn, walk, jump').

There was a feeling of anguish and not getting through, and the longer it went, the more it hit home. Remember the game is an Alpha version in Early Access. Processing things out of context and clarifying them needs to be a lot stronger for a good game experience.

Gameplay wise Vinny could have done a few things better:

- He started using keyboard correction only towards the end (when speech to text had actually improved).

- Vinny only stumbled on the Help menu towards the end. It would have been more useful to train speech to text on how to play the game, but unfortunately the novel introduction was offered as a choice and he picked that. The Bot Colony book should only be offered for supplemental speech training.

- Saying things twice helps people, but not machines.

- He did get an answer to "What are your commands?", but did not make use of the information.

- He didn't realize training was over, and kept repeating 'the toy giraffe' without saying what to do with it.

- Asking the robot to put stuff in his ass is funny, but the best we could have done is to say something clinical like 'own body cannot be the target of a manipulation command'. Not sure how much that would improve the experience.

Avatar image for chriscyotg
ChrisCYotG

134

Forum Posts

137

Wiki Points

0

Followers

Reviews: 0

User Lists: 3

I sure hope Vinny closed the book on Bot Colony

Avatar image for entreri10
Entreri10

581

Forum Posts

15

Wiki Points

0

Followers

Reviews: 0

User Lists: 10

This is the best. You're the best Vinny.

Avatar image for dewar
dewar

186

Forum Posts

34

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Hmm, so I was right, he should have asked the robot to switch the salt and pepper. I guess there's no reason to assume that the robot would have been able to understand a sentence with multiple subjects. Maybe a demonstration of a couple of more complicated commands would have been handy.

Avatar image for meauntienora
MeAuntieNora

1312

Forum Posts

0

Wiki Points

0

Followers

Reviews: 2

User Lists: 1

Right. Nine-hundred and eleven is a joke in my town.

Avatar image for thelastgunslinger
thelastgunslinger

619

Forum Posts

86

Wiki Points

0

Followers

Reviews: 2

User Lists: 9

This is easily one of the funniest things they've ever done. Bravo Vinny.

Avatar image for ptys
ptys

2290

Forum Posts

3

Wiki Points

0

Followers

Reviews: 0

User Lists: 14

Shouldn't we call this segment, 'Story Time with Vinny'. Fantastic!!!

Avatar image for icantbestopped
ICantBeStopped

523

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I have never understood the "video glitch" aesthetic. I've never seen huge artifact cubes, or someone's face go upside down real fast before correcting itself... even on the worst Skype conversations.

Avatar image for stonyman65
stonyman65

3818

Forum Posts

1

Wiki Points

0

Followers

Reviews: 0

User Lists: 4

Why do you do this to yourself Vinny?

Avatar image for nexuson
nexuson

39

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Fantastic, one of top 10 of Vinny QL ever...

Avatar image for keithcrash
Keithcrash

133

Forum Posts

26

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

my god didn't see me

Avatar image for larrydavis
LarryDavis

1698

Forum Posts

23

Wiki Points

0

Followers

Reviews: 1

User Lists: 0

So this is Lifeline, but without the voice of Ultra-Babe Elisha Cuthbertâ„¢? I'M OUT!

Loading Video...

Avatar image for ianyarborough
ianyarborough

169

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

Three things:

1) Butt Colony

2) DAT BEARD

3)Lovelovelove Vinny

Avatar image for stolige
stolige

13

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Great video Vinny. My fellow employees perform similarly to Jimmy the robot a lot of the time.

Avatar image for botcolony
BotColony

31

Forum Posts

59

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Edited By BotColony

Bot Colony is not just about commands. Take a look at this

https://www.dropbox.com/s/ginpub8ztnmhfae/Bot%20Colony%20Robot%20Visual%20Memories.mp4

@imbiginjapan said:

@singing_pigs said:

@mrsmiley said:

@botcolony said:

If you go to the link above

http://steamcommunity.com/games/263040/announcements/detail/190591878968722392

you can how the game works with a trained profile and you'll also see what the gameplay looks like. If someone plays it without a trained profile, or doesn't realize they have to hit Enter for the input to be evaluated - you get Vinny's experience. If people don't save their speech profile or don't read anything before they jump in and play, then yes, they'll have an experience like Vinny. By the way, you can also type.

I think that's fair, although it seemed odd that even single words, pronounced as clearly as possible, weren't recognized. It's not like there was background noise getting in the way of using the boom. Out of curiosity, how much training is needed to have the experience in the video you linked? I mean, Vinny went through a good 15-20 minutes of it. Do you have to repeat the training 2-3 times for it to work properly? Also, even if the voice recognition is perfect, the lack of contextual awareness is something I hope you guys are working to fix (like when Vinny said "walk forward" twice, then said "more" and it wasn't recognized).

I respect what you guys are doing, but when there is voice recognition software out there (Siri, Google Voice, etc) that accurately recognizes voice and context with zero training, I can completely see why someone would become frustrated with this game, as they would expect the voice recognition to be as a good as tech that has been existing for years. Anyways, good luck!

EDIT: I should also mention that, even when vinny's commands are recognized, or when he types commands, the robot often still doesn't understand, or performs an action totally different to what was commanded.

I think the point is that Vinny accidentally didn't save ANY of his training. Also they're not using their own speech recognition technology, they're using Microsoft's (or Dragon, if you have that installed).

Yeah, regardless of what you think of the gameplay it's unfair to pin the voice recognition experience of a guy using a third party program via boom mic with no saved voice profile on the game... especially when you can type commands.

That said the whole natural speech interface reminds me to some extent of the vaguely frustrating but nonetheless intriguing Starship Titanic. Of course that game is many years old and outside of 'programming' commands this doesn't seem to advance the natural language command concept too far.

The massive elephant in the room with this stuff is that a parser cannot reinterpret mistakes, infer intent or learn unknown terms based on conversational context. Even the most advanced language parsers (those used in the modern form of Turing test) are severely limited in inference capabilities and are only superior in their word and sentence tree libraries.

Avatar image for brillohead
Brillohead

47

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Hilarious, wish jeff was on this too.

Avatar image for imbiginjapan
ImBigInJapan

330

Forum Posts

5

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

Edited By ImBigInJapan

@singing_pigs said:

@mrsmiley said:

@botcolony said:

If you go to the link above

http://steamcommunity.com/games/263040/announcements/detail/190591878968722392

you can how the game works with a trained profile and you'll also see what the gameplay looks like. If someone plays it without a trained profile, or doesn't realize they have to hit Enter for the input to be evaluated - you get Vinny's experience. If people don't save their speech profile or don't read anything before they jump in and play, then yes, they'll have an experience like Vinny. By the way, you can also type.

I think that's fair, although it seemed odd that even single words, pronounced as clearly as possible, weren't recognized. It's not like there was background noise getting in the way of using the boom. Out of curiosity, how much training is needed to have the experience in the video you linked? I mean, Vinny went through a good 15-20 minutes of it. Do you have to repeat the training 2-3 times for it to work properly? Also, even if the voice recognition is perfect, the lack of contextual awareness is something I hope you guys are working to fix (like when Vinny said "walk forward" twice, then said "more" and it wasn't recognized).

I respect what you guys are doing, but when there is voice recognition software out there (Siri, Google Voice, etc) that accurately recognizes voice and context with zero training, I can completely see why someone would become frustrated with this game, as they would expect the voice recognition to be as a good as tech that has been existing for years. Anyways, good luck!

EDIT: I should also mention that, even when vinny's commands are recognized, or when he types commands, the robot often still doesn't understand, or performs an action totally different to what was commanded.

I think the point is that Vinny accidentally didn't save ANY of his training. Also they're not using their own speech recognition technology, they're using Microsoft's (or Dragon, if you have that installed).

Yeah, regardless of what you think of the gameplay it's unfair to pin the voice recognition experience of a guy using a third party program via boom mic with no saved voice profile on the game... especially when you can type commands.

That said the whole natural speech interface reminds me to some extent of the vaguely frustrating but nonetheless intriguing Starship Titanic. Of course that game is many years old and outside of 'programming' commands this doesn't seem to advance the natural language command concept too far.

The massive elephant in the room with this stuff is that a parser cannot reinterpret mistakes, infer intent or learn unknown terms based on conversational context which makes them enormously difficult to interact with. Even the most advanced language parsers (those used in the modern form of Turing test) are severely limited in inference capabilities and are only superior in their word and sentence tree libraries.

Avatar image for kantrip
kantrip

58

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Agreed on the Boom Mic comments. May not have been the right kind of mic for that, however the whole agonizing portion of "put the pepper grinder down" would have driven me nuts with or without good voice recognition.

Looks like a fun game but way too detailed for my tastes

Avatar image for imbiginjapan
ImBigInJapan

330

Forum Posts

5

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

@darkest4: Nah, there's something glorious about Vinny alone, screaming at a computer in a tiny room in the TV Guide office. I was kind of hoping that a security guard would come after getting a report that there was a crazed homeless man in the building.

Avatar image for theimmortalbum
theimmortalbum

646

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

Edited By theimmortalbum

Oh my gosh. Hilarious.

Avatar image for twolines
TwoLines

3406

Forum Posts

319

Wiki Points

0

Followers

Reviews: 0

User Lists: 5

@toggery said:

Did you mean?

Nice QL, Andrew.

It's Philips.

Avatar image for xrayzwei
xrayzwei

191

Forum Posts

2188

Wiki Points

0

Followers

Reviews: 0

User Lists: 6

"This is not a game"

Avatar image for famicom601
famicom601

29

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Wow. This was great.

Avatar image for stonyman65
stonyman65

3818

Forum Posts

1

Wiki Points

0

Followers

Reviews: 0

User Lists: 4

I'm getting a weird Phantom 2040 vibe from this...

Avatar image for bollard
Bollard

8298

Forum Posts

118

Wiki Points

0

Followers

Reviews: 3

User Lists: 12

WHY WOULDNT HE CLICK FURTHER TO THE FUCKING RIGHT

Avatar image for wolfskind
wolfskind

106

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 2

Voice commands + VinnyAndrew Philips = great stuff :D

Avatar image for toggery
toggery

69

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Did you mean?

Nice QL, Andrew.

Avatar image for jumbolia_woodrum
jumbolia_woodrum

4

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

wow... that's pretty painful to watch

Avatar image for xseedx
xseedx

74

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Edited By xseedx

What an excellent excellent video, i was in tears. I am sure the game can perform better, but this way it was perfectly orchestrated comedy!

Avatar image for l4wd0g
l4wd0g

2395

Forum Posts

353

Wiki Points

0

Followers

Reviews: 0

User Lists: 7

Edited By l4wd0g

This was amazing.

Avatar image for dr_mantas
dr_mantas

2557

Forum Posts

92

Wiki Points

0

Followers

Reviews: 0

User Lists: 9

Edited By dr_mantas

So pumped!

As funny as that text Vinny was reading seemed, it addresses a very real future issue. Robots taking over manual jobs will bring about MASSIVE inequality, think worse than Brasil or Russia today, with wealth concentrated at the hands of corporations that own the robots. The only solution seems to be government taking initiative in the field of robot manual labor. Might be a bit socialist, but it's probably best.

Avatar image for ki11tank
ki11tank

737

Forum Posts

0

Wiki Points

0

Followers

Reviews: 34

User Lists: 8

seriously biggest thing i'll miss is vinny not being on a podcast now. too bad i feel like vinny on the am show would just strain patrick a bit as he's then the only one not there then.

Avatar image for luchohubanov
luchohubanov

5

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I suggest this gets turned into a regular thing - Bot Colony Endurance Run anyone?

Avatar image for billyok
billyok

613

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Edited By billyok

@billyok: isn't he using the logitec headphones mic he mentioned at the start???

I don't believe so. He showed it at the start and had it on hand as a backup plan, but never put it on because the boom mic was working ("working" used loosely here) as an input mic.

Avatar image for nycalexdunk
Nycalexdunk

80

Forum Posts

832

Wiki Points

0

Followers

Reviews: 4

User Lists: 2

@billyok: isn't he using the logitec headphones mic he mentioned at the start???