PXL PUSHR: A Peculiar Marriage of iPad and Kinect

Avatar image for alex
alex

3983

Forum Posts

7447

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

Edited By alex

Kill Screen magazine recently hosted an event at New York City's Museum of Modern Art. Titled "Arcade," the party was an offshoot of the museum's Talk to Me exhibit, a project designed to "highlight the groundbreaking ways in which objects help people interact with complex systems and networks." You can read more on that exhibit here, if you like, because I'm not really going to be talking about it in this article. I'll be the first to admit that most of the main exhibit was utterly lost on me. I pretty much just went to check out the games the Kill Screen team had curated for the evening's event.

Say hello to PXL PUSHR. No, I don't know why the letter
Say hello to PXL PUSHR. No, I don't know why the letter "U" gets to be the only used vowel, either.

Many of those games consisted of already released indie favorites like Bit.Trip Beat, Echochrome, Canabalt, QWOP, and Limbo, all projected onto the dimly-lit white walls of the museum like animated art installations. It was a fine selection of games to be sure, albeit a largely familiar one to those in attendance.

Also tucked away in a corner of the museum's second floor was a little unreleased oddity called PXL PUSHR. At first glance, it looks a little like a pixelated version of your typical Kinect minigame, with players attempting to form shapes to match colored pixels that appear in odd places on the screen. Then you notice that the Kinect appears to be hooked up to a computer. Then you notice the iPad on the table next to the TV, as well as the person using it to create the pixel patterns on the screen. Then you realize there's a whole rhythmic element to the game, on top of this newly-realized competitive element. That last part makes particular sense when you meet PXL PUSHR's makers: Harmonix developers Matt Boch and Ryan Challinor.

Boch and Challinor both have extensive experience with Kinect. Both work on the Dance Central team, and have spent their days playing with Microsoft's magical camera technology since its Project Natal infancy. That said, PXL PUSHR isn't something born out of some dream of taking Kinect tech to its next logical evolution, or what have you. In talking to Challinor, the whole thing sounds like it popped up pretty much on a whim. He'd been working in his spare time on a program he'd dubbed "Synapse," a Kinect application specifically designed to interact with any application that can handle OSC events. At some point Boch came along and ideas for an actual game started to percolate. Three weeks later, here the thing sat in a corner of the Museum of Modern Art in New York City, with a massive line of people waiting to try it out.

On the surface, PXL PUSHR seems like the same "human Tetris" minigame we've seen a dozen times over since the Kinect launch. Contort your body into various positions to match what the screen demands of you (in this case, covering the highlighted pixels on the screen) in order to progress to the next round. Kinect Adventures has done it, Carnival Games has done it, and Majesco even has a whole game dedicated to the idea.

The goal is to match your body with the pixels within the lightly-colored bar, which moves from side to side in time with the soundtrack.
The goal is to match your body with the pixels within the lightly-colored bar, which moves from side to side in time with the soundtrack.

So what's different here? Apart from the aggressively retro graphics that are about as purposely pixelated as anything in the Bit.Trip series, the trick with PXL PUSHR is that the progression of the game isn't pre-determined, nor is it randomized. Via an iPad hooked up to the same computer as the Kinect sensor (the program supports both Macs and PCs, according to Challinor), a second player uses a gridlike HUD to program where the pixels will appear for their competitor. The game's scoring is entirely based on how many pixels the player on the screen hits, versus how many they miss. Whatever they miss feeds into the iPad player's score.

Oh, and it's all rhythmic. A small, translucent bar moves across the screen in particular time with the background music, and you have to be highlighting whatever pixels happen to be in the bar's path as it moves along. Think Lumines, if you had to frantically run from side to side to hit all the required pixels. Exhausting as that may sound, it's actually quite a lot of fun. The player with the iPad gets the sort of trollish thrill of trying to screw up their opponent, while the player gets a bit of an enjoyable workout trying to contort and dart about, depending on what their tormentor has cooked up.

An iPad and a Kinect working in harmony feels like something out of some weird, hippy-ish Utopian dream. Not that Microsoft and Apple technologies haven't played at least reasonably nice together before, but PXL PUSHR requires them to work in tandem to exist. Homebrew Kinect development is nothing new, and Microsoft has even made a point to support the crazy endeavors of homebrew programmers like Challinor and Boch. Apple is not quite as willing to let people to hack around with their fancy tablets, but in this case, no hacking is really required. Boch and Challinor are simply using an existing sequencer app called TouchOSC to program the in-game action. It's already a fairly customizable app, and it apparently was all the pair needed to allow the other player to do exactly what they wanted them to do.

This is what the player holding the iPad sees, the idea being to try to place your dots in increasingly challenging spots.
This is what the player holding the iPad sees, the idea being to try to place your dots in increasingly challenging spots.

Perhaps realizing that a relatively limited number of people will have a Kinect, an iPad, and the know-how to hook all these things up to play on a properly-sized screen, Team PXL (as Boch and Challinor are calling themselves for this particular project) plan to simply release the app for free once it's finished. They'll announce its availability via their Twitter account when the thing is "complete," though given its relatively breezy development cycle and whimsical conception, one gets the impression that Boch and Challinor will just keep tweaking PXL PUSHR until they find something else to occupy their time--after all, they were adjusting the live Arcade demo until ten minutes before they opened the doors.

If nothing else, PXL PUSHR is a nifty example of what can happen when developers go beyond developing indie games using expected technologies. The idea of mixing and matching technologies to bend to the will of what the developer aims to do is kind of a fascinating one, when you consider how restrictive console development--and in some cases, even PC development--can be.

Perhaps as time rolls on, we'll see increased examples of programmers and designers finding ways to take two seemingly incompatible pieces of tech and finding creative ways to make them work. Considering all the various pieces of console, computer, and whatever else technology I have lying around my apartment, I certainly wouldn't mind a few interesting excuses to do something unexpected with them.

Avatar image for alex
alex

3983

Forum Posts

7447

Wiki Points

0

Followers

Reviews: 0

User Lists: 1

#1  Edited By alex

Kill Screen magazine recently hosted an event at New York City's Museum of Modern Art. Titled "Arcade," the party was an offshoot of the museum's Talk to Me exhibit, a project designed to "highlight the groundbreaking ways in which objects help people interact with complex systems and networks." You can read more on that exhibit here, if you like, because I'm not really going to be talking about it in this article. I'll be the first to admit that most of the main exhibit was utterly lost on me. I pretty much just went to check out the games the Kill Screen team had curated for the evening's event.

Say hello to PXL PUSHR. No, I don't know why the letter
Say hello to PXL PUSHR. No, I don't know why the letter "U" gets to be the only used vowel, either.

Many of those games consisted of already released indie favorites like Bit.Trip Beat, Echochrome, Canabalt, QWOP, and Limbo, all projected onto the dimly-lit white walls of the museum like animated art installations. It was a fine selection of games to be sure, albeit a largely familiar one to those in attendance.

Also tucked away in a corner of the museum's second floor was a little unreleased oddity called PXL PUSHR. At first glance, it looks a little like a pixelated version of your typical Kinect minigame, with players attempting to form shapes to match colored pixels that appear in odd places on the screen. Then you notice that the Kinect appears to be hooked up to a computer. Then you notice the iPad on the table next to the TV, as well as the person using it to create the pixel patterns on the screen. Then you realize there's a whole rhythmic element to the game, on top of this newly-realized competitive element. That last part makes particular sense when you meet PXL PUSHR's makers: Harmonix developers Matt Boch and Ryan Challinor.

Boch and Challinor both have extensive experience with Kinect. Both work on the Dance Central team, and have spent their days playing with Microsoft's magical camera technology since its Project Natal infancy. That said, PXL PUSHR isn't something born out of some dream of taking Kinect tech to its next logical evolution, or what have you. In talking to Challinor, the whole thing sounds like it popped up pretty much on a whim. He'd been working in his spare time on a program he'd dubbed "Synapse," a Kinect application specifically designed to interact with any application that can handle OSC events. At some point Boch came along and ideas for an actual game started to percolate. Three weeks later, here the thing sat in a corner of the Museum of Modern Art in New York City, with a massive line of people waiting to try it out.

On the surface, PXL PUSHR seems like the same "human Tetris" minigame we've seen a dozen times over since the Kinect launch. Contort your body into various positions to match what the screen demands of you (in this case, covering the highlighted pixels on the screen) in order to progress to the next round. Kinect Adventures has done it, Carnival Games has done it, and Majesco even has a whole game dedicated to the idea.

The goal is to match your body with the pixels within the lightly-colored bar, which moves from side to side in time with the soundtrack.
The goal is to match your body with the pixels within the lightly-colored bar, which moves from side to side in time with the soundtrack.

So what's different here? Apart from the aggressively retro graphics that are about as purposely pixelated as anything in the Bit.Trip series, the trick with PXL PUSHR is that the progression of the game isn't pre-determined, nor is it randomized. Via an iPad hooked up to the same computer as the Kinect sensor (the program supports both Macs and PCs, according to Challinor), a second player uses a gridlike HUD to program where the pixels will appear for their competitor. The game's scoring is entirely based on how many pixels the player on the screen hits, versus how many they miss. Whatever they miss feeds into the iPad player's score.

Oh, and it's all rhythmic. A small, translucent bar moves across the screen in particular time with the background music, and you have to be highlighting whatever pixels happen to be in the bar's path as it moves along. Think Lumines, if you had to frantically run from side to side to hit all the required pixels. Exhausting as that may sound, it's actually quite a lot of fun. The player with the iPad gets the sort of trollish thrill of trying to screw up their opponent, while the player gets a bit of an enjoyable workout trying to contort and dart about, depending on what their tormentor has cooked up.

An iPad and a Kinect working in harmony feels like something out of some weird, hippy-ish Utopian dream. Not that Microsoft and Apple technologies haven't played at least reasonably nice together before, but PXL PUSHR requires them to work in tandem to exist. Homebrew Kinect development is nothing new, and Microsoft has even made a point to support the crazy endeavors of homebrew programmers like Challinor and Boch. Apple is not quite as willing to let people to hack around with their fancy tablets, but in this case, no hacking is really required. Boch and Challinor are simply using an existing sequencer app called TouchOSC to program the in-game action. It's already a fairly customizable app, and it apparently was all the pair needed to allow the other player to do exactly what they wanted them to do.

This is what the player holding the iPad sees, the idea being to try to place your dots in increasingly challenging spots.
This is what the player holding the iPad sees, the idea being to try to place your dots in increasingly challenging spots.

Perhaps realizing that a relatively limited number of people will have a Kinect, an iPad, and the know-how to hook all these things up to play on a properly-sized screen, Team PXL (as Boch and Challinor are calling themselves for this particular project) plan to simply release the app for free once it's finished. They'll announce its availability via their Twitter account when the thing is "complete," though given its relatively breezy development cycle and whimsical conception, one gets the impression that Boch and Challinor will just keep tweaking PXL PUSHR until they find something else to occupy their time--after all, they were adjusting the live Arcade demo until ten minutes before they opened the doors.

If nothing else, PXL PUSHR is a nifty example of what can happen when developers go beyond developing indie games using expected technologies. The idea of mixing and matching technologies to bend to the will of what the developer aims to do is kind of a fascinating one, when you consider how restrictive console development--and in some cases, even PC development--can be.

Perhaps as time rolls on, we'll see increased examples of programmers and designers finding ways to take two seemingly incompatible pieces of tech and finding creative ways to make them work. Considering all the various pieces of console, computer, and whatever else technology I have lying around my apartment, I certainly wouldn't mind a few interesting excuses to do something unexpected with them.

Avatar image for sagesebas
sagesebas

2465

Forum Posts

579

Wiki Points

0

Followers

Reviews: 3

User Lists: 5

#2  Edited By sagesebas

900 dollars that is what I am willing to pay

Avatar image for rjayb89
rjayb89

7813

Forum Posts

9437

Wiki Points

0

Followers

Reviews: 0

User Lists: 17

#3  Edited By rjayb89

By just viewing these there images on this news article, my Kinect is aroused.

Avatar image for winsord
winsord

1642

Forum Posts

86

Wiki Points

0

Followers

Reviews: 0

User Lists: 13

#4  Edited By winsord

This sounds pretty awesome; but it also sounds pretty expensive to play if you don't already have all of the gear. XD

Avatar image for zameer
zameer

637

Forum Posts

11759

Wiki Points

0

Followers

Reviews: 7

User Lists: 3

#5  Edited By zameer

Makes me wish Harmonix was big enough to experiment more and do these kinda games on a retail scale!

Avatar image for vexxan
Vexxan

4642

Forum Posts

943

Wiki Points

0

Followers

Reviews: 0

User Lists: 3

#6  Edited By Vexxan

Awesome but expensive.

Avatar image for bassman2112
bassman2112

1212

Forum Posts

475

Wiki Points

0

Followers

Reviews: 23

User Lists: 12

#7  Edited By bassman2112

Microsoft and Apple products working together?!

Madness.

Avatar image for mumrik
Mumrik

1136

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#8  Edited By Mumrik

I hope they shot whoever came up with that name - specifically the spelling.

Avatar image for awwbees
awwbees

2

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#9  Edited By awwbees

No one has shot me yet.

Avatar image for mattboch
mattboch

2

Forum Posts

111

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#10  Edited By mattboch

I shot you a high-five for coming up with an awesome title that incorporated the teamPXL name!

Avatar image for wolf_blitzer85
wolf_blitzer85

5460

Forum Posts

2

Wiki Points

0

Followers

Reviews: 0

User Lists: 6

#11  Edited By wolf_blitzer85

Harmonix=Happiness

Avatar image for vinsanityv22
vinsanityv22

1066

Forum Posts

6

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#12  Edited By vinsanityv22

Neat. Hopefully it'll actually come to 360 Kinect sometime...although, it'll be hard to come up with a replacement for the iPad though.

Avatar image for shartcarbuncle
ShartCarbuncle

49

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 2

#13  Edited By ShartCarbuncle

I drank way too much of the free wine at the party and didn't really pay any attention to the exhibit.

Avatar image for example1013
Example1013

4854

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#14  Edited By Example1013

@vinsanityv22 said:

Neat. Hopefully it'll actually come to 360 Kinect sometime...although, it'll be hard to come up with a replacement for the iPad though.

Wii U.

Avatar image for theht
TheHT

15998

Forum Posts

1562

Wiki Points

0

Followers

Reviews: 1

User Lists: 9

#15  Edited By TheHT
@Example1013 said:

@vinsanityv22 said:

Neat. Hopefully it'll actually come to 360 Kinect sometime...although, it'll be hard to come up with a replacement for the iPad though.

Wii U.

Wow. That's actually a *mostly* perfect fit.