TV Comment Bot

Last weekend I participated in an event here in Brooklyn called Art Hack Day where a bunch of artists and technologists with different skill sets all got together to implement new projects in 36 hours and finish with a gallery opening. I teamed up with David Newbury and Blair Neal on an installation we called “TV Helper” which is now also running as a Twitter-bot called TV Comment Bot.

The TV Helper is designed to make new TV shows out of existing ones by inserting new subtitle text over any video feed, replacing the original plot and dialogue of the show being watched. When possible the TV Helper algorithms will reference specific objects it “sees” in the video stream in the plot lines being created.

Additionally the genre of the new show can be a customized by the viewer using the set of provided knobs to be a mix of 8 different styles: Sports, News, Politics, Humor, Crime, NASCAR, Religion and Horror.

Here are some of my favorite results of feed from the home edition that is now running 24/7 since the Super Bowl on Feb 1st. You can find hundreds more on the Twitter feed.

If you're interested in hacking together a bit of this yourself, the two main tools used were the DeepBeliefSDK based analysis app that I wrote recently and this MadLibs generator created by David Newbury. We combined these using Quartz Composer / Syphon / OSC to create the simply text overlays for display.

The whole thing looked a bit like this behind the scenes:

Early display prototype.

Signal path sketch.

Software screenshot.

Testing, testing.

Me with the project!

Home edition.

Since this can run in real-time I'm also curious to try this out as an additional overlay during a VJ set in the future. We'll see how that goes.

Lastly a huge shout out to the Art Hack Day organizers for baby sitting all us artists while we worked. If you'd like to see more of the results from the event my friend Alejandro blogged about the awesome Oculus / Unity drowning game they made. You can find additional photos of the action (several of which are on this page!) on Margarida Malarkey's site.

[Update] Also on Art Hack Day: Deluge, read the details on the cool WiFi Taser by Max Henstell and another write up in this Makezine post.

[Update 2] Below are some more recent pictures from the Apple WWDC event, political press events and of course TV.

One Year Back In Brooklyn

It took me about 12 months of living in Brooklyn before I decided that I needed my own website. That isn't to say that I don't have several other websites already and that other people hadn't given me this suggestion numerous times over the years, but now its finally happened. With this in mind, for the first entry, a quick recap of a bunch of things I would have written, belated mini-blog posts for in the last year if I had been keeping up with it...

View from my apartment. Just happily resigned my lease for another year.

View from my apartment. Just happily resigned my lease for another year.

SXSW 2014

I went to SXSW 2014 with Game of Phones to be part of the AT&T / Vice Mobile Movement pavilion. We built a Telephonegram booth that played a series of continuous daily rounds for anyone passing by.

On the trip I also got a chance to visit with a bunch of VJs at a VDMX meet up. One of those opportunities to put faces to people that I've emailed with for years.

Actually managed to go out to concerts every night while there but sadly didn't get to make it to any of the interactive or film events.

Lastly, as a bonus got to shoot a slow motion video of my friend Juliette showing Lady Gaga how to control the stage visuals from an iPad.

 

NY Mappathon at Mapping Festival 2014

In late May I went to Geneva with my friends Chika, Anton and Tom for the 10th annual Mapping Festival. We ran a 3-day VJ workshop with a focus on projection mapping with students from around the world. There was also plenty of time to check out some of the events, presentations and performances over the weeklong festival, but the big highlight was just spending time talking with other visual artists in the beautiful city of Geneva.

For the festival I also got to do a short VJ set along with vade, 35 seconds of which you can watch in the included video and like a proper tourist I have a short slideshow of pictures from the trip.

 

Eyeo Festival 2014

Photo credit: Blair Neal

Shortly after the trip to Geneva it was off to Minneapolis for Eyeo Festival. This trip was a real treat, the presenters were all amazing and it was probably the friendliest, most excited cross section of the arts tech scene that I've come across so far. Frieder Nake's “Yes, Of Course” keynote speech was extremely fitting for the crowd, we all left the room carrying that spirit with us the rest of the week and then back home.

I also got an opportunity to do a 5 minute Ignite Talk on Game of Phones, the slides of which are available online (the video will be available soon). The best personal moment related to this was getting a high five from Nicholas Feltron and then finding out that I know the guy who does the visuals for his girlfriend.

Too many things to point out, all of the talks I went to were great, but in particular I was looking forward to seeing the ones from Jessica Hagy and Claire Evans who did not disappoint.

PS. There is a special Thank You round of Game of Phones for the Eyeo Festival organizers!

 

I helped out with a bunch of random events in NYC

... and David Lublin.

... and David Lublin.

Since my return a bunch creative agencies, organizations and friends have asked me to help out with projects they are working on. Usually my involvement is minimal, called in to assist with a few technical details at the last minute, but nonetheless they were a lot of fun to be part of and worth mentioning a few particularly cool ones in a single block..

  • I did some of the setup at Tao Downtown with the Rockwell Group. Also performed the visuals at the opening night event, ended up in this random celebrity slide show photo.
  • My friend Nick Gould called me in to do some production and on site work for goodco / i-D Think Aloud: Future Fashion Show. This involved a building a “Peppers Ghost” style holographic projection system along with green screen footage.
  • Filling in as a teacher on visual performance at dubspot.
  • Ran the visuals at one of the venues for the 2013 Brooklyn Electronic Music Festival using material prepared by Benton-C Bainbridge.
 

Brooklyn!

How far / long did you travel to be here in Brooklyn?

Even though the last year has included a lot of travel I'm most excited just to be back in my hometown. It's really my favorite place (so far) in the world and I'm not sure how I stayed away for so long. It probably had something to do with having such amazing friends up in Troy, who are all now encouraged to visit or move here to be closer to me.

I won't hang on this so just to throw out a few highlights in the BK, reconnecting with old friends, making lots of new friends, not missing family events, reconnecting with bagels, getting to go to lots of concerts, getting around by subway.. and I'm also a fan of having a skyline view. There's still a lot of readjustment to do and it feels like I still need to move faster to keep up.

Readily available weird ice cream flavors

And that's a little of what I've been up to over the last year. More to follow as it happens.