SixthSense Creator Releasing Code for Super-Cool Wearable Gesture Interface Device

by Lisa Hoover - Nov. 06, 2009Comments (8)

s i x t h s e n s e

Remember the scene in the movie Minority Report where Tom Cruise uses hand gestures instead of a mouse to interact with a computer screen displayed on the wall? The idea isn't really that far-fetched and software developer Pranav Mistry has been working on making it a reality.

Mistry is the creator of SixthSense, a wearable gesture interface that uses a camera and tiny projector to display data and information onto surfaces, walls, and even your hand. Special fingertip sensors let users manipulate the data and use their hands to interact with it. During a presentation at the TEDIndia conference this week, the PhD student announced plans to release SixthSense under an open source license in the coming months.

"I notice that it's hard to for these kind of things to market in some sense. . . because I don't want this to comply with some of kind of corporate policy," says Mistry. "Rather than waiting for that time to come, I want people to make their own system. Why not?"

"People will be able to make their own hardware. I will give them instructions how to make it. And also provide them key software...give them basic key software layers. . . they will be able to build their own applications. They will be able to modify base level and do anything".

The device, which can be built for about $350, has fascinating implications beyond its infinite coolness. SixthSense has the ability to sense objects around you and displays content relevant to your environment. If you're in a bookstore, for instance, and hold up a copy of Learning the Vi and Vim Editors, SixthSense shows you pricing guides, information about the author, and so on. Mistry's device puts the Internet literally at your fingertips.

Image courtesy of Pranav Mistry and Sam Ogden.



Gerard Braad uses OStatic to support Open Source, ask and answer questions and stay informed. What about you?



8 Comments
 

Another technology breakthrough!


0 Votes

amazing! can't wait!


0 Votes

woo! i'll build this as soon as i can! i love DIY


0 Votes

In case folks are interested, an SDK for this interface (not by Mistry though) is already available (just go to ACM digital library and go thru this year's UbiComp 2009 conference demos). The SDK which was demonstrated in UbiComp allows one to develop their own mobile applications on top of this gestural interface and run on a smartphone (Mistry's application OTOH only runs on a laptop).


0 Votes

Can this be ported to the andriod platform. Game changer for sure.


0 Votes

Pretty cool!


0 Votes

can any body give me the link to the svn of this project, from where i can get the code this, is it open source right now ??, or if not when it will be please moderators do inform us soon. As this device is an revolution to computation world. Many open source developers are really waiting eagerly, wanting to work on it. Surely this will give big fight to tablet PCs which are next eye catching products, although open source can really make a difference.


0 Votes

I went to the ubicomp site that was mentioned and i couldn't find anything in u UbiComp 2009 conference demos .... could you be a little bit more specific on the exact web site? I'd love to find out if this could work with a Ipod touch


0 Votes
Share Your Comments

If you are a member, to have your comment attributed to you. If you are not yet a member, Join OStatic and help the Open Source community by sharing your thoughts, answering user questions and providing reviews and alternatives for projects.