SixthSense Creator Releasing Code for Super-Cool Wearable Gesture Interface Device

by Lisa Hoover - Nov. 06, 2009Comments (22)

s i x t h s e n s e

Remember the scene in the movie Minority Report where Tom Cruise uses hand gestures instead of a mouse to interact with a computer screen displayed on the wall? The idea isn't really that far-fetched and software developer Pranav Mistry has been working on making it a reality.

Mistry is the creator of SixthSense, a wearable gesture interface that uses a camera and tiny projector to display data and information onto surfaces, walls, and even your hand. Special fingertip sensors let users manipulate the data and use their hands to interact with it. During a presentation at the TEDIndia conference this week, the PhD student announced plans to release SixthSense under an open source license in the coming months.

"I notice that it's hard to for these kind of things to market in some sense. . . because I don't want this to comply with some of kind of corporate policy," says Mistry. "Rather than waiting for that time to come, I want people to make their own system. Why not?"

"People will be able to make their own hardware. I will give them instructions how to make it. And also provide them key software...give them basic key software layers. . . they will be able to build their own applications. They will be able to modify base level and do anything".

The device, which can be built for about $350, has fascinating implications beyond its infinite coolness. SixthSense has the ability to sense objects around you and displays content relevant to your environment. If you're in a bookstore, for instance, and hold up a copy of Learning the Vi and Vim Editors, SixthSense shows you pricing guides, information about the author, and so on. Mistry's device puts the Internet literally at your fingertips.

Image courtesy of Pranav Mistry and Sam Ogden.



Kartik Subbarao uses OStatic to support Open Source, ask and answer questions and stay informed. What about you?



22 Comments
 

Another technology breakthrough!


0 Votes

amazing! can't wait!


0 Votes

woo! i'll build this as soon as i can! i love DIY


0 Votes

In case folks are interested, an SDK for this interface (not by Mistry though) is already available (just go to ACM digital library and go thru this year's UbiComp 2009 conference demos). The SDK which was demonstrated in UbiComp allows one to develop their own mobile applications on top of this gestural interface and run on a smartphone (Mistry's application OTOH only runs on a laptop).


0 Votes

Can this be ported to the andriod platform. Game changer for sure.


0 Votes

Pretty cool!


0 Votes

can any body give me the link to the svn of this project, from where i can get the code this, is it open source right now ??, or if not when it will be please moderators do inform us soon. As this device is an revolution to computation world. Many open source developers are really waiting eagerly, wanting to work on it. Surely this will give big fight to tablet PCs which are next eye catching products, although open source can really make a difference.


0 Votes

I went to the ubicomp site that was mentioned and i couldn't find anything in u UbiComp 2009 conference demos .... could you be a little bit more specific on the exact web site? I'd love to find out if this could work with a Ipod touch


0 Votes

Cant able to find the software and gadgets information till now

If some one know the links please help us make our project too111


0 Votes

Where can I get the Code For the SIXTH SENSE? This is amazing. I'm going to build one as soon as the open source comes out as long as I can get the code.


0 Votes

When will the code come out? WHAT IS THE CODE?


0 Votes

i think the code is at TED.com. oh, by the way, it can be used on the iphone.


0 Votes

I have develope a solar celled version of the sixth sense, if you want. I am still finalizing some hardware and some software, so I will put out the code pretty soon.


0 Votes

hey!! bring out the code after its done.

when is it coming to india?


by the way same kind of stuff is been done by a IIT-H student!!

the video is on youtube.


0 Votes

can some one provide me the code software for this sixth sense deive..........


0 Votes

hi Pranav Mistry, cool... when will you release the specs and code?


0 Votes

can any of u guys tell me how this software work.....like when the scanner reads the bar code how does it show the information about the flight timings etc......


0 Votes

what is the releasing date of this amazing mobile


0 Votes

Hi every one:


Anyone around here has the code or knows where to find it?? Is there any documentation available.


best regards


0 Votes

I remain sticked on the impression that this demo conference is essentially well faked. All video processing algorithms they used for their sixth sense project is well known since a few years. My bet is all demonstration cases he shows are short well calibrated use case which are still very very far from becoming something usable every single day anywhere on anything. For proof the racing game demo is probably the badest one.

The device which embedded cameras & the small video projector he built may be interesting but for rest just look for augmented reality opensource code and I guess you'll find better code than what this guy may publish as open source code someday ...


0 Votes

i like the sixth sense so i want the open source code and the link for code


0 Votes

so awesome. I love the idea that you can interact with objects, rather than staring at a screen.


0 Votes
Share Your Comments

If you are a member, to have your comment attributed to you. If you are not yet a member, Join OStatic and help the Open Source community by sharing your thoughts, answering user questions and providing reviews and alternatives for projects.