Project Mudra Phase-1 with IR LED

In this video we are trying to do the mouse operations with our hands. Using IR led's. This was in a very intial phase, when we were trying to learn the basics of image processing.

we are tracking the ir leds, and the mouse is moved according to the movement of the leds. And if the user wants to do the left click operation then he will show 2 IR leds. So lets say you have a glove, with ir leds at the finger tip, then the user can move the mouse with one finger, and then if you take your thumb out, it does a left click operation.

Project Mudra- The making

We have tried to add the swipe feature in our project. In user interfaces, which gives you the ability to operate the computer using your hands. When the user wants to perform any gesture, then he has to trigger an event whch detects that gesture.
what we have tried here is, we allow the user to do his normal operation and at the same time he can perform gestures, without triggering any event. the computer automatically distinguish between the mouse movement and the gestures performed. So you can move the mouse around with your hands, and at any point of time 
you can do the swipe operation in the air, which wll be detected by the computer.


These pics were taken when we were working on the swipe feature of our project.

Abstract of ProjectMudra

In recent years the popularity for natural interfaces has experienced tremendous growth. Natural interfaces provide the computers or the so called machines with a sense of humanity. The basic knowledge required to understand and utilize a computer system is reduced to a minimal extent. There have been recent commercial developments in the area of natural interfaces, including the Microsoft XBOX Kinect and Nintendo WII. However, the capital cost of such a system remains very high.

The primary purpose of this project is to explore and develop an interface that helps simple computer systems to support gestural interface. Recent laptops have cameras attached to their screens and almost all desktop PCs have webcams. We could utilize these existing facilities to support detection of human gestures, which would ultimately lead to the direct interaction of computers with humans.

In the implementation of the project, we would be using infrared lights to distinguish multiple fingers. With a glove having infrared light emitters on the fingertips, the setup will allow to distinguish gestures such as pinching fingers, turning hands, and so forth. As a result, the input bandwidth to the computer system is increased from a single mouse pointer to that of 10 fingers at max. This allows us to utilize multi-touch features that come along with the recent Windows 7 operating system. The goal is to use positional information and temporal trajectories to track gestures. However, the touch area would be limited to the size of the monitor and only 2-dimenional analysis would be made.

The project ensures that the natural interfacing is reached to the common hands with minimal cost. These utilities would have a crucial social impact. According to the United Nations Millennium goals, child education is one of the major focuses. The children could seamlessly interact with computer system in a very natural way. The fun of multiple children interacting with a single computer would be a unique experience in collaborative learning. The learning curve for using a computer is reduced to a minimum. The social impact of this project would be noteworthy. The game and HCI industry would benefit a lot in this project endeavour.

Guidelines on Comments

As the community participates in the ProjectMudra blog, we want to offer some guidelines on how we are going handle comments in general. Our primary goal is for this to be a place for open discussion about Engineering ProjectMudra, so we don't want to have lots of overhead and process.

We love comments. We know everyone on the ProjectMudra team will be watching for comments and is looking forward to the dialog. We will work to make sure that the software programmers represents themselves as such, especially if they work on ProjectMudra.

Things we want to see in comments:

• Lots of good interesting responses on this project
  
• Keep it on topic
  
• Keep it respectful
  
• Keep it fun
  

Things that will get comments edited/deleted:

• Offensive or abusive language or behavior
  
• Misrepresentation (i.e., claiming to be somebody you're not) - if you don't want to use your real name, that's fine, as long as your "handle" isn't offensive, abusive, or misrepresentative
  
• Blog-spam of any kind
  

We hope these rules will keep the discussion lively and on topic.

With regards,

• Abin Abraham Alichan (abinalichan@gmail.com)
  
• Bhumkar Yogesh (yogesh.hifi@gmail.com)
  
• Dave Ankit (ankitdave06@gmail.com)