The main purpose of the study of human-computer interaction is to develop techniques such that they enhance the way users can interact with their computers and make it more intuitive. The use of physical devices like mouse, keyboard for human-computer interaction hinders the intuitiveness and naturalness of the interface as there is a strong barrier between the user and computer. With the development of ubiquitous computing, current user human-computer Interaction with a personal computer today limited to just keyboard and mouse interaction is not sufficient. Being able to interact with the system naturally is becoming ever more important in many fields of human-computer interaction. Direct use of hands as an input device is an attractive method for providing natural human-computer interaction rather than traditional text-based interfaces through graphical-based user interfaces. Although the market for hand gesture-based interface design is huge, building a robust hand gesture recognition system remains a challenging problem for traditional vision-based approaches. Hence this hand gesture recognition system which can efficiently track both static and dynamic hand