FingerNav is a Python-based virtual mouse that uses computer vision and AI to track hand gestures, enabling users to control their computer without a physical mouse. This innovative solution leverages OpenCV, MediaPipe, and PyAutoGUI for gesture recognition and interaction.
- Hand Gesture Recognition:
- Control cursor movement using hand position.
- Perform left-click, right-click, and double-click gestures.
- Scroll horizontally and vertically with pinch gestures.
- Brightness and Volume Control:
- Adjust system brightness and volume using pinch gestures.
- Multi-Hand Support:
- Detects and distinguishes between left and right hands.
- Customizable Gestures:
- Detects various gestures such as Fist, V-sign, Pinch, and more.
-
Hand Detection: The program uses MediaPipe to identify and track hand landmarks in real-time.
-
Gesture Classification: Custom algorithms classify gestures based on the relative position of hand landmarks.
-
Action Mapping: Recognized gestures are mapped to specific system actions, such as mouse clicks or scrolling.
-
Fine Control: Smooth cursor movements and fine-grained control of brightness and volume through pinch gestures.
- Python 3.7+
- Webcam
Install the required libraries using:
pip install -r requirements.txt- OpenCV
- MediaPipe
- PyAutoGUI
- Pycaw
- Screen Brightness Control
-
Run the Application: Start the program by running the
GestureControllerclass in the Python script.python fingernav.py
-
Control Your System:
- Move your hand to control the cursor.
- Use predefined gestures for specific actions.
-
Exit: Press the
Enterkey to close the application.
| Gesture | Action |
|---|---|
| V-Gesture | Move Cursor |
| Fist | Drag (Hold Left Click) |
| Index Finger | Left Click |
| Middle Finger | Right Click |
| Two Fingers Closed | Double Click |
| Pinch Major | Adjust Brightness/Volume |
| Pinch Minor | Scroll |
Gest: Enumerates gestures like Fist, Index, Pinch, etc.HandRecog: Recognizes and classifies hand gestures based on landmark positions.
Controller: Maps gestures to system actions (e.g., mouse movement, scrolling).GestureController: Manages webcam input and integrates hand detection and gesture recognition.
- Add voice command integration.
- Enhance gesture recognition accuracy.
- Support additional system actions.
- Ensure the webcam is functioning and positioned correctly.
- Adjust the environment for proper lighting to improve gesture recognition.
- If gestures are not recognized properly, ensure required libraries are installed and up to date.
This project is open-source and available under the MIT License.
We welcome contributions! Feel free to submit issues or pull requests to enhance FingerNav.