Motion Capture and Transfer Using CV

About The Project

In this project, we have taken the concept of hand and pose detection and used it to control certain actions. To perform these actions games were used as a suitable medium. Some of the games were made by the team members whereas some members used pre-existing games and controlled them. For hand detection the games used were Snakes (made in Pygame), Bubble shooter (pre-existing) and Smashkarts(pre-existing). The team created various different actions using hand detection on the user camera feed and then used 3D geometry to determine poses and then relay action to the game.
On the other hand some team members used pose(body) detection for the game control. The games chosen were Red Ball 4(pre-existing) and Subway surfers(pre-existing). In a similar fashion like hand detection the pose detection project detects the pose of the user using video input and then using 3D geometry analysis detects the pose the user is in and then gives input to the game to perform action.

To get more in-depth information of the project read the documentation.


Meet The Team

Mentors

team-member

Kolla Ananta Raj

Computer Vision
team-member

Manav Kapadnis

Computer Vision

Mentees

Ananya Das

Computer Vision

She worked with Bubble shooter game and used hand detection and tracking modules of mediapipe library to play the games with hand gestures.

Divyansh Raghuvanshi

Computer Vision

He worked on controlling the character of the Subway Surfer game with the help of hand and body gestures, using OpenCV and mediapipe library.

Nikhil Giri

Computer Vision

He worked on hand guesture control using openCV and mediapipe, made a Snakes game using Pygame and a program to control keyboard using hand.

Pratik Ingle

Computer Vision

He was involved in the detection of hand and body gestures and came up with a game to play using these gestures.

Shivam Raj

Computer Vision

He worked on a python script facilitating mouse control using hand gestures which used OpenCV and pyautogui libraries of Python.

Tanmay Mohanty

Computer Vision

He worked on upper body position tracking using OpenCV and MediaPipe. The hand movements were mapped to game controls to play RedBall 4.