CV_Rythm_Beat_Game
As part of a 10-week course focused on Game AI, our team had about three weeks to implement a prototype based on the class material. CV_Rythm_Beat_Game is a rhythm beat ame that implements real-time hand-tracking using your webcam thanks to OpenCV and MediaPipe.
Genre: Rythm
Engine/Tools: Unity, OpenCV, MediaPipe,Python
Team Size: 4
Duration: 3+ Weeks
Responblities
Team Leadership & Coordination:
Successfully led and coordinated a small team of three collaborators, ensuring smooth communication and task management.
Main Level Design & Scene Creation
Created the primary level scene where gameplay takes place, focusing on user interaction and game flow.
Game Mechanics Co-Design & Programming:
-
Song Manager: Developed a system to manage and play the selected songs, ensuring smooth transitions and control over the game’s music tracks.
-
Note Spawning System: Programmed lanes that dynamically spawn music notes in sync with the chosen track to create a challenging rhythm experience.
-
Hand-Tracking Detectors: Built detectors that track whether the player’s hand hit or missed the notes, accurately measuring timing precision.
Technical Development:
-
Real-time Hand Tracking System: Implemented a hand tracking system using OpenCV and MediaPipe to track player hand movements in real-time, linking them to the in-game actions.
-
Hand Collider System: Scripted a system to estimate the span of the collider based on the player's hand rotation and position, enhancing accuracy during gameplay.

