top of page

CV_Rythm_Beat_Game

As part of a 10-week course focused on Game AI, our team had about three weeks to implement a prototype based on the class material.  CV_Rythm_Beat_Game is a rhythm beat ame that implements real-time hand-tracking using your webcam thanks to OpenCV and MediaPipe.  

Genre: Rythm

Engine/Tools: Unity, OpenCV,  MediaPipe,Python

Team Size: 4

Duration: 3+ Weeks

Responblities

Team Leadership & Coordination:

Successfully led and coordinated a small team of three collaborators, ensuring smooth communication and task management.


Main Level Design & Scene Creation

Created the primary level scene where gameplay takes place, focusing on user interaction and game flow.

Game Mechanics Co-Design & Programming:

  • Song Manager: Developed a system to manage and play the selected songs, ensuring smooth transitions and control over the game’s music tracks.

  • Note Spawning System: Programmed lanes that dynamically spawn music notes in sync with the chosen track to create a challenging rhythm experience.

  • Hand-Tracking Detectors: Built detectors that track whether the player’s hand hit or missed the notes, accurately measuring timing precision.

Technical Development:

  • Real-time Hand Tracking System: Implemented a hand tracking system using OpenCV and MediaPipe to track player hand movements in real-time, linking them to the in-game actions.

  • Hand Collider System: Scripted a system to estimate the span of the collider based on the player's hand rotation and position, enhancing accuracy during gameplay.

  • GitHub
  • LinkedIn

© 2024 Reuben Chavez

  • GitHub
  • LinkedIn

© 2024 Reuben Chavez

bottom of page