Skeleton Sport

Originally created for Massey University's Engineering Experience Day, this has also been used at several Massey Engineering student outreach events in high schools. This is a basic game that uses pose detection to control up to five on screen figures. The figures are drawn as stick figures and the aim is to kick/hit a ball into a goal at either end of the screen. It is very basic and there is a lot that could be done to improve it, but it hints at the possibilities of what is possible using just a cheap webcam and a web browser.

The demo itself is written in JavaScript and uses the Electron wrapper to make it into a PC app. A webcam is used and TensorFlow’s pre-trained PoseNet [here] to track the players’ poses.