Search code, repositories, users, issues, pull requests...
Thank you for your interest in our paper on skeletal tracking microgestures (STMG). We have a simple demo available to show microgestures on Meta Quest 2, Meta Quest Pro, and Meta Quest 3. Please understand that this is currently experimental work.
Enable hand tracking in your headset's Settings: Settings -> Movement tracking -> Hand Tracking -> Hand and body tracking -> Enable https://www.meta.com/help/quest/articles/headsets-and-accessories/controllers-and-hand-tracking/hand-tracking/
Download the demo application from this repo and to install it you’ll need adb https://developer.android.com/tools/adb and then run: adb install stmg_demo.apk
To launch the app you can find the app under Applications -> Unknown Sources -> Microgestures Sample Or to launch the app from command line: adb shell am start -n com.realitylabs.stmg/com.realitylabs.stmg.MainActivity
Please note that the model you are trying is not exactly the same as the one presented in the paper. Due to technical constraints and the ongoing evolution of hand tracking, we do not currently offer the exact model from the paper. Relatedly, we are only able to offer the thumb swipe and thumb tap model outputs at this time, but not pinch.
