raechao93/OpenGestureXR ? reverse-engineered prompt

Reverse engineered prompt

Build me an open source SDK for hand gesture interaction in XR that works from one simple API. I want it to track hands in real time from a webcam or depth camera, recognize a few common gestures like grab, open hand, pinch, point, thumbs up, and peace, then stream the results to a local server that apps can read either live or by polling.

Please include a small Python backend, a clean gesture detection and classification layer, and a Unity client that can connect to it and turn gestures into object interaction. It should feel like a working prototype I can run locally, with multi hand support, smoothing, confidence thresholds, and a basic way to collect gesture data and train a better model later.

If you need to, look up current docs online for any libraries or setup details. Keep it simple to start, but structure it so it could grow into support for different XR devices later through OpenXR.

Are you gonna build this?

make sure you review the code using coderabbit

Try freeSponsored — opens CodeRabbit in a new tab