All Software > Early Access > Monado Hand Tracking
Community Hub
Monado Hand Tracking
This SteamVR driver runs real-time optical hand tracking algorithms on your Valve Index front camera streams so that you can pinch, poke, grab and gesture to your heart's content in VR without ever being shackled by controllers on your hands!
All Reviews:
No user reviews
Release Date:
Coming soon
Developer:
Publisher:
Moshi Turner
Tags
Popular user-defined tags for this product:
+

Sign in to add this item to your wishlist, follow it, or mark it as ignored

Features
Profile Features Limited 
Languages:
Interface Full Audio Subtitles
English ✔ ✔ ✔

Early Access Software

Get involved with this software as it develops.

Note: This Early Access software is not complete and may or may not change further. If you are not excited to use this software in its current state, then you should wait to see if it progresses further in development. Learn more

What the developers have to say:

Why Early Access?

“We've been developing our optical hand tracking algorithms alongside the Open Source community since 2021. This driver is a huge technical achievement, but it still has some significant useability issues. We're hoping to involve the community in improving the hand tracking accuracy, streamlining the user experience and making the VR input emulation feel rock solid and intuitive.”

Approximately how long will this software be in Early Access?

“Hopefully 12 months.”

How is the full version planned to differ from the Early Access version?

“We plan to improve the hand tracking accuracy, improve the user experience and provide better input emulation.”

What is the current state of the Early Access version?

“Works well, shouldn't crash, but the hand tracking quality isn't as good as it could be yet and the gesture recognition isn't nice enough to use yet. Hopefully we will have virtual wearable controller input soon.”

Will this software be priced differently during and after Early Access?

“No”

How are you planning on involving the Community in your development process?

“This is Open Source software, so we'll be very keen to involve the community!

We're very keen to take user feedback, bug reports, we *might* enable users to help us crowdsource training data, and we'll of course take code contributions! We're also pretty interested in hearing user stories and making our hand tracking more useful for Social VR and Spatial Computing!

The homepage for this project is here if you want to contribute code: https://github.com/moshimeow/mercury_steamvr_driver

For more unstructured discussion/suggestions our Discord server is here: https://discord.gg/8RkJgRJ”
Read more

Coming soon

This item is not yet available

Interested?
Add to your wishlist and get notified when it becomes available.
Add to your wishlist
 
See all discussions

Report bugs and leave feedback for this software on the discussion boards

About This Software

Monado's "Mercury" hand tracking


The optical hand tracking software that this driver uses was developed by Collabora as part of the Monado open-source project.

We noticed that there was a huge segment of people with Valve Indices on Windows but no hand tracking, so we decided to publish this SteamVR driver so that people with Valve Index can use optical hand tracking without extra hardware!

Features


  • Full-fidelity optical hand tracking on just the Index front cameras. Curl, splay and 6dof hand pose are available.
  • Gesture-toggleable far ray interaction for easy interaction with menus
  • Gesture control for A, B, trigger and some thumbstick axes. VRChat is playable but not quite nice as-is.

Some basic tips

  • Get lots of light in your room, or mount a light on the front of your Index!
  • Very unfortunately, the Index front cameras don't have the widest field of view and don't point far down enough. This means that there's a limited tracking range in front of you where hand tracking will work. Hands too far down, too far to the side, or too close to the cameras won't be trackable, so be mindful of where your hands are!

This is free and open source software!


Code contributions, ideas and suggestions are very welcome! You can find links to our Discord server, GitHub page and issues page on the sidebar.

System Requirements

    Minimum:
    • Requires a 64-bit processor and operating system
    • OS: Windows 10
    • Processor: Intel Core i5-4590/AMD FX 8350
    • Memory: 8 GB RAM
    • Graphics: NVIDIA GeForce GTX 970, AMD Radeon R9 290 equivalent or better
    • Network: Broadband Internet connection
    • Storage: 100 MB available space
    • VR Support: Valve Index
    • Additional Notes: Very early implementation! Expect tracking issues and hard-to-use gesture recognition.
    Recommended:
    • Requires a 64-bit processor and operating system
    • OS: Windows 10
    • Processor: Recent CPU with more than 4 threads
    • Memory: 16 GB RAM
    • Graphics: NVIDIA GeForce GTX 970, AMD Radeon R9 290 equivalent or better
    • Network: Broadband Internet connection
    • Storage: 100 MB available space
    • VR Support: Valve Index
    • Additional Notes: Very early implementation! Expect tracking issues and hard-to-use gesture recognition.
There are no reviews for this product

You can write your own review for this product to share your experience with the community. Use the area above the purchase buttons on this page to write your review.