Motion Capture Tools (my 2022 list)
October 6, 2022By Alan Kent · AI agent architect; building Ordinary AnimatorHere is a list of motion capture (and related) tools I have come across on twitter or similar. Feel free to leave a comment for tools I have missed!
Webcam MoCap (upper body)
- VSeeFace - webcam tracking for upper body (for VTubers). With LeapMotion (now UltraLeap) camera, can also do finger tracking. I like this one because it uses the VMC (Virtual Motion Capture) protocol, allowing merging of a range of tools. It is my go-to app for upper body tracking.
- Kalidoface (3D) - web browser motion capture that can control a VRM file. I like this for demos as it requires zero software to be installed!
- Sony Semiconductor Solutions have released some AR support
https://twitter.com/kazuhiro800/status/1536922434057940993?s=21&t=XUEqkT5wU6JiFerly0QLOg
Webcam Mocap (Facial)
- Waidayo - iPhone app that supports the VMC protocol.
- iFacialMocap - an iPhone app that does facial MoCap tracking (expressions)
- Unity Live Capture - includes a facial expression capture solution
Webcam Mocap (full body)
- MocapForAll and MocapForStreamers by KenjiASABA (article)
https://twitter.com/kenjiasaba/status/1531550342328250369?s=21&t=AmqEVJtmabed93Gtbyt2xQ
https://twitter.com/KenjiASABA/status/1541740622369165313?s=20&t=6VJ9A27TleKzKrQPtMrvaw
- The FreeMoCap Project - markerless mocap using multiple cameras
- ThreeDPoseTracker - sounded good, but last time I visited it said no longer maintained. However there are still lots of tweets with the #TDPT tag.
https://twitter.com/naopluss/status/1536706390060072962?s=21&t=RXkULrx3xLMWHCFCoHfI1Q
- Webcam Motion Capture for Vtubers (YouTube) including hand tracking (although I found it dropped my fingers a lot)
- MotionMuse - "easy to use character animation software dedicated to ease the animation process"
Motion capture from video files
- DeepMotion.com (twitter)
- Move.ai - example tracking 9 people in a video
- Plask.ai (twitter)
- Pixcap
Some sources of videos of motions
https://twitter.com/jagar001/status/1546469995911163904?s=21&t=WzA2cU3gpAzk9r6L8PWTrA
- Funny running styles
https://twitter.com/kyle_kenworthy/status/1522968331921203200?s=21&t=hkTJNzn-aIR6jZ-yV4abSw
VR Headsets and Equipment
- PlayAniMaker by MuRo (may not be popular, but its been the most reliable way for me to create upper body animations, including hand positions - no jitters that frequently occurs with webcams)
- I have recently using some Unity asset store tools OpenXR based solution from R1Tools and Final IK which can create animation clips.
- HTC Vive has trackers that you can attach to other things (like cameras, your knees, etc) to track the position of other real world objects.
- AI for predicting body movements based on VR headset positioning (very cool!)
https://twitter.com/awinkler_/status/1572968904401776641?s=21&t=mBUItrxyMYHyveBwh2aHVw
Hardware
- Rokoko has a range of impressive gear and tools, such as full body capture suits, gloves, and face capture software
- OptiTrack has a range of tools for motion and facial capture (markerless mocap).
- Tundra Tackers - multiple trackers per USB dongle, often out of stock
- SlimeVR - small devices, cheaper than Rokoko etc suits
- Mocopi - not launched yet (launching Jan 2023?), but looks similar to SlimeVR trackers
Cool Individuals
Character Model Creation
- VRoid Studio
- Ready Player Me
- Blender
Other related
- OVR-SmoothTracking - a tool on booth that smooths out motion capture movements
https://twitter.com/henomohesan/status/1550123100876177408?s=21&t=-AwZtmdAzCsS_9WloPkphQ
- Ready Player Me characters in React apps by Zach Doster (blog)