- Jun 10, 2008 Here is a great tutorial on how to do camera tracking in Blender, using the Voodoo camera tracker. The Voodoo software can estimates camera parameters, like position and rotation and reconstructs a 3d scene from image sequences. At the tutorial, a virtual object is placed in real footage. Go check out the tutorial here.
- Voodoo Camera Trackerは、ハノーファー大学情報技術研究所の開発していた無料の全自動カメラトラッカーであり 、VooCATの基となったソフトウェアである 。 VooCATがリリースされた後も開発が続けられていた。 かつてはBlender界隈でも使われていた が、2011年にはBlender 2.61に独自のカメラト.
Voodoo, the well known free camera tracking software, has recently been updated with some nice fixes.
3dfx boards for Macintosh. Mac video card makers embraced the 3dfx chipset with a vengeance when they were released. Most of the early cards (Voodoo Graphics and Voodoo II) were identical to their PC counterparts with adapters being provided to hook up the Mac monitors. The Voodoo Camera Tracker works very alike to commercial available camera trackers (also called match movers), e.g. 3D-Equalizer by Science-D-Visions, boujou by 2d3, Matchmover by RealViz, PFTrack by The Pixel Farm, SynthEyes by Andersson Technologies, or VooCAT by Scenespector Systems.
From the Voodoo site:
The Voodoo camera tracker estimates camera parameters and reconstructs a 3D scene from image sequences. The estimation algorithm offers a full automatic and robust solution to estimate camera parameters for long video sequences. The results are useful for many applications like film production, 3D reconstruction or video coding... Export the estimated camera parameters to the 3D animation package 3D Studio Max, Softimage, Maya or Blender.
Voodoo Camera Tracker Machinery
Voodoo, for Linux and Windows, has the following fixes listed with this new version:
- fixed bug that causes regular crashes in free-move tracking in version 0.8 and version 0.8.1
- allow later refinement (bundle adjustment) of results in memory
- added new Modelling Tools
This is a list of the most relevant vtubing software. The information is as accurate as I could figure it out, but there might be errors or some details might change. If you find anything that needs to be corrected, please let me know.
Additional explanations:
- iPhone means that an iPhone is basically required
- iFacialMocap support means that tracking data can be received from the iFacialMocap iPhone app
- VMC protocol means that the application can send and/or receive tracking data from other VMC protocol capable applications, allowing the combination of multiple tracking methods (e.g. VSeeFace receiving VR tracking from Virtual Motion Capture and iPhone/ARKit face tracking from Waidayo)
- Tobii means that the Tobii eye tracker is supported
- VR means that VR tracking is used and no camera based tracking is supported
- Desktop means that mouse and keyboard input is captured and can be used to animate the avatar instead of or in addition to face tracking
- Leap Motion means that hand and finger tracking through Leap Motion is supported
The order of this list is arbitrary and quite possibly biased, since I develop VSeeFace. Please also note that this list only includes information about tracking, not about other features like transparent background support, model formats and so on.
You can find another overview by Runa Yukiko here.
3D models
- VSeeFace (VMC protocol, Leap Motion)
- Tracking World (VR, VMC protocol)
- Virtual Motion Capture (VR, Tobii, VMC protocol)
- VMagicMirror (VMC protocol, iFacialMocap support, Desktop)
- Luppet (iFacialMocap support, Leap Motion)
- VUP (Leap Motion)
- SUVA (VR, Tobii)
- 3tene (Leap Motion)
- VDRAW (Desktop)
- Waidayo (iPhone, VMC protocol)
Live2D
Details for 3D model programs
Voodoo Camera Tracker Mac Download
Application | Price | Face tracking | VR | Leap Motion | Tobii eye tracker | VMC Protocol | iFacialMocap | Desktop tracking | iPhone required | Platform | Gaze tracking | Eyebrow tracking | Models | Account required |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
VSeeFace | free | OpenSeeFace, 66pt | no | yes | no | send, receive (from two sources) | planned | no | no | Windows | yes | yes | VRM, VSFAvatar (Unity asset bundle) | no |
Tracking World | free | - | yes | no | no | send, receive | no | no | no | Windows | no | no | VRM | no |
Virtual Motion Capture | free/¥300 | - | yes | no | yes | send (paid only), receive | no | no | no | Windows | yes (Tobii) | no | VRM | no |
VMagicMirror | free | DlibFaceLandmarkDetector, 17pt | no | no | no | no | yes | yes | no | Windows | no | no | VRM | no |
Luppet | trial/¥6,000+ | ULSee Lite, 30pt | no | yes | no | no | yes | no | no | Windows | no, moves with head | no | VRM | full version requires login |
VUP | free | Faceunity | no | yes | no | no | no | no | no | Windows | yes | maps to expressions | VRM | yes |
SUVA | $4.99 | - | yes | no | yes | no | no | no | no | Windows | yes (Tobii) | no | Unity asset bundle | no |
Hitogata | free | Dlib, custom? | no | no | no | no | no | no | no | Windows | no? | yes | Character maker, FBX, VRM | no |
Wakaru | free | Dlib, 68pt | no | no | no | no | no | no | no | Windows | yes | yes | VRM | no |
3tene | free/¥2,000 | Dlib, 68pt | 3tenePRO only | yes | no | no | no | no | no | Windows, Mac | no | no | VRM | no |
VDRAW | ¥1,000 | Banuba Face AR | no | no | no | no | no | no | no | Windows | ? | ? | VRM | ? |
Waidayo | free | ARKit | no | no | no | send | no | no | yes | iPhone | yes | yes | VRM | no |
VKatsu | free | Dlib, 68pt | yes | no | no | no | no | no | no | Windows | no | yes | Character maker (restricted use), paid export to Virtual Cast only | no |
VTuber Maker/Live3D | free/free trial | BaiduFace | no | no | no | no | no | no | no | Windows | ? | ? | Character maker ($19.99) | yes |
Animaze | free/various fees | Hyprface | no | yes | no | no | no | no | no | Windows | yes | yes | VRM (needs conversion for Animaze) | no |
Details for 2D model programs
Application | Price | Face tracking | iPhone required |
---|---|---|---|
VTube Studio (Steam) | free with watermark/12.49€ | OpenSeeFace 66pt, ARKit/ARCore | no |
PrprLive | free/$9.99 DLC | IntraFace/GameAnimoji | no |
FaceRig | $14.99+ plus $3.99 (Live2D DLC) | ULSee, 66pt | no |
Animaze | free/various fees | Hyprface | no |
Notes
Voodoo Camera Tracker Machine
3tene is pronounced 'mitene' from Japanese みてね, not 'threeteen'.