-replication-fbt-
Description
-replication-fbt- is a markerless Full Body Tracking solution for VR using only webcams. By using two or more cameras, it can detect pose keypoints on the primary person in the scene, it then triangulates these keypoints against calibrated viewpoints to reconstruct the pose in 3D, which is finally translated and output as VR trackers.
Features (Demo & Full):
Dual camera input & detection
Webcam intrinsic & extrinsic calibration (lens distortion & position detection & correction)
Pose detection & reconstruction via Google MediaPipe
In-app tracking setup & preview
VRChat OSC tracker output
Performance, Output address, and Appearance customisation
Features (Full only):
Multi (3+) camera input & detection
Pose detection & reconstruction via OpenMMLab RTMpose
(Requires properly set up GPU drivers/runtimes)
Native SteamVR tracker output
Extra motion smoothing/prediction tuning
-It is highly recommended to start with the Demo version-
If you are only using this for VRChat, the Demo should include everything you need.
Only purchase the Full version if you have specific need for the extra features included,
and/or you wish to support me and my projects (For which I will be eternally grateful)
(Features locked in Demo version and availability of the Demo may change in future versions based on performance/feedback)
System requirements
WINDOWS:
- Requires a 64-bit processor and operating system
- OS: Windows 10 64-bit (1809 or later)
- Processor: Quad-core x86-64, e.g. Core i5-8400/Ryzen 5 2600
- Memory: 8 GB RAM
- Graphics: Any GPU or integrated graphics with OpenGL 3.0
- Storage: 3 GB available space
- VR Support: Not required. Optional SteamVR output via a driver installed via app (no HMD needed for VRChat OSC)
- Additional Notes: At least two USB/Integrated webcams are required, and must be fixed in a location where they can see your whole body from different angles. Prefer cameras on separate USB controllers to improve frame delivery. A printer is needed once for the calibration target generated by the app. Tracking runs on the CPU and needs no GPU. A display of at least 1360x900 is expected by the interface. An internet connection is only needed for the optional RTMPose model and CUDA runtime downloads, and/or sending tracking data to another device.
- Requires a 64-bit processor and operating system
- OS: Windows 11 64-bit
- Processor: 6-core or better, e.g. Core i5-12400/Ryzen 5 5600
- Memory: 16 GB RAM
- Graphics: Any Direct3D 12 GPU, or NVIDIA Turing or later
- DirectX: Version 12
- Storage: 6 GB available space
- VR Support: SteamVR compatible system
- Additional Notes: At least two USB/Integrated webcams are required, and must be fixed in a location where they can see your whole body from different angles. Prefer cameras on separate USB controllers to improve frame delivery. A printer is needed once for the calibration target generated by the app. Tracking runs better on the GPU. A display of at least 1360x900 is expected by the interface. An internet connection is only needed for the optional RTMPose model and CUDA runtime downloads, and/or sending tracking data to another device.
LINUX:
- OS: Ubuntu 22.04 LTS or newer, x86-64, glibc 2.35+
- Processor: Quad-core x86-64, e.g. Core i5-8400/Ryzen 5 2600
- Memory: 8 GB RAM
- Graphics: Any GPU or integrated graphics with OpenGL 3.0 (Mesa 22+)
- Storage: 4 GB available space
- VR Support: Not required. Optional SteamVR output via a driver installed via app (no HMD needed for VRChat OSC)
- Additional Notes: At least two USB/Integrated webcams are required, and must be fixed in a location where they can see your whole body from different angles. Prefer cameras on separate USB controllers to improve frame delivery. A printer is needed once for the calibration target generated by the app. Tracking runs on the CPU and needs no GPU. A display of at least 1360x900 is expected by the interface. An internet connection is only needed for the optional RTMPose model and CUDA runtime downloads, and/or sending tracking data to another device.
- OS: Ubuntu 24.04 LTS or newer
- Processor: 6-core or better, e.g. Core i5-12400/Ryzen 5 5600
- Memory: 16 GB RAM
- Graphics: AMD with ROCm 6 installed, or NVIDIA Turing or later
- Storage: 7 GB available space
- VR Support: SteamVR compatible system
- Additional Notes: At least two USB/Integrated webcams are required, and must be fixed in a location where they can see your whole body from different angles. Prefer cameras on separate USB controllers to improve frame delivery. A printer is needed once for the calibration target generated by the app. Tracking runs better on the GPU. A display of at least 1360x900 is expected by the interface. An internet connection is only needed for the optional RTMPose model and CUDA runtime downloads, and/or sending tracking data to another device.
