-replication-fbt-
Описание
-replication-fbt- is a markerless Full Body Tracking solution for VR using only webcams. By using two or more cameras, it can detect pose keypoints on the primary person in the scene, it then triangulates these keypoints against calibrated viewpoints to reconstruct the pose in 3D, which is finally translated and output as VR trackers.
Features (Demo & Full):
Dual camera input & detection
Webcam intrinsic & extrinsic calibration (lens distortion & position detection & correction)
Pose detection & reconstruction via Google MediaPipe
In-app tracking setup & preview
VRChat OSC tracker output
Performance, Output address, and Appearance customisation
Features (Full only):
Multi (3+) camera input & detection
Pose detection & reconstruction via OpenMMLab RTMpose
(Requires properly set up GPU drivers/runtimes)
Native SteamVR tracker output
Extra motion smoothing/prediction tuning
-It is highly recommended to start with the Demo version-
If you are only using this for VRChat, the Demo should include everything you need.
Only purchase the Full version if you have specific need for the extra features included,
and/or you wish to support me and my projects (For which I will be eternally grateful)
(Features locked in Demo version and availability of the Demo may change in future versions based on performance/feedback)
Системные требования
WINDOWS:
- 64-разрядные процессор и операционная система
- ОС: Windows 10 64-bit (1809 or later)
- Процессор: Quad-core x86-64, e.g. Core i5-8400/Ryzen 5 2600
- Оперативная память: 8 GB ОЗУ
- Видеокарта: Any GPU or integrated graphics with OpenGL 3.0
- Место на диске: 3 GB
- Поддержка VR: Not required. Optional SteamVR output via a driver installed via app (no HMD needed for VRChat OSC)
- Дополнительно: At least two USB/Integrated webcams are required, and must be fixed in a location where they can see your whole body from different angles. Prefer cameras on separate USB controllers to improve frame delivery. A printer is needed once for the calibration target generated by the app. Tracking runs on the CPU and needs no GPU. A display of at least 1360x900 is expected by the interface. An internet connection is only needed for the optional RTMPose model and CUDA runtime downloads, and/or sending tracking data to another device.
- 64-разрядные процессор и операционная система
- ОС: Windows 11 64-bit
- Процессор: 6-core or better, e.g. Core i5-12400/Ryzen 5 5600
- Оперативная память: 16 GB ОЗУ
- Видеокарта: Any Direct3D 12 GPU, or NVIDIA Turing or later
- DirectX: версии 12
- Место на диске: 6 GB
- Поддержка VR: SteamVR compatible system
- Дополнительно: At least two USB/Integrated webcams are required, and must be fixed in a location where they can see your whole body from different angles. Prefer cameras on separate USB controllers to improve frame delivery. A printer is needed once for the calibration target generated by the app. Tracking runs better on the GPU. A display of at least 1360x900 is expected by the interface. An internet connection is only needed for the optional RTMPose model and CUDA runtime downloads, and/or sending tracking data to another device.
LINUX:
- ОС: Ubuntu 22.04 LTS or newer, x86-64, glibc 2.35+
- Процессор: Quad-core x86-64, e.g. Core i5-8400/Ryzen 5 2600
- Оперативная память: 8 GB ОЗУ
- Видеокарта: Any GPU or integrated graphics with OpenGL 3.0 (Mesa 22+)
- Место на диске: 4 GB
- Поддержка VR: Not required. Optional SteamVR output via a driver installed via app (no HMD needed for VRChat OSC)
- Дополнительно: At least two USB/Integrated webcams are required, and must be fixed in a location where they can see your whole body from different angles. Prefer cameras on separate USB controllers to improve frame delivery. A printer is needed once for the calibration target generated by the app. Tracking runs on the CPU and needs no GPU. A display of at least 1360x900 is expected by the interface. An internet connection is only needed for the optional RTMPose model and CUDA runtime downloads, and/or sending tracking data to another device.
- ОС: Ubuntu 24.04 LTS or newer
- Процессор: 6-core or better, e.g. Core i5-12400/Ryzen 5 5600
- Оперативная память: 16 GB ОЗУ
- Видеокарта: AMD with ROCm 6 installed, or NVIDIA Turing or later
- Место на диске: 7 GB
- Поддержка VR: SteamVR compatible system
- Дополнительно: At least two USB/Integrated webcams are required, and must be fixed in a location where they can see your whole body from different angles. Prefer cameras on separate USB controllers to improve frame delivery. A printer is needed once for the calibration target generated by the app. Tracking runs better on the GPU. A display of at least 1360x900 is expected by the interface. An internet connection is only needed for the optional RTMPose model and CUDA runtime downloads, and/or sending tracking data to another device.





