Ceb 4D Humans
NON-COMMERCIAL use only
For academic use, go to https://smpl.is.tue.mpg.de/ for detailed instruction
For commercial use, visit Meshcapade's licensing page (https://meshcapade.com/assets/body-models) to explore commercial licensing options.
WINDOWS ONLY
IMPORTANT
To work, you need to install git on your machine.
You can get it from this link https://git-scm.com/downloads and install it
If you want to install WHAM using offline files, get the WHAM_checkpoints.zip at: https://carlosedubarreto.gumroad.com/l/dependency/2jhtxqo
Free Animation Library
CEB 4D Humans Free Animation Files
Collaborate with the Animation Library
If you created animation and could share, please send me. You can contact me at:
- twitter: https://twitter.com/carlosedubarret
- patreon: https://www.patreon.com/posts/88956782
- discord server: https://discord.gg/BRuu43Nv2J
-
discord user: carlosedubarreto
Important information:
To fully work, you need a CUDA card. Users reported that they were able to run on a GPU with 6gb of VRAM.
If it doesnt work for you can try to use Google Colab to help. More information below
If you want dont want to use Google Colab, please test on your PC using the FREE version.
To use the addon you need to register on https://smpl.is.tue.mpg.de/ and agree with its license
CEB 4D humans heavy work done on top of the 4D humans code (available for free at https://github.com/shubham-goel/4D-Humans)
What CEB 4D human is?
The CEB 4d humans addon is a tool that can make you animation work much faster by using a single video as input and export a very good animation that can be used in many ways:
- create an animation reference for you to create your own animation, understanding better how the body moves
- you can use it with he smoothing tools to fix th jitter that usually comes with markesless mocap solution
- you can select key poses (and erase everything else) to use as the first pass on your animation project
What you can do with CEB 4D Humans:
- you can easily create animations using almost any video with one or more people
- use the provided tools to remove jitter
- use the foot height to lock the foot on the Z axis (in case you have some unexpected results where the body goes away from the floor when it shouldn't)
What you can't do:
- you can't have finger tracking
-
you can't have face tracking
Computer Specs needed:
Total 15gb of free space on the hard drive which is:
10gb free on windows user folder (usually drive C)
5gb free for venv data (any drive you select)
A CUDA compatible card with 6gb (users reported that it works) to run the full process on your pc.
If you dont have CUDA card or less then 6gb of memory you can run animation generation on google colab and import it on the addon to finalize and import the data.
Tutorial on how to install the addon
https://youtu.be/N2uLELEi-zg?si=00V8BFdu9rrwbTlj
Import Animations from Animation Library page
Export animations and how to send us to improve the animation library
How to use the animation on your own character
To transfer the animation to your character you can do something called retarget
By retargetting you can make your own character to come to life.
Here is an tutorial explanin how to do retargting from 4d human to a mixamo armature made by https://twitter.com/poomnattawat1
https://youtu.be/NQqP82wHnoc?si=WU4N9wrpY2396ce2
Tutorial using google Colab + CEB 4D Humans
link to official 4d humans google colab was not working in October 2023, try this colab instead: https://colab.research.google.com/drive/1xcdCNrFGXCCjUkqPHlgPix3wOhyxE75o?usp=sharing
https://youtu.be/3kksPkqL414?si=rRd_6tsz9cxe05ma
Tools:
Smooth
This tools uses SmoothNet (https://github.com/cure-lab/SmoothNet) to clean the data created with CEB 4D Humans.
this smooth will only work with animation created with CEB 4d Humans or the google colab one.
Smooth 2 "j4ck (Giacomo Spaconi) Method"
this smooth tool can make the animation much better than the raw data, and this tool can be used on other animtions, not only in CEB 4d Humans ones.
https://youtu.be/kPcQLMVUNaA?si=C0QjsR8QsNVhwzzE
Foot height lock
This tool can help to make the animation not to fly around. Select the place where it should start to be locked to the floor, and when it should stop. this selection is necessary because you can have some action where the character jumps
https://youtu.be/dexAcyGb7CY?si=2iVeh31oqpE_M43U
Pack of free animations
This product also comes with a pack with several raw animations created with CEB 4d humans, that can be loaded loaded in blender using the addon.
Expect more animations to come in the future.
The pack is called "PKL_Animations_1.zip" and it comes with 11 animations.
How to use the animation pack?
log of changes:
2024-04-22 Free 0.30: The free version was updated to work with Blender 4.1 and also got some tools from the Full version, such as SmoothNet and the great Giacomo Spaconi "j4ck" Smooth
2024-04-21 1.11 Beta
- Fix to make IK Control to work with WHAM, enable IK control in all 3 animation types (4d humans, wham and slahmr)
- added the source selector to choose which character to transform to IK Control
- added the load video on screen option to 4D Humans and WHAM
- adding quick save and quick load for markers
- better error handling on 4d humans, update to work with blender 4.1 for 4d humans, wham and slahmr
- Now slahmr should be simpler to install (First install and use 4d humans once them install SLAHMR and it should work)
2024-04-13: 1.10 Beta Enabled to retarget the result after using the IK Control tools. Fixed the import PKL in 4d Humans
2024-04-06: 1.09 Beta - IK - FK control, Better Foor Lock and floor detection
2024-03-23: 1.08 Beta - Offline install of WHAM checkpoints using file "wham_offline_checkpoints.zip", actorcore rig preset
2024-03-11: 1.07 Beta - Fixing SLAHMR instalation problems, fixed the load video in SLAHMR, in case the image plane addon was not loaded
2024-02-24: 1.06 Beta - WHAM Update 2024-02-19 and started packing with the SMPL FBX
2024-02-19: 1.05 Beta - Finished adding SLAHMR and tools to load part of a video (for SLAHMR)
2024-02-12: 1.04 Beta - Adding SLAHMR (incomplete) to the addon, fix 4d humans creation and import
2024-02-10: 1.03 Beta - Fixes to the bugs introduced on version 1.02 and I've added the fix z location if you use the local option (its not available for world option)
2024-02-07: 1.02 Beta - Option to load pose/pose_world and trans/trans_world. Export and import of pkl files (now you can import the results from google colab) IMPORTANT: Had to remove this version due to some issues that showed up on this version
2024-02-06: 1.01 Beta: Added possibility of multiple characters, and the correction to get all the animation. If there is a glitch on the detection, it will come as another character.
2024-02-05: 1.00 BETA: Introducing the addition WHAN project (https://github.com/yohanshin/WHAM) that is more stable and faster than 4d humans
2023-11-20: 0.55:Added Presets for retargeting UE4,UE5 and metahuman characters. Also added presets for some BlenderStudio Rigs (Ellie v1 and Rain v2.4)
2023-11-19: 0.54: Adjust rest position, this tool enables you to use the CEB 4d humans retarget system even if the target character is not in T pose. Added preset for retarget to "Character Creator +" character
2023-11-17: 0.53: New tool "Extract Marked Frames", that enables you to clean the animation more easily and faster
2023-10-13: 0.52: Fix where you can use videos with more than 1.300 frames
2023-09-19: 0.51: the mixamo rig now gets the prefix automatically (you dont have to write the prefix anymore)
2023-09-18: 0.50: added retargeting options (with mixamo and autorigpro presets) and fixed some bugs
2023-09-16: 0.41: fixed some bugs, rebuild the way to interact with the action list on the panel, make the core option more modular and added an option to make the next action to be in the same direction and place as the previous action (watch the video for better understanding)
2023-09-15: 0.40: Added tools to create a full animation using multiple parts of animations (using the power of NLA), updated the foot height lock, to consider also the wrists placement to have a better result
2023-09-10: 0.30 - Fixed Armature orientation (not its not upside down anymore)
2023-09-09: 0.22 - Added Link to Animation Library page (Free/Paid)
2023-09-05: 0.21 - added option to use less vram (about 8.5gb on my tests) (Free/Paid)
Choose a product version:
Sales | 70+ |
Customer Ratings | 2 |
Average Rating | |
Published | 8 months ago |
Blender Version | 4.1, 4.0, 3.6 |
License | Mit |
Have questions before purchasing?
Contact the Creator with your questions right now.
Login to Message