Ceb 4D Humans

by CEB Studios in Addons


NON-COMMERCIAL use only


WINDOWS ONLY



IMPORTANT

To work, you need to install git on your machine.

You can get it from this link https://git-scm.com/downloads and install it

If you want to install WHAM using offline files, get the WHAM_checkpoints.zip at: https://carlosedubarreto.gumroad.com/l/dependency/2jhtxqo



Free Animation Library

CEB 4D Humans Free Animation Files


Collaborate with the Animation Library

If you created animation and could share, please send me. You can contact me at:


Important information:

To fully work, you need a CUDA card. Users reported that they were able to run on a GPU with 6gb of VRAM.

If it doesnt work for you can try to use Google Colab to help. More information below

If you want dont want to use Google Colab, please test on your PC using the FREE version.


To use the addon you need to register on https://smpl.is.tue.mpg.de/ and agree with its license


CEB 4D humans heavy work done on top of the 4D humans code (available for free at https://github.com/shubham-goel/4D-Humans)


What CEB 4D human is?

The CEB 4d humans addon  is a tool that can make you animation work much faster by using a single video as input and export a very good animation that can be used in many ways:

  • create an animation reference for you to create your own animation, understanding better how the body moves
  • you can use it with he smoothing tools to fix th jitter that usually comes with markesless mocap solution
  • you can select key poses (and erase everything else) to use as the first pass on your animation project


What you can do with CEB 4D Humans:

  • you can easily create animations using almost any video with one or more people
  • use the provided tools to remove jitter 
  • use the foot height to lock the foot on the Z axis (in case you have some unexpected results where the body goes away from the floor when it shouldn't)


What you can't do:

  • you can't have finger tracking
  • you can't have face tracking


Computer Specs needed:

Total 15gb of free space on the hard drive which is:

10gb free on windows user folder (usually drive C)

5gb free for venv data (any drive you select)


A CUDA compatible card with 6gb (users reported that it works) to run the full process on your pc.

If you dont have CUDA card or less then 6gb of memory you can run animation generation on google colab and import it on the addon to finalize and import the data.


Tutorial on how to install the addon

https://youtu.be/N2uLELEi-zg?si=00V8BFdu9rrwbTlj


Import Animations from Animation Library page

https://youtu.be/JNHl8W-gKu0


Export animations and how to send us to improve the animation library

https://youtu.be/ih9ie2lW0MA


How to use the animation on your own character

To transfer the animation to your character you can do something called retarget

By retargetting you can make your own character to come to life.

Here is an tutorial explanin how to do retargting from 4d human to a mixamo armature made by https://twitter.com/poomnattawat1

https://youtu.be/NQqP82wHnoc?si=WU4N9wrpY2396ce2


Tutorial using google Colab + CEB 4D Humans

link to official 4d humans google colab was not working in October 2023, try this colab instead: https://colab.research.google.com/drive/1xcdCNrFGXCCjUkqPHlgPix3wOhyxE75o?usp=sharing

https://youtu.be/3kksPkqL414?si=rRd_6tsz9cxe05ma



Tools:

Smooth

This tools uses SmoothNet (https://github.com/cure-lab/SmoothNet) to clean the data created with CEB 4D Humans.

this smooth will only work with animation created with CEB 4d Humans or the google colab one.


Smooth 2 "j4ck (Giacomo Spaconi) Method"

this smooth tool can make the animation much better than the raw data, and this tool can be used on other animtions, not only in CEB 4d Humans ones.


https://youtu.be/kPcQLMVUNaA?si=C0QjsR8QsNVhwzzE


Foot height lock

This tool can help to make the animation not to fly around. Select the place where it should start to be locked to the floor, and when it should stop. this selection is necessary because you can have some action where the character jumps


https://youtu.be/dexAcyGb7CY?si=2iVeh31oqpE_M43U


Pack of free animations

This product also comes with a pack with several raw animations created with CEB 4d humans, that can be loaded loaded in blender using the addon.

Expect more animations to come in the future.

The pack is called "PKL_Animations_1.zip" and it comes with 11 animations. 


How to use the animation pack?
Unzip the "PKL_Animations_1.zip" file and you will have a PKL files. 
Load them using the Import option on the "Import/Export Animation" part of the panel
Then, you can load the animation using the "Import Raw option"
You can use the smooth option to make the animation more stable, as you can do if you are using your own footage.


To install using offline data.
download "4d_humans_optional_offline_model_files.zip" from the link https://carlosedubarreto.gumroad.com/l/dependency/2jhtxqo , its inside the folder "CEB 4D Humans"


log of changes:

2024-04-22 Free 0.30: The free version was updated to work with Blender 4.1 and also got some tools from the Full version, such as SmoothNet and the great Giacomo Spaconi "j4ck" Smooth

2024-04-21 1.11 Beta

- Fix to make IK Control to work with WHAM, enable IK control in all 3 animation types (4d humans, wham and slahmr)

- added the source selector to choose which character to transform to IK Control

- added the load video on screen option to 4D Humans and WHAM

- adding quick save and quick load for markers

- better error handling on 4d humans, update to work with blender 4.1 for 4d humans, wham and slahmr

- Now slahmr should be simpler to install (First install and use 4d humans once them install SLAHMR and it should work)

2024-04-13: 1.10 Beta  Enabled to retarget the result after using the IK Control tools. Fixed the import PKL in 4d Humans

2024-04-06: 1.09 Beta - IK - FK control, Better Foor Lock and floor detection

2024-03-23: 1.08 Beta - Offline install of WHAM checkpoints using file "wham_offline_checkpoints.zip", actorcore rig preset

2024-03-11: 1.07 Beta - Fixing SLAHMR instalation problems, fixed the load video in SLAHMR, in case the image plane addon was not loaded

2024-02-24: 1.06 Beta - WHAM Update 2024-02-19 and started packing with the SMPL FBX

2024-02-19: 1.05 Beta - Finished adding SLAHMR and tools to load part of a video (for SLAHMR)

2024-02-12: 1.04 Beta - Adding SLAHMR (incomplete) to the addon, fix 4d humans creation and import

2024-02-10: 1.03 Beta - Fixes to the bugs introduced on version 1.02 and I've added the fix z location if you use the local option (its not available for world option)

2024-02-07: 1.02 Beta - Option to load pose/pose_world and trans/trans_world. Export and import of pkl files (now you can import the results from google colab) IMPORTANT: Had to remove this version due to some issues that showed up on this version

2024-02-06: 1.01 Beta:  Added possibility of multiple characters, and the correction to get all the animation. If there is a glitch on the detection, it will come as another character.

2024-02-05: 1.00 BETA: Introducing the addition WHAN project (https://github.com/yohanshin/WHAM) that is more stable and faster than 4d humans

2023-11-20: 0.55:Added Presets for retargeting UE4,UE5 and metahuman characters. Also added presets for some BlenderStudio Rigs (Ellie v1 and Rain v2.4)

2023-11-19: 0.54: Adjust rest position, this tool enables you to use the CEB 4d humans retarget system even if the target character is not in T pose. Added preset for retarget to "Character Creator +" character

2023-11-17: 0.53: New tool "Extract Marked Frames", that enables you to clean the animation more easily and faster

2023-10-13: 0.52: Fix where you can use videos with more than 1.300 frames

2023-09-19: 0.51: the mixamo rig now gets the prefix automatically (you dont have to write the prefix anymore)

2023-09-18: 0.50: added retargeting options (with mixamo and autorigpro presets) and fixed some bugs

2023-09-16: 0.41: fixed some bugs, rebuild the way to interact with the action list on the panel, make the core option more modular and added an option to make the next action to be in the same direction and place as the previous action (watch the video for better understanding)

2023-09-15: 0.40: Added tools to create a full animation using multiple parts of animations (using the power of NLA), updated the foot height lock, to consider also the wrists placement to have a better result

2023-09-10: 0.30 - Fixed Armature orientation (not its not upside down anymore)

2023-09-09: 0.22 - Added Link to Animation Library page (Free/Paid)

2023-09-05: 0.21 - added option to use less vram (about 8.5gb on my tests) (Free/Paid)

Choose a product version:

Sales 70+
Customer Ratings 2
Average Rating
Published 8 months ago
Blender Version 4.1, 4.0, 3.6
License Mit
Have questions before purchasing?

Contact the Creator with your questions right now.

Login to Message