Jump to content
Sign in to follow this  
Oakley

Blending between Mocap and an IK Rig

Recommended Posts

Goal: To set up a rig/rigs that would enable a character blend both Mocap/Mixamo animation and IK animation in C4D. Also if possible joint by joint eg. turn on IK just for the arm and hands.

 

Problem: Numerous. I think I am on the right track I have a few other theories to try out(PSR Tags). Currently I am using 3 rigs all with the same bone structure and hierarchy. The Mocap rig with Motion Clips(Driver), The IK rig with keyframes(Driver) and the Target Rig(Driven) and using a Pose Morph tag and some expresso to blend between the 2 (See user data control on Driver Null). This method looks like it would work for an either/or situation between the 2 driver rigs but does not seem to allow control on a per joint basis. The biggest problem I am having at the moment is the blend between the 2 is incorrect (gimbal issue?). I cant seem to freeze the coords of the joints to 0 on the Mocap rig as this ruins the Mocap data positioning from Mixamo(Perhaps the work around would be to bake the motion clips down although that would not be ideal).

 

Advanced: In terms of using our own BVH Mocap data, I think I have figured out a way possibly using Ikinema Webanimate to clean and transfer the Mocap data to the Mixamo rig we have been using as a base and then bring it into cinema. If anyone has any insights on a better workflow i am all ears, project is in R19. Cheers!

 

I had to remove the mesh but the rigs are in the file.

Orange=Mocap

Yellow=IK

White=Output

3_rig_test_nomesh_01.c4d

3_rig_test_nomesh.mp4

Share this post


Link to post
Share on other sites

Hi

 

I hope you get a answer to these technical rigging questions, but iv not found any definitive answers to the very problems you are asking, if fact you have gone further than I had because I had a much better solution, MODO/ACS Kit.  With C4D its either a full manual rig with controllers, or a simple Mocap for simple rig for Mocap, but Im sure what you after is possible with some technical assistance, sorry I cant be of any help on that end.

 

Dan

Share this post


Link to post
Share on other sites
  • Topic Author
  • Thanks for your help. How do you find the workflow with MODO/ACS? Ive seen that it supports re-targeting for Mocap and IK/FK rigs, sort of exactly what I am after but I am wary of MODO as its regarded as a specialist modeling tool with a few generalist features from what I can see. i suppose in the same regard C4D is an awesome Motion Graphics tool with generalist features. I worry about how good its general/character animation tools are to complement the ACS. 

     

    Sometimes I think we should bite the bullet and just get Maya for our character animation work but I am not sure if I can convince up top to buy the licences since we are pretty heavily invested in C4D. Modo might be more palatable, blender even more so. My work for a solution continues!

    Share this post


    Link to post
    Share on other sites

    Hi

     

    MODO strengths are Modeling, and UV Mapping and are some way ahead in this area to C4D, but less intuitive that C4D.  

     

    The ACS kit2 for MODO allows you to use a Biped rig only, but  like C4D character tool has full IK/FK blending but with a much better solution for Mocap data.  The ACS kit has a dedicated simple step method to bring in a Mocap file and apply it to the ACS rig without loosing its controllers untill you bake down the animation.  This opens up the very thing that your trying to do, have both a Mocap and ik/fk Blending with the ability to correct keys of the mocap that maybe dont deform so well.  While C4D does not have better method for mocap it does have NLA which MODO dont have.  All you have to do is store each mocap to a action in MODO, and then bring the next mocap in, then keep doing this untill you have a load of actions.  Then you can bake all actions down in one go.  You then have PLA that you can bring into C4D for Motion clips to construct your animation.  It may be the case that you have your character set up with two rigs one with full IK/FK control, and another for Mocap.  Im sure you should be able to switch between two skin tags.  While it wont allow you to combine or blend the two during a single animation you can make motion clips for two rigs and blend them, it depends on what you want to do.

     

    The main advantage I see with putting MODO into the pipeline is to be able to fine tune a mocap and key over areas that didnt look so good like hands, or arms going through the legs.  Also the ACS kit has a nice solution for storing poses, and mirroring them.  The manual is excellent, its a full video manual.

     

    At 1:20 of this video your see the retargetting and the ability of animating over mocap data.  In the video manual it goes into detail on how to do this so you may want to watch the workflow  Here.  Looks like they have updated it since I last looked with Mixamo support.

     

    https://www.autocharactersetup.com/#product-overview

     

     

    Dan

    Share this post


    Link to post
    Share on other sites
  • Topic Author
  • Again thanks for your help. I have given up on the 3 rig setup for the moment, I will post updates if I revisit it and solve it. 

     

    For now for our IK based animations we might look into Rodenburgs People in Motion R2, this will let us use an IK rig quickly on the mixamo rig which we can bake down to motion clips and combine with mocap motion clips. It looks like it might support mocap in the future also.


    For cleaning and retargeting custom Mocap the software IKinema webanimate seems to be the best bet.

     

    This isn't the exact solution I was looking for, its either/or but it will work well enough for our upcoming project

    Share this post


    Link to post
    Share on other sites

    Hey Jamie,
    Sorry to raise an old thread, curious if you ever worked this out? I've been struggling myself with this for the past week. 
    There's an example at about 58:00 in this video but no detail on how it's accomplished. Seems complicated if it involves scripts and things.
    https://www.youtube.com/watch?v=4fSRxlTD22M

    Share this post


    Link to post
    Share on other sites

    So, I made some of the stuff for what Brandon showed in that video.

     

    I was planning on making and releasing a new updated mixamo template in the character object that would give you IK or Mocap etc. Sadly, it's a complicate thing. I have fully FK rig controls you can use, but IK is harder to keep things matching. I have something that kind of works, but the elbows and knees are hard to keep in line with the mocap, and that's what's been preventing me from releasing anything. 

     

    You can do it manually each time, but that's a pain in the ass.  Just use local rotation constraints on the parents that drive the controllers and you have mocap driving your ik and such, but setting it up each time is the pain and that's what I have been hoping to alleviate but have not finished yet.

     

    Share this post


    Link to post
    Share on other sites
    3 hours ago, BretBays said:

    So, I made some of the stuff for what Brandon showed in that video.

     

    I was planning on making and releasing a new updated mixamo template in the character object that would give you IK or Mocap etc. Sadly, it's a complicate thing. I have fully FK rig controls you can use, but IK is harder to keep things matching. I have something that kind of works, but the elbows and knees are hard to keep in line with the mocap, and that's what's been preventing me from releasing anything. 

     

    You can do it manually each time, but that's a pain in the ass.  Just use local rotation constraints on the parents that drive the controllers and you have mocap driving your ik and such, but setting it up each time is the pain and that's what I have been hoping to alleviate but have not finished yet.

     

    Sounds like your onto something very interesting Bret.  Keep us up to date on your progress.

     

    Dan

    Share this post


    Link to post
    Share on other sites

    Hi Bret, please make it happen ;) I could use it to no end. Also would pay for it of course.

    Share this post


    Link to post
    Share on other sites

    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.

    Guest
    Reply to this topic...

    ×   Pasted as rich text.   Paste as plain text instead

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.

    Sign in to follow this  

    • Recently Browsing   0 members

      No registered users viewing this page.

    ×
    ×
    • Create New...