This repo is used to map Controller value to Mesh Vertex by using Artificial Neural Network.

• Maya [2018.6] [Cut ID:201903222215-65bada0e52]
• Python 3.6
• Numpy in Maya (you can download the python env and copy the numpy under Lib/sit-packages/ to your folder)

Character rig file Ray is used to demonstrate my code, you can use the modified one from google cloud, the modification lies in that I split the head and body. Thanks for CGTarian for developing and releasing the character rig.

1. Training data generation

• it's recommended that you arrange your data folder like this

data
│
└───csv
│
└───ctrl
│
└───mesh
│   
└───pca

• you should prepare a controller config file as below if you want to train your own character, I have a default one in config/ctrlName.txt for character Ray.

Each line is as follows:
ControlName ControlType Index MinVAlue MaxValue (DefaultValue if there is)
Control type is either r-rotation, t-translation, or s-scale
Index is either x, y, or z
ray_ac_lf_upperlid t y -1 1 0.781
      .
      .
      .
ray_ac_cn_wrinkles c nose_bridge_intensity 0 2 0.5

• then you can run below script in Maya Script Editor

import sys
sys.path.append("/full/path/to/top/level/of/this/repository")
import os
os.chdir("/full/path/to/top/level/of/this/repository")
import script.generate_frame as gf
gf.main(controller_file_path="/full/path/to/your/controller/file", frame_num=num_of_frames_to_generate)

2. Training csv generation

python script/generate_csv.py "/full/path/to/your/data/folder" "/full/path/to/your/csv/folder"

3. PCA

python bin/pca.py "/full/path/to/your/training/csv/file" num_of_pca_components

4. Training

python bin/train.py config/example.yaml "/full/path/to/your/training/save/folder" --num_workers=4 --device_ids=0

5. Testing

python bin/test.py "/full/path/to/your/training/save/ckpt" "/full/path/to/your/training/config/file" "/full/path/to/your/test/csv/file"

6. Weight map

• fast-n-deep-faces

@article{Bailey:2020:FDF,
  note = {Presented at SIGGRAPH 2020, Washington D.C.},
  doi = {10.1145/3386569.3392397},
  title = {Fast and Deep Facial Deformations},
  journal = {ACM Transactions on Graphics},
  author = {Stephen W. Bailey and Dalton Omens and Paul Dilorenzo and James F. O'Brien},
  number = 4,
  month = aug,
  volume = 39,
  year = 2020,
  pages = {94:1--15},
  url = {http://graphics.berkeley.edu/papers/Bailey-FDF-2020-07/},
}

• FaceBaker

@inproceedings{inproceedings,
author = {Radzihovsky, Sarah and Goes, Fernando and Meyer, Mark},
year = {2020},
month = {08},
pages = {1-2},
title = {FaceBaker: Baking Character Facial Rigs with Machine Learning},
doi = {10.1145/3388767.3407340}
}