Skip to main content
TikTok Effect House Platform Logo
Latest
Download
Log in
Face Effects

Face Avatar Drive

Face Avatar Drive allows you to track the position and movements of the facial features. You can track all features of the face or only particular features.

Add a Face Avatar Drive Node

Add the Face Avatar Drive node from the Visual Scripting panel. This node controls the Deformation component to drive the 3D Face Avatar deformation with facial movement. Learn more about the Face Avatar Drive node.

Prepare a 3D Face Avatar Model

The Face Avatar Drive node maps the movement of key points of your face that are recognized by the camera to the key channels of the blend shape of the face avatar model.

Set Up the Blend Shape

The Face Avatar Drive node controls 52 facial features but only supports one blend shape. You must prepare one blend shape with different channels that match the facial feature name in the following table.

Tip
Tip

The Face Avatar Drive feature only recognizes the matched naming targets and will ignore the other channels. You don’t need to create all 52 channels. Just pick the ones you need for your effect.

To create the blend shape, use a digital content creation tool, like Autodesk® Maya®.

LeftCentralRight
eyeBlinkLefteyeBlinkRight
eyeLookDownLefteyeLookDownRight
eyeLookInLefteyeLookInRight
eyeLookOutLefteyeLookOutRight
eyeLookUpLefteyeLookUpRight
eyeSquintLefteyeSquintRight
eyeWideLefteyeWideRight
jawForward
jawLeftjawRight
jawOpen
mouthClose
mouthFunnel
mouthPucker
mouthLeftmouthRight
mouthSmileLeftmouthSmileRight
mouthFrownLeftmouthFrownRight
mouthDimpleLeftmouthDimpleRight
mouthStretchLeftmouthStretchRight
mouthRollLower
mouthRollUpper
mouthShrugLower
mouthShrugUpper
mouthPressLeftmouthPressRight
mouthLowerDownLeftmouthLowerDownRight
mouthUpperUpLeftmouthUpperUpRight
browDownLeftbrowDownRight
BrownInnerUp
browOuterUpLeftbrowOuterUpRight
cheekPuff
cheekSquintLeftcheekSquintRight
noseSneerLeftnoseSneerRight
tongueOut

Download this example FBX as a reference.

avatarDrive_23_freshBlend.zip

Import a 3D Model

Import the model and make sure the Import blendshape checkbox is selected. You can also select all your blend shape channels in the Inspector panel.

Add a 3D Model to the Hierarchy panel

Drag and drop the model from the Assets panel to the Hierarchy panel. You can see that the Deformation component is auto-generated since the model contains blend shapes.

Link a Model to the Face Avatar Drive Node

Pin the Deformation component to the Visual Scripting panel as the input of the FaceAvatarDrive node.

Create a model setup like the one shown in the screenshot below. Then the facial expression will be updated.

Now you can control your avatar!

Demo Effect: Face Avatar Drive With a Head Tracker

Check out this tutorial to learn how to add a Head Tracker as the parent to make your face avatar follow your head.

Demo Effect: Customize Face Avatar Drive With the Face Avatar Result Node

You can also play with the Face Avatar Result node to create more advanced interactions.

In this example, Face Avatar Result is used with eyeBlinkRight in the blend shape channel to control the right eye of the alienAvatar object. In the Deformation component channel of the alienAvatar object, select Set eyeBlinkRight to add the node.