Skip to main content
Project

Audio2Face

A Blender 5.2 extension that runs NVIDIA Audio2Face-3D and Audio2Emotion locally on GPU, driving Shape Keys from WAV or live audio.

Year
2026-present
Role
Developer
Team
Personal Project
Status
Active
Audio2Face Preferred Emotion sliders with joy loaded while a WAV drives the face

Preferred Emotion sliders, with Load mixing the authored values into the live face.

Audio2Face Auto Audio2Emotion controls and read-only Mixed Emotion output

Auto Audio2Emotion tuning with read-only Mixed Emotion from the worker.

Audio2Face model tuning sliders driving live Shape Keys on a head mesh

Model Tuning during Selected WAV playback, with live ARKit Shape Key values.

  1. 01

    Install the platform ZIP

    Drop the Windows or Linux extension into a local Blender User Default repository. The ZIP already contains the native worker.

  2. 02

    Select and optimize models

    Point Preferences at the Audio2Face-3D and Audio2Emotion repository roots, then build GPU engines with Optimize Models.

  3. 03

    Target Shape Keys and start the worker

    Add Mesh, Curve, Surface, or Lattice objects, then start the package-local worker so both models load once.

  4. 04

    Play audio and mix emotion

    Selected WAV playback or live PCM starts inference. Preferred and auto emotion mix while Shape Keys update on the audio clock.

  • Blender 5.2
  • Python
  • C++
  • CUDA
  • TensorRT
  • Audio2Face-3D v3.0
  • Audio2Emotion v3.0