A real-time facial performance capture pipeline built for webcam use, for portable and easy Real-Time Face. MediaPipe extracts 478 landmarks from webcam input, feeding a custom-trained actor-specific AI model that predicts 52 ARKit-compatible blend shapes. Then streams them live into Unreal Engine 5 via LiveLink, subsequently driving a MetaHuman rig.
This video depicts the ROM process for Memesis, it uses your webcam and instructs you through 31 facial expressions to train the AI on youspecifically. This is the 1st ROM and so is not exemplary, however proves the pipeline is working and functioning.
1st Memesis stream working: when you add a source, you can add the file location of your training .nzp and set what webcam index you need (laptop webcam would be 0). Once started capture should stream through LiveLink once the subject has been assigned.
Madelineorla 