Avatarify

Avatars for Skype and Zoom. Democratized.

Disclaimer: This project is unrelated to Samsung AI Center.

Requirements

conda
CUDA

Performance:

Linux (with 1080 Ti GPU): 33 fps
Mac OSX (MacBook Pro 2018; no GPU): ~1 fps

Install

Download

Download model's weights from Google Drive or Yandex.Disk [716 MB]
Place vox-adv-cpk.pth.tar file in the root directory

Linux

Linux uses v4l2loopback to create virtual camera.

Install avatarify dependencies (sudo privelege is required):

bash scripts/install.sh

Mac

For Mac it's quite difficult to create a virtual camera, so we'll use CamTwist app:

Download and install CamTwist from here. It's easy.
Setup avatarify conda environment with all required dependencies:

source scripts/install_mac.sh

Window

Coming soon!

Setup avatars

Copy your avatars into avatars folder. Crop pictures to make them square. Prefer pictures with uniform background.

Run

Your web cam must be plugged-in. You can choose your camera by changing CAMID in scripts/settings.sh script.

Linux

It is supposed that there is only one web cam connected to the computer at /dev/video0. The run script will create virtual camera /dev/video9. You can change these settings in scripts/settings.sh.

You can use command v4l2-ctl --list-devices to list all devices in your system. For example, if the web camera is /dev/video1 then the device id is 1.

Run:

bash run.sh

Mac

Run:

bash run_mac.sh

Go to CamTwist.
Choose Desktop+ and press Select.
In the Settings section choose Confine to Application Window and select python (avatarify) from the drop-down menu.

Tips

Your face should fit in the red rectagle: it should not fit perfectly, but don't get too close/far. After that, press any number from 0 to 9 on your keyboard and one of the avatars from avatars directory will appear.

Run Skype or Zoom only when Avatarify is running.

Skype

Go to Settings -> Audio & Video, choose avatarify or CamTwist camera.

Zoom

Go to Settings -> Video and choose avatarify or CamTwist from Camera drop-down menu.

Slack

Make a call, allow browser using cameras, click on Settings icon, choose avatarify in Video settings drop-down menu.

Contribution

Our goal is to democratize deepfake avatars. To make the technology even more accessible, we have to tackle two major problems:

Add support for more platforms (Linux and Mac are already supported).
Optimize neural network run-time. Running network real-time on CPU is of high priority.

Please make pull requests if you have any improvements or bug-fixes.

Troubleshooting

Zoom/Skype doesn't see avatarify camera. Restart Zoom/Skype and try again.
Avatar image is frozen: In Zoom, try Stop and Start Video.
bash run_mac.sh crashes with "Cannot open camera": Try to change CAMID in run_mac.sh from 0 to 1 or 2
pipe:0: Invalid data found when processing input: Make sure CAMID in scripts/settings.sh is correct. Use v4l2-ctl --list-devices to query available devices.

Credits

Avatrify uses First Order Motion Model for generating avatars.