Know Your Meme

Facemorphs

Added 4 years ago / Updated 3 years ago
Cover5

Submission   29,822

Part of a series on Deepfakes. [View Related Entries]

[View Related Sub-entries]

[2] cd first-order-model / content/first-order-model 3) Click this button 5) Click the link Mount your Google drive folder on Colab [3] from google.colab import drive drive.mount ('/content/gdrive') 4) Click this button Go to this URL in a browser: https://accounts.google.com/o/oauth2/auth?client_id=9473189{ Enter your authorization code: .......... Mounted at /content/gdrive Add folder https://drive.google.com/drive/folders/1kZ1gCnpfU0BnpdU47pLM _TQ6RypDDqgw? usp=sharing to your google drive.
II 0:37/0:41
II 0:12/0:41
+ Code + Text Copy to Drive E Files [22] from demo import load_checkpoints <> generator, kp_detector = load_checkpoints(config_path= checkpoint_path='/content/g first-order-model gdrive Perform image animation sample_data generated.mp4 make_animation ort img_as_ubyte Download Delete file ike_animation(source_image, driving_vide Rename file video Сoрy path 13) Right-click "generated.mp4, '../generated. mp4', [img_as_ubyte (frame Refresh wnloaded from /content folder then "download" HTML (display(source_image, driving_video, predictions).
Ofirst-order-model-demo.ipynb File Edit View Insert Runtime Tools Help Cannot save changes + Code + Text A Copy to Drive Table of contents Demo for paper "First Order Motion Model for Image Animation" [22] from demo import load_checkpoints generator, kp_detector = load_checkpo checkpoin <> Running on your data B Section Perform image animation 12) Click this folder icon from demo import make_animation from skimage import img_as_ubyte predictions = make_animation(source_i #save resulting video imageio.mimsave('../generated.mp4', [ #video can be downloaded from /conten HTML (display(source_image, driving_vi 100%|| 836/836 [00:34<00:00
Create a model and load checkpoints [5] from demo import load_checkpoints generator, kp_detector = load_checkpoints (config_path='config/vox-256.yaml', 10) Press this button checkpoint_path='/content/gdrive/My Drive/first-order-motion-model/vox-cpk. Perform image animation [6] from demo import make_animation from skimage import img_as_ubyte 11) Then this one predictions = make_animation(source_image, driving_video, generator, kp_detector, relative=True) #save resulting video imageio.mimsave('../generated.mp4', [img_as_ubyte(frame) for frame in predictions]) #video can be downloaded from /content folder HTML (display(source_image, driving_video, predictions).to_htm15_video()) 100%| || 211/211 [00:07<00:00, 29.03it/s]
View All 12 Images

Navigation
About • Origin • Spread • Various Examples • External References • Recent Images • Recent Videos

About

Facemorphs, also known as First Order Motion Model Deepfakes, refer to videos using a motion capture method that makes static images of people's faces move according to the training model's motion. The method is similar to deepfakes, but uses only one still image instead of a set of images. Facemorphs gained popularity in July 2020 as they were applied to a variety of subjects, particularly to video game developer YandereDev. The method was used frequently with the Yakuza 0 song Baka Mitai.

In March 2021, facemorphs saw a surge in popularity following the release of WOMBO mobile app.

Origin

On February 29th, 2020, researchers from the University of Trento in Italy published a paper titled "First Order Motion Model for Image Animation." (FOMMIA, or FOMM) In the paper, the researchers describe a method for making a source image move according to the motion of a training model.[1]

On March 1st, content creator Verbalase uploaded an Instagram[2] video on Instagram using images of people such as Barack Obama and Donald Trump (shown below). It is unknown whether Verbalase used FOMMIA although but it is possible given how close the upload date is to the paper's publication. The YouTube reupload of Verbalase's video posted on March 8th received over 530,000 views in four months.[3]

Facemorphing was popularized by content creator @heyitswindy, who on July 9th, 2020, tweeted[4] one of the earliest examples of a humorous facemorph based on a popular photograph of YandereDev and the sound from Consume the Cum Chalise video.

Spread

On July 10th, 2020, @heyitswindy[5] posted a similar facemorph of YandereDev using audio from a recent TikTok, receiving almost 50,000 likes and 11,700 tweets (shown below). In a reply to the tweet, @heyutwindy mentioned that he used a demo for FOMMIA to create the images.[6]

In a July 13th tweet, @heyitswendy demonstrated the use of the software method with an image of YandereDev (shown below).

Starting in mid-July 2020, Facemorphs gained significant popularity on Twitter, with memes ofter using photographs of internet-popular people and characters.

On July 19th, heyitswindy uploaded a tutorial video for doing facemorphs to his YouTube channel, gaining over 80,000 views in less than two weeks (shown below).[7]

WOMBO

Wombo, stylized as WOMBO and also known as Wombo.ai, is a mobile application that generates lip sync facemorphs based on a provided image and using a selection of available songs, including "Chug Jug With You", "Baka Mitai," and "What Is Love?". Launched in January 2021, the app achieved viral popularity in March 2021.

Various Examples

External References

[1] Aliaksandr Siarohin, Stéphane Lathuilière, Sergey Tulyakov, Elisa Ricci, Nicu Sebe – First Order Motion Model for Image Animation

[2] Instagram – verbalase

[3] YouTube Obama Beatbox by Verbalase

[4] Twitter – @heyitswindy

[5] Twitter – @heyitswindy

[6] Aliaksandr Siarohin – "Demo for paper First Order Motion Model for Image Animation

f7. YouTube – heyitswindy

Share Pin

Related Entries 10 total

Cover3
DeepNude
Screen_shot_2023-01-31_at_12.33.28_pm
Atrioc Deepfake Pornography C...
Cover1
Deep Nostalgia
Buttered_sausage
Buttered Sausage

View All Related Entries

Sub-entries 1 total

Cover4
Wombo AI

Recent Images 12 total

View All Images

Recent Videos 14 total

View All Videos

Load 5 Comments
Kym

Know Your Meme

  Like Page   1.8M likes