Face2Face, real time facial manipulation technology.

Face2Face: Real-time Face Capture and Reenactment of RGB Videos

We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam.

Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure.

Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit.

Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.

Better than CGI, the source video is the actual person.

Its said that government is always 10 years ahead in technology.

I'm sorry, whats the purpose of this "technology"? I can think of no good but I'm a bit cynical.

On the other hand, framing someone for a crime, false flag attacks, getting a false confession and ruining reputations will never be easier.

In recent times, Anders Breivik comes to mind. There are countless youtube videos claiming that Breivik has been doctored, replaced by someone or some kind of technology, that he's a completely fictitious character.You'll recall that Anders Breivik was the alleged person who carried out the Norway attacks killing 77 people. Just days before the attack, Norway had called for a Palestinian state:

Norwegian FM says 'it is perfectly legitimate' for Palestinian president to turn to the UN with a proposal for statehood.

Take note that the children massacred at the camp were from members of the Labour Party, those that have traditionally supported Palestine.

Here is a statement by Eskil Pedersen. Breivik stated that he was the primary target:

“The peace process goes nowhere, and though the whole world expect Israel to comply, they do not. We in Labour Youth will have a unilateral economic embargo of Israel from the Norwegian side.”

— AUF Eskil Pedersen

originally posted by: gladtobehere

I'm sorry, whats the purpose of this "technology"? I can think of no good but I'm a bit cynical.

Can be used for blackmailing and false claims from the target person.

I was going to do a thread on this yesterday. Love how these guys used George Bush during a CNN report. Very dangerous tech. Not that I believe everything on tv anyway. But now everyone will claim. ... "I know it's true, I saw him or her say it right from their own mouth".

I know it's been done before, such as in movies like Forrest Gump and comercials. But this is Much, Much cleaner.

And to be able to mimic facial expressions as well. Media can say that someone's facial language shows lying or truth... 😯

S$F.... this thread needs more flags.

What the actual hell?

We can't even be sure the person we're watching is actually speaking and not some one using a manipulation program. Not many things in the tech world bother me but I find this unsettling.

Imagine a new Humphrey Bogart movie or another Crow movie starring Brandon Lee. Aside from the obvious criminal and conspiratorial applications, I can imagine Hollywood having a heyday with this.

a reply to: gladtobehere

This is an incredibly disturbing piece of tech.

You don't even need to see how disgusted I am right now..someone can just cut and paste my reaction anyway.

a reply to: N3k9Ni

I share your sentiment... and I feel bad for the Muppets... this will be their end, because we can make whomever we want into a muppet now.

Mercy.

Well, that's pretty nifty.

Scary, but nifty.

When does it get released as an app on my phone?

a reply to: N3k9Ni

Perfect tool if you wish whitewash history in the digital era

Imagine all the historical videos that can now be digitally altered in order to warp the truth in our history

It does make me wonder, if this tech being shown to the public, how long has it been there behind closed doors ?

originally posted by: Discotech
a reply to: N3k9Ni

Perfect tool if you wish whitewash history in the digital era

Imagine all the historical videos that can now be digitally altered in order to warp the truth in our history

It does make me wonder, if this tech being shown to the public, how long has it been there behind closed doors ?

They were doing that in the past. It was called "colorization". Cable networks had a spare capacity of broadcast hours and they needed something to fill in the space. The quick solution was to buy broadcast rights to old black and white movies. But the viewers wouldn't watch black/white movies on their widescreen and supersize color CRT TV's. So that left the broadcasters in a dilemma; how to take advantage of old movies while still giving viewers color programming? So they went to the digital processing departments and started colorizing in old movies. Frame by frame, faces were turned pink, suits became blue, brown or black, dresses became pastel colors and so on. Sometime it looked really bad. Film directors like Woody Allen were horrified, because the broadcast network was editing the content and modifying the artists artwork.

a reply to: stormcell

Not exactly the same colouring in black & white images to literally changing the facial movements of somebody though is it ?

Get a decent voice impersonator and you can effectively create your own history

a reply to: Discotech

What bothered me the most about the video was examples they used of Bush and Putin. When I saw that, my mind was staggered by the implications.

It is amazing how far this has come. On the other hand agree with the concerns with it being in the wrong hands and all. The topic really does deserve more attention considering it can, very well may be, be used in media manipulation, one needs to be aware of all the facets of deception.

I'm just sayin'...this is stuff only comic book villains come up with

The FBI had a company named Lanier Office Products make them a voice sampler/reproducer device that could get a sample of anyone's voice over the phone, (land line), and then it could transpose that copied voice from another person speaking in real time, and the voice heard would be the voice that was duplicated by the device. And this was way back in the early 80's.
It is scary in the extreme what kind of secrets are out there today.

This device is still non public, but the FBI still has it and uses it to trick criminals, or whoever they have on their Sh#t list.
They can likely produce an entire video now of anyone doing anything and it would be believed.

Plot twist: that's how they carried on the Bin Laden videos after he died of natural causes! BAM!

Yes? No?

No?

Okay

I just wanted my own conspiracy.

a reply to: gladtobehere

It's the same technology that managed to frame Arnie in the movie Running Man...turned him from a cop asking difficult questions, to the 'Butcher' of the 'Bakersfield massacre'...and when did the movie hit the theatres?

1987.

This tech has been around a LONG time.

Don't pay any attention to the man operating those controls....

oh my God , thats it , now im not going to believe any video

nice

Scary stuff indeed, now we have even less of a reason to believe what comes out of the mouths of politicians and talking heads on the telescreen