The Subtle Effects of Blood Circulation Can Be Used To Detect Deepfakes
An anonymous reader quotes a report from IEEE Spectrum: This work, done by two researchers at Binghamton University (Umur Aybars Ciftci and Lijun Yin) and one at Intel (Ilke Demir), was published in IEEE Transactions on Pattern Analysis and Machine Learning this past July. In an article titled, "FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals," the authors describe software they created that takes advantage of the fact that real videos of people contain physiological signals that are not visible to the eye. In particular, video of a person's face contains subtle shifts in color that result from pulses in blood circulation. You might imagine that these changes would be too minute to detect merely from a video, but viewing videos that have been enhanced to exaggerate these color shifts will quickly disabuse you of that notion. This phenomenon forms the basis of a technique called photoplethysmography, or PPG for short, which can be used, for example, to monitor newborns without having to attach anything to a their very sensitive skin. Deep fakes don't lack such circulation-induced shifts in color, but they don't recreate them with high fidelity. The researchers at SUNY and Intel found that "biological signals are not coherently preserved in different synthetic facial parts" and that "synthetic content does not contain frames with stable PPG." Translation: Deep fakes can't convincingly mimic how your pulse shows up in your face. The inconsistencies in PPG signals found in deep fakes provided these researchers with the basis for a deep-learning system of their own, dubbed FakeCatcher, which can categorize videos of a person's face as either real or fake with greater than 90 percent accuracy. And these same three researchers followed this study with another demonstrating that this approach can be applied not only to revealing that a video is fake, but also to show what software was used to create it. In a newer paper (PDF), researchers showed that they "can distinguish with greater than 90 percent accuracy whether the video was real, or which of four different deep-fake generators was used to create a bogus video," the report adds.
from Slashdot https://ift.tt/3d56p8t
Read more of this story at Slashdot.
from Slashdot https://ift.tt/3d56p8t
0 Response to "The Subtle Effects of Blood Circulation Can Be Used To Detect Deepfakes"
Post a Comment