Psychology

Most People Are Really Bad At Matching Pictures Of Faces

It's routine whether you're going through airport security or hitting up your favorite bar: you have to show your ID. But how effective is that, really? Who's to say you're not carrying the ID of someone who just looks like you? It turns out that that's a very good question. Over and over, studies show that most people are lousy at matching pictures of unfamiliar faces, regardless of training. Yet we keep checking IDs just the same.

Passport control at the airport.

I'm Gonna Have To See Some Fake ID

Here's just one of many examples. In 2014, a research team out of Australia published a study looking into how passport officers compared to regular people when it came to matching pictures of unfamiliar faces. They had 30 passport officers perform three experiments. In the first, real people showed the officer an ID, some of which had the person's real image, some of which had an image of a person who looked a bit like them. Even though the circumstances were actually easier than the real world (the ID photos were taken just days before the experiment, and the fake IDs just had a roughly identical photo that probably wouldn't be good enough for someone who really wanted to fool an officer), the officers were lousy. They accepted 14 percent of the fakes and rejected six percent of the real IDs, for an overall error rate of 10 percent. That may sound small, but it adds up. When 100,000 people pass through an airport's security line on a given day, that's 10,000 ID-matching mistakes.

You might think that in the second experiment, where they just had to tell if two photos taken two years apart were of the same person, officers would do better. They didn't: their error rate was nearly 20 percent. They also weren't any better than the general public: their scores on a basic face-matching test were the same as population norms, and years on the job had no effect on performance in either of the experiments.

A more recent study in an August 2017 issue of the Journal of Experimental Psychology found that novices did perform slightly worse than trained police officers on a photo-matching test — but everyone still botched the job. Police officers in that study accepted 25 percent of fake IDs, compared to 26 percent by novices. That's nothing to brag about.

Want to see how you'd perform in a face-matching challenge? Take this test to find out if you're a "super-recognizer." (A score of 10/14 or more suggests you may have special skills. The test starts easy, but gets significantly harder by the end.)

In a 2017 study, volunteers had to decide whether each of these pairs were of the same or different people. They accepted about 24 percent of incorrect matches.

What's The Solution?

This is one of many areas where artificial intelligence can come in handy. You may notice that Facebook and certain photo apps can identify your friends' faces in a snapshot with unsettling accuracy. Facebook, Google, and other researchers have all boasted artificial intelligence systems that perform better than humans at matching faces. What's more, many of those systems can go a step further by identifying who the person is from a photo. Artificial intelligence checking our IDs may smack of a dystopian sci-fi novel, but it's certainly more accurate than what we've got now. We, for one, welcome our new robot bar bouncers.

How Does Facial Recognition Work?

Share the knowledge!

Key Facts In This Video

  1. Facebook can recognize faces with 97.35% accuracy, which is still less than a human's ability to recognize faces. 00:25

  2. There are four main issues you face when developing facial recognition software: aging, pose, illumination, emotions. 02:15

  3. Mastercard is trying to see if taking a selfie could be a viable way to authenticate a credit card purchase. 05:02

Written By Ashley Hamer September 13, 2017