Facial recognition biometric technology is showing improvement in one-to-many searches, according to the latest tests from the National Institute of Standards and Technology. Results from NIST’s 2013 test of facial recognition algorithms show that accuracy has improved for some up to 30% since 2010.
The report by NIST biometric researchers Patrick Grother and Mei Ngan, Performance of Face identification Algorithms, includes results from algorithms submitted by 16 organizations. Researchers defined performance by recognition accuracy — how many times the software correctly identified the photo — and the time the algorithms took to match one photo against massive photo data sets.
“We studied the one-to-many identification because it is the largest market for face recognition technology,” Grother said. “These algorithms are used around the world to detect duplicates in databases, fraudulent applications for passports and driving licenses, in token-less access control, surveillance, social media tagging, lookalike discovery and criminal investigations.”
Four research groups enrolled in both the 2013 and the previous 2010 test, enabling NIST researchers to compare performance improvements over time. They found that those groups had improved their performance on the tests by from 10% and almost 30%. One organization decreased its error rate from 8.9% in 2010 to 6.4% in 2013.
In both years the study used a database of 1.6 million faces. In 2010, the images were frontal “mugshot” images from law enforcement agencies that closely comply with the ANSI/NIST ITL 1-2011 Type 10 standard. In 2013, researchers added a small database of images taken for visa applications that meet an ISO standard and 140,000 webcam images taken in poorly controlled environments that do not comply with any standard.
The tested algorithms performed the best on the relatively high-quality ISO standardized images collected for passport, visa and driving license applications. Detecting duplicates in those applications is the biggest segment of the face recognition marketplace. No algorithms worked well with the webcam images. Search failure rates for those images were around three times greater than for the higher quality images.
The study also shows that rates of missing facial matches increase as the database size increases as expected, but that it does so only slowly. When the number of facial images increased by a factor of 10—from 160,000 to 1.6 million—the error rate only increased by about 1.2 times. This slower-then-expected growth in error rates occurs in many natural phenomenon, and “is largely responsible for the operational utility of face identification algorithms,” explains Grother.
Images of older individuals were identified more accurately than those of younger persons, suggesting that we become steadily easier to recognize using facial recognition software, and more distinguishable from our contemporaries, as we age.