BiometricsFace recognition on the go

Published 10 January 2011

New mobile phone software recognizes friends in real time; the smart phone’s camera picks out faces in the crowd and tags them with names — so that their latest entries in Facebook, LinkedIn, or tweet appears on the smart phone’s screen

While companies like Vuzix work on augmented reality hardware, Viewdle is working on the software side, demonstrating a face recognition system for mobile phones at the Consumer Electronics Show (CES) in Las Vegas. Using the phone’s camera, it can pick out faces and tag them with names on the fly; the goal is then to link these names with social networks and other online sources, so that their latest tweet or Linked In job title can appear beneath their image.

Technology Review reports that the primary challenge for the developers was creating a system that can work with the constrained memory, processing power, and low quality optics of mobile phones (phone manufacturers can increase the resolution of the imaging sensor but do little to improve the lens, typically resulting in more fuzzy pixels rather than better images.) The Viewdle software works by creating compressed “faceprints” that are stored in a database on the phone.

These faceprints are created from multiple images to allow the system to recognize a face even when a person changes their expression or is seen at an angle.

Faceprints are created either directly from a few seconds of video of the person taken with the phone, or a user can give Viewdle access to the tagged pictures in their Facebook account. Viewdle will analyze these pictures remotely and send the user’s phone the corresponding faceprint database. Viewdle has been able to limit the processing requirements of its software to about 30 percent of the CPU power of a typical smart phone.

TR notes that mobile device makers Qualcomm and Blackberry are among Viewdle’s investors, and the company, which is headquartered in Palo Alto, California, but does most of its research and development in Kiev, hopes that their software will start showing up in products by mid 2011.