Watching the watchers: new solution monitors CCTV operators

Published 14 April 2009

People watching CCTV images back in the control rooms often have too many screens to monitor at once, and as a result may miss the criminal or antisocial activities they are there to spot; a new solution monitor the monitors

Quis custodiet ipsos custodes?” (Who will guard the guardians?) Plato asked. Owners of CCTVs wanted an answer. Here is why. CCTV may strike many of us as an Orwellian invention, but CCTV systems are also full of holes for the organizations that pay for them. The reason is that the people watching CCTV images back in the control rooms often have too many screens to monitor at once, and as a result may miss the criminal or antisocial activities they are there to spot.

Paul Marks writes that Ulas Vural and Yusuf Akgul of the Gebze Institute of Technology in Turkey come to the rescue of CCTV operators. The two have developed a gaze-tracking camera system that watches the eyeballs of CCTV operators as they work. It then automatically produces a summary of the CCTV video sequences they have missed during their shift. “This increases the reliability of the surveillance system by giving a second chance to the operator,” the researchers write in the journal Pattern Recognition Letters.

The system uses Webcam-style cameras trained on the irises of the CCTV operators. From this, software works out where the operators are looking as they stare at each monitor — and the areas they have not been paying attention to. From this it creates a video of what they missed, for them and their bosses to watch at the end of their shift. To make sure the summary can be watched as quickly as possible, Vural and Akgul have developed an algorithm that discards frames that show only the background with no people or moving vehicles in them, to leave only a few key frames for each scene of interest. Vural says the system runs on a standard PC and processes the images in real time, so the summary frames are ready to browse, like a fast-motion flip book, at the end of the shift.

Privacy campaigners may enjoy the irony if the gaze-tracking system comes to be regarded as intrusive by CCTV operators — who could fear that employers will use it to dispense with their services if they consistently miss too much on-screen skulduggery.

-read more in U. Vural and Y. S. Akgul, “Eye-gaze Based Real-time Surveillance Video Synopsis,” Pattern Recognition Letters (20 March 2009) (DOI: 10.1016/j.patrec.2009.03.002)