Why Drones and AI Can’t Quickly Find Missing Flood Victims, Yet
The ideal solution is an AI system that scans the entire image, prioritizes images that have the strongest signs of victims, and highlights the area of the image for a responder to inspect. It could also decide whether the location should be flagged for special attention by search-and-rescue crews.
Where AI Falls Short
While this seems to be a perfect opportunity for computer vision and machine learning, modern systems have a high error rate. If the system is programmed to overestimate the number of candidate locations in hopes of not missing any victims, it will likely produce too many false candidates. That would mean overloading squinters or, worse, the search-and-rescue teams, which would have to navigate through debris and muck to check the candidate locations.
Developing computer vision and machine learning systems for finding flood victims is difficult for three reasons.
One is that while existing computer vision systems are certainly capable of identifying people visible in aerial imagery, the visual indicators of a flood victim are often very different compared with those for a lost hiker or fugitive. Flood victims are often obscured, camouflaged, entangled in debris or submerged in water. These visual challenges increase the possibility that existing classifiers will miss victims.
Second, machine learning requires training data, but there are no datasets of aerial imagery where humans are tangled in debris, covered in mud and not in normal postures. This lack also increases the possibility of errors in classification.
Third, many of the drone images often captured by searchers are oblique views, rather than looking straight down. This means the GPS location of a candidate area is not the same as the GPS location of the drone. It is possible to compute the GPS location if the drone’s altitude and camera angle are known, but unfortunately those attributes rarely are. The imprecise GPS location means teams have to spend extra time searching.
How AI Can Help
Fortunately, with humans and AI working together, search-and-rescue teams can successfully use existing systems to help narrow down and prioritize imagery for further inspection.
In the case of flooding, human remains may be tangled among vegetation and debris. Therefore, a system could identify clumps of debris big enough to contain remains. A common search strategy is to identify the GPS locations of where flotsam has gathered, because victims may be part of these same deposits.
An AI classifier could find debris commonly associated with remains, such as artificial colors and construction debris with straight lines or 90-degree corners. Responders find these signs as they systematically walk the riverbanks and flood plains, but a classifier could help prioritize areas in the first few hours and days, when there may be survivors, and later could confirm that teams didn’t miss any areas of interest as they navigated the difficult landscape on foot.
Robin R. Murphy is Professor of Computer Science and Engineering, Texas A&M University. Thomas Manzini is Ph.D. Student in Robotics, Texas A&M University. This story is published courtesy of The Conversation.
