Risk analysisBig Data, Internet of Things enable real-time probabilistic risk analysis

Published 11 August 2015

Statistical models are playing an increasingly important role in risk analysis and helping the United States and other countries around the globe mitigate the effects of natural and man-made disasters. With the increased ability to collect data through the Internet of Things and analyze this data in real time, the field of risk analysis is entering an exciting new phase based on real-time probabilistic risk analysis. This emerging paradigm can enable humans to better manage risks associated with complex systems, including space shuttles launching into orbit, illicit nuclear materials crossing national boundaries and the side effects of chemicals and even medical drugs.

Statistical models are playing an increasingly important role in risk analysis and helping the United States and other countries around the globe mitigate the effects of natural and man-made disasters, said Siddhartha (Sid) Dalal during a presentation at the 2015 Joint Statistical Meetings (JSM 2015) in Seattle.

Dalal presented a talk, titled “Challenges in Risk Analysis of Complex Systems: From Space Shuttle Challenger and Dirty Bombs to Medical Drugs and Chemicals,” at a luncheon sponsored by the American Statistical Association’s (ASA) Committee on Statistical Partnerships among Academe, Industry, and Government (SPAIG).

Dalal is chief data scientist and senior vice president at AIG, an international insurance organization with customers in more than 100 countries and jurisdictions. He also is an adjunct professor teaching data mining to graduate students at Columbia University.

While statistical models can provide insight into risks, the field is experiencing a sea change brought on by new advances in technology and data collection, including Big Data and the Internet of Things (IoT), said Dalal during his luncheon presentation. IoT describes the growing network of physical objects or “things” embedded with electronics, software, sensors and connectivity, enabling these objects to exchange data with their manufacturers, their operators and other connected devices.

The ASA notes that with the increased ability to collect data through IoT and analyze this data in real time, the field of risk analysis is entering an exciting new phase based on real-time probabilistic risk analysis. This emerging paradigm can enable humans to better manage risks associated with complex systems, including space shuttles launching into orbit, illicit nuclear materials crossing national boundaries and the side effects of chemicals and even medical drugs, explained Dalal, who is an expert in the field of risk analysis and was appointed by the National Academy of Sciences to a panel commissioned to study the Challenger disaster. The panel’s research demonstrated the ability of statistical science to predict risks to space shuttles and convinced the National Air and Space Administration (NASA) to establish a probabilistic risk assessment group.

The data sets that enable real-time risk analyses range from small sets to terabytes of data on the millions of shipping containers entering U.S. ports to medical information about new drug treatments. While this data-driven age provides an abundance of data to enable real-time probabilistic risk analysis, this same abundance of data can make it challenging to create unified decision systems for risk analysis. Risk analysis depends on strong decision-making: Analysts seek to identify different kinds of risks, quantify risks and their consequences and invent interventions to increase the world’s resilience.

Today, new methodologies and technologies enable smarter decision-making that improves global resilience. These methods include generating possible accident scenarios, combining the power of Big Data with cutting-edge analytical techniques to predict the probability of these accidents and working passively (for example, observing accident data from videos) as well as actively (for example, leveraging sensors and IoT to detect and prevent risks before they occur) to build a more resilient world, described Dalal.

The ASA notes that risk and resiliency analytics are already playing a key role in U.S. government public policy. Recent examples include the Department of Homeland Security’s work on preventing dirty bomb material from entering the country and the identification of dangerous drug interactions by the U.S. Food and Drug Administration and National Institutes of Health.

Global resilience depends upon society’s ability to identify, quantify and understand the consequences of risks — from health risks, to natural events like floods, to accidents and others. To prepare for risks and recover from their consequences, we must analyze and understand data from our past, as well as elicit information about future events,” Dalal told the audience.

Big Data, the sophisticated modeling techniques of machine learning and Bayesian statistics, and sensor technologies will help us make society more resilient than ever before,” he concluded.

JSM 2015 is being held August 8-13 at the Washington State Convention Center in Seattle, and is being attended by more than 6,000 statisticians from academia, business, industry, and government.