Assured Autonomy Tools Portal
Continual Assurance of Learning-Enabled, Cyber-Physical Systems (LE-CPS)

Verisig: verifying safety properties of hybrid systems with neural network controllers

Abstract

This paper presents Verisig, a hybrid system approach to verifying safety properties of closed-loop systems using neural networks as controllers. We focus on sigmoid-based networks and exploit the fact that the sigmoid is the solution to a quadratic differential equation, which allows us to transform the neural network into an equivalent hybrid system. By composing the network\textquoterights hybrid system with the plant\textquoterights, we transform the problem into a hybrid system verification problem which can be solved using state-of-the-art reachability tools. We show that reachability is decidable for networks with one hidden layer and decidable for general networks if Schanuel\textquoterights conjecture is true. We evaluate the applicability and scalability of Verisig in two case studies, one from reinforcement learning and one in which the neural network is used to approximate a model predictive controller.

Year of Publication
2019
Conference Name
22nd International Conference on Hybrid Systems: Computation and Control
Conference Location
Montreal, Quebec, Canada
DOI
10.1145/3302504.3311806