Go to main content

PDF

Description

As autonomous vehicle (AV) technology grows more widespread, questions still persist about how to effectively verify their safety. Much progress has been made in developing testing methodologies such as falsification for autonomous vehicles that interface with driving simulators to generate rich sets of scenarios. We present extensions to the Scenic scenario specification language and VerifAI toolkit that improve the scalability of such methods by allowing for falsification to be done more efficiently and with more complex models of the end goal. We first present a parallelized framework that is interfaced with both the simulation and sampling capabilities of Scenic and the falsification capabilities of VerifAI, reducing the execution time bottleneck inherently present in simulation-based testing. We then present an extension of VerifAI's falsification algorithms to support multi-dimensional objective optimization during sampling, using the concept of rulebooks to specify multiple metrics and a preference ordering over the metrics that can be used to guide the counterexample search process. Lastly, we evaluate the benefits of these extensions with a comprehensive set of experiments written in the Scenic language.

Details

Files

Statistics

from
to
Export
Download Full History
Formats
Format
BibTeX
MARCXML
TextMARC
MARC
DublinCore
EndNote
NLM
RefWorks
RIS