DomainSweep: Input Domain Driven Falsification of Cyber-Physical Systems

Loading...
Thumbnail Image

Persistent link to this item

Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

DomainSweep: Input Domain Driven Falsification of Cyber-Physical Systems

Published Date

2024-05

Publisher

Type

Thesis or Dissertation

Abstract

Modern Cyber-Physical Systems (CPS), tasked with complex control functions like autonomous driving, increasingly incorporate AI-enabled controllers based on deep neural networks (DNN). This growth necessitates robust safety measures and reliable protocols that ensure these systems function correctly. However, as these systems grow in complexity and scale, traditional verification methods become limited. Instead of attempting to prove that a system's properties are always correct, an alternative approach is to focus on identifying inputs that cause the system to violate a specified property. This technique is known as Falsification. Typically, falsification employs a black-box strategy, using search-based testing and heuristics to diminish some robustness metric of a system's property. Although these methods are flexible and reusable across various systems, they often do not yield optimal results due to their reliance on general heuristics. Contrariwise, white-box falsification methods offer precision but are limited because they are tailored to specific systems or architectures, shrinking their wider applicability. To address these challenges, we introduce DomainSweep, a novel black-box falsification tool that leverages input domain models to effectively falsify CPS properties. Utilizing a Variational Autoencoder (VAE), DomainSweep adopts a unique approach by exploring low-dimensional embedding of the inputs to guide the falsification process. Experimental evaluations with various encoding schemas and coverage strategies demonstrated that DomainSweep achieved a falsification success rate of 60.18\%, significantly outperforming Breach, a well-known black-box tool, and delivering competitive results compared to FalsifAI, a state-of-the-art white-box framework. This demonstrates DomainSweep's robust capability in system falsification and establishes a strong foundation for future work in this field.

Description

University of Minnesota M.S. thesis. May 2024. Major: Computer Science. Advisor: Sanjai Rayadurgam. 1 computer file (PDF); vii, 41 pages.

Related to

Replaces

License

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Suggested citation

Zahar, Youssef. (2024). DomainSweep: Input Domain Driven Falsification of Cyber-Physical Systems. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/264277.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.