In this paper, we present an approach to conformance testing based on abstract state machines (ASMs) that combines model refinement and test execution (RATE) and its application to three case studies. The RATE approach consists in generating test sequences from ASMs and checking the conformance between code and models in multiple iterations. The process follows these steps: (1) model the system as an abstract state machine; (2) validate and verify the model; (3) generate test sequences automatically from the ASM model; (4) execute the tests over the implementation and compute the code coverage; (5) if the coverage is below the desired threshold, then refine the abstract state machine model to add the uncovered functionalities and return to step 2. We have applied the proposed approach in three case studies: a traffic light control system (TLCS), the IEEE 11073-20601 personal health device (PHD) protocol, and the mechanical ventilator Milano (MVM). By applying RATE, at each refinement level, we have increased code coverage and identified some faults or conformance errors for all the case studies. The fault detection capability of RATE has also been confirmed by mutation analysis, in which we have highlighted that, many mutants can be killed even by the most abstract models.

(2023). RATE: A model-based testing approach that combines model refinement and test execution [journal article - articolo]. In SOFTWARE TESTING VERIFICATION & RELIABILITY. Retrieved from https://hdl.handle.net/10446/235470

RATE: A model-based testing approach that combines model refinement and test execution

Bombarda, Andrea;Bonfanti, Silvia;Gargantini, Angelo;
2023-01-01

Abstract

In this paper, we present an approach to conformance testing based on abstract state machines (ASMs) that combines model refinement and test execution (RATE) and its application to three case studies. The RATE approach consists in generating test sequences from ASMs and checking the conformance between code and models in multiple iterations. The process follows these steps: (1) model the system as an abstract state machine; (2) validate and verify the model; (3) generate test sequences automatically from the ASM model; (4) execute the tests over the implementation and compute the code coverage; (5) if the coverage is below the desired threshold, then refine the abstract state machine model to add the uncovered functionalities and return to step 2. We have applied the proposed approach in three case studies: a traffic light control system (TLCS), the IEEE 11073-20601 personal health device (PHD) protocol, and the mechanical ventilator Milano (MVM). By applying RATE, at each refinement level, we have increased code coverage and identified some faults or conformance errors for all the case studies. The fault detection capability of RATE has also been confirmed by mutation analysis, in which we have highlighted that, many mutants can be killed even by the most abstract models.
articolo
2023
Bombarda, Andrea; Bonfanti, Silvia; Gargantini, Angelo Michele; Lei, Yu; Duan, Feng
(2023). RATE: A model-based testing approach that combines model refinement and test execution [journal article - articolo]. In SOFTWARE TESTING VERIFICATION & RELIABILITY. Retrieved from https://hdl.handle.net/10446/235470
File allegato/i alla scheda:
File Dimensione del file Formato  
RATE A model-based testing approach that combines model refinement and test execution.pdf

Solo gestori di archivio

Versione: publisher's version - versione editoriale
Licenza: Licenza default Aisberg
Dimensione del file 5.09 MB
Formato Adobe PDF
5.09 MB Adobe PDF   Visualizza/Apri
Pubblicazioni consigliate

Aisberg ©2008 Servizi bibliotecari, Università degli studi di Bergamo | Terms of use/Condizioni di utilizzo

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10446/235470
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact