Logo PTI Logo FedCSIS

Proceedings of the 21st Conference on Computer Science and Intelligence Systems (FedCSIS)

Annals of Computer Science and Information Systems, Volume 47

A Model-Based Testing Framework For Distributed Simulations

, ,

DOI: http://dx.doi.org/10.15439/2026F2984

Citation: Tom van den Berg, ,

Full text

Abstract. This paper explores the use of Model Based Testing (MBT) techniques and in particular the Component Modelling \& Analysis (ComMA) framework to automate the verification of distributed simulation components. As defence simulation environments grow in complexity, ensuring reliable interoperability between modular components becomes increasingly challenging. ComMA's MBT support is extended with simulation specific capabilities, such as logical time management and dynamic entities, enabling automated online testing from formally specified interface models. Use cases demonstrate the feasibility of this approach. The work also aligns MBT activities with established simulation engineering processes. Results highlight benefits, remaining challenges, and directions for future work.

References

  1. I. Kurtev, J. Hooman, M. Schuts and D. van der Munnik, “Model based component development and analysis with ComMA,” Science of Computer Programming, vol. 233, 2024, https://dx.doi.org/10.1016/j.scico.2023.103067.
  2. J. Hannay, T. v. d. Berg, S. Gallant and K. Gupton, “Modeling and Simulation as a Service infrastructure capabilities for discovery, composition and execution of simulation services,” JDMS, no. Special Issue, 2020, https://dx.doi.org/10.1177/1548512919896855.
  3. F. Moradi, A framework for component based modelling and simulation using BOMs and semantic web technology, Stockholm: KTH, 2008, ISBN 978-91-7178-957-0.
  4. I. Mahmood, A Verification Framework for Component Based Modeling and Simulation, Sweden: KTH, 2013, ISBN 978-91-7501-628-3.
  5. IEEE 1516, “IEEE Standard for Modeling and Simulation (M&S) - High Level Architecture (HLA) (IEEE 1516),” IEEE, 2025.
  6. SISO, “Base Object Model (BOM) Template Specification (SISO-STD-003-2006),” SISO, 2006.
  7. IEEE, “IEEE Recommended Practice for Distributed Simulation Engineering and Execution Process (DSEEP),” IEEE 1730-2022.
  8. IEEE, “IEEE Recommended Practice for Verification, Validation and Acceptance/Accreditation of a Distributed Simulation: An Overlay to the Distributed Simulation Engineering and Execution Process,” IEEE 1730.2-2022.
  9. S. AbdelGaber, A. Abdo, L. Abdelhamid and R. Mohamed, “PSCCTEM Ontology to overcome pesticide paradox in Model Based Testing,” International Journal of Computer Science and Information Scecurity (IJCSIS), 2021, https://dx.doi.org/10.5281/zenodo.5504287.
  10. M. Broy, B. Jonsson, J.-P. Katoen, M. Leucker and A. Pretschner, “Model-based testing of reactive systems,” in Volume 3472 of Springer LNCS, 2005, https://dx.doi.org/10.1007/b137241.
  11. M. Schuts, J. Hooman, I. Kurtev, I. Tlili and E. Oerlemans, “Online Model-Based Testing Reusing Multiple Design Models in an Industrial Setting,” The Journal of Object Technology, vol. 24, 2025, https://dx.doi.org/10.5381/jot.2025.24.2.a6.
  12. T. van den Berg, “Interoperability testing tools and techniques,” in SISO SImulation Interoperability Workshop (18F-SIW-007), Orlando, 2018.
  13. IEEE, “DRAFT Software and systems engineering - Software testing - Model Based Testing (IEEE 29119-8),” IEEE, 2025.
  14. IEEE, “Software and systems engineering - Software testing - Test Processes (IEEE 29119-2),” IEEE, 2013.
  15. M. Schuts, J. Hooman, I. Kurtev and D. Swagerman, “Reverse Engineering of Legacy Software Interfaces to a Model-Based Approach,” in Federated Conference on Computer Science and Information Systems, 2018, https://dx.doi.org/10.15439/2018f64.