Odu, Oluwafemi, Belle, Alvine B., Wang, Song, Kpodjedo, Segla, Lethbridge, Timothy C. et Hemmati, Hadi.
2025.
« Automatic instantiation of assurance cases from patterns using large language models ».
Journal of Systems and Software, vol. 222.
Prévisualisation |
PDF
Kpodjedo-S-J-L-2025-30573.pdf - Version publiée Licence d'utilisation : Creative Commons CC BY-NC-ND. Télécharger (5MB) | Prévisualisation |
Résumé
An assurance case is a structured set of arguments supported by evidence, demonstrating that a system’s nonfunctional requirements (e.g., safety, security, reliability) have been correctly implemented. Assurance case patterns serve as templates derived from previous successful assurance cases, aimed at facilitating the creation of new assurance cases. Despite using these patterns to generate assurance cases, their instantiation remains a largely manual and error-prone process that heavily relies on domain expertise. Thus, exploring techniques to support their automatic instantiation becomes crucial. This study aims to investigate the potential of Large Language Models (LLMs) in automating the generation of assurance cases that comply with specific patterns. Specifically, we formalize assurance case patterns using predicate-based rules and then utilize LLMs, i.e., GPT- 4o and GPT-4 Turbo, to automatically instantiate assurance cases from these formalized patterns. Our findings suggest that LLMs can generate assurance cases that comply with the given patterns. However, this study also highlights that LLMs may struggle with understanding some nuances related to pattern-specific relationships. While LLMs exhibit potential in the automatic generation of assurance cases, their capabilities still fall short compared to human experts. Therefore, a semi-automatic approach to instantiating assurance cases may be more practical at this time.
| Type de document: | Article publié dans une revue, révisé par les pairs |
|---|---|
| Professeur: | Professeur Kpodjedo, Sègla Jean-Luc |
| Affiliation: | Génie logiciel et des technologies de l'information |
| Date de dépôt: | 24 févr. 2025 19:04 |
| Dernière modification: | 04 mars 2025 15:02 |
| URI: | https://espace2.etsmtl.ca/id/eprint/30573 |
Actions (Authentification requise)
 |
Dernière vérification avant le dépôt |