Analysis of ChatGPT as a supporting Tool for software analysis
DOI:
https://doi.org/10.33448/rsd-v15i5.51066Keywords:
Requirements Engineering, Artificial Intelligence, Software Analysis, Software Engineering.Abstract
Artificial Intelligence is used in different stages of software development. This use has expanded the possibilities for automation and support in software modeling activities. The objective of this research was to analyze how ChatGPT can be applied to software modeling, evaluating its contributions, possible uses, and limitations in supporting requirement elicitation and modeling activities within a software development process. This study is applied research, with a qualitative approach and exploratory and descriptive objectives. The procedures adopted were bibliographic research and a case study using a public document from the Municipality of Limeira's system procurement process. Based on this material, we conduct interactions with ChatGPT to identify, organize, and classify software and system requirements, and to support the construction of analysis diagrams. The results obtained show that ChatGPT can help identify requirements, actors, and important elements in the documents, facilitating the initial understanding of the system. However, modeling still relies on human supervision, as inconsistencies and misinterpretations may arise. Therefore, its use without human validation is not recommended in the structural definition stages.
References
Belzner, L., Gabor, T., & Wirsing, M. (2023). Large language model assisted software engineering: Prospects, challenges, and a case study. In Bridging the gap between AI and reality: First International Conference, AISoLA 2023, Proceedings (pp. 355–374). Springer. https://doi.org/10.1007/978-3-031-46002-9_23
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (pp. 610–623). https://doi.org/10.1145/3442188.34459227
Bhandari, K., Kumar, K., & Sangal, A. L. (2023). Artificial intelligence in software engineering: Perspectives and challenges. In Proceedings of the 3rd International Conference on Secure Cyber Computing and Communication (ICSCCC 2023) (pp. 133–137). IEEE. https://doi.org/10.1109/ICSCCC58608.2023.10176436
Bruce, P., Bruce, A., & Gedeck, P. (2019). Practical statistics for data scientists: 50+ essential concepts using R and Python (2nd ed.). O’Reilly Media.
Cámara, J., Troya, J., Burgueño, L., & Vallecillo, A. (2023). On the assessment of generative AI in modeling tasks: An experience report with ChatGPT and UML. Software and Systems Modeling, 22(3), 781–793. https://doi.org/10.1007/s10270-023-01105-5
Champa, A. I., Rabbi, M. F., Nachuma, C., & Zibran, M. F. (2024). ChatGPT in action: Analyzing its use in software development. In Proceedings of the 21st International Conference on Mining Software Repositories (MSR ’24) (pp. 182–186). ACM. https://doi.org/10.1145/3643991.3645077
Damian, D. E., & Zowghi, D. (2003). RE challenges in multi-site software development organizations. Requirements Engineering, 8(3), 149–160.
De Bari, D., Garaccione, G., Coppola, R., Torchiano, M., & Ardito, L. (2024). Evaluating large language models in exercises of UML class diagram modeling. In Proceedings of the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM ’24) (pp. 393–399). ACM. https://doi.org/10.1145/3674805.3690741
Du, X., Liu, M., Wang, K., Wang, H., Liu, J., & Chen, Y. (2024). Evaluating large language models in class-level code generation. In Proceedings of the 46th IEEE/ACM International Conference on Software Engineering (ICSE 2024) (pp. 982–994). IEEE/ACM. https://doi.org/10.1145/3597503.3639219
Géron, A. (2019). Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow (2nd ed.). O’Reilly Media.
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2024). Large language models for software engineering: A systematic literature review. ACM Transactions on Software Engineering and Methodology, 33(8), Article 220, 1–79. https://doi.org/10.1145/3695988
Kalai, A. T., Nachum, O., Vempala, S. S., & Zhang, E. (2025). Why language models hallucinate. arXiv preprint. https://doi.org/10.48550/arXiv.2509.04664
Kokol, P. (2024). The use of AI in software engineering: A synthetic knowledge synthesis of the recent research literature. Information, 15(6), 354. https://doi.org/10.3390/info15060354
Larman, C. (2004). Applying UML and patterns: An introduction to object-oriented analysis and design and iterative development (3rd ed.). Prentice Hall.
Mitchell, M. (2019). Artificial intelligence hits the barrier of meaning. Information, 10(2), 51. https://doi.org/10.3390/info10020051
Pereira, A. S., Shitsuka, D. M., Parreira, F. J., & Shitsuka, R. (2018). Metodologia da pesquisa científica. Santa Maria: Editora da UFSM.
Pressman, R. S., & Maxim, B. R. (2021). Engenharia de software: Uma abordagem profissional (9ª ed.). AMGH.
Risemberg, R. I. C., Wakin, M., & Shitsuka, R. (2026). A importância da metodologia científica no desenvolvimento de artigos científicos. E-Acadêmica, 7(1), e0171675. https://doi.org/10.52076/eacad-v7i1.675
Russell, S., & Norvig, P. (2021). Artificial intelligence: A modern approach (4th ed.). Pearson.
Saleem, S., Asim, M. N., Van Elst, L., & Dengel, A. (2025). Generative language models potential for requirement engineering applications: Insights into current strengths and limitations. Complex & Intelligent Systems, 11, Article 278. https://doi.org/10.1007/s40747-024-01707-6
Samhan, A., AlHajHassan, S., Dabaa’t, S. A., & Elrashidi, A. (2024). A review of AI-assisted impact analysis for software requirements change: Challenges and future directions. In Proceedings of the 25th International Arab Conference on Information Technology (ACIT) (pp. 1–13). IEEE. https://doi.org/10.1109/ACIT62805.2024.10877072
Sobania, D., Briesch, M., Hanna, C., & Petke, J. (2023). An analysis of the automatic bug fixing performance of ChatGPT. In Proceedings of the IEEE/ACM International Conference on Software Engineering (ICSE). IEEE.
Sommerville, I. (2011). Engenharia de software (9ª ed.). Pearson Prentice Hall.
Sriwilailak, C., Higo, Y., Lapvikai, P., Ragkhitwetsagul, C., & Choetkiertikul, M. (2024). Autorepairability of ChatGPT and Gemini: A comparative study. 2024 31st Asia-Pacific Software Engineering Conference (APSEC), 442–446. https://doi.org/10.1109/APSEC65559.2024.00056
Tabassum, M. R., Ritchie, M. J., Mustafiz, S., & Kienzle, J. (2024). Using LLMs for use case modelling of IoT systems: An experience report. In Proceedings of the ACM/IEEE 27th International Conference on Model Driven Engineering Languages and Systems Companion (MODELS Companion ’24) (pp. 611–619). ACM. https://doi.org/10.1145/3652620.3687810
Tavares, L. P. (Ed.). (2023). Metodologia da pesquisa científica: Dos conceitos teóricos à construção do projeto de pesquisa. Editora Amplla. https://doi.org/10.51859/amplla.mpc119.1123-0
Tuape, M., Hasheela-Mufeti, V. T., Kayanda, A., Porras, J., & Kasurinen, J. (2021). Software engineering in small software companies: Consolidating and integrating empirical literature into a process tool adoption framework. IEEE Access, 9, 130366–130388. https://doi.org/10.1109/ACCESS.2021.3113328
Ye, H., Liu, T., Zhang, A., Hua, W., & Jia, W. (2023). Cognitive mirage: A review of hallucinations in large language models. arXiv preprint. https://doi.org/10.48550/arXiv.2309.06794
Zhang, J., Chen, Y., Liu, C., Niu, N., & Wang, Y. (2023). Empirical evaluation of ChatGPT on requirements information retrieval under zero-shot setting. In Proceedings of the International Conference on Intelligent Computing and Next Generation Networks (ICNGN 2023) (pp. 1–6). IEEE. https://doi.org/10.1109/ICNGN59831.2023.10396810
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Jonathan Alves Nogueira Damacena, Diogo Félix da Silva, Marcelo Laurentino da Silva, Cristina Corrêa de Oliveira
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1) Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2) Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3) Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
