System Usability Scale Based on Paraconsistent Annotated Evidential Logic ET
DOI:
https://doi.org/10.33448/rsd-v10i8.17617Keywords:
System Usability Scale; Paraconsistent Logic Annotated Eτ; Contradiction; Two-dimension analysis.Abstract
The evaluation of the user experience using a software directly affects its quality. The System Usability Scale measures the end user's experience with the system, which presents contradictory issues. The objective of this article is to demonstrate a deepening of those contradictions, using the Evidential Annotated Paraconsistent Logic Eτ, with the application of a survey for eleven professionals who evaluated a system. A comparison of the results of the above scale was performed with the Para-analyzer algorithm, using the pair (μ, λ), assigning the even questions to μ and the odd questions to λ. The first result showed a positive assessment of usability, with the System Usability Scale (76.59). The second result, performed with the Para-analyzer, presented the global average (0.75, 0.25), which indicates a similarity with the first, highlighting two contradictory items. The evaluation improved the usability analysis, as respondents agreed on nine usability characteristics. However, there was a divergence in one item, as five respondents rated two questions with high values, presenting a contradiction in the assessment. This result may show a perception failure in the instrument's semantics, which could indicate a need for training of participants before the beginning of the process. The main contribution of this research was to evaluate the usability of a software in conjunction with the Para-analyzer, enabling a more detailed analysis, as it works with the pair (μ, λ), being possible to evaluate the results in two dimensions.
References
Abe, J. M. (7 de 2010). Paraconsistent logics and applications. 4th International Workshop on Soft Computing Applications, (pp. 11–18). 10.1109/SOFA.2010.5565631
Abe, J. M. (2015). Paraconsistent Intelligent-Based Systems - New Trends in the Applications of Paraconsistency (Vol. 94). (Springer, Ed.) Switzerland: Springer. https://doi-org.ez338.periodicos.capes.gov.br/10.1007/978-3-319-19722-7
Abe, J. M., Akama, S., & Nakamatsu, K. (2015). Introduction to Annotated Logics: Foundations for Paracomplete and Paraconsistent Reasoning. Cham: Springer International Publishing. 10.1007/978-3-319-17912-4_1
Abe, J. M., Da Silva Filho, J. I., Celestino, U., & Corrêa, d. A. (2011). Lógica Paraconsistente Anotada Evidencial Eτ. Comunicar.
Akama, S. (2016). Towards Paraconsistent Engineering. Springer International Publishing. 10.1007/978-3-319-40418-9
Brooke, J. (11 de 1995). SUS: A quick and dirty usability scale. Usability Eval. Ind., 189.
Buyya, R., Broberg, J., & Goscinski, A. (2011). Cloud Computing: principles and paradigms. John Wiley & Sons.
Carvalho, F. R., & Abe, J. M. (2018). A Paraconsistent Decision-Making Method (Vol. 87). Springer International Publishing. https://doi.org/10.1007/978-3-319-74110-9
Chen, C., Lin, S., Shoga, M., Wang, Q., & Boehm, B. (2018). How Do Defects Hurt Qualities? An Empirical Study on Characterizing a Software Maintainability Ontology in Open Source Software. (pp. 226–237). IEEE. 10.1109/QRS.2018.00036
Da Silva Filho, J. I., Abe, J. M., & Torres, G. L. (2008). Inteligência artificial com as redes de análises paraconsistentes. LTC-Livros Técnicos e Científicos Editora SA, 313.
Denning, P. J. (8 de 2016). Software quality. Communications of the ACM, 59, 23–25. 10.1145/2971327
Esaki, K., Azuma, M., & Komiyama, T. (2013). Introduction of Quality Requirement and Evaluation Based on ISO/IEC SQuaRE Series of Standard. Em Trustworthy Computing and Services (pp. 94–101). Springer Berlin Heidelberg. 10.1007/978-3-642-35795-4_12
Ghanbari, H., Vartiainen, T., & Siponen, M. (2 de 2018). Omission of Quality Software Development Practices: A Systematic Literature Review. ACM Comput. Surv., 51. 10.1145/3177746
Harrison, R., Flood, D., & Duce, D. (2013). Usability of mobile applications: literature review and rationale for a new usability model. Journal of Interaction Science, 1, 1. 10.1186/2194-0827-1-1
ISO/IEC 25010. (15 de 1 de 2021). Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — System and software quality models. Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — System and software quality models. Fonte: https://www.iso.org/standard/35733.html.
ISO/IEC 25040. (15 de 1 de 2021). Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Evaluation process. Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Evaluation process. Fonte: https://www.iso.org/standard/35765.html.
Jeff Sauro, J. R. (2016). Quantifying the User Experience. Elsevier.
Kniberg, H. (11 de 2015). Scrum and XP from the Trenches (Enterprise Software Development). lulu.com; Annotated edition.
Laudon, J. P. (2014). Management information systems: Managing the Digital Firm (13th ed.). Pearson.
Manchar, A., & Chouhan, A. (2 de 2017). Salesforce CRM: A new way of managing customer relationship in cloud environment., (pp. 1-4). 10.1109/ICECCT.2017.8117887
Nakai, H., Tsuda, N., Honda, K., Washizaki, H., & Fukazawa, Y. (2016). Initial Framework for Software Quality Evaluation Based on ISO/IEC 25022 and ISO/IEC 25023. (pp. 410–411). IEEE. 10.1109/QRS-C.2016.66
Pereira, A. S., Shitsuka, D. M., Parreira, F. J., & Shitsuka, R. (2018). Metodologia da pesquisa científica. Fonte: http://repositorio.ufsm.br/handle/1/15824
Shen, P., Ding, X., Ren, W., & Yang, C. (2018). Research on Software Quality Assurance Based on Software Quality Standards and Technology Management. (pp. 385–390). IEEE. 10.1109/SNPD.2018.8441142
Wahyuningrum, T., Kartiko, C., & Wardhana, A. C. (10 de 2020). Exploring e-Commerce Usability by Heuristic Evaluation as a Compelement of System Usability Scale. 2020 International Conference on Advancement in Data Science, E-learning and Information Systems (ICADEIS). IEEE. 10.1109/icadeis49811.2020.9277343
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Luiz Roberto Forçan; Jair Minoro Abe; Samira Sestari do Nascimento; Cristina Corrêa de Oliveira
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1) Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2) Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3) Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
