Usability Evaluation of SIDUMAS Badung Using Think Aloud, Heuristic Evaluation and SUS
DOI:
10.33395/sinkron.v8i1.12034Keywords:
Public Service, Application, Public Complaint System, Usability EvaluationAbstract
This study aims to 1) find out the problems that occur in the Badung Regency community complaint system (SIDUMAS) by conducting a usability evaluation using the think-aloud method, heuristic evaluation and system usability scale, 2) conduct a usability evaluation on the community complaint system can determine the level of application usability and determine recommendations for improvements needed by the Badung community complaint system (SIDUMAS). Respondents who participated in this study were Badung people consisting of 5 usability experts and 30 general public. Determination of respondents in this study based on the criteria of the method used. The data in this study were obtained through usability evaluation results on the public complaint application questionnaires and data from interviews with respondents. The method used to evaluate the public complaint system is a combination of 3 methods, namely think aloud, heuristic evaluation and system usability scale which will produce an assessment to determine the usability and recommendations for improvements to the Badung SIDUMAS system. The results showed that: (1) Using the think-aloud method, it was found that the problems experienced by users of the community complaint system application on average experienced the same problems in the test. The results of research with heuristic evaluation found that there is 1 problem that has the highest severity rating where the problem must be fixed immediately. The results of the calculation of the average system usability scale score on user satisfaction obtained a score of 78 with acceptability ranges in the acceptable category. Furthermore, for the percentile rank score, the value obtained is 78 so it is in the grade B category. (2) Making recommendations for improvement in the study focused on changing the layout on the page and navigation menu on the results of data causing errors experienced by users.
Downloads
References
Acosta-Vargas, P., Salvador-Ullauri, L. A., & Luján-Mora, S. (2019). A heuristic method to evaluate web accessibility for users with low vision. IEEE Access, 7, 125634–125648.
Barnum, C. M. (2020). Usability testing essentials: ready, set... test! Morgan Kaufmann.
Fan, M., Lin, J., Chung, C., & Truong, K. N. (2019). Concurrent think-aloud verbalizations and usability problems. ACM Transactions on Computer-Human Interaction (TOCHI), 26(5), 1–35.
Hasibuan, N., & Putri, R. A. (2022). Usability Evaluation of Wedding Administrative Information System using System Usability Scale. Sinkron: Jurnal Dan Penelitian Teknik Informatika, 7(4), 2198–2207.
Hertzum, M. (2020). Usability Testing: A Practitioner’s Guide to Evaluating the User Experience. Synthesis Lectures on Human-Centered Informatics, 13(1), i–105.
Holden, R. J. (2020). A simplified system usability scale (SUS) for cognitively impaired and older adults. Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care, 9(1), 180–182.
Jordan, P. W. (2020). An introduction to usability. CRC Press.
Kaya, A., Ozturk, R., & Altin Gumussoy, C. (2019). Usability measurement of mobile applications with system usability scale (SUS). In Industrial engineering in the big data era (pp. 389–400). Springer.
Kumar, B. A., & Goundar, M. S. (2019). Usability heuristics for mobile learning applications. Education and Information Technologies, 24(2), 1819–1833.
Mahendra, G. S., & Asmarajaya, I. K. A. (2022). Evaluation Using Black Box Testing and System Usability Scale in the Kidung Sekar Madya Application. Sinkron: Jurnal Dan Penelitian Teknik Informatika, 7(4), 2292–2302.
Nioga, A., Brata, K. C., & Fanani, L. (2019). Evaluasi Usability Aplikasi Mobile KAI Access Menggunakan Metode System Usability Scale (SUS) Dan Discovery Prototyping (Studi Kasus PT KAI). J-PTIIK: Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer, 3(2), 1396–1402.
Prasetyaningtias, T., Muslimah Az-Zahra, H., & Hendra Brata, A. (2018). Analisis Usability Pada Aplikasi Mobile E-Government Layanan Aspirasi dan Pengaduan Online Rakyat (LAPOR!) Dengan Heuristic Evaluation. Analisis Usability Pada Aplikasi Mobile E-Government Layanan Aspirasi Dan Pengaduan Online Rakyat ( LAPOR !) Dengan Heuristic Evaluation, 2(11), 4647–4653.
Rasmila. (2018). Evaluasi Website Dengan Menggunakan System Usability Scale (SUS) Pada Perguruan Tinggi Swasta Di Palembang. JUSIFO : Jurnal Sistem Informasi, 02(Vol 2 No 1 (2018): JUSIFO), 108–121.
Rocha, N. P. (2021). Heuristic Evaluation of the Usability of Smart Home Applications. Comprehensible Science: ICCS 2021, 315, 483.
Saputra, D., Syah, E. A., & Darnis, F. (2022). Usability Testing on the Simponik Website using the System Usability Scale (SUS). Sinkron: Jurnal Dan Penelitian Teknik Informatika, 7(4), 2584–2592.
Sohaib, O., Solanki, H., Dhaliwa, N., Hussain, W., & Asif, M. (2019). Integrating design thinking into extreme programming. Journal of Ambient Intelligence and Humanized Computing, 10(6), 2485–2492.
Tantri Fajarini, P., Ayu Wirdiani, N. K., & Arya Dharmaadi, I. P. (2020). Evaluasi Portal Berita Online pada Aspek Usability Menggunakan Heurtistic Evaluation dan Think Aloud. Jurnal Teknologi Informasi Dan Ilmu Komputer, 7(5), 905. https://doi.org/10.25126/jtiik.2020753587
Trukenbrod, A. K., Backhaus, N., & Thomaschke, R. (2020). Measuring subjectively experienced time in usability and user experience testing scenarios. International Journal of Human-Computer Studies, 138, 102399.
Usability.gov. (2021). Recruiting Usability Test Participants. Recruiting Usability Test Participants.
Vlachogianni, P., & Tselios, N. (2022). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392–409.
Weichbroth, P. (2020). Usability of mobile applications: a systematic literature study. IEEE Access, 8, 55563–55577.
Downloads
|
How to Cite
Issue
Section
License
Copyright (c) 2023 I Nyoman Gede Ardi Yana Putra, I Made Candiasa, Luh Joni Erawati Dewi
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Muhammad Khoiruddin harahap
Google Scholar 
Moraref
PKP Index
Garuda Kemdikbud
Indonesia OneSearch
OCLC Worldcat
Dimensions
Index Copernicus
Scilit
