Usability Evaluation of Mobile USSD-SMS Interactive Result Checking System for Resource-Constrained Settings (MIRCS) using System Usability Score (SUS).
Keywords:Short Messaging Service, Unstructured Supplementary Service Data, System Usability Scale, Evaluation, usability, Higher Education
Mobile phones, especially smartphones have impacted the way we access information related to education. For instance, students are now able to view their results using a smartphone on a browser. However, these result systems that make it possible for students to view their exam results through web browsers or emails on their mobile devices need an internet connection for the process to work as expected. Also, given the indigent nature of most students in developing countries, this creates a digital divide for students that do not own smartphones. With many students coming from rural and often low economic status homes, not many can afford smartphones. Hence, leveraging on the potentials of Unstructured Supplementary Service Data (USSD) and Short Message Service (SMS), a Mobile USSD-SMS Interactive Result Checking System for Resource-Constrained Settings (MIRCS) was developed to provide a device agnostic accessible Result Checking System. This study evaluated MIRCS using System Usability Scale (SUS) to verify the effectiveness from a usability point of view. The result of the evaluation shows that the MIRCS is usable which received grade C (66.21), although it does not meet the acceptable level specified by SUS. Further analysis of the interaction with respondents suggests some areas of improvement to include cost of service, high availability and accuracy.
Crompton, H., & Burke, D. (2018). The use of mobile learning in higher education: A systematic review. Computers & Education, 123, 53–64. doi:10.1016/j.compedu.2018.04.007
Anyiam, O. O., Okengwu, U. A., & Anyiam, F. N. (2020). An Enhanced Result Processing and Checking System for Public Universities using 2FA and TOTP. International Journal of Engineering Research And, V9(02). https://doi.org/10.17577/IJERTV9IS020111
Vikram K. C. and Timothy X. B. (2018). RASP-IVR: A Low Cost Interactive Voice Response System. In 2nd African Conference for Human Computer Interaction (AfriCHI ’18). https://doi.org/10.1145/3283458.3283489
Poon, A., Giroux, S., Eloundou-Enyegue, P., Guimbretière, F., & Dell, N. (2019, May). Engaging high school students in cameroon with exam practice quizzes via sms and whatsapp. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1-13).
Kawu, A. A., Abdullahi, A., Joseph, E., Mishra, A., & Abdulrahman, A. (2020, February). MIRCS: A Mobile USSD-SMS Interactive Result Checking System for Resource-Constrained Settings. In Proceedings of the 2020 9th International Conference on Software and Computer Applications (pp. 264-268).
Nielsen, J. (2012, January). Usability 101: Introduction to Usability. Accessed 25/2/2023 https://www.nngroup.com/articles/usability-101-introduction-to-usability/
Usability.gov. Accessed:18/3/2023 https://www.usability.gov/how-to-and-tools/methods/usability-testing.html
Moran, K. (2019, December). Usability Testing 101: User testing. Accessed 18/3/2023 https://www.nngroup.com/articles/usability-testing-101/
Ratnawati, S., Widianingsih, L., Anggraini, N., Marzuki Shofi, I., Hakiem, N., & Eka M Agustin, F. (2020). Evaluation Of Digital Library’s Usability Using the System Usability Scale Method of (A Case Study). 2020 8th International Conference on Cyber and IT Service Management (CITSM). doi:10.1109/citsm50537.2020.9268801
Harper, B. D., & Norman, K. L. (1993, February). Improving user satisfaction: The questionnaire for user interaction satisfaction version 5.5. In Proceedings of the 1st Annual Mid-Atlantic Human Factors Conference (Vol. 224, p. 228). sn.
Kirakowski, J., & Corbett, M. (1993). SUMI: the Software Usability Measurement Inventory. British Journal of Educational Technology, 24(3), 210–212. doi:10.1111/j.1467-8535.1993.tb00076.x
Lewis, J. R. (2002). Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction, 14(3-4), 463-488.
Brooke, J. (1996). SUS-A quick and dirty usability scale. Usability evaluation in industry, 189(194), 4-7.
Vlachogianni, P., & Tselios, N. (2022). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392-409.
Lewis, J. R. (2018). The system usability scale: past, present, and future. International Journal of Human–Computer Interaction, 34(7), 577-590.
Abuhlfaia, K., & de Quincey, E. (2019, November). Evaluating the usability of an e-learning platform within higher education from a student perspective. In Proceedings of the 2019 3rd International Conference on Education and E-Learning (pp. 1-7).
Supriyadi, D., Safitri, S. T., & Kristiyanto, D. Y. (2020). Higher Education e-Learning Usability Analysis Using System Usability Scale. IJISTECH (International Journal of Information System and Technology), 4(1), 436-446.
Lewis, J. R., & Sauro, J. (2018). Item benchmarks for the system usability scale. Journal of Usability Studies, 13(3).
Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative research in sport, exercise and health, 11(4), 589-597.
Braun, V., Clarke, V., Hayfield, N., & Terry, G. (2019). Thematic Analysis. Handbook of Research Methods in Health Social Sciences, 843–860. doi:10.1007/978-981-10-5251-4_103
Herawati, A., Negeri, U., Suseno, J. M., Siti, J., & Sulistyaningrum, D. (2021). Evaluation of higher education learning management system usability using system usability scale. In UHAMKA International Conference on ELT and CALL (UICELL) (Vol. 2, pp. 2-3).
How to Cite
Copyright (c) 2023 Zainab Tassala Muhammad, Abdullahi Abubakar Kawu, Ibrahim Abdullahi, Musa Bawa
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.