Usability Evaluation of Mobile USSD-SMS Interactive Result Checking System for Resource-Constrained Settings (MIRCS) using System Usability Score (SUS).


  • Zainab Tassala Muhammad Ibrahim Badamasi Babangida University Lapai, Nigeria
  • Abdullahi Abubakar Kawu Ibrahim Badamasi Babangida University
  • Ibrahim Abdullahi Ibrahim Badamasi Babangida University
  • Musa Bawa Ibrahim Badamasi Babangida University




Short Messaging Service, Unstructured Supplementary Service Data, System Usability Scale, Evaluation, usability, Higher Education


Mobile phones, especially smartphones have impacted the way we access information related to education. For instance, students are now able to view their results using a smartphone on a browser. However, these result systems that make it possible for students to view their exam results through web browsers or emails on their mobile devices need an internet connection for the process to work as expected. Also, given the indigent nature of most students in developing countries, this creates a digital divide for students that do not own smartphones. With many students coming from rural and often low economic status homes, not many can afford smartphones. Hence, leveraging on the potentials of Unstructured Supplementary Service Data (USSD) and Short Message Service (SMS), a Mobile USSD-SMS Interactive Result Checking System for Resource-Constrained Settings (MIRCS) was developed to provide a device agnostic accessible Result Checking System. This study evaluated MIRCS using System Usability Scale (SUS) to verify the effectiveness from a usability point of view. The result of the evaluation shows that the MIRCS is usable which received grade C (66.21), although it does not meet the acceptable level specified by SUS. Further analysis of the interaction with respondents suggests some areas of improvement to include cost of service, high availability and accuracy.

GS Cited Analysis


Download data is not yet available.


Crompton, H., & Burke, D. (2018). The use of mobile learning in higher education: A systematic review. Computers & Education, 123, 53–64. doi:10.1016/j.compedu.2018.04.007

Anyiam, O. O., Okengwu, U. A., & Anyiam, F. N. (2020). An Enhanced Result Processing and Checking System for Public Universities using 2FA and TOTP. International Journal of Engineering Research And, V9(02).

Vikram K. C. and Timothy X. B. (2018). RASP-IVR: A Low Cost Interactive Voice Response System. In 2nd African Conference for Human Computer Interaction (AfriCHI ’18).

Poon, A., Giroux, S., Eloundou-Enyegue, P., Guimbretière, F., & Dell, N. (2019, May). Engaging high school students in cameroon with exam practice quizzes via sms and whatsapp. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1-13).

Kawu, A. A., Abdullahi, A., Joseph, E., Mishra, A., & Abdulrahman, A. (2020, February). MIRCS: A Mobile USSD-SMS Interactive Result Checking System for Resource-Constrained Settings. In Proceedings of the 2020 9th International Conference on Software and Computer Applications (pp. 264-268).

Nielsen, J. (2012, January). Usability 101: Introduction to Usability. Accessed 25/2/2023 Accessed:18/3/2023

Moran, K. (2019, December). Usability Testing 101: User testing. Accessed 18/3/2023

Ratnawati, S., Widianingsih, L., Anggraini, N., Marzuki Shofi, I., Hakiem, N., & Eka M Agustin, F. (2020). Evaluation Of Digital Library’s Usability Using the System Usability Scale Method of (A Case Study). 2020 8th International Conference on Cyber and IT Service Management (CITSM). doi:10.1109/citsm50537.2020.9268801

Harper, B. D., & Norman, K. L. (1993, February). Improving user satisfaction: The questionnaire for user interaction satisfaction version 5.5. In Proceedings of the 1st Annual Mid-Atlantic Human Factors Conference (Vol. 224, p. 228). sn.

Kirakowski, J., & Corbett, M. (1993). SUMI: the Software Usability Measurement Inventory. British Journal of Educational Technology, 24(3), 210–212. doi:10.1111/j.1467-8535.1993.tb00076.x

Lewis, J. R. (2002). Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction, 14(3-4), 463-488.

Brooke, J. (1996). SUS-A quick and dirty usability scale. Usability evaluation in industry, 189(194), 4-7.

Vlachogianni, P., & Tselios, N. (2022). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392-409.

Lewis, J. R. (2018). The system usability scale: past, present, and future. International Journal of Human–Computer Interaction, 34(7), 577-590.

Abuhlfaia, K., & de Quincey, E. (2019, November). Evaluating the usability of an e-learning platform within higher education from a student perspective. In Proceedings of the 2019 3rd International Conference on Education and E-Learning (pp. 1-7).

Supriyadi, D., Safitri, S. T., & Kristiyanto, D. Y. (2020). Higher Education e-Learning Usability Analysis Using System Usability Scale. IJISTECH (International Journal of Information System and Technology), 4(1), 436-446.

Lewis, J. R., & Sauro, J. (2018). Item benchmarks for the system usability scale. Journal of Usability Studies, 13(3).

Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative research in sport, exercise and health, 11(4), 589-597.

Braun, V., Clarke, V., Hayfield, N., & Terry, G. (2019). Thematic Analysis. Handbook of Research Methods in Health Social Sciences, 843–860. doi:10.1007/978-981-10-5251-4_103

Herawati, A., Negeri, U., Suseno, J. M., Siti, J., & Sulistyaningrum, D. (2021). Evaluation of higher education learning management system usability using system usability scale. In UHAMKA International Conference on ELT and CALL (UICELL) (Vol. 2, pp. 2-3).


Crossmark Updates

How to Cite

Muhammad, Z. T., Kawu, A. A. ., Abdullahi, I., & Bawa, M. (2023). Usability Evaluation of Mobile USSD-SMS Interactive Result Checking System for Resource-Constrained Settings (MIRCS) using System Usability Score (SUS). Sinkron : Jurnal Dan Penelitian Teknik Informatika, 8(2), 1172-1180.