UX Evaluation Using Firstclick, Performance Measurement, RTA, And Questionnaire On E-Commerce Website


  • I Made Candiasa Program Pascasarja, Universitas Pendidikan Ganesha, Indonesia
  • I Gede Aris Gunadi Program Pascasarja, Universitas Pendidikan Ganesha, Indonesia
  • I Nyoman Wahyu Semeru Putra Program Pascasarja, Universitas Pendidikan Ganesha, Indonesia




User Experience, Firstclick, Performance Measurement, Retrospective Think Aloud, Questionnaire


E-commerce has made transactions easier for several persons. SKI (Semadi Kwazay Indoland), a company in the real estate market, is one of the numerous organizations that develop e-commerce websites. The company wants the e-commerce website to attract a wider audience. Therefore, an evaluation is necessary to measure the usefulness of the website. Twenty responses were divided into two groups of ten: the advanced group and the novice group. The selected assessment approaches are performance measurement to evaluate the system's efficiency and error rate, first-click usability testing to evaluate the system's effectiveness, and RTA and the SUS questionnaire to evaluate user happiness. The following are the study's findings: This e-commerce website is quite efficient, as there is no significant difference in the time necessary to complete the 10 activities between the two groups of respondents. The mean participant questionnaire score for the e-commerce website was 49.75, which was much lower than the average SUS score of 68. The e-commerce website page is highly effective, as the performance measurement test results suggest a comparatively low error rate across both novice and advanced respondent groups.

GS Cited Analysis


Download data is not yet available.


Alhadreti, O., & Mayhew, P. (2016). “Thinking about thinking aloud”: An investigation of think-aloud methods in usability testing. Proceedings of the 30th International BCS Human Computer Interaction Conference 30, 1–3.

Blattgerste, J., Behrends, J., & Pfeiffer, T. (2022). A Web-Based Analysis Toolkit for the System Usability Scale. Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments, 237–246.

Fan, M., Lin, J., Chung, C., & Truong, K. N. (2019). Concurrent think-aloud verbalizations and usability problems. ACM Transactions on Computer-Human Interaction (TOCHI), 26(5), 1–35.

Hasibuan, N., & Putri, R. A. (2022). Usability Evaluation of Wedding Administrative Information System using System Usability Scale. Sinkron: Jurnal Dan Penelitian Teknik Informatika, 7(4), 2198–2207.

Iqbal, T., & Bahruni, B. (2019). Evaluasi Usability Test e-Repository dengan menggunakan Metode Nielsen’s Attributtes of Usability (NAU). Jurnal JTIK (Jurnal Teknologi Informasi Dan Komunikasi), 3(2), 40–45.

Jain, S., & Purandare, P. (2021). Study of the Usability Testing of E-Commerce Applications. Journal of Physics: Conference Series, 1964(4), 42059.

Kumaresh, S., Haran, R., & Jarret, M. M. (2021). Analytics of e-commerce platforms based on user-experience (UX). In Intelligent Computing and Innovation on Data Science (pp. 309–318). Springer.

Liapis, A., Katsanos, C., Xenos, M., & Orphanoudakis, T. (2019). Effect of personality traits on UX evaluation metrics: a study on usability issues, valence-arousal and skin conductance. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 1–6.

Liu, L., Cruz, A. M., & Rincon, A. M. R. (2019). Technology acceptance, adoption, and usability: arriving at consistent terminologies and measurement approaches. In Everyday technologies in healthcare (pp. 319–338). CRC Press.

Permana, A. A. J. (2019). Usability Testing Pada Website E-Commerce Menggunakan Metode System Usability Scale (Sus)(Studi Kasus: Umkmbuleleng. Com). JST (Jurnal Sains Dan Teknologi), 8(2), 149–158.

Ritonummi, S., & Niininen, O. (2021). User experience of an e-commerce website: A case study. In Contemporary Issues in Digital Marketing (pp. 61–71). Routledge.

Saputra, D., Syah, E. A., & Darnis, F. (2022). Usability Testing on the Simponik Website using the System Usability Scale (SUS). Sinkron: Jurnal Dan Penelitian Teknik Informatika, 7(4), 2584–2592.

Soleimani, S. (2019). Automatic Analysis of Voice Emotions in Think Aloud Usability Evaluation: A Case of Online Shopping. University of Leicester.

Utami, N. W., Arthana, I. K. R., & Darmawiguna, I. G. M. (2020). Evaluasi Usability Pada E-Learning Universitas Pendidikan Ganesha Dengan Metode Usability Testing. Jurnal Nasional Pendidikan Teknik Informatika: JANAPATI, 9(1), 107–118.

Wahyuningrum, T., Kartiko, C., & Wardhana, A. C. (2020). Exploring e-Commerce Usability by Heuristic Evaluation as a Compelement of System Usability Scale. 2020 International Conference on Advancement in Data Science, E-Learning and Information Systems (ICADEIS), 1–5.

Wang, J., Antonenko, P., Celepkolu, M., Jimenez, Y., Fieldman, E., & Fieldman, A. (2019). Exploring relationships between eye tracking and traditional usability testing data. International Journal of Human–Computer Interaction, 35(6), 483–494.


Crossmark Updates

How to Cite

Candiasa, I. M. ., Gunadi, I. G. A. ., & Putra, I. N. W. S. . (2023). UX Evaluation Using Firstclick, Performance Measurement, RTA, And Questionnaire On E-Commerce Website. Sinkron : Jurnal Dan Penelitian Teknik Informatika, 8(1), 451-460. https://doi.org/10.33395/sinkron.v8i1.12037