System Usability Scale in Information System Application Development Using Systematic Mapping Study
Keywords:
Information System, Systematic Mapping Study, System Evaluation, System Usability Scale, User ExperienceAbstract
The System Usability Scale (SUS) is a widely used usability evaluation method due to its simplicity and reliability. However, no study has systematically mapped the application of SUS in information system applications. This research aims to conduct a Systematic Mapping Study (SMS) to analyze the use of SUS in 30 international journals indexed in SpringerLink during the 2021–2025 period, focusing on publication trends, application domains, number and types of respondents, respondent criteria, and SUS score results. After the screening process, 28 relevant articles were identified, of which 14 directly employed SUS. The mapping results indicate that the technology domain dominates the application of SUS, with most respondents being general application users, while publication trends show fluctuations with a peak in 2025. These findings are consistent with the research objective, namely to provide a comprehensive overview of SUS usage patterns. The novelty of this study lies in mapping respondent characteristics and variations in SUS scores within the context of information system applications, which has not been systematically mapped before. The results are expected to serve as both an academic reference and practical guidance for developers and researchers in improving system design based on user experience.
References
A. M. Deshmukh and R. Chalmeta, “Validation of system usability scale as a usability metric to evaluate voice user interfaces,” PeerJ Comput Sci, vol. 10, 2024, doi: 10.7717/peerj-cs.1918.
A. Nagy, Y. Spyridis, G. J. Mills, and V. Argyriou, "User Experience Evaluation of AR Assisted Industrial Maintenance and Support Applications," arXiv preprint, Oct. 2024, [Online]. Available: https://arxiv.org/abs/2410.17348
AlGhannam, B. A., Al-Zubidi, R. T., Albqami, M., & Aldossary, A. (2018). Towards a standard Arabic System Usability Scale: Psychometric evaluation using communication-disorder app. International Journal of Human–Computer Interaction,?34(9),?799–804. https://doi.org/10.1080/10447318.2017.1417843
Alam, R. G. G., & Kurniasih, P. R. (2024). Use of the System Usability Scale (SUS) Method in the SIMAMURAT Application. Journal Scientific and Applied Informatics (JSAI),?7(2),?14-26 https://doi.org/10.36085/jsai.v7i2.6209
Andriyani, R., & Sari, A. O. (2023). Penerapan Metode System Usability Scale Untuk Evaluasi Sistem Informasi E-Procurement. JoMMiT?: Jurnal Multi Media Dan IT, 7(2), 064–069. https://doi.org/10.46961/jommit.v7i2.902
Apriyanthi, N. P. E., Mentayani, N. P. A., Gunawan, I. M. A., & Indrawan, G. (2024). Evaluasi Usability Dengan Pendekatan System Usability Scale (SUS) Pada Aplikasi TMHub. Jurnal Teknologi Komputer dan Sistem Informasi (JTKSI),?7(1),?23-29 https://doi.org/10.56327/jtksi.v7i1.1600
Bangor, A., Kortum, P., & Miller, J. (2008). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies,?4(3),?114–123.
Bilung, M., Maharani, S., & Khairina, D. M. (2023). Analisis Kepuasan Pengguna Sistem Informasi Terpadu Layanan Program Studi (SIPLO) Menggunakan System Usability Scale (SUS). Adopsi Teknologi Dan Sistem Informasi (ATASI), 2(2), 89–97. https://doi.org/10.30872/atasi.v2i2.387
Borsci, S., Federici, S., & Lauriola, M. (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive Processing,?10(3),?193–197. https://doi.org/10.1007/s10339-009-0345-z
C. R. Uva, L. Tori, and G. Manghisi, "Augmented Reality in Industry: A Systematic Review of Recent Applications," Electronics, vol. 13, no. 6, p. 1147, 2025, doi: 10.3390/electronics13061147.
Dutta, R., Mantri, A., & Singh, G. (2022). Evaluating system usability of mobile augmented reality application for teaching Karnaugh-Maps. Smart Learning Environments, 9(1), 6. https://doi.org/10.1186/s40561-022-00189-8
Fiandhika, M. F., & Kelana, B. (2024). System Usability Scale Validation from the Expert Perspective. E3S Web of Conferences,?483,?03008. https://doi.org/10.1051/e3sconf/202448303008
Fuller Tyszkiewicz, M., Richardson, B., Klein, B., Skouteris, H., Christensen, H., Austin, D., & Hyzy, M. (2022). System usability scale scores for digital health apps: Meta analysis (preprint). JMIR Preprints. https://doi.org/10.2196/preprints.37290
Grier, R. A., Bangor, A., Kortum, P., & Peres, S. C. (2013). The System Usability Scale: Beyond Standard Usability Testing. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57(1), 546–550.
Hyzy, M., Bond, R., Mulvenna, M., Bai, L., Dix, A., Leigh, S., & Hunt, S. (2022). System Usability Scale Benchmarking for Digital Health Apps: Meta analysis. JMIR mHealth and uHealth,?10(8),?e37290. https://doi.org/10.2196/37290
K. N. Sari and Y. S. Nugroho, Systematic Mapping Study Terhadap Penerapan System Usability Scale Untuk Evaluasi Tingkat Kegunaan Perangkat Lunak, Serima-CE, vol. 1, no. 1, pp. –, 2023. [Online]. Available: https://jurnal.unissula.ac.id/index.php/serima/article/download/30665/9437
Kiki Nur Indah Sari, Yusuf Sulistyo Nugroho. "Systematic Mapping Study Terhadap Penerapan System Usability Scale Untuk Evaluasi Tingkat Kegunaan Perangkat Lunak." Seminar Riset Mahasiswa – Computer & Electrical (SERIMA-CE), Vol. 1, No. 1, 2023
Kurniawan, S. S., Maharani, N. Z., Sensuse, D., & Purwaningsih, E. H. (2025). Applying User-Centered Design and System Usability Scale to Design Knowledge Management System for Exam Proctors in Higher Education. Scientific Journal of Informatics,?11(4),?1043–1056. https://doi.org/10.15294/sji.v11i4.9919
Lewis, J. R., & Sauro, J. (2009). The Factor Structure of the System Usability Scale (pp. 94–103). https://doi.org/10.1007/978-3-642-02806-912
M. Hinggi, R. Bond, M. Mulvenna, A. Dix, and S. Hunt, "System Usability Scale Benchmarking for Digital Health Apps: A Meta-analysis," Journal of Medical Internet Research, vol. 24, no. 8, p. e37290, Aug. 2022, doi: 10.2196/37290.
M. Hyzy, R. Bond, M. Mulvenna, L. Bai, A. Dix, S. Leigh, and S. Hunt, "System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis," JMIR mHealth and uHealth, vol. 10, no. 8, p. e37290, 2022, doi: 10.2196/37290.
M. K. Anam, S. Susanti, N. Nurjayadi, F. Zoromi, and A. K. Sari, “Evaluation of An Existing System Using The System Usability Scale (SUS) as A Guideline for System Improvement,” JURNAL TEKNIK INFORMATIKA, vol. 18, no. 1, pp. 122–132, Apr. 2025, doi: 10.15408/jti.v18i1.40766.
Maulana, A. E. (2024b). Evaluasi Aplikasi DOI by RJI pada Aspek Usability dan User Experiance Menggunakan Metode System Usability Scale (SUS) dan User Experience Questionnaire (UEQ). Explorer, 4(2), 106–114. https://doi.org/10.47065/explorer.v4i2.1478
Mulia Sulistiyono, H. D. Prajoto, & Bernadhed (2023). Evaluating the User-Friendliness of a Mobile Application for Outpatient Food Monitoring: A System Usability Scale (SUS) Approach. Jurnal Riset Informatika, 6(1), 29–36. https://doi.org/10.34288/jri.v6i1.264
Nagy, A., Spyridis, Y., Mills, G. J., & Argyriou, V. (2024). User Experience Evaluation of AR Assisted Industrial Maintenance and Support Applications. arXiv preprint, Oct 22, 2024.
Nur Indah Sari, K., & Sulistyo Nugroho, Y. (2023). Systematic Mapping Study Terhadap Penerapan System Usability Scale Untuk Evaluasi Tingkat Kegunaan Perangkat Lunak. In Seminar Riset Mahasiswa-Computer & Electrical (SERIMA-CE (Vol. 1, Issue 1).
Ozzi Suria. "A Statistical Analysis of System Usability Scale (SUS) Evaluations in Online Learning Platform." Journal of Information Systems and Informatics, Vol. 6, No. 2, June 2024, doi: 10.51519/journalisi.v6i2.750
Parera, G., & Darwis, M. (2023). Usability of JKN Mobile Application Using System Usability Scale (SUS) Method. bit Tech, 5(3), 138–145. https://doi.org/10.32877/bt.v5i3.691
Putra, R. R., Yasirandi, R., & Matradipti, M. M. Q. (2024). Evaluation of Travel App’s Usability Using the System Usability Scale Method. Scientific Journal of Informatics,?11(2),?439–450. https://doi.org/10.15294/sji.v11i2.4509
Q. Khan et al., “Psychometric evaluation of the System Usability Scale in the context of a childrearing app co-designed for low- and middle-income countries,” Digit Health, vol. 11, Jan. 2025, doi: 10.1177/20552076251335413.
R. Sousa and K. Dunn Lopez, “Towards Usable E-Health: A Systematic Review of Usability Questionnaires,” Applied Clinical Informatics, vol. 8, no. 2, pp. 470–490, 2017. [Online]. Available: https://www.ncbi.nlm.nih.gov/articles/PMC6241759/
Rahmawati, S. D., & Prasetiyo, B. (2024). Application of Lean UX and System Usability Scale (SUS) Methods in Redesigning User Interface and User Experience on Adella Hospital Online Registration Website. Journal of Advances in Information Systems and Technology,?6(2), 41 (Article 2430).
Revi Raka Putra, R., Yasirandi, R., & Matradipti, M. M. Q. (2024). Evaluation of Travel App’s Usability Using the System Usability Scale Method. Scientific Journal of Informatics, 11(2), 439–450. https://doi.org/10.15294/sji.v11i2.4509
Rowi, S., & Achmadi, F. (2024). Usability Test Using the System Usability Scale in the Industrial Engineering Laboratory Universitas X Indonesia. Jurnal Teknik Industri UMC,?4(1),?39–46. https://doi.org/10.33479/sakti.v4i1.89
S. S. Kurniawan, N. Z. Maharani, D. Sensuse, and E. H. Purwaningsih, "Applying User-Centered Design and System Usability Scale to Design Knowledge Management System for Exam Proctors in Higher Education," Scientific Journal of Informatics, vol. 11, no. 4, pp. 1043–1056, 2025, doi: 10.15294/sji.v11i4.9919.
S. Almasi, K. Bahaadinbeigy, H. Ahmadi, and R. Rabiei, “Usability Evaluation of Dashboards: A Systematic Literature Review of Tools,” BioMed Research International, vol. 2023, Article ID 9990933, 2023. [Online]. Available: https://www.ncbi.nlm.nih.gov/articles/PMC9977530/
Sari, M. A., & Tania, K. D. (2021). Usability Evaluation in Knowledge Management System (KMS) Using System Usability Scale (SUS) Method. International Journal of Informatics and Computer Science (IJICS),?6(3),?119–125. https://doi.org/10.30865/ijics.v6i3.4244
Sauro, J., & Lewis, J. R. (2018). The System Usability Scale: Past, Present, and Future. International Journal of Human–Computer Interaction,?34(7),?577–590. https://doi.org/10.1080/10447318.2018.1455307
Silvia & Rahayu Amalia. (2025). Implementation of Usability Scale System in TikTok Usability Evaluation. Journal Scientific and Applied Informatics (JSAI), 8(1), 1 10. https://doi.org/10.36085/jsai.v8i1.7720
Suharsih, R., Febriani, R., & Triputra, S. (2024). Usability of Jawara Sains Mobile Learning Application Using System Usability Scale (SUS). Jurnal Online Informatika (JOIN), 6(1), – 75.45 (skor SUS, B grade). https://doi.org/10.15575/join.v6i1.700
Setiawan, D., & Wicaksono, S. L. (2020). Evaluasi Usability Google Classroom Menggunakan System Usability Scale. Walisongo Journal of Information Technology, 2(1), 71. https://doi.org/10.21580/wjit.2020.2.1.5792
Setiyawati, N., & Bangkalang, D. H. (2022). The Comparison of Evaluation on User Experience and Usability of Mobile Banking Applications Using User Experience Questionnaire and System Usability Scale. Proceedings of International Academic Symposium of Social Science, 82(1), 87. https://doi.org/10.3390/proceedings2022082087
Thamilarasan, Y., Ikram, R. R. R., Osman, M., Salahuddin, L., Bujeri, W. Y. W., & Kanchymalay, K. (2023). Enhanced System Usability Scale using the Software Quality Standard Approach. Engineering, Technology & Applied Science Research,?13(5),?11779–11784. https://doi.org/10.48084/etasr.5971
