SIGNAL App Review Sentiment Analysis using Support Vector Machine (SVM) on Google Play Store Comments

Moch Panji Agung Saputra; Muhammad Bintang Eighista Dwiputra

doi:10.47194/orics.v6i1.366

Authors

Moch Panji Agung Saputra
moch16006@mail.unpad.ac.id
Department of Mathematics, Universitas padjadjaran
Muhammad Bintang Eighista Dwiputra

Abstract

The SIGNAL (National Digital Samsat) application is a digital innovation that makes it easier to pay motor vehicle taxes in Indonesia. This study aims to analyze user sentiment towards the SIGNAL application through reviews on the Google Play Store, using Support Vector Machine (SVM) as a classification method. The analysis process includes the stages of review data collection, pre-processing (text cleaning, tokenization, stopword removal, and stemming), text transformation to numeric features using Term Frequency-Inverse Document Frequency (TF-IDF), and SVM model training. The dataset is taken from 10,000 of the latest reviews consisting of reviews classified into three sentiment categories: positive, negative, and neutral. The evaluation results show that the SVM model has a high accuracy of 91%, with consistent precision, recall, and F1-score values in each sentiment category. Positive sentiment dominates reviews (59%), followed by negative sentiment (33.8%) and neutral (7.2%). This analysis provides valuable insights for developers to improve the quality of applications, especially in understanding user needs and expectations.

References

Afriani, L., Permana, I., Muliasari, D., & Khasanah, U. (2023). The Role of The Use of Information Technology in Orderly Financial Administration and Tax Compliance in Digital Business. IJESS International Journal of Education and Social Science, 4(2), 105-113.

Bhirud, S. K., Bhagvat, K. D., Marathe, A. P., Rajput, J. A., & Kotwal, H. R. (2019). Stop word removal of English text documents based on finite automata. IJSRD - International Journal for Scientific Research & Development, 7(4), 39.

Devaranti, S., Murodi, H. A., & Machrunnisa, M. (2023). Innovation of motor vehicle tax services through SIGNAL app (National Digital Samsat) at UPTD Balaraja Samsat Office Tangerang District. Jurnal Administrasi Negara, 29(2).

Fauzy, M. I., & Abdulloh, F. F. (2024). Sentiment Analysis of Online Vehicle Tax Renewal Application Users Using Support Vector Machine Algorithm. Journal of Applied Informatics and Computing, 8(2), 516-522.

Husada, H. C., & Paramita, A. S. (2021). Analisis Sentimen Pada Maskapai Penerbangan di Platform Twitter Menggunakan Algoritma Support Vector Machine (SVM). Teknika, 10(1), 18-26.

Husain, N. P., & Kadir, M. I. (2024). The Oyster Mushroom Harvesting Determination System Based On Image Processing and Multi Layer Perceptron. Sinkron: jurnal dan penelitian teknik informatika, 8(4), 2212-2221.

Ihdini, M. H., & Sari, I. R. (2023). The Effect of Tax Socialization, Taxpayer Awareness and Implementation of E-SAMSAT on Taxpayer Compliance Motor Vehicle: Taxes Socialization; Taxpayer Awareness; Application of E SAMSAT; Motorized Vehicles Taxpayer Compliance. Jurnal Penelitian Ekonomi Dan Akuntansi, 8(3).

Jianqiang, Z., & Xiaolin, G. (2017). Penelitian perbandingan metode pra-pemrosesan teks pada analisis sentimen Twitter. Akses IEEE , 5 , 2870-2879.

Kustyana, E., Prasetyo, E., Nurfauziah, S., Azahra, W. A., & Nanda, Z. (2024). Sentiment Analysis of MyPertamina on Google Play Store Using Naïve Bayes for Sustainable Policies. Jurnal Dialektika: Jurnal Ilmu Sosial, 22(3), 297-311.

Ladani, D. J., & Desai, N. P. (2020, March). Stopword identification and removal techniques on tc and ir applications: A survey. In 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS) (pp. 466-472). IEEE.

Martha, A., & Jayadi, R. (2025). Factors influencing adoption of mobile government services: Evidence from Indonesia's vehicle registration application. Journal of System and Management Sciences, 15(1), 243–253.

Mudjiyanti, R., Purnadi, P., Wardani, S., & Kusbandiyah, A. (2022). Analysis of Motor Vehicle Tax Payment Compliance at Samsat Banyumas Regency. Innovation Business Management and Accounting Journal, 1(3), 65-71.

Powers, D. M. (2020). Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv preprint arXiv:2010.16061.

Saeik, F., Avgeris, M., Spatharakis, D., Santi, N., Dechouniotis, D., Violos, J., ... & Papavassiliou, S. (2021). Task offloading in Edge and Cloud Computing: A survey on mathematical, artificial intelligence and control theory solutions. Computer Networks, 195, 108177.

Saputri, R., & Mutiarin, D. (2024). Impact of NEW SAKPOLE on Original Local Government Revenue Post-COVID-19: A Case Study of Central Java Province BAPENDA. Scientific Journal of Informatics, 11(2), 523-538.

Singh, J., & Gupta, V. (2016). Text stemming: Approaches, applications, and challenges. ACM Computing Surveys (CSUR), 49(3), 1-46.

Tan, K. L., Lee, C. P., & Lim, K. M. (2023). A survey of sentiment analysis: Approaches, datasets, and future research. Applied Sciences, 13(7), 4550.

Vijayarani, S., & Janani, R. (2016). Text mining: open source tokenization tools-an analysis. Advanced Computational Intelligence: An International Journal (ACII), 3(1), 37-47.