Evaluation of the M-Paspor App as a Public Service: A Sentiment Analysis

Ignatius Novianto Hariwibowo; Wimpie Yustino Setiawan

doi:10.24198/jmpp.v10i1.68645

Evaluation of the M-Paspor App as a Public Service: A Sentiment Analysis

Ignatius Novianto Hariwibowo, Wimpie Yustino Setiawan

Abstrak

This study is purposed to evaluate the public service performance of the Immigration Office’s M-Passport application using sentiment analysis. This study implemented the data of comments or customer reviews from the Google Play Store. A web scraping technique was employed to collect data, with a total number of 12,138 comments collected. Sentiment analysis was applied to identify and label positive and negative comments. In order to ensure the labeling results, a model test was carried out to confirm the accuracy level. The findings show that 69.1 % comments are negative and 30.9% are positive. The model testing results indicated a more than 80% accuracy level based on the Naive Bayes algorithm, Random Forest, Logistic Regression, and Decision Tree. The results showed that the majority of users are not satisfied with the service, indicating that the system performance of M-Passport has not satisfied user expectations.

Kata Kunci

Public Service; M-Paspor; Sentiment Analysis

Teks Lengkap:

PDF (English)

Referensi

Abouelela, M., Tirachini, A., Chaniotakis, E., & Antoniou, C. (2025). Why do passengers use pooled-rides services? Social effects and implications for policy making. Travel Behaviour and Society, 41, 101072. https://doi.org/10.1016/j.tbs.2025.101072

Azzami, D. R., Baenil Huda, Agustia Hananto, & Tukino. (2025). Analysis of User Comment Sentiment on the Siwaslu Application Using the Naive Bayes Method. Journal of Artificial Intelligence and Engineering Applications (JAIEA), 4(3), 2235–2240. https://doi.org/10.59934/jaiea.v4i3.1132

Bahasoan, A. (2024). Public Service Transformation: Innovative Strategies of Ambon City Government Towards Openness and Public Satisfaction. Jurnal Manajemen Pelayanan Publik, 8(2), 345-358. https://doi.org/10.24198/jmpp.v8i2.52436

Bressolles, G., Durrieu, F., & Senecal, S. (2014). A consumer typology based on e-service quality and e-satisfaction. Journal of Retailing and Consumer Services, 21(6), 889–896. https://doi.org/10.1016/j.jretconser.2014.07.004

Chatterjee, R., & Suy, R. (2019). An Overview of Citizen Satisfaction with Public Service: Based on the Model of Expectancy Disconfirmation. Open Journal of Social Sciences, 07(04), 243–258. https://doi.org/10.4236/jss.2019.74019

Chen, T., Guo, W., Gao, X., & Liang, Z. (2021). AI-based self-service technology in public service delivery: User experience and influencing factors. Government Information Quarterly, 38(4), 101520. https://doi.org/10.1016/j.giq.2020.101520

Claudia, & Lestari, D. P. (2024). User-Centered Interaction Design for Indonesia’s E-Government Passport Application: The M-Paspor Indonesia Case Study. 2024 IEEE International Conference on Data and Software Engineering (ICoDSE), 235–240. https://doi.org/10.1109/ICoDSE63307.2024.10829902

Filtenborg, A. F., Gaardboe, F., & Sigsgaard-Rasmussen, J. (2017). Experimental replication: an experimental test of the expectancy disconfirmation theory of citizen satisfaction. Public Management Review, 19(9), 1235–1250. https://doi.org/10.1080/14719037.2017.1295099

Giri Van Transco, & Asti Herliana. (2025). Public Sentiment Analysis on Police Service Satisfaction Using Twitter Dataset Based on NLP and SVM. Journal of Artificial Intelligence and Engineering Applications (JAIEA), 4(3), 2222–2229. https://doi.org/10.59934/jaiea.v4i3.1139

Grimmelikhuijsen, S., & Porumbescu, G. A. (2017). Reconsidering the expectancy disconfirmation model. Three experimental replications. Public Management Review, 19(9), 1272–1292. https://doi.org/10.1080/14719037.2017.1282000

Guo, Y. (2024). Digital Government and Public Interaction. IGI Global. https://doi.org/10.4018/979-8-3693-3665-6

Guy, M.E., & Ely, T.L. (2018). Essentials of Public Service: An Introduction to Contemporary Public Administration. Melvin & Leigh, Publishers.

Hadwan, M., Al-Sarem, M., Saeed, F., & Al-Hagery, M. A. (2022). An Improved Sentiment Classification Approach for Measuring User Satisfaction toward Governmental Services’ Mobile Apps Using Machine Learning Methods with Feature Engineering and SMOTE Technique. Applied Sciences, 12(11), 5547. https://doi.org/10.3390/app12115547

Jin, Y., Cheng, K., Wang, X., & Cai, L. (2023). A Review of Text Sentiment Analysis Methods and Applications. Frontiers in Business, Economics and Management, 10(1), 58–64. https://doi.org/10.54097/fbem.v10i1.10171

Kowalski, R., Esteve, M., & Jankin Mikhaylov, S. (2020). Improving public services by mining citizen feedback: An application of natural language processing. Public Administration, 98(4), 1011–1026. https://doi.org/10.1111/padm.12656

Morgeson, F. V. (2013). Expectations, Disconfirmation, and Citizen Satisfaction with the US Federal Government: Testing and Expanding the Model. Journal of Public Administration Research and Theory, 23(2), 289–305. https://doi.org/10.1093/jopart/mus012

Oliver, R. L. (1980). A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions. Journal of Marketing Research, 17(4), 460–469. https://doi.org/10.1177/002224378001700405

Pratama, I. R., Cahyana, Y., Rahmat, & Wahiddin, D. (2025). Model Machine Learning Untuk Analisis Sentimen Masyarakat Terhadap Kenaikan PPN di Media Sosial X. Bulletin of Computer Science Research, 5(4), 277–286.

Pratama, R. A., & Utami, D. A. (2023). Effectiveness of M-Paspor Applications in Aspects of Public Service and E-government. Jurnal Ilmiah Kajian Keimigrasian, 6(1), 109–118. https://doi.org/10.52617/jikk.v6i1.380

Priyanto, H. (2024). Public Service Quality in Banyuwangi District: A Study in Welfare Perspective. Jurnal Manajemen Pelayanan Publik, 8(1), 77-94. https://doi.org/10.24198/jmpp.v8i1.48657

Rabbani, M., & Fajar, A. N. (2024). A Comprehensive Examination of User Satisfaction in Indonesian Passport Services: Insights from the M Paspor Application. Article in Journal of Theoretical and Applied Information Technology, 15(5). https://www.researchgate.net/publication/379052755

Rahayu, A. I., & Kacung, S. (2025). Sentiment Analysis of Online Lending Services Using Support Vector Machine and Logistic Regression. Bulletin of Computer Science Research, 5(5), 447–455.

Reddick, C.G., & Demir, T. (2024). Handbook Of Public Service Delivery. Edward Elgar Publishing.

Saputra, J. P. B., & Kumar, A. (2025). Emotion Detection in Railway Complaints Using Deep Learning and Transformer Models: A Data Mining Approach to Analyzing Public Sentiment on Twitter. Journal of Digital Society, 1(2).

Sǎvescu, A. R., Mazurencu-Marinescu-Pele, M., Conda, A.-I., Bolovǎneanu, V., & Pele, D. T. (2025). Infodemic insights: Mapping COVID-19’s digital discourse in Romania. Management & Marketing, 20(1), 15–34. https://doi.org/10.2478/mmcks-2025-0003

Shafritz, J.M., Russell, E.W., Borick, C.P., & Hyde, A.C. (2016). Introducing Public Administration. Taylor & Francis.

Shao, K., & Wang, X. (2023). Do government subsidies promote enterprise innovation?——Evidence from Chinese listed companies. Journal of Innovation & Knowledge, 8(4), 100436. https://doi.org/https://doi.org/10.1016/j.jik.2023.100436

Stahl, M.M. (2022). The Promise of Public Service: Ideas and Examples for Effective Service. Taylor & Francis.

Van Ryzin, G. G. (2013). An Experimental Test of the Expectancy-Disconfirmation Theory of Citizen Satisfaction. Journal of Policy Analysis and Management, 32(3), 597–614. https://doi.org/10.1002/pam.21702

Wang, C. (2025). Text Mining for Mental Disease Screening for Social Network Users (pp. 19–27). https://doi.org/10.2991/978-2-38476-422-8_4

Yaziji, W., Aprilia, R., Sensuse, D. I., Lusa, S., & Wibowo, P. A. (2023). Assessing Service Quality in Passport Application Mobile Apps(M-Paspor) and its Influence on User Satisfaction. Indonesian Journal of Computer Science, 12(6). https://doi.org/10.33022/ijcs.v12i6.3545

Zhang, J., Chen, W., Petrovsky, N., & Walker, R. M. (2022). The Expectancy‐Disconfirmation Model and Citizen Satisfaction with Public Services: A Meta‐analysis and an Agenda for Best Practice. Public Administration Review, 82(1), 147–159. https://doi.org/10.1111/puar.13368

Zharif Mustaqim, I., Melani Puspasari, H., Tri Utami, A., Syalevi, R., & Ruldeviyani, Y. (2024). Assessing public satisfaction of public service application using supervised machine learning. IAES International Journal of Artificial Intelligence (IJ-AI), 13(2), 1608. https://doi.org/10.11591/ijai.v13.i2.pp1608-1618

DOI: https://doi.org/10.24198/jmpp.v10i1.68645