Sentiment Analysis of Fintech Application Users in Indonesia Using Machine Learning Algorithms
DOI:
https://doi.org/10.62123/aqila.v3i1.171Keywords:
Sentiment Analysis, Machine Learning, Fintech, Natural Language Processing, Indonesian Text, Support Vector MachineAbstract
This study focuses on Indonesian users' sentiments regarding 9 fintech apps based on their Google Play Store reviews. The rapid growth of the fintech industry in Indonesia makes it crucial to understand user perceptions and satisfaction. Around 2,554 reviews from users of Kredivo, ShopeePay, Dana, GoPay, LinkAja, Bareksa, Flip, Jenius, and OVO were analyzed. The user review text and data were preprocessed using text cleaning, slang normalization, stopword removal, stemming, and the Sastrawi library and were moved through the TF-IDF vectorizer (term frequency-inverse document frequency). The four algorithms were Naive Bayes, Logistic Regression, Support Vector Machine (SVM), and Random Forest. The results showed that SVM (Linear) achieved the best overall balanced performance with an accuracy of 80.23%, precision of 77.79%, recall of 80.23%, and the highest F1-score of 78.53%, outperforming Naive Bayes (accuracy 81.21%, F1-score 78.32%), Logistic Regression (accuracy 80.43%, F1-score 77.81%), and Random Forest (accuracy 78.08%, F1-score 75.81%). While Naive Bayes recorded the highest raw accuracy, SVM was selected as the best model due to its superior F1-score, which provides a more balanced evaluation across all sentiment classes. Machine learning provided a snapshot of the reviews’ sentiments, with 42.4% positive, 51.4% negative, and 6.1% neutral. Kredivo and ShopeePay had the most favorable sentiments of 72.4% and 70.9%. The most salient sentiment indicators include 'bagus' (good) and 'bantu' (help) as top positive classifiers, while 'buruk' (bad) and 'kecewa' (disappointed) emerged as the most prominent negative classifiers, with 'mudah' (easy) and 'cepat' (fast) also strongly associated with positive sentiment. The results of this study give fintech firms a better grasp of user satisfaction, and fintech user positive sentiments.
References
[1] D. P. Nugraha, B. Setiawan, R. J. Nathan, and M. Fekete-Farkas, “Fintech Adoption Drivers for Innovation for SMEs in Indonesia,” Journal of Open Innovation: Technology, Market, and Complexity, vol. 8, no. 4, Dec. 2022, doi: 10.3390/joitmc8040208.
[2] B. Setiawan, T. D. Phan, J. Medina, M. Wieriks, R. J. Nathan, and M. Fekete-Farkas, “Quest for financial inclusion via digital financial services (Fintech) during COVID-19 pandemic: case study of women in Indonesia,” Journal of Financial Services Marketing, vol. 29, no. 2, pp. 459–473, Jun. 2024, doi: 10.1057/s41264-023-00217-9.
[3] A. D. Widiantoro, A. Wibowo, and B. Harnadi, “User Sentiment Analysis in the Fintech OVO Review Based on the Lexicon Method,” in 2021 6th International Conference on Informatics and Computing, ICIC 2021, Institute of Electrical and Electronics Engineers Inc., 2021. doi: 10.1109/ICIC54025.2021.9632909.
[4] R. Nurcahyo, A. S. Prabuwono, A. F. Fainusa, N. Wibowo, M. Habiburrahman, and K. Hindriyandhito, “Enhancing User Satisfaction in Indonesia’s e-wallet Market: A Comprehensive Analysis of Factors and Priorities,” Hum. Behav. Emerg. Technol., vol. 2023, 2023, doi: 10.1155/2023/8864865.
[5] W. A. Deviani, K. Kusumahadi, and E. Nurhazizah, “Service Quality For Digital Wallet In Indonesia Using Sentiment Analysis And Topic Modelling,” International Journal of Business and Technology Management, Apr. 2022, doi: 10.55057/ijbtm.2022.4.1.6.
[6] B. Setiawan, “A Review of Sentiment Analysis Applications in Indonesia Between 2023-2024,” 2024.
[7] P. Nandwani and R. Verma, “A review on sentiment analysis and emotion detection from text,” Dec. 01, 2021, Springer. doi: 10.1007/s13278-021-00776-6.
[8] J. Singh, G. Singh, and R. Singh, “Optimization of sentiment analysis using machine learning classifiers,” Human-centric Computing and Information Sciences, vol. 7, no. 1, Dec. 2017, doi: 10.1186/s13673-017-0116-3.
[9] J. Hartmann, M. Heitmann, C. Siebert, and C. Schamp, “More than a Feeling: Accuracy and Application of Sentiment Analysis,” International Journal of Research in Marketing, vol. 40, no. 1, pp. 75–87, Mar. 2023, doi: 10.1016/j.ijresmar.2022.05.005.
[10] C. H. Lin and U. Nuha, “Sentiment analysis of Indonesian datasets based on a hybrid deep-learning strategy,” J. Big Data, vol. 10, no. 1, Dec. 2023, doi: 10.1186/s40537-023-00782-9.
[11] S. Liang, “The Future of Finance: Fintech and Digital Transformation,” 2023.
[12] D. Tiwari, B. Nagpal, B. S. Bhati, A. Mishra, and M. Kumar, “A systematic review of social network sentiment analysis with comparative study of ensemble-based techniques,” Artif. Intell. Rev., vol. 56, no. 11, pp. 13407–13461, Nov. 2023, doi: 10.1007/s10462-023-10472-w.
[13] W. Zhang, X. Li, Y. Deng, L. Bing, and W. Lam, “A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges,” Nov. 2022, [Online]. Available: http://arxiv.org/abs/2203.01054
[14] Y. C. Hua, P. Denny, J. Wicker, and K. Taskova, “A systematic review of aspect-based sentiment analysis: domains, methods, and trends,” Artif. Intell. Rev., vol. 57, no. 11, Nov. 2024, doi: 10.1007/s10462-024-10906-z.
[15] J. Ipmawati, S. Saifulloh, and K. Kusnawi, “Analisis Sentimen Tempat Wisata Berdasarkan Ulasan pada Google Maps Menggunakan Algoritma Support Vector Machine,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 4, no. 1, pp. 247–256, Jan. 2024, doi: 10.57152/malcom.v4i1.1066.
[16] N. A. Semary, W. Ahmed, K. Amin, P. Pławiak, and M. Hammad, “Enhancing machine learning-based sentiment analysis through feature extraction techniques,” PLoS One, vol. 19, no. 2 February, Feb. 2024, doi: 10.1371/journal.pone.0294968.
[17] A. Bhavani and B. Santhosh Kumar, “A Review of State Art of Text Classification Algorithms,” in Proceedings - 5th International Conference on Computing Methodologies and Communication, ICCMC 2021, Institute of Electrical and Electronics Engineers Inc., Apr. 2021, pp. 1484–1490. doi: 10.1109/ICCMC51019.2021.9418262.
[18] A. Ichsan, S. Riyadi, and D. Pardede, “Analysis of Logistic Regression Regularization in Wild Elephant Classification with VGG-16 Feature Extraction,” Journal of Computer Networks, Architecture and High Performance Computing, vol. 6, no. 2, pp. 783–793, Apr. 2024, doi: 10.47709/cnahpc.v6i2.3789.
[19] R. A. Disha and S. Waheed, “Performance analysis of machine learning models for intrusion detection system using Gini Impurity-based Weighted Random Forest (GIWRF) feature selection technique,” Cybersecurity, vol. 5, no. 1, Dec. 2022, doi: 10.1186/s42400-021-00103-8.
[20] G. Biau and E. Scornet, “Rejoinder on: A random forest guided tour,” Jun. 01, 2016, Springer New York LLC. doi: 10.1007/s11749-016-0488-0.
[21] A. W. Pradana and M. Hayaty, “The Effect of Stemming and Removal of Stopwords on the Accuracy of Sentiment Analysis on Indonesian-language Texts,” Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control, pp. 375–380, Oct. 2019, doi: 10.22219/kinetik.v4i4.912.
[22] M. Das, S. Kamalanathan, and P. Alphonse, “A Comparative Study on TF-IDF feature Weighting Method and its Analysis using Unstructured Dataset,” 2020.
[23] S. Minaee, N. Kalchbrenner, E. Cambria, N. Nikzad, M. Chenaghlu, and J. Gao, “Deep Learning-Based Text Classification,” Apr. 30, 2022, Association for Computing Machinery. doi: 10.1145/3439726.
[24] M. Sokolova and G. Lapalme, “A systematic analysis of performance measures for classification tasks,” Inf. Process. Manag., vol. 45, no. 4, pp. 427–437, Jul. 2009, doi: 10.1016/j.ipm.2009.03.002.
[25] P. H. C. Samanmali and R. A. H. M. Rupasingha, “Sentiment analysis on google play store app users’ reviews based on deep learning approach,” Multimed. Tools Appl., vol. 83, no. 36, pp. 84425–84453, Nov. 2024, doi: 10.1007/s11042-024-19185-w.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Made Marshall Vira Deva, Lukman Abdurrahman, Hanif Fakhrurroja
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
