ANALISIS SENTIMEN MENGGUNAKAN MODEL CONCATENATION CLASSIFICATION INDOBERT UNTUK ULASAN PENGGUNA APLIKASI MYTELKOMSEL DI PLAYSTORE

Isi Artikel Utama

Tri Fitria Ningsih
Ronsen Purba
Fermi Pasha

Abstrak

In the digital era, user reviews of mobile applications have become an important data source for evaluating and improving service quality. This study aims to analyze user sentiment toward the MyTelkomsel application on Google PlayStore using the Concatenation Classification IndoBERT approach, which combines embeddings from IndoBERT and FastText to enrich the semantic representation of text. A total of 30,000 user reviews in Indonesian from 2022 to 2024 were collected through web scraping using the google-play-scraper library. The data was processed through several preprocessing stages, including normalization, cleaning, stopword removal, and stemming, followed by sentiment labeling into five categories: very negative, negative, neutral, positive, and very positive, based on polarity scores. Modeling was performed by combining the [CLS] token vector from IndoBERT (768 dimensions) and the FastText vector (300 dimensions), resulting in a 1068-dimensional vector. The dataset was split into 80% training data, 20% testing data and 80% training data, 10% testing data and 10% validation data . Evaluation using metrics such as accuracy, precision, recall, and F1-score showed high performance, with accuracy reaching 95% in 2022–2023 and increasing to 96% in 2024. These results indicate that the IndoBERT concatenation approach significantly improves sentiment classification accuracy and is effective in handling unstructured user review texts

Rincian Artikel

Cara Mengutip
[1]
T. F. Ningsih, R. Purba, dan F. Pasha, “ANALISIS SENTIMEN MENGGUNAKAN MODEL CONCATENATION CLASSIFICATION INDOBERT UNTUK ULASAN PENGGUNA APLIKASI MYTELKOMSEL DI PLAYSTORE”, JTM, vol. 15, no. 1, Jun 2026.
Bagian
Articles

Referensi

[1] O. A. Irmawan, I. Budi, A. B. Santoso, and P. K. Putra, “Improving Sentiment Analysis and Topic Extraction in Indonesian Travel App Reviews Through BERT Fine-Tuning,” Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), vol. 13, no. 2, pp. 359–370, Jul. 2024, doi: 10.23887/janapati.v13i2.77028.

[2] C. Fiarni and christell Cellose, “Sentiment Analysis Of Indonesian Video Streaming Application Services Reviews Using Fine-Tuning Indobert And Aspect Modeling,” Journal of Computer Sciences and Informatics, no. 0, p. 1, 2024, doi: 10.5455/JCSI.20240915104407.

[3] A. Naufal, “Analisis Ulasan Pengguna Aplikasi Kesehatan Digital dengan Aspect-Based Sentiment Analysis sebagai Strategi Peningkatan Kualitas Layanan menggunakan Machine Learning,” 2025.

[4] Bing Liu, Sentiment Analysis: Mining Opinions, Sentiments, and Emotions. Cambridge University Press. . 2020. Accessed: Apr. 03, 2025. [Online]. Available: https://www.google.co.id/books/edition/Sentiment_Analysis/PdX7DwAAQBAJ?hl=en&gbpv=1&pg=PA12&printsec=frontcover&dq=posit

[5] D. Jurafsky and J. H. Martin, “Speech and Language Processing An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition with Language Models Third Edition draft Summary of Contents.”

[6] A. Bharathi, “Natural Language Processing for Enterprise Applications,” Ushus-Journal of Business Management, vol. 2022, no. 4, pp. 29–39, doi: 10.12725/ujbm.61.2.

[7] A. Vaswani et al., “Machine Learning,” Jun. 2017, [Online]. Available: http://arxiv.org/abs/1706.03762

[8] J. Devlin, M.-W. Chang, K. Lee, K. T. Google, and A. I. Language, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.” [Online]. Available: https://github.com/tensorflow/tensor2tensor

[9] A. Dwiyono, M. Fachrurrozi, J. Palembang-Prabumulih, K. Ogan Ilir, and S. Selatan, “Analisis Perbandingan Klasifikasi Intent Chatbot Menggunakan Deep Learning BERT, RoBERTa, dan IndoBERT,” Journal of Information System Research, vol. 6, no. 1, pp. 605–616, 2024, doi: 10.47065/josh.v6i1.6051.

[10] L. Bodhi Wijaya, Y. Nuraga Wicaksana, S. S. Widhiasari, and A. Saptawijaya, “Wijaya dkk: Pengembangan Model Deteksi Hoaks Berbahasa Indonesia Menggunakan Kombinasi IndoBERT dan BiLSTM Pengembangan Model Deteksi Hoaks Berbahasa Indonesia Menggunakan Kombinasi IndoBERT dan BiLSTM,” 2024.

[11] J. Pranata, S. Agustian, and E. Haerani, “Penggunaan Model Bahasa indoBERT pada Metode Random Forest Untuk Klasifikasi Sentimen Dengan Dataset Terbatas,” Technology and Science (BITS), vol. 6, no. 3, pp. 1668–1676, 2024, doi: 10.47065/bits.v6i3.6335.

[12] Anugerah Simanjuntak et al., “Research and Analysis of IndoBERT Hyperparameter Tuning in Fake News Detection,” Jurnal Nasional Teknik Elektro dan Teknologi Informasi, vol. 13, no. 1, pp. 60–67, Feb. 2024, doi: 10.22146/jnteti.v13i1.8532.

[13] S. Kom. , M. K. Dr. Maria Susan Anggreany, “Confusion Matrix.” Accessed: Apr. 09, 2025. [Online]. Available: https://socs.binus.ac.id/2020/11/01/confusion-matrix/

[14] Kuncahyo Setyo Nugroho, “Confusion Matrix untuk Evaluasi Model pada Supervised Learning.” Accessed: Apr. 15, 2025. [Online]. Available: https://ksnugroho.medium.com/confusion-matrix-untuk-evaluasi-model-pada-unsupervised-machine-learning-bc4b1ae9ae3f

[15] S. Aras, M. Yusuf, R. Y. Ruimassa, E. A. B. Wambrauw, and E. B. Pala’langan, “Sentiment Analysis on Shopee Product Reviews Using IndoBERT,” Journal of Information Systems and Informatics, vol. 6, no. 3, pp. 1616–1627, Sep. 2024, doi: 10.51519/journalisi.v6i3.814.

[16] H. Imaduddin, F. Yusfida A’la, and Y. S. Nugroho, “Sentiment Analysis in Indonesian Healthcare Applications using IndoBERT Approach.” [Online]. Available: www.ijacsa.thesai.org

[17] M. Daffa, A. Fahreza, A. Luthfiarta, M. Rafid, M. Indrawan, and A. Nugraha, “Analisis Sentimen: Pengaruh Jam Kerja Terhadap Kesehatan Mental Generasi Z,” JOURNAL OF APPLIED COMPUTER SCIENCE AND TECHNOLOGY (JACOST), vol. 5, no. 1, pp. 2723–1453, 2024, doi: 10.52158/jacost.715.

[18] M. Isnan, G. N. Elwirehardja, and B. Pardamean, “Sentiment Analysis for TikTok Review Using VADER Sentiment and SVM Model,” in Procedia Computer Science, Elsevier B.V., 2023, pp. 168–175. doi: 10.1016/j.procs.2023.10.514.

[19] D. Chi, T. Huang, Z. Jia, and S. Zhang, “Research on sentiment analysis of hotel review text based on BERT-TCN-BiLSTM-attention model,” Array, vol. 25, Mar. 2025, doi: 10.1016/j.array.2025.100378.

[20] E. Cambria, D. Das, S. Bandyopadhyay, and A. Feraco, “Socio-Affective Computing 5 A Practical Guide to Sentiment Analysis.” [Online]. Available: http://www.springer.com/series/13199

[21] H. K. Putra, M. Arif Bijaksana, and A. Romadhony, “Deteksi Penggunaan Kalimat Abusive Pada Teks Bahasa Indonesia Menggunakan Metode IndoBERT.”

[22] O. I. Gifari, M. Adha, I. Rifky Hendrawan, F. Freddy, and S. Durrand, “Analisis Sentimen Review Film Menggunakan TF-IDF dan Support Vector Machine,” JIFOTECH (JOURNAL OF INFORMATION TECHNOLOGY, vol. 2, no. 1, 2022.

[23] S. Aras, M. Yusuf, R. Y. Ruimassa, E. A. B. Wambrauw, and E. B. Pala’langan, “Sentiment Analysis on Shopee Product Reviews Using IndoBERT,” Journal of Information Systems and Informatics, vol. 6, no. 3, pp. 1616–1627, Sep. 2024, doi: 10.51519/journalisi.v6i3.814.

[24] A. Z. M. Noor, R. Gernowo, and O. D. Nurhayati, “Data Augmentation for Hoax Detection through the Method of Convolutional Neural Network in Indonesian News,” Jurnal Penelitian Pendidikan IPA, vol. 9, no. 7, pp. 5078–5084, Jul. 2023, doi: 10.29303/jppipa.v9i7.4214.