Sentiment Analysis Using Grok AI as an Auto-Labeling Tool in The Text Processing Stage
DOI:
10.33395/sinkron.v9i2.14632Keywords:
ai, grok, labeling, x.Abstract
A critical aspect of Natural Language Processing (NLP) is text processing, where text labeling represents the most significant challenge due to its resource-intensive nature when conducted manually. At this stage, automatic labeling emerges as a more practical solution, particularly with the advent of Artificial Intelligence (AI), which offers tools to address this obstacle. Grok AI, equipped with a new feature operable on Platform X, provides a promising approach. This study aims to leverage the Grok AI feature on Platform X for automatic text labeling. The research methodology involves labeling text data obtained from a public dataset. To assess the quality of the labeling results, an evaluation method employing Naive Bayes classification modeling is applied. The findings reveal that Grok AI's performance closely approximates that of human labeling. The highest accuracy achieved by Grok AI is 51.71% using the k-Nearest Neighbors (k-NN) algorithm, approaching the human labeling accuracy of 60.52% with k-NN. Furthermore, Grok AI surpasses the performance of VADER labeling, which achieves an accuracy of only 49.49% with Naive Bayes. Consequently, the Grok AI feature on Platform X presents a viable alternative for the automatic labeling of text data.
Downloads
References
Abro, Abdul Ahad, Mir Sajjad Hussain Talpur, and Awais Khan Jumani. 2023. “Natural Language Processing Challenges and Issues : A Literature Review.” Journal of Science 36(4):1522–36.
Albab, M. Ulil, Yohana Karuniawati P, and Mohammad Nur Fawaiq. 2023. “Optimization of the Stemming Technique on Text Preprocessing President 3 Periods Topic.” Jurnal TRANSFORMATIKA 20(2):1–10.
Amaliah, Fitrah, and I. Kadek Dwi Nuryana. 2022. “Perbandingan Akurasi Metode Lexicon Based Dan Naive Bayes Classifier Pada Analisis Sentimen Pendapat Masyarakat Terhadap Aplikasi Investasi Pada Media Twitter.” Journal of Informatics and Computer Science 3(3):384–93.
Andriana, Herda, Shofa Shofia Hilabi, and Agustia Hananto. 2023. “Penerapan Metode K-Nearest Neighbor Pada Sentimen Analisis Pengguna Twitter Terhadap KTT G20 Di Indonesia.” JURIKOM (Jurnal Riset Komputer) 10(1):60–67.
Anwar, Muchamad Taufiq, and DennyPermana Arief Permana. 2023. “Analisis Sentimen Masyarakat Indonesia Terhadap Produk Kendaraan Listrik Menggunakan VADER.” Jurnal Teknik Informatika Dan Sistem Informasi 10(1):783–92.
Ashari, Ilham Firman. 2023. “Analysis Sentiments In Facebook Down Case Using Vader And Naive Bayes Classification Method.” Multitek Indonesia: Jurnal Ilmiah 16(2):75–89.
Asri, Yessy, Widya Nita Suliyanti, Dwina Kuswardani, and Muhamad Fajri. 2022. “Pelabelan Otomatis Lexicon Vader Dan Klasifikasi Naive Bayes Dalam Menganalisis Sentimen Data Ulasan PLN Mobile.” PETIR: Jurnal Pengkajian Dan Penerapan Teknik Informatika 15(2):264–75.
Barik, Kousik, and Sanjay Misra. 2024. “Analysis of Customer Reviews with an Improved VADER Lexicon Classifier.” Journal of Big Data 11(10):1–29.
Basha, M. John, S. Vijayakumar J. Jayashankari, Ahmed Hussein, and Alawadi Pulatova. 2023. “Advancements in Natural Language Processing for Text Understanding.” Pp. 1–9 in E3S Web of Conferences 399. Vol. 04031.
Cholil, Saifur Rohman, Titis Handayani, Rastri Prathivi, and Tria Ardianita. 2021. “Implementasi Algoritma Klasifikasi K-Nearest Neighbor (KNN) Untuk Klasifikasi Seleksi Penerima Beasiswa.” IJCIT (Indonesian Journal on Computer and Information Technology) 6(2):118–27.
Gaja, Muhammad Yusuf Rismanda, Iqbal Maulana, and Oman Komarudin. 2023. “Analisis Sentimen Opini Pengguna Aplikasi Vidio Pada Ulasan Playstore Menggunakan Algoritma Naive Bayes.” JATI (Jurnal Mahasiswa Teknik Informatika) 7(4):2767–74.
Hidayat, Taupik, Rinda Cahyana, and Indri Tri Julianto. 2024. “Analisis Sentimen Layanan Sistem Informasi Akademik Mahasiswa Menggunakan Algoritma Naive Bayes.” Algoritma 21(1):119–30.
Illia, F., M. P. Eugenia, and S. A. Rutba. 2021. “Sentiment Analysis on PeduliLindungi Application Using TextBlob and VADER Library.” Pp. 278–88 in The 1 International Conference on Data Science and Official Statistics (ICDSOS). Jakarta: Politeknik Statistika.
Insan, Moh Khoirul, Umi Hayati, and Odi Nurdiawan. 2023. “Analisis Sentimen Aplikasi Brimo Pada Ulasan Pengguna Di Google Play Menggunakan Algoritma Naive Bayes.” JATI (Jurnal Mahasiswa Teknik Informatika) 7(1):478–83.
Julianto, Indri Tri, Dede Kurniadi, and Benedicto B. Balilo Jr. 2023. “Enhancing Sentiment Analysis With Chatbots : A Comparative Study Of Text Pre-Processing.” JUTIF 4(6):1419–30.
Julianto, Indri Tri, Dede Kurniadi, Benedicto B. Balilo Jr, and Fauza Rohman. 2024. “The Role Of Feature Selection In Enhancing The Accuracy Of AI Assistant Auto-Labeling.” Jurteksi 11(1):85–92.
Julianto, Indri Tri, Dede Kurniadi, Yosep Septiana, and Ade Sutedi. 2023. “Alternative Text Pre-Processing Using Chat GPT Open AI.” Janapati 12(1):67–77.
Khairunnisa, Syifa, Adiwijaya Adiwijaya, and Said Al Faraby. 2021. “Pengaruh Text Preprocessing Terhadap Analisis Sentimen Komentar Masyarakat Pada Media Sosial Twitter (Studi Kasus Pandemi COVID-19).” Jurnal Media Informatika Budidarma 5(2):406–14.
Moeis, Dikwan, Nasir Usman, Andi Harmin, Muhammad Faisal, Ida Mulyadi, and Musdalifa Thamrin. 2024. “Microsoft Copilot Training for Monitoring Student Learning : A Case Study Vocational High School Makassar - Indonesia.” Jurnal Pengabdian Masyarakat 4(3):1911–22.
Nurwanda, Nana Suarna, and Willy Prihartono. 2024. “Penerapan NLP (Natural Language Processing) Dalam Analisis Sentimen Pengguna Telegram Di Playstore.” JATI (Jurnal Mahasiswa Teknik Informatika) 8(2):1841–46.
Parlika, Rizky, Sunu Ilham Pradika, Amir Muhammad Hakim, and Kholilul Rachman N. M. 2020. “Analisis Sentimen Twitter Terhadap Bitcoin Dan Cryptocurrency Berbasis Python TextBlob.” Jurnal Ilmiah Teknologi Informasi Dan Robotika 2(2):33–37.
Pebdika, Angga, Ruli Herdiana, and Dodi Solihudin. 2023. “Klasifikasi Menggunakan Metode Naive Bayes Untuk Menentukan Calon Penerima PIP.” JATI (Jurnal Mahasiswa Teknik Informatika) 7(1):452–58.
Prasetya, Adam, Ferdiansyah Ferdiansyah, Yesi Novaria Kunang, Edi Surya Negara, and Winoto Chandra. 2021. “Sentiment Analisis Terhadap Cryptocurrency Berdasarkan Comment Dan Reply Pada Platform Twitter.” Journal of Information Systems and Informatics 3(2):268–77.
Pratama, Aditiya Yoga, Yuyun Umaidah, and Apriade Voutama. 2021. “Analisis Sentimen Media Sosial Twitter Dengan Algoritma K-Nearest Neighbor Dan Seleksi Fitur Chi-Square (Kasus Omnibus Law Cipta Kerja).” Sains Komputer & Informatika 5(2):897–910.
Rachmat, Budi Kurniawan, Achmad Suwarisman, Iis Afriyanti, Aditya Wahyudi, and Dedi Dwi Saputra. 2023. “Analisis Sentimen Complain Dan Bukan Complain Pada Twitter Telkomsel Dengan SMOTE Dan Naïve Bayes.” Jurnal Teknologi Informasi Dan Komunikasi) 7(1):107–13.
Russel, S. J., and P. Norvig. 2021. Artificial Intelligence: A Modern Approach (4th Ed.). London: pearson.
Sutedi, Ade, Indri Tri Julianto, and Leni Fitriani. 2024. “Segmentasi Wilayah Terdampak Bencana Berdasarkan Fitur Geo-Posisi.” JTIIK 11(4):797–804.
Telnoni, Patrick Adolf, Suryatiningsih, and Ely Rosely. 2020. “Pelabelan Data Dengan Latent Dirichlet Allocation Dan K-Means Clustering Pada Data Twitter Menggunakan Bahasa Indonesia Data Labeling Using Latent Dirichlet Allocation and K-Means Clustering on Indonesian-Based Twitter.” Jurnal Elektro Telekomunikasi Terapan (JETT) 7(2):885–92.
Utami, Dian Siti, and Adhitia Erfina. 2021. “Analisis Sentimen Pinjaman Online Di Twitter Menggunakan Algoritma Support Vector Machine (SVM).” SISMATIK (Seminar Nasional Sistem Informasi Dan Manajemen Informatika) 1(1):299–305.
Watori, Jananto, Riska Aryanti, and Agus Junaidi. 2020. “Penggunaan Algoritma Klasifikasi Terhadap Analisa Sentimen Pemindahan Ibukota Dengan Pelabelan Otomatis.” Jurnal Informatika 7(1):85–90.
Xiao, Yu, and Zhezhi Jin. 2021. “Summary of Research Methods on Pre-Training Models of Natural Language Processing.” Open Access Library Journal 8(7).
Downloads
How to Cite
Issue
Section
License
Copyright (c) 2025 Yoga Handoko Agustin, Dede Kurniadi, Indri Tri Julianto, Benedicto B. Balilo Jr

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.