A Hybrid PULTS–SWARA–ELECTRE-I Model for Multi-Criteria Political Sentiment Classification on Indonesian Twitter Data
DOI:
10.33395/sinkron.v9i4.15314Keywords:
Sentiment Classification; SWARA; ELECTRE; PULTS; Feature SelectionAbstract
Social media platforms such as Twitter have become crucial for analyzing political sentiment, particularly in contexts where public opinion shifts rapidly. This study proposes a hybrid classification model that combines Probabilistic Uncertain Linguistic Term Set (PULTS), Stepwise Weight Assessment Ratio Analysis (SWARA), and ELimination Et Choice Translating REality (ELECTRE-I). Using a dataset of 7,800 tweets collected between January and July 2024 covering five major political parties in Indonesia, the model classifies tweets into positive, negative, and neutral sentiments. To address class imbalance, Easy Data Augmentation (EDA) was applied, while Term Frequency–Inverse Document Frequency (TF-IDF) was used for feature extraction. The results show that the proposed model achieves 90% accuracy and an F1-score of 85%, outperforming baseline methods such as SVM (86.7%), Naïve Bayes (83.3%), Decision Tree (88%), and K-Means (76.7%). These improvements demonstrate that the integration of linguistic uncertainty with expert-driven feature weighting provides measurable advantages in political sentiment classification. Beyond performance, the study contributes theoretically by extending multi-criteria decision-making methods into sentiment analysis and by offering a more interpretable alternative to opaque machine learning models. Together, these findings highlight the practical value of explainable decision frameworks for political communication while advancing methodological approaches for analyzing sentiment under uncertainty.
Downloads
References
Akram, M., & Ilyasa, F. (2025). An Enhanced Interval Rough Numbers-Based Outranking Technique for Evaluation of Technology for Sustainable Mining. Iranian Journal of Fuzzy Systems, 22(1), 111–130. https://doi.org/10.22111/ijfs.2025.49980.8832
Albladi, A., Islam, M., & Seals, C. (2025). Sentiment Analysis of Twitter Data Using NLP Models: A Comprehensive Review. IEEE Access, 13, 30444–30468. https://doi.org/10.1109/ACCESS.2025.3541494
Alodat, A. M., Al-Qora’n, L. F., & Abu Hamoud, M. (2023). Social Media Platforms and Political Participation: A Study of Jordanian Youth Engagement. Social Sciences, 12(7), Article 7. https://doi.org/10.3390/socsci12070402
Ansari, M. Z., Aziz, M. B., Siddiqui, M. O., Mehra, H., & Singh, K. P. (2020). Analysis of Political Sentiment Orientations on Twitter. Procedia Computer Science, 167, 1821–1828. https://doi.org/10.1016/j.procs.2020.03.201
Aufar, M., Andreswari, R., & Pramesti, D. (2020). Sentiment Analysis on Youtube Social Media Using Decision Tree and Random Forest Algorithm: A Case Study. 2020 International Conference on Data Science and Its Applications (ICoDSA), 1–7. https://doi.org/10.1109/ICoDSA50139.2020.9213078
Bueno, I., Carrasco, R. A., Porcel, C., Kou, G., & Herrera-Viedma, E. (2021). A linguistic multi-criteria decision making methodology for the evaluation of tourist services considering customer opinion value. Applied Soft Computing, 101, 107045. https://doi.org/10.1016/j.asoc.2020.107045
Chia, M. Y., Huang, Y. F., & Koo, C. H. (2022). Resolving data-hungry nature of machine learning reference evapotranspiration estimating models using inter-model ensembles with various data management schemes. Agricultural Water Management, 261, 107343. https://doi.org/10.1016/j.agwat.2021.107343
Fahmi, A., Kahraman, C., & Bilen, Ü. (2016). ELECTRE I Method Using Hesitant Linguistic Term Sets: An Application to Supplier Selection. International Journal of Computational Intelligence Systems, 9(1), 153–167. https://doi.org/10.1080/18756891.2016.1146532
Fitri, V. A., Andreswari, R., & Hasibuan, M. A. (2019). Sentiment Analysis of Social Media Twitter with Case of Anti-LGBT Campaign in Indonesia using Naïve Bayes, Decision Tree, and Random Forest Algorithm. Procedia Computer Science, 161, 765–772. https://doi.org/10.1016/j.procs.2019.11.181
Gearhart, S., Zhang, B., & Adegbola, O. (2024). Tweeting, talking, or doing politics? Testing the influence of communication on democratic engagement. Telematics and Informatics Reports, 16, 100167. https://doi.org/10.1016/j.teler.2024.100167
Harumy, T. H. F., Fauziah, R., & Dini, S. (2021). Sentiment Analysis Using Simple K-Means to Cluster Tourist in Ecotourism Destination in Sumatera – Indonesia. 2021 International Conference on Data Science, Artificial Intelligence, and Business Analytics (DATABIA), 58–63. https://doi.org/10.1109/DATABIA53375.2021.9650211
Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024). Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence. Cognitive Computation, 16(1), 45–74. https://doi.org/10.1007/s12559-023-10179-8
Hill, C. H., Fresneda, J. E., & Anandarajan, M. (2025). The wisdom of the lexicon crowds: Leveraging on decades of lexicon-based sentiment analysis for improved results. Journal of Big Data, 12(1), 129. https://doi.org/10.1186/s40537-025-01186-7
Huang, D., Ren, L., & Li, Z. (2025). Enhancing aspect-based sentiment analysis with linking words-guided emotional augmentation and hybrid learning. Neurocomputing, 612, 128705. https://doi.org/10.1016/j.neucom.2024.128705
Jaya Hidayat, T. H., Ruldeviyani, Y., Aditama, A. R., Madya, G. R., Nugraha, A. W., & Adisaputra, M. W. (2022). Sentiment analysis of twitter data related to Rinca Island development using Doc2Vec and SVM and logistic regression as classifier. Procedia Computer Science, 197, 660–667. https://doi.org/10.1016/j.procs.2021.12.187
Mao, Y., Liu, Q., & Zhang, Y. (2024). Sentiment analysis methods, applications, and challenges: A systematic literature review. Journal of King Saud University - Computer and Information Sciences, 36(4), 102048. https://doi.org/10.1016/j.jksuci.2024.102048
Masduki, & Wendratama, E. (2025). Digital Activism for Press Freedom Advocacy in Post-Authoritarian Indonesia. Journalism and Media, 6(3), Article 3. https://doi.org/10.3390/journalmedia6030101
Meena, G., Mohbey, K. K., & Kumar, S. (2023). Sentiment analysis on images using convolutional neural networks based Inception-V3 transfer learning approach. International Journal of Information Management Data Insights, 3(1), 100174. https://doi.org/10.1016/j.jjimei.2023.100174
Mishra, A. R., Rani, P., Saha, A., Hezam, I. M., Cavallaro, F., & Chakrabortty, R. K. (2023). An extended DNMA-based multi-criteria decision-making method and its application in the assessment of sustainable location for a lithium-ion batteries’ manufacturing plant. Heliyon, 9(3), e14244. https://doi.org/10.1016/j.heliyon.2023.e14244
Muhammad, P. F., Kusumaningrum, R., & Wibowo, A. (2021). Sentiment Analysis Using Word2vec And Long Short-Term Memory (LSTM) For Indonesian Hotel Reviews. Procedia Computer Science, 179, 728–735. https://doi.org/10.1016/j.procs.2021.01.061
Mumuni, A., & Mumuni, F. (2025). Automated data processing and feature engineering for deep learning and big data applications: A survey. Journal of Information and Intelligence, 3(2), 113–153. https://doi.org/10.1016/j.jiixd.2024.01.002
Murikah, W., Nthenge, J. K., & Musyoka, F. M. (2024). Bias and ethics of AI systems applied in auditing—A systematic review. Scientific African, 25, e02281. https://doi.org/10.1016/j.sciaf.2024.e02281
N, S. K., Khan, Z. A., Swaminathan, B., Prakash, S., Jayanthi, S., & Kumari, R. (2025). ChatGPT and Sentiment Analysis: Unveiling Emotional Insights in Textual Data. Procedia Computer Science, 259, 52–60. https://doi.org/10.1016/j.procs.2025.03.306
Naz, S., Butt, S. A., ul Hassan, M. M., Escorcia-Gutierrez, J., Fatima, A., & ul Ain, F. (2025). A hybrid novel SWARA-ELECTRE-I method using probabilistic uncertain linguistic information for feature selection in image recognition. Neurocomputing, 612, 128615. https://doi.org/10.1016/j.neucom.2024.128615
Ojeda-Hernández, M., López-Rodríguez, D., & Mora, Á. (2023). Lexicon-based sentiment analysis in texts using Formal Concept Analysis. International Journal of Approximate Reasoning, 155, 104–112. https://doi.org/10.1016/j.ijar.2023.02.001
Oluwasakin, E., Torku, T., Tingting, S., Yinusa, A., Hamdan, S., Poudel, S., Hasan, N., Vargas, J., & Poudel, K. (2023). Minimization of high computational cost in data preprocessing and modeling using MPI4Py. Machine Learning with Applications, 13, 100483. https://doi.org/10.1016/j.mlwa.2023.100483
Onan, A. (2023). Hierarchical graph-based text classification framework with contextual node embedding and BERT-based dynamic fusion. Journal of King Saud University - Computer and Information Sciences, 35(7), 101610. https://doi.org/10.1016/j.jksuci.2023.101610
Patrick, H. A., J, P. G., Sharief, M. H., & Mukherjee, U. (2023). Sentiment Analysis Perspective using Supervised Machine Learning Method. 2023 Fifth International Conference on Electrical, Computer and Communication Technologies (ICECCT), 1–4. https://doi.org/10.1109/ICECCT56650.2023.10179807
Puhacheuskaya, V., & Järvikivi, J. (2022). I was being sarcastic!: The effect of foreign accent and political ideology on irony (mis)understanding. Acta Psychologica, 222, 103479. https://doi.org/10.1016/j.actpsy.2021.103479
Ruan, C., Gong, S., & Chen, X. (2024). Multi-criteria group decision-making with extended ELECTRE III method and regret theory based on probabilistic interval-valued intuitionistic hesitant fuzzy information. Complex & Intelligent Systems, 11(1), 92. https://doi.org/10.1007/s40747-024-01645-3
Singer, H., & Özşahin, Ş. (2025). A spherical fuzzy SWARA approach to identify and prioritize factors affecting the pyrolysis process. Biomass and Bioenergy, 202, 108213. https://doi.org/10.1016/j.biombioe.2025.108213
Sivageerthi, T., Bathrinath, S., Uthayakumar, M., & Bhalaji, R. K. A. (2022). A SWARA method to analyze the risks in coal supply chain management. Materials Today: Proceedings, 50, 935–940. https://doi.org/10.1016/j.matpr.2021.06.338
Smairi, N., Abadlia, H., Brahim, H., & Chaari, W. L. (2024). Fine-tune BERT based on Machine Learning Models For Sentiment Analysis. Procedia Computer Science, 246, 2390–2399. https://doi.org/10.1016/j.procs.2024.09.531
Vahdani, B., Mousavi, S. M., Tavakkoli-Moghaddam, R., & Hashemi, H. (2013). A new design of the elimination and choice translating reality method for multi-criteria group decision-making in an intuitionistic fuzzy environment. Applied Mathematical Modelling, 37(4), 1781–1799. https://doi.org/10.1016/j.apm.2012.04.033
Wang, Y., Cui, Z., & Ke, R. (2023). Chapter 3—Machine learning basics. In Y. Wang, Z. Cui, & R. Ke (Eds.), Machine Learning for Transportation Research and Applications (pp. 25–40). Elsevier. https://doi.org/10.1016/B978-0-32-396126-4.00008-4
Xie, W., Ren, Z., Xu, Z., & Wang, H. (2018). The consensus of probabilistic uncertain linguistic preference relations and the application on the virtual reality industry. Knowledge-Based Systems, 162, 14–28. https://doi.org/10.1016/j.knosys.2018.07.016
Zahid, K., Akram, M., & Kahraman, C. (2022). A new ELECTRE-based method for group decision-making with complex spherical fuzzy information. Knowledge-Based Systems, 243, 108525. https://doi.org/10.1016/j.knosys.2022.108525
Zaitseva, E., Rabcan, J., Levashenko, V., & Kvassay, M. (2023). Importance analysis of decision making factors based on fuzzy decision trees. Applied Soft Computing, 134, 109988. https://doi.org/10.1016/j.asoc.2023.109988
Zaoui Seghroucheni, O., Lazaar, M., & Al Achhab, M. (2025). Using AI and NLP for Tacit Knowledge Conversion in Knowledge Management Systems: A Comparative Analysis. Technologies, 13(2), Article 2. https://doi.org/10.3390/technologies13020087
Zhang, F., & Song, W. (2024). Product improvement in a big data environment: A novel method based on text mining and large group decision making. Expert Systems with Applications, 245, 123015. https://doi.org/10.1016/j.eswa.2023.123015
Downloads
|
How to Cite
Issue
Section
License
Copyright (c) 2025 Taufik Yuandika Bahri, Chairini Aisyah
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Google Scholar 
Moraref
PKP Index
Garuda Kemdikbud
Indonesia OneSearch
OCLC Worldcat
Dimensions
Index Copernicus
Scilit
Muhammad Khoiruddin harahap
