Graph-Based Hybrid GNN-Transformer for Imbalanced Credit Card Fraud Detection

Authors

  • Muhammad Bayu Wijaya Putra Universitas Pembangunan Jaya
  • Rinto Priambodo Universitas Pembangunan Jaya

DOI:

10.33395/sinkron.v10i3.16245

Keywords:

credit card fraud detection, graph neural network, real-time system, transaction monitoring, transformer

Abstract

Credit card fraud detection faces two major challenges: severe class imbalance and the limited ability of conventional feature-based models to capture relational patterns among transactions. This study proposes a graph-based Hybrid GNN-Transformer architecture for imbalanced credit card fraud detection by integrating transaction-level relational learning through k-nearest neighbor graph construction and feature-interaction learning through multi-head self-attention. The novelty of this study lies in combining graph-based transaction modeling and Transformer-based feature interaction within a unified architecture. Using the selected graph configuration  and validation-based threshold tuning, the proposed model achieved 79.71% precision, 74.32% recall, 76.92% F1-score, 96.06% ROC-AUC, and 68.65% PR-AUC. Compared with Logistic Regression, Random Forest, and Gradient Boosting baselines, the hybrid model showed competitive fraud detection sensitivity, although the baseline classifiers still achieved stronger overall F1-score and PR-AUC. Ablation results show that the hybrid architecture improves minority-class detection compared with single-branch variants by combining relational transaction information from the GNN branch and feature-interaction information from the Transformer branch. These findings indicate that graph-based hybrid representation learning is a promising direction for imbalanced fraud detection, while further optimization is still required to improve precision-recall balance and competitiveness against strong feature-based baselines.

GS Cited Analysis

Downloads

Download data is not yet available.

References

Afriyie, J. K., Tawiah, K., Pels, W. A., Addai-Henne, S., Dwamena, H. A., Owiredu, E. O., Ayeh, S. A., & Eshun, J. (2023). A supervised machine learning algorithm for detecting and predicting fraud in credit card transactions. Decision Analytics Journal, 6, 100163. https://doi.org/10.1016/j.dajour.2023.100163

Aitha, A. R., & Pandiri, L. (2025). A hybrid GNN-transformer framework for explainable and scalable financial fraud detection. In Proceedings of the 1st International Conference on Intelligent Methods and Advanced Computer Scientific Innovations (IMACSI 2025) (Vol. 1, pp. 424–432). SCITEPRESS. https://doi.org/10.5220/0014159100004932

Ali, A., Abd Razak, S., Othman, S. H., Eisa, T. A. E., Al-Dhaqm, A., Nasser, M., Elhassan, T., Elshafie, H., & Saif, A. (2022). Financial fraud detection based on machine learning: A systematic literature review. Applied Sciences, 12(19), 9637. https://doi.org/10.3390/app12199637

Amelia, T. S., Hasibuan, M. N. S., & Pane, R. (2022). Comparative analysis of resampling techniques on machine learning algorithm. Sinkron: Jurnal dan Penelitian Teknik Informatika, 7(2), 628–634. https://doi.org/10.33395/sinkron.v7i2.11427

Baisholan, N., Dietz, J. E., Gnatyuk, S., Turdalyuly, M., Matson, E. T., & Baisholanova, K. (2025). A systematic review of machine learning in credit card fraud detection under original class imbalance. Computers, 14(10), 437. https://doi.org/10.3390/computers14100437

Chen, Y., Zhao, C., Xu, Y., Nie, C., & Zhang, Y. (2025). Deep learning in financial fraud detection: Innovations, challenges, and applications. Data Science and Management. Advance online publication. https://doi.org/10.1016/j.dsm.2025.08.002

Cheng, D., Zou, Y., Xiang, S., & Jiang, C. (2025). Graph neural networks for financial fraud detection: A review. Frontiers of Computer Science, 19(9), 199609. https://doi.org/10.1007/s11704-024-40474-y

Cherif, A., Ammar, H., Kalkatawi, M., Alshehri, S., & Imine, A. (2024). Encoder–decoder graph neural network for credit card fraud detection. Journal of King Saud University – Computer and Information Sciences, 36, 102003. https://doi.org/10.1016/j.jksuci.2024.102003

Federal Trade Commission. (2025, March 10). New FTC data show a big jump in reported losses to fraud to $12.5 billion in 2024. https://www.ftc.gov/news-events/news/press-releases/2025/03/new-ftc-data-show-big-jump-reported-losses-fraud-125-billion-2024

Habibpour, M., Gharoun, H., Mehdipour, M., Tajally, A. R., Asgharnezhad, H., Shamsi, A., Khosravi, A., & Nahavandi, S. (2023). Uncertainty-aware credit card fraud detection using deep learning. Engineering Applications of Artificial Intelligence, 123, 106248. https://doi.org/10.1016/j.engappai.2023.106248

Hernandez Aros, L., Bustamante Molano, L. X., Gutierrez-Portela, F., Moreno Hernandez, J. J., & Rodríguez Barrero, M. S. (2024). Financial fraud detection through the application of machine learning techniques: A literature review. Humanities and Social Sciences Communications, 11, 1130. https://doi.org/10.1057/s41599-024-03606-0

Motie, S., & Raahemi, B. (2024). Financial fraud detection using graph neural networks: A systematic review. Expert Systems with Applications, 240, 122156. https://doi.org/10.1016/j.eswa.2023.122156

Olaniyan, J., Olaniyan, D., Obagbuwa, I. C., & Ngafeeson, M. (2025). Graph-temporal contrastive transformer for financial fraud detection using transaction behavior modeling. Algorithms, 18(12), 770. https://doi.org/10.3390/a18120770

Siagian, N. A., Sipayung, S. P., Rikki, A., & Marbun, N. (2025). Integrating SMOTE with XGBoost for robust classification on imbalanced datasets: A dual-domain evaluation. Sinkron: Jurnal dan Penelitian Teknik Informatika, 9(3), 1094–1107. https://doi.org/10.33395/sinkron.v9i3.15029

Syahbani, A. M., Firdaus, W., & Musodo, K. A. (2025). A comparative study of data mining algorithms for fraud detection in financial transactions. Sinkron: Jurnal dan Penelitian Teknik Informatika, 9(2), 814–821. https://doi.org/10.33395/sinkron.v9i2.14645

Tarissa, B. V., & Dewayanto, T. (2024). Penerapan machine learning dan deep learning pada peningkatan deteksi credit card fraud: A systematic literature review. Diponegoro Journal of Accounting, 13(3), 1–15.

The Nilson Report. (2024). Card fraud losses worldwide in 2023 (No. 1276). https://nilsonreport.com/articles/card-fraud-losses-worldwide-in-2023/

Downloads


Crossmark Updates

How to Cite

Putra, M. B. W. ., & Priambodo, R. (2026). Graph-Based Hybrid GNN-Transformer for Imbalanced Credit Card Fraud Detection. Sinkron : Jurnal Dan Penelitian Teknik Informatika, 10(3), 1786-1798. https://doi.org/10.33395/sinkron.v10i3.16245