Multimodal Detection Models for Poultry Fraud Monitoring on Jetson Nano

Authors

  • Rachmad Atmoko Faculty of Computer Science, Universitas Brawijaya, Indonesia
  • Rizal Setya Perdana Faculty of Computer Science, Universitas Brawijaya, Indonesia
  • Fariz Rizky Wijaya Faculty of Vocational Studies, Universitas Brawijaya, Indonesia
  • Akas Bagus Setiawan Department of Information Technology, Politeknik Negeri Jember, Indonesia

DOI:

10.33395/sinkron.v10i2.15884

Keywords:

CNN-SVM; Jetson Nano; poultry fraud; thermal imaging; YOLOv11

Abstract

This study defines an indoor commercial poultry-house scenario with no Global Positioning System (GPS) signal, variable bird density, illumination shifts, occlusion, and normal versus fraud episodes characterized as abnormal poultry population behavior (an unauthorized deviation between observed bird count and expected inventory baseline). We evaluate an unmanned aerial vehicle (UAV) to an edge-computing pipeline on Jetson Nano by comparing three models: You Only Look Once version 11 (YOLOv11) with red-green-blue (RGB) input, YOLOv11 with RGB and thermal late fusion, and a convolutional neural network (CNN) backbone with a support vector machine (SVM) classifier. The dataset contains 12,000 frames with synchronized RGB-thermal augmentation to preserve modality alignment. Evaluation covers mean Average Precision (mAP), precision, recall, F1-score, counting errors via mean absolute error (MAE) and root mean square error (RMSE), and edge metrics including frames per second (FPS), latency, and memory. YOLOv11 RGB+thermal records mAP@0.5 of 0.94 (Table 4a), MAE of 1.4, and RMSE of 2.0 (Table 4b), compared with YOLOv11 RGB at 0.91, 1.8, and 2.5 and CNN-SVM at 0.85, 2.6, and 3.4 (Table 4a-4b). For edge throughput, CNN-SVM reaches 28 FPS, while YOLOv11 RGB reaches 18 FPS and YOLOv11 RGB+thermal reaches 14 FPS (Table 8). As a scenario study, these metric-supported results indicate that YOLOv11 RGB+thermal is accuracy-first, CNN-SVM is speed-first, and YOLOv11 RGB is a balanced option for real-time poultry fraud monitoring.

GS Cited Analysis

Downloads

Download data is not yet available.

References

Abdalshefie Abuhussein, M. F., El-Soaly, I. S., Elmessery, W. M., & Abd El-Wahhab, G. G. (2024). Thermal imaging and advanced deep learning for automated broiler detection and counting. Al-Azhar Journal of Agricultural Engineering, 7(1). https://doi.org/10.21608/azeng.2024.282011.1013

Bumbálek, R., Umurungi, S. N., Ufitikirezi, J. D. M., Zoubek, T., Kuneš, R., Stehlík, R., ... Bartoš, P. (2025). Deep learning in poultry farming: Comparative analysis of YOLOv8, YOLOv9, YOLOv10, and YOLOv11 for dead chickens detection. Poultry Science, 104(9), 105440. https://doi.org/10.1016/j.psj.2025.105440

Cao, L., Xiao, Z., Liao, X., Yao, Y., Wu, K., Mu, J., Li, J., & Pu, H. (2021). Automated chicken counting in surveillance camera environments based on the point supervision algorithm: LC-DenseFCN. Agriculture, 11(6), 493. https://doi.org/10.3390/agriculture11060493

Cruz, E., Hidalgo-Rodriguez, M., Acosta-Reyes, A. M., Rangel, J. C., & Boniche, K. (2024). AI-based monitoring for enhanced poultry flock management. Agriculture, 14(12), 2187. https://doi.org/10.3390/agriculture14122187

Cruz, E., Hidalgo-Rodriguez, M., Acosta-Reyes, A. M., Rangel, J. C., Boniche, K., & Gonzalez-Olivardia, F. (2025). ACMSPT: Automated counting and monitoring system for poultry tracking. AgriEngineering, 7(3), 86. https://doi.org/10.3390/agriengineering7030086

Depuru, B. K., Putsala, S., & Mishra, P. (2024). Automating poultry farm management with artificial intelligence: Real-time detection and tracking of broiler chickens for enhanced and efficient health monitoring. Tropical Animal Health and Production, 56(2), 75. https://doi.org/10.1007/s11250-024-03922-2

Elmessery, W. M., Gutiérrez, J., Abd El-Wahhab, G. G., Elkhaiat, I. A., El-Soaly, I. S., Alhag, S. K., ... Abdelshafie, M. F. (2023). YOLO-based model for automatic detection of broiler pathological phenomena through visual and thermal images in intensive poultry houses. Agriculture, 13(8), 1527. https://doi.org/10.3390/agriculture13081527

Flores, E. J. (2026). Lightweight vision models for egg fertility detection. Engineering, Technology and Applied Science Research, 16(1), 31618–31623. https://doi.org/10.48084/etasr.15693

Guo, Y., Chai, L., Aggrey, S. E., Oladeinde, A., Johnson, J., & Zock, G. (2020). A machine vision-based method for monitoring broiler chicken floor distribution. Sensors, 20(11), 3179. https://doi.org/10.3390/s20113179

Guo, Y., Aggrey, S. E., Yang, X., Oladeinde, A., Qiao, Y., & Chai, L. (2023). Detecting broiler chickens on litter floor with the YOLOv5-CBAM deep learning model. Artificial Intelligence in Agriculture, 9, 36–45. https://doi.org/10.1016/j.aiia.2023.08.002

Guo, Y., Wu, Z., You, B., Chen, L., Zhao, J., & Li, X. (2025). YOLO-SDD: An effective single-class detection method for dense livestock production. Animals, 15(9), 1205. https://doi.org/10.3390/ani15091205

Hakani, R., & Rawat, A. (2024). Edge computing-driven real-time drone detection using YOLOv9 and NVIDIA Jetson Nano. Drones, 8(11), 680. https://doi.org/10.3390/drones8110680

Hassoun, A., Måge, I., Schmidt, W. F., Temiz, H. T., Li, L., Kim, H.-Y., ... Cozzolino, D. (2020). Fraud in animal origin food products: Advances in emerging spectroscopic detection methods over the past five years. Foods, 9(8), 1069. https://doi.org/10.3390/foods9081069

Ji, W., Luo, Y., Liao, Y., Wu, W., Wei, X., Yang, Y., ... Sun, Y. (2023). UAV assisted livestock distribution monitoring and quantification: A low-cost and high-precision solution. Animals, 13(19), 3069. https://doi.org/10.3390/ani13193069

Khan, Z., Yoon, S.-C., & Bhandarkar, S. M. (2025). Deep learning model compression and hardware acceleration for high-performance foreign material detection on poultry meat using NIR hyperspectral imaging. Sensors, 25(3), 970. https://doi.org/10.3390/s25030970

Neethirajan, S. (2022). Automated tracking systems for the assessment of farmed poultry. Animals, 12(3), 232. https://doi.org/10.3390/ani12030232

Parivendan, S. C., Sailunaz, K., & Neethirajan, S. (2025). Socializing AI: Integrating social network analysis and deep learning for precision dairy cow monitoring-A critical review. Animals, 15(13), 1835. https://doi.org/10.3390/ani15131835

Patel, D. J., Patel, P. S., Patel, T. J., Viradiya, M. D., Patel, J. B., & Garg, D. (2025). Real-time object detection and recognition on Jetson Nano. In ICT Analysis and Applications (Lecture Notes in Networks and Systems, pp. 349–360). Springer. https://doi.org/10.1007/978-981-97-8602-2_32

Qin, W., Yang, X., Wang, Y., Wei, Y., Zhou, Y., & Zheng, W. (2025). YOLOPoul: Performance evaluation of a novel YOLO object detectors benchmark for multi-class manure identification to warn about poultry digestive diseases. Smart Agricultural Technology, 12, 101145. https://doi.org/10.1016/j.atech.2025.101145

Sarvajcz, K., Ari, L., & Menyhart, J. (2024). AI on the road: NVIDIA Jetson Nano-powered computer vision-based system for real-time pedestrian and priority sign detection. Applied Sciences, 14(4), 1440. https://doi.org/10.3390/app14041440

Triyanto, W. A., Adi, K., & Suseno, J. E. (2024). Chicken tracking for location mapping of lameness chickens using YOLOv8 and deep learning-based tracking algorithm. Indonesian Journal of Electrical Engineering and Computer Science, 34(1), 407–418. https://doi.org/10.11591/ijeecs.v34.i1.pp407-418

Vinothkanna, A., Dar, O. I., Liu, Z., & Jia, A.-Q. (2024). Advanced detection tools in food fraud: A systematic review for holistic and rational detection method based on research and patents. Food Chemistry, 446, 138893. https://doi.org/10.1016/j.foodchem.2024.138893

Wu, Z., Yang, J., Zhang, H., & Fang, C. (2025). Enhanced methodology and experimental research for caged chicken counting based on YOLOv8. Animals, 15(6), 853. https://doi.org/10.3390/ani15060853

Yang, X., Chai, L., Bist, R. B., Subedi, S., & Wu, Z. (2022). A deep learning model for detecting cage-free hens on the litter floor. Animals, 12(15), 1983. https://doi.org/10.3390/ani12151983

Yu, Z., Liu, L., Jiao, H., Chen, J., Chen, Z., Song, Z., Lin, H., & Tian, F. (2023). Leveraging SOLOv2 model to detect heat stress of poultry in complex environments. Frontiers in Veterinary Science, 9, 1062559. https://doi.org/10.3389/fvets.2022.1062559

Downloads


Crossmark Updates

How to Cite

Atmoko, R., Perdana, R. S. ., Wijaya, F. R. ., & Setiawan, A. B. . (2026). Multimodal Detection Models for Poultry Fraud Monitoring on Jetson Nano. Sinkron : Jurnal Dan Penelitian Teknik Informatika, 10(2), 870-879. https://doi.org/10.33395/sinkron.v10i2.15884