Image-Based Food Classification for Nutritional Information Estimation Using Deep Learning
DOI:
10.33395/sinkron.v10i3.16170Keywords:
Deep Learning, Food Recognition, Nutrition Detection, Image Processing, Mobile ApplicationAbstract
This study aims to develop an image-based food classification application integrated with nutritional information retrieval using a deep learning approach. The proposed system is designed to recognize food types from images and provide nutritional information based on an Indonesian food nutrition database. The method involves collecting a dataset of 8,248 images representing 38 categories of Indonesian traditional foods, performing image preprocessing and data augmentation, and developing a Convolutional Neural Network (CNN) model based on the MobileNetV2 architecture through transfer learning. Model performance was evaluated using a 3-fold stratified cross-validation strategy and measured using accuracy, precision, recall, and F1-score metrics. Experimental results showed that the proposed model achieved average accuracy, precision, recall, and F1-score values of 98.85%, 98.88%, 98.85%, and 98.85%, respectively, demonstrating robust and consistent classification performance across the validation folds. The trained model was subsequently deployed into a mobile application using TensorFlow Lite to support real-time food classification and nutritional information presentation. The main contribution of this study is the development of an end-to-end mobile system that integrates deep learning-based food classification with an Indonesian food nutrition database, enabling users to obtain calorie, protein, fat, and carbohydrate information quickly and conveniently for dietary monitoring and health awareness.
Downloads
References
Aung, L. H., Funabiki, N., Aung, S. T., & Kao, W.-C. (2024). Design of UI image generation method for Flutter programming learning assistant system. 2024 IEEE 13th Global Conference on Consumer Electronics (GCCE), 42–43. https://doi.org/10.1109/GCCE62371.2024.10760391
Bailey, R. L. (2021). Overview of dietary assessment methods for measuring intakes of foods, beverages, and dietary supplements in research studies. Current Opinion in Biotechnology, 70, 91–96. https://doi.org/10.1016/j.copbio.2021.02.007
Ciocca, G., Napoletano, P., & Schettini, R. (2017). Food recognition: A new dataset, experiments, and results. IEEE Journal of Biomedical and Health Informatics, 21(3), 588–598. https://doi.org/10.1109/JBHI.2016.2636441
Diana, F. M. (2020). Gizi dalam siklus kehidupan. Rajawali Pers.
Darma Udayana, I. P. A. E., Sudarma, M., & Surya Cipta Nugraha, P. G. (2020). Implementation of convolutional neural networks to recognize images of common Indonesian food. IOP Conference Series: Materials Science and Engineering, 846(1), 012023. https://doi.org/10.1088/1757-899X/846/1/012023
Eldridge, A. L., Piernas, C., Illner, A. K., Gibney, M. J., Gurinović, M. A., de Vries, J. H. M., & Cade, J. E. (2019). Evaluation of new technology-based tools for dietary intake assessment: An ILSI Europe Dietary Intake and Exposure Task Force evaluation. Nutrients, 11(1), 55. https://doi.org/10.3390/nu11010055
GBD Diet Collaborators. (2019). Health effects of dietary risks in 195 countries, 1990–2017: A systematic analysis for the Global Burden of Disease Study 2017. The Lancet, 393(10184), 1958–1972. https://doi.org/10.1016/S0140-6736(19)30041-8
Hanandita, W., & Tampubolon, G. (2015). The double burden of malnutrition in Indonesia: Social determinants and geographical variations. SSM - Population Health, 1, 16–25. https://doi.org/10.1016/j.ssmph.2015.10.002
Höchsmann, C., & Martin, C. K. (2020). Review of the validity and feasibility of image-assisted methods for dietary assessment. International Journal of Obesity, 44(12), 2358–2371. https://doi.org/10.1038/s41366-020-00693-2
Konstantakopoulos, F. S., Georga, E. I., Tachos, N. S., & Fotiadis, D. I. (2023). Weight estimation of Mediterranean food images using random forest regression algorithm. 2023 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 1–4. https://doi.org/10.1109/EMBC40787.2023.10340040
Konstantakopoulos, F. S., Georga, E. I., & Fotiadis, D. I. (2024). A review of image-based food recognition and volume estimation artificial intelligence systems. IEEE Reviews in Biomedical Engineering, 17, 136–152. https://doi.org/10.1109/RBME.2023.3283149
Liang, Y., & Li, J. (2017). Deep learning-based food calorie estimation method in dietary assessment. arXiv. https://doi.org/10.48550/arXiv.1706.04062
Liu, D., Zuo, E., Wang, D., He, L., Dong, L., & Lu, X. (2025). Deep learning in food image recognition: A comprehensive review. Applied Sciences, 15(14), 7626. https://doi.org/10.3390/app15147626
Liu, Y., Pu, H., & Sun, D.-W. (2021). Efficient extraction of deep image features using convolutional neural network (CNN) for applications in detecting and analysing complex food matrices. Trends in Food Science & Technology, 113, 193–204. https://doi.org/10.1016/j.tifs.2021.04.042
Lo, F. P. W., Sun, Y., Qiu, J., & Lo, B. (2020). Image-based food classification and volume estimation for dietary assessment: A review. IEEE Journal of Biomedical and Health Informatics, 24(7), 1926–1939. https://doi.org/10.1109/JBHI.2020.2987943
Meyers, A., Johnston, N., Rathod, V., Korattikara, A., Gorban, A., Silberman, N., ... & Murphy, K. P. (2015). Im2Calories: Towards an automated mobile vision food diary. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 1233–1241. https://doi.org/10.1109/ICCV.2015.146
Muharram, F. R., Tjandra, S., Madani, N. J., Rokx, C., & Abdullah, A. (2025). Trends in the double burden of malnutrition among Indonesian adults, 2007 to 2023. Scientific Reports, 15(1), 34883. https://doi.org/10.1038/s41598-025-17348-9
Park, S. J., Palvanov, A., Lee, C. H., Jeong, N., Cho, Y. I., & Lee, H. J. (2019). Development of a food image detection and recognition model of Korean food for mobile dietary management. Nutrition Research and Practice, 13(6), 521–528. https://doi.org/10.4162/nrp.2019.13.6.521
Popkin, B. M., Corvalan, C., & Grummer-Strawn, L. M. (2020). Dynamics of the double burden of malnutrition and the changing nutrition reality. The Lancet, 395(10217), 65–74. https://doi.org/10.1016/S0140-6736(19)32497-3
Rachmi, C. N., Agho, K. E., Li, M., & Baur, L. A. (2016). Stunting, underweight and overweight in children aged 2.0–4.9 years in Indonesia: Prevalence trends and associated risk factors. PLOS ONE, 11(5), e0154756. https://doi.org/10.1371/journal.pone.0154756
Shetgaonkar, P., Bandokar, T., Patrekar, S., Naik, S., & Harkare, P. (2025). An AI-based approach for real-time nutrition and calories analysis. 2025 6th International Conference on Communication, Computing & Industry 6.0 (C2I6), 1–10. https://doi.org/10.1109/C2I666499.2025.11366951
Shim, J. S., Oh, K., & Kim, H. C. (2021). Dietary assessment methods in epidemiologic studies. Epidemiology and Health, 43, e2021017. https://doi.org/10.4178/epih/e2014009
Surekha, A., Aswini, P., Kumar, M., Manisha, V., Reddy, V., & Reddy, B. (2025). AI-based food recognition and nutrient prediction. International Journal of Emerging Research in Science, Engineering, and Management, 1(6), 44–54. https://doi.org/10.58482/ijersem.v1i6.6
Tan, M., & Le, Q. V. (2019). EfficientNet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning (ICML), 6105–6114.
Teixeira, V., Voci, S., Mendes-Netto, R., & Silva, D. (2018). The relative validity of a food record using the smartphone application MyFitnessPal. Nutrition & Dietetics, 75(2), 219–226. https://doi.org/10.1111/1747-0080.12401
World Health Organization. (2023). Obesity and overweight. https://www.who.int/news-room/fact-sheets/detail/obesity-and-overweight
Zhang, Y., Deng, L., Zhu, H., Wang, W., Ren, Z., Zhou, Q., Lu, S., Sun, S., Zhu, Z., Gorriz, J. M., & Wang, S. (2023). Deep learning in food category recognition. Information Fusion, 98, 101859. https://doi.org/10.1016/j.inffus.2023.101859
Downloads
|
How to Cite
Issue
Section
License
Copyright (c) 2026 Sahrial Ihsani Ishak, Sri Dianing Asri, Bias Yulisa Geni, Okma Arnilia, Tri Widodo
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Muhammad Khoiruddin harahap
Google Scholar 
Moraref
PKP Index
Garuda Kemdikbud
Indonesia OneSearch
OCLC Worldcat
Dimensions
Index Copernicus
Scilit
