Retrieval-Augmented LLM-Based Empathetic Chatbot for Early Postpartum Depression Screening in Aceh

Authors

  • Cut Amalia Saffiera Universitas Islam Kebangsaan Indonesia
  • Fiqey Indriati Eka Sari Institut Teknologi Sepuluh Nopember
  • Nur Amalia Hasma Universitas Islam Kebangsaan Indonesia
  • Rizaki Akbar Universitas Islam Kebangsaan Indonesia

DOI:

10.33395/sinkron.v10i2.15841

Keywords:

Artificial Intelligence, Chatbot, Conversational Agent, Digital Health, Large Language Models, Postpartum Depression, Retrieval-Augmented Generation

Abstract

Postpartum Depression (PPD) remains a significant maternal mental health concern, particularly in low-resource settings where access to professional psychological services is limited. Although digital mental health tools have emerged to address this gap, most existing chatbot-based systems rely on rule-based interactions, offer limited personalization, and lack integration of structured clinical screening mechanisms. This study addresses the lack of culturally adapted, LLM-based empathic chatbots for postpartum mental health screening in low-resource Indonesian settings. We design and implement an AI-driven conversational chatbot that integrates a Retrieval-Augmented Generation (RAG) architecture with a Large Language Model (LLM) to enable context-aware, knowledge-grounded response generation. The system incorporates a Patient Health Questionnaire-9 (PHQ-9)–based screening module to support early identification of depressive symptoms and adaptive conversational support. An early-stage usability evaluation was conducted through a seven-day user interaction study involving 30 postpartum mothers in Aceh, with 12 participants completing the System Usability Scale (SUS). The system achieved an average SUS score of 85.63, indicating excellent perceived usability. While the evaluation focuses on usability rather than clinical effectiveness, the findings suggest that the proposed system demonstrates feasibility as a culturally adapted, scalable digital support tool for early postpartum mental health screening. Further studies with larger samples and long-term evaluation are required to assess clinical impact and sustained user engagement.

GS Cited Analysis

Downloads

Download data is not yet available.

References

Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021). Perceptions and opinions of patients about mental health chatbots: Scoping review. Journal of Medical Internet Research, 23(1), e17828. https://doi.org/10.2196/17828

Ahtisham, B., Tausif, S., Bhatti, Z. H., Masood, A., & Shahid, S. (2023). An AI chat-based solution aimed to screen postpartum depression. In IFIP Conference on Human-Computer Interaction (pp. 319–328). Cham: Springer Nature Switzerland.

Boothby, N., Veatch, M., & Pentes, M. (2011). Evaluating treatment of Axis I mental health disorders in Aceh, Indonesia. The Psychiatrist, 35(7), 248–255. https://doi.org/10.1192/pb.bp.110.034777

Brännström, A., Wester, J., & Nieves, J. C. (2024). A formal understanding of computational empathy in interactive agents. Cognitive Systems Research, 85, 101203. https://doi.org/10.1016/j.cogsys.2023.101203

Brooke, J. (1996). SUS: A “quick and dirty” usability scale. In P. W. Jordan, B. Thomas, I. L. McClelland, & B. Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). London: Taylor & Francis.

Ernawati, E. (2020). Faktor yang berhubungan dengan kejadian post partum blues pada ibu nifas di Ruang Nuri Rumah Sakit Bhayangkara Makassar. Media Keperawatan, 11(1), 25–30.

Howard, L. M., Molyneaux, E., Dennis, C. L., Rochat, T., Stein, A., & Milgrom, J. (2014). Non-psychotic mental disorders in the perinatal period. The Lancet, 384(9956), 1775–1788. https://doi.org/10.1016/S0140-6736(14)61276-9

Jones, A. (2022). Postpartum help-seeking: The role of stigma and mental health literacy. Maternal and Child Health Journal, 26(5), 1030–1037. https://doi.org/10.1007/s10995-022-03399-1

Kaur, P., Sharma, R., & Singh, M. (2024). Perinatal mental detection with chatbots using machine learning. In 2024 4th International Conference on Technological Advancements in Computational Sciences (ICTACS) (pp. 1498–1503). IEEE. https://doi.org/10.1109/ICTACS57996.2024.00031

Khan, Z., Yang, J., Jawad, R., Martinez, I., Hoque, M., Zhao, X., & Samuel, J. (2025, May). MomCare with AI: A dual embedding-based RAG-LLM chatbot for postpartum depression. In International Conference on Information and Communication Technology for Intelligent Systems (pp. 459–477). Singapore: Springer Nature Singapore.

Lorincz, J., Barišić, K., & Vlahović, V. (2026). Usability testing and the System Usability Scale effectiveness assessment on different sensing devices of prototype and live web system counterpart. Sensors, 26(2), 679. https://doi.org/10.3390/s26020679

Mane, H. Y., Doig, A. C., Gutierrez, F. X., Jasczynski, M., Yue, X., Srikanth, N. P., Mane, S., Sun, A., Moats, R. A., Patel, P., & He, X. (2023). Practical guidance for the development of Rosie, a health education question-and-answer chatbot for new mothers. Journal of Public Health Management and Practice, 29(5), 663–670. https://doi.org/10.1097/PHH.0000000000001800

Mawarpury, M., Sari, K., & Safrina, L. (2017). Layanan kesehatan mental di puskesmas: Apakah dibutuhkan? Insight: Jurnal Pemikiran dan Penelitian Psikologi, 13(1), 1–10.

Mitchell, A. R., Gordon, H., Lindquist, A., Walker, S. P., Homer, C. S., Middleton, A., et al. (2023). Prevalence of perinatal depression in low- and middle-income countries: A systematic review and meta-analysis. JAMA Psychiatry, 80(5), 425–431. https://doi.org/10.1001/jamapsychiatry.2023.0205

O’Hara, M. W., & McCabe, J. E. (2013). Postpartum depression: Current status and future directions. Annual Review of Clinical Psychology, 9(1), 379–407. https://doi.org/10.1146/annurev-clinpsy-050212-185612

Rickwood, D. J., & Coleman-Rose, C. L. (2023). The effect of survey administration mode on youth mental health measures: Social desirability bias and sensitive questions. Heliyon, 9(9), e14902. https://doi.org/10.1016/j.heliyon.2023.e14902

Suharwardy, S., Ramachandran, M., Leonard, S. A., Gunaseelan, A., Lyell, D. J., Darcy, A., et al. (2023). Feasibility and impact of a mental health chatbot on postpartum mental health: A randomized controlled trial. AJOG Global Reports, 3(3), 100165. https://doi.org/10.1016/j.xagr.2023.100165

Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., et al. (2021). The growing field of digital psychiatry: Current evidence and the future of apps, social media, chatbots, and virtual reality. World Psychiatry, 20(3), 318–335. https://doi.org/10.1002/wps.20883

Tsai, Z., Kiss, A., Nadeem, S., Sidhom, K., Owais, S., Faltyn, M., & Van Lieshout, R. J. (2022). Evaluating the effectiveness and quality of mobile applications for perinatal depression and anxiety: A systematic review and meta-analysis. Journal of Affective Disorders, 296, 443–453. https://doi.org/10.1016/j.jad.2021.09.020

Upadhyay, R. P., Chowdhury, R., Salehi, A., Sarkar, K., Singh, S. K., Sinha, B., et al., & Kumar, A. (2017). Postpartum depression in India: A systematic review and meta-analysis. Bulletin of the World Health Organization, 95(10), 706–717. https://doi.org/10.2471/BLT.17.200139

Utami, M. S. M., Kwok, W. H., Kotz, J., Walker, R., Wang, G., & Marriott, R. (2025, July). Facilitating Aboriginal perinatal mental health information access with a retrieval-augmented LLM-based chatbot. In 2025 47th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 1–7). IEEE.

Vinarti, R. A., Sani, N. A., Amalia, R., Sulistyani, E., Noveyani, A. E., Suryaputra, E., & Arwan, M. A. (2024). KIA-CHAT: A QnA chatbot for postnatal and newborn care. Jurnal Promkes: The Indonesian Journal of Health Promotion and Health Education, 12(1 SP), 97–101. https://doi.org/10.20473/jpk.V12.I1SP.2024.97-101

World Health Organization. (2025). Perinatal mental health. Geneva: World Health Organization. Retrieved April 10, 2025, from https://www.who.int/teams/mental-health-and-substance-use/promotion-prevention/maternal-mental-health

Downloads


Crossmark Updates

How to Cite

Saffiera, C. A., Fiqey Indriati Eka Sari, Nur Amalia Hasma, & Rizaki Akbar. (2026). Retrieval-Augmented LLM-Based Empathetic Chatbot for Early Postpartum Depression Screening in Aceh. Sinkron : Jurnal Dan Penelitian Teknik Informatika, 10(2), 1003-1013. https://doi.org/10.33395/sinkron.v10i2.15841