Object Recognition for Ingredient Detection and Recipe Retrieval Using Single Shot Multibox Detector

Authors

  • William Olii Department of Informatics Engineering, Faculty of Engineering, De La Salle Catholic University Manado, Indonesia
  • Debby Paseru Department of Informatics Engineering, Faculty of Engineering, De La Salle Catholic University Manado, Indonesia https://orcid.org/0000-0002-5526-4092
  • Junaidy Sanger Department of Informatics Engineering, Faculty of Engineering, De La Salle Catholic University Manado, Indonesia https://orcid.org/0000-0001-9823-1496

DOI:

https://doi.org/10.35799/jis.v26i1.66334

Keywords:

ingdredient detection, object recognition, recipe retrieval

Abstract

Object recognition has become an essential area of computer vision, enabling systems to identify and classify visual information for practical, everyday applications. This study aims to develop an object-recognition system capable of detecting common food ingredients and retrieving suitable recipes to assist users in cooking decisions. The research employs a dataset of 1,800 images representing six vegetable categories and implements the Single Shot Multibox Detector within an application that integrates automated recipe retrieval through a conversational artificial intelligence model. The system is evaluated through functional testing, scenario-based testing, and quantitative performance measurement using established object-recognition metrics. The results show that the model performs most effectively with an eighty–twenty training–testing split, achieving high precision and robust detection across varied lighting conditions, backgrounds, and object distances. The study also demonstrates that the system successfully identifies multiple ingredients within a single image and provides relevant recipe suggestions. These findings indicate that the approach can support domestic decision-making by connecting real-time ingredient recognition with intelligent retrieval of cooking information. The outcomes highlight the practical potential of object recognition for daily-use applications and suggest directions for expanding ingredient categories and improving detection accuracy in future work.

Keywords: Ingredient detection; object recognition; recipe retrieval

References

Alfin, M., Akbar, M. ., Manik, A. R., Purba, J., & Perdana, A. (2025). Pengembangan Aplikasi Rekomendasi Resep Makanan Berdasarkan Bahan Menggunakan Api. JATI (Jurnal Mahasiswa Teknik Informatika), 9(6), 10152–10160. https://doi.org/10.36040/jati.v9i6.16419

Asmawati, A., Kurniawan, Y., & Fadilah, R. . (2025). Efisiensi Pemilahan Sampah Daur Ulang Menggunakan Model CNN SSD-MobileNet V2. ICIT Journal, 11(2), 197–208.

Ayyadevara, V. . (2019). Neural Networks with Keras Cookbook. Packt Publishing.

Batubara, N. ., Awangga, R. M., & Pane, S. F. (2020). Perbandingan Faster R-CNN dengan SSD Mobilenet Untuk Mendeteksi Plat Nomor. Kreatif Industri Nusantara.

Bouazizi, O., Azroumahli, C., El Mourabit, A., & Oussouaddi, M. (2024). Road Object Detection using SSD-MobileNet Algorithm: Case Study for Real-Time ADAS Applications. Journal of Robotics and Control (JRC), 5(2), 551–560. https://doi.org/10.18196/jrc.v5i2.21145

Chen, J., & Ngo, C. (2016). Deep-based Ingredient Recognition for Cooking Recipe Retrieval. Proceedings of the 24th ACM International Conference on Multimedia, 32–41. https://doi.org/10.1145/2964284.2964315

Dangeti, P. (2017). Statistics for Machine Learning. Birmingham: Packt Publishing.

Dharma, A.S., Pardosi, C.N.S., & Silaen, Z. P. (2025). Comparative Performance of Yolov8 and Ssd-mobilenet Algorithms for Road Damage Detection in Mobile Applications. Sinkron, 9(3), 1159–1169. https://doi.org/10.33395/sinkron.v9i3.15008

Fuady, S., Nehru, N., & Anggraeni, G. (2020). Deteksi Objek Menggunakan Metode Single Shot Multibox Detector Pada Alat Bantu Tongkat Tunanetra Berbasis Kamera. Journal of Electrical Power Control and Automation (JEPCA), 3(2), 39–43. https://doi.org/10.33087/jepca.v3i2.38

Greyling, C. (2023). HuggingChat (online). https://cobusgreyling.medium.com/ huggingchat-from-huggingface-is-an-open-source-ai-chat-interface-9be3b0e09b79

Habibi, R., & Aprilian, R. (2020). Tutorial dan penjelasan aplikasi e-office berbasis web menggunakan metode RAD. Jakarta: Kreatif Industri Nusantara.

Iskandar, L. ., & Nugra, R. . (2022). nnovations in Culinary Exploration: AI-Enhanced Food Recipe Search Techniques. Advanced International Journal of Material Science and Engineering, 7(3), 12–20.

Juhartini, Dwinita Arwidiyarti, & Desmiwati. (2025). Single Shot Multibox Detector (SSD) in Object Detection: A Review. IJACI : International Journal of Advanced Computing and Informatics, 1(2), 118–127. https://doi.org/10.71129/ijaci.v1i2.pp118-127

Kumar, V., Goel, V., Amoriya, A., & Kumar, A. (2023). Object Detection Using SSD. 2023 5th International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), 743–748. DOI: 10.1109/ICAC3N60023.2023.10541704

Liu, D., Zuo, E., Wang, D., He, L., Dong, L., & Lu, X. (2025). Deep Learning in Food Image Recognition: A Comprehensive Review. Applied Sciences, 15(14), 7626. https://doi.org/10.3390/app15147626

Maulidiansyah, M., & Abdillah, I. (2023). Klasifikasi Jenis Jagung Berdasarkan Bentuk Biji Menggunakan Metode You Only Look Once (YOLO). JEECOM Journal of Electrical Engineering and Computer, 5(2), 215–226. https://doi.org/10.33650/jeecom.v5i2.6802

Mellyssa, W., Dewi, A., Misriana, M., Suryati, S., & Rachmawati, R. (2022). Pengaruh Algoritma Deep Learning dalam Meningkatkan Akurasi Sistem Pendeteksian Kondisi Jalan Raya. Prosiding Seminar Nasional Politeknik Negeri Lhokseumawe.

Millstein, F. (2018). Convolutional Neural Networks In Python: Beginner’s Guide To Convolutional Neural Networks in Phyton. South Carilina: CreateSpace Independent Publishing.

Min, W., Jiang, S., Liu, L., Rui, Y., & Jain, R. (2022). A Survey on Food Computing. ACM Computing Surveys, 55(1), 1–37. https://doi.org/10.48550/arXiv.1808.07202

Negoro, W. A., Amalia, F., & Santoso, E. (2019). Pengembangan Aplikasi Resep Masakan dengan Rekomendasi berdasarkan Bahan-Bahan Makanan Berbasis Web. Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer, 3(9), 9212–9221.

Pernando, P., Rafi Muttaqin, M., & Raymond Ramadhan, Y. (2023). Deteksi Jenis Sampah Secara Realtime Menggunakan Metode Single Shot Multibox Detector (SSD). JATI (Jurnal Mahasiswa Teknik Informatika), 7(3), 1890–1895. DOI: 10.36040/jati.v7i3.6976

Prasetyo, S. E., Atmaja, C., Ardian, M., Ardhiansyah, A., Sudarni, A. R., & Khaira, M. (2024). Benchmarking YOLOv3 and SSD: A Performance Comparison for Multi-Object Detection. Edu Komputika Journal, 11(2), 136–146. https://doi.org/10.15294/edukom.v11i2.28005

Purwanto, H., Novriadi, A., & At Thariq, F. (2022). Application of Artificial Intelligence SSD MobileNet and Tiny YOLOv2 for Food Recipe Search. International Journal of Engineering, Science and Information Technology, 2(3), 1–7. https://doi.org/10.52088/ijesty.v2i3.276

Puspitasari, F. ., & Pangaribuan, H. (2025). Deteksi Kalori pada Citra Makanan dengan Algoritma Single Shot Multibox Detector. Comasie Journal, 12(2), 9–100.

Ramadhan, M. H. . (2021). Pendeteksian Jenis Sampah dengan Single Shot Multibox Detector secara Real Time [Skripsi]. Universitas Sriwijaya, Palembang.

Salsabila, Z. K., Prakisya, N. P. T., & Liantoni, F. (2025). Deep Learning Architectures for Waste Detection: A Systematic Literature Review. Jurnal Media Informasi Teknologi, 2(1), 41–52. https://doi.org/10.69616/mit.v2i1.213

Saputra, A. A., Susilo, B., Yusa, M., & Nurjanah, U. (2022). Sistem Pendeteksi Genus Gulma Pada Tanaman Jagung Menggunakan Algoritme Single Shot Detector. Rekursif: Jurnal Informatika, 10(1), 48–60. https://doi.org/10.33369/rekursif.v10i1.18634

Tanujaya, H., & Lina, L. (2023). Pengenalan Objek menggunakan Metode Single Shot Multibox Detector pada Bahan Sembako. Jurnal Ilmu Komputer Dan Sistem Informasi, 11(1), 1–6.

Younis, A., Shixin, L., Jn, S., & Hai, Z. (2020). Real-Time Object Detection Using Pre-Trained Deep Learning Models MobileNet-SSD. Proceedings of 2020 6th International Conference on Computing and Data Engineering, 44–48. https://doi.org/10.1145/3379247.3379264

Zhou, X., Wang, D., & Krähenbühl, P. (2021). Objects as points: CenterNet-based detection advancements. IEEE Transactions on Paten Analysis and Machine Intelligence, 4(3), 1–15.

Downloads

Published

2026-04-10

How to Cite

Olii, W., Paseru, D., & Sanger, J. (2026). Object Recognition for Ingredient Detection and Recipe Retrieval Using Single Shot Multibox Detector . Jurnal Ilmiah Sains, 26(1), 48–61. https://doi.org/10.35799/jis.v26i1.66334

Issue

Section

Articles