CoGY-Net: An Efficient AI-Powered Shelf OOS Detection System

Eshghanmalek, Mohsen; Derhami, Vali; Ghasemzadeh, Mohammad

doi:10.22124/cse.2026.32660.1150

Document Type : Original Article

Authors

Department of Computer Engineering, Faculty of Engineering, Yazd University, Yazd, Iran

https://doi.org/10.22124/cse.2026.32660.1150

Abstract

In modern retail management, there is a high demand for being able to efficiently identify empty shelves. To address the inherent limitations of current monitoring systems in handling dense arrangements and geometrically diverse products, To address this image processing problem, we propose CoGY-Net—a robust, intelligent Out-of-Stock (OOS) detection framework that takes RGB images of retail shelves as input. Our approach significantly enhances the standard YOLO architecture through two primary innovations. First, we integrate the Contourlet Transform as a geometric pre-processor to improve the extraction of curved product features within cluttered backgrounds, leveraging its superior directionality over traditional transforms. Second, we employ the Golden Eagle Optimizer (GEO), a metaheuristic algorithm, to eliminate the inefficiency of manual tuning by autonomously identifying the ideal training hyperparameters and anchor boxes tailored to the specific dataset. Furthermore, to ensure the system remains reliable across varying shelf depths, we implemented a scale-invariant dynamic gap analysis logic to pinpoint empty spaces accurately. In this way we manage to fill the research gap which was the lack of an automated and geometry-aware detection framework capable of handling dense shelf layout and curved products in real environments. The system was evaluated on the Out-Of-Stock-23 dataset. Experimental results demonstrate that CoGY-Net achieves an accuracy 90% and provides a high-precision, automated solution with superior stability, making it highly suitable for seamless integration into real-time smart retail environments and autonomous inventory systems.

Keywords

References

[1] Arash, S., Jamal, G., & Seyyed Ali, Z. (2025). Advanced deep learning approaches for accurate and efficient suspicious behavior detection in surveillance videos. Computational Sciences and Engineering, 4(2), 203–216.

[2] Christos, M., Eleni, V., & George, A. P. (2025). Annotation tools for computer vision tasks. In Seventeenth International Conference on Machine Vision (ICMV 2024), Edinburgh, United Kingdom.

[3] Patel, S., & Niani, R. (2025). Advanced computer vision-based retail analytics: A novel approach to customer behavior and product movement tracking. In Proceedings of the IISE Annual Conference (pp. 1–6).

[4] García-Arca, J., Prado-Prado, J. C., & González-Portela Garrido, A. T. (2020). On-shelf availability and logistics rationalization: A participative methodology for supply chain improvement. Journal of Retailing and Consumer Services, 52, Article 101881.

[5] Lin, M. H., Sarwar, M. A., Daraghmi, Y. A., & İk, T. U. (2022). On-shelf load cell calibration for positioning and weighing assisted by activity detection: Smart store scenario. IEEE Sensors Journal, 22(4), 3455–3463.

[6] Araya Lobos, M. (2021). Detecting out of shelf supermarket products [Master’s thesis, Universitat Politècnica de Catalunya].

[7] Yilmazer, R., & Birant, D. (2021). Shelf auditing based on image classification using semi-supervised deep learning to increase on-shelf availability in grocery stores. Sensors, 21(2), 660.

[8] Mohammad Noor, M. Ch., Usha, K. A., Sampath, D. M. B., Omkar, J. D., & Saikumar, K. (2020). Implementation of online and offline product selection system using FCNN deep learning: Product analysis. Materials Today: Proceedings, 45.

[9] Moorthy, R., Behera, S., Verma, S., Bhargave, S., & Ramanathan, P. (2015). Applying image processing for detecting on-shelf availability and product positioning in retail stores. In Proceedings of the ACM International Conference Proceeding Series (pp. 451–457). Kochi, India.

[10] Higa, K., & Iwamoto, K. (2018). Robust estimation of product amount on store shelves from a surveillance camera for improving on-shelf availability. In Proceedings of the IST 2018—IEEE International Conference on Imaging Systems and Techniques (pp. 1–6). Kraków, Poland.

[11] Zivkovic, Z. (2004). Improved adaptive Gaussian mixture model for background subtraction. In Proceedings of the 17th International Conference on Pattern Recognition (Vol. 2, pp. 28–31). Cambridge, UK.

[12] KaewTraKulPong, P., & Bowden, R. (2002). An improved adaptive background mixture model for real-time tracking with shadow detection. In Proceedings of Video-Based Surveillance Systems (pp. 135–144). Boston, MA, USA.

[13] Godbehere, A. B., Matsukawa, A., & Goldberg, K. (2012). Visual tracking of human visitors under variable-lighting conditions for a responsive audio art installation. In Proceedings of the American Control Conference (pp. 4305–4312). Montréal, QC, Canada.

[14] Andaur, J. M. R., Ruz, G. A., & Goycoolea, M. (2021). Predicting out-of-stock using machine learning: An application in a retail packaged foods manufacturing company. Electronics, 10(22), 2787.

[15] Saqlain, M., Rubab, S., Khan, M. M., Ali, N., & Ali, S. (2022). Hybrid approach for shelf monitoring and planogram compliance (HYB-SMPC) in retails using deep learning and computer vision. Mathematical Problems in Engineering, Article 4840643.

[16] Higa, K., & Iwamoto, K. (2019). Robust shelf monitoring using supervised learning for improving on-shelf availability in retail stores. Sensors, 19, 2722.

[17] Kejriwal, N., Garg, S., & Kumar, S. (2015). Product counting using images with application to robot-based retail stock assessment. In Proceedings of the 7th Annual IEEE International Conference on Technologies for Practical Robot Applications (pp. 1–6). Woburn, MA, USA.

[18] Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008). Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110, 346–359.

[19] Rosado, L., Gonçalves, J., Costa, J., Ribeiro, D., & Soares, F. (2016). Supervised learning for out-of-stock detection in panoramas of retail shelves. In Proceedings of the IEEE International Conference on Imaging Systems and Techniques (pp. 406–411). Chania, Greece.

[20] Rosten, E., Porter, R., & Drummond, T. (2010). Faster and better: A machine learning approach to corner detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 105–119.

[21] Mohammadi-Balani, A., Nayeri, M. D., Azar, A., & Taghizadeh-Yazdi, M. (2021). Golden eagle optimizer: A nature-inspired metaheuristic algorithm. Computers & Industrial Engineering, 152, 107050.

[22] Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 779–788).

[23] Wang, C. Y., Bochkovskiy, A., & Liao, H.-Y. M. (2023). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 746–754). Vancouver, Canada.

[24] Jocher, G., Chaurasia, A., Qiu, J., & Ultralytics Team. (2023). YOLOv8: Ultralytics next-generation object detection and segmentation [Ultralytics technical report].

[25] Zhang, X., Liu, H., Wang, J., & Chen, Y. (2023). Dense object detection in retail shelves using improved YOLO architectures. Expert Systems with Applications, 213, 119091.

[26] Rao, S. N. (2024). YOLOv11 architecture explained: Next-level object detection with enhanced speed and accuracy. Medium. Retrieved February 25, 2025.

[27] Tian, Z., Shen, C., Chen, H., & He, T. (2019). FCOS: Fully convolutional one-stage object detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (pp. 9627–9636).

[28] Zhou, X., Wang, D., & Krähenbühl, P. (2019). Objects as points. arXiv. https://arxiv.org/abs/1904.07850

[29] Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020). End-to-end object detection with transformers. In Computer Vision—ECCV 2020 (pp. 213–229). Springer.

[30] Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021). Swin Transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (pp. 10012–10022).

CoGY-Net: An Efficient AI-Powered Shelf OOS Detection System

References

References

Volume 5, Issue 2September 2025Pages 267-286

Volume 5, Issue 2
September 2025
Pages 267-286