您好,欢迎访问上海市农业科学院 机构知识库!

Computer Vision-Based Assistance System for Visually Impaired Individuals in Vending Machine Interactions

文献类型: 会议论文

第一作者: Karla Miriam Reyes Leiva

作者: Karla Miriam Reyes Leiva 1 ; Roy Abi Zeid Daou 2 ; José Javier Serrano Olmedo 3 ;

作者机构: 1.Engineering Faculty, Universidad Tecnologica, Centroamericana UNITEC, San Pedro Sula, Honduras|Escuela Tecnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, Madrid, Spain

2.Biomedical Technologies Department, Faculty of Public Health, Jounieh, Lebanon|Lebanon Mechatronics department, Polytech, La Sagesse Univeristy, Beirut, Lebanon

3.Escuela Tecnica Superior de Ingenieros de Telecomunicación Universidad Politécnica de Madrid, Madrid, Spain

关键词: YOLO;Training;Visualization;Navigation;Computational modeling;Supervised learning

会议名称: IEEE Central America and Panama Convention

主办单位:

页码: 1-7

摘要: Vending machines are widely known for their convenient accessibility to a wide range of products, eliminating the need for human assistance. However, visually impaired individuals often encounter difficulties when it comes to independently selecting, paying for, and retrieving items from these machines due to their heavy reliance on visual cues. This project aimed to address this issue by developing a computer vision-based model that would aid visually impaired individuals in acquiring products from vending machines. The research involved curating a comprehensive dataset, which consisted of images depicting various types of vending machines and the objects they dispense such as beverages and snacks, also labels for beverages. This dataset served as the foundation for training a custom object detection models using the state-of-the-art framework from YOLO family, applying supervised learning and semi supervised learning. By leveraging these models, the aim was to enable the system to accurately identify and locate products within vending machines. To evaluate the performance of the developed model, a series of tests were conducted. The results obtained from these assessments showcased the potential of the model in facilitating a system that could significantly enhance accessibility and independence for visually impaired individuals who interact with vending machines. The positive outcomes indicated that the model had the ability to successfully identify and track products within the vending machines, thus enabling users to navigate the purchasing process more effectively. The model demonstrated promising performance and exhibited potential for integration into a larger system aimed at improving accessibility and independence for visually impaired individuals when interacting with vending machines.

分类号: tp3-53

  • 相关文献

[1]MGRFormer: A Multimodal Transformer Approach for Surgical Gesture Recognition. Kevin Feghoul,Deise Santana Maia,Mehdi El Amrani,Mohamed Daoudi,Ali Amad. 2024

[2]One-step reverse transcription loop-mediated isothermal amplification assay for rapid detection of melon yellow spot virus. Zeng, Rong,Xu, Li-hui,Gao, Shi-gang,Dai, Fu-ming,Ni, Xiu-hong,Chen, Chun-lei,Chen, Jian-cai.

[3]Virtual Visualization System for Growth of Tobacco Root. Xi, Lei,Ren, Yanna,Wang, Qiang,Zhang, Longlong,Ma, Xinming,Xiong, Shuping,Ma, Xinming,Yang, Juan. 2011

[4]Group behavior of UAVs in obstacles presence. D. Kucherov,A. Kozub,O. Kostyna. 2016

[5]Proportional Controller-Based Algorithm Ensuring Safe Avoidance of Obstacles for Autonomous Tractors. Gülşah Demirhan Aydın,Arda Günay,Mehmet Küçükosmanoğlu. 2024

[6]Design and Implementation of a QoL Improvement System for Visually Impaired Patients. Roy Abi Zeid Daou,Jad Beaino,Johnny Hawat,Ramy Ibrahim,Ali Hayek,Josef Boercsoek,Jose Javier Serrano Olmedo. 2023

[7]Virtual Visualization System for Growth of Tobacco Root. Lei Xi,Shuping Xiong,Yanna Ren,Qiang Wang,Juan Yang. 2011

[8]Design and Implementation of a Smart Human Posture Monitoring Device Using a Wearable Vest. Roy Abi Zeid Daou,Elio Geha,Youssef Aoun,Ali Hayek,Josef Boercsoek,Jose Javier Serrano Olmedo. 2023

[9]Visualizing Complexity: A Dynamic Approach to Reverse Engineering. Ketki Balde,Lalji Prasad,Rashmi Yadav. 2024

[10]Research and Application of Pig Iris Recognition Technology. Shipu Xu,Guoqing Liu,Yong Liu,Yunsheng Wang. 2024

[11]Building Common Ground: An Inter-Institutional Computing & Engineering Education Transfer Learning Community. Danyelle Tauryce Ireland,Rebecca Zarch,Ilana Hipshman,Ashley Clark. 2021

[12]A Comparative Study of Various Learning Models for Object Detection in Contextual Scene Interpretation. Taranpreet Singh,Dr.Hemang Shrivastava. 2023

[13]Hybrid Confidentiality Framework for Secured Cloud Computing. Gaurav Shrivastava,Sachin Patel. 2022

[14]An Innovative Method for Authenticating and Accounting for Cloud-based Financial Transactions is to Publicly Disseminate the User's Private Key. Pravin R. Nerkar,Manoj K. Ramaiya. 2023

[15]Blockchain Cloud Computing: Comparative study on DDoS, MITM and SQL Injection Attack. Mamta Swarnkar,Shekh Kulsum Almas,Nagendra Singh,Harsh Pratap Singh,Anuprita Mishra,Anula Khare. 2024

[16]A Systematic Literature Review on Developing Job Profiles and Training Content for Open Data-Driven Smart Cities. Koukounidou Vasiliki,Kokkinaki Angelika,Osta Alain,Tsakiris Theodoros. 2024

[17]Revolutionizing Healthcare with Federated Learning: A Comprehensive Review. Snehlata Mishra,Ritu Tondon,Narendra Pal Singh Rathore. 2024

[18]Student’s Feedback by emotion and speech recognition through Deep Learning. Ati Jain,Hare Ram Sah. 2021

作者其他论文 更多>>