Computer Vision-Based Assistance System for Visually Impaired Individuals in Vending Machine Interactions
文献类型: 会议论文
第一作者: Karla Miriam Reyes Leiva
作者: Karla Miriam Reyes Leiva 1 ; Roy Abi Zeid Daou 2 ; José Javier Serrano Olmedo 3 ;
作者机构: 1.Engineering Faculty, Universidad Tecnologica, Centroamericana UNITEC, San Pedro Sula, Honduras|Escuela Tecnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, Madrid, Spain
2.Biomedical Technologies Department, Faculty of Public Health, Jounieh, Lebanon|Lebanon Mechatronics department, Polytech, La Sagesse Univeristy, Beirut, Lebanon
3.Escuela Tecnica Superior de Ingenieros de Telecomunicación Universidad Politécnica de Madrid, Madrid, Spain
关键词: YOLO;Training;Visualization;Navigation;Computational modeling;Supervised learning
会议名称: IEEE Central America and Panama Convention
主办单位:
页码: 1-7
摘要: Vending machines are widely known for their convenient accessibility to a wide range of products, eliminating the need for human assistance. However, visually impaired individuals often encounter difficulties when it comes to independently selecting, paying for, and retrieving items from these machines due to their heavy reliance on visual cues. This project aimed to address this issue by developing a computer vision-based model that would aid visually impaired individuals in acquiring products from vending machines. The research involved curating a comprehensive dataset, which consisted of images depicting various types of vending machines and the objects they dispense such as beverages and snacks, also labels for beverages. This dataset served as the foundation for training a custom object detection models using the state-of-the-art framework from YOLO family, applying supervised learning and semi supervised learning. By leveraging these models, the aim was to enable the system to accurately identify and locate products within vending machines. To evaluate the performance of the developed model, a series of tests were conducted. The results obtained from these assessments showcased the potential of the model in facilitating a system that could significantly enhance accessibility and independence for visually impaired individuals who interact with vending machines. The positive outcomes indicated that the model had the ability to successfully identify and track products within the vending machines, thus enabling users to navigate the purchasing process more effectively. The model demonstrated promising performance and exhibited potential for integration into a larger system aimed at improving accessibility and independence for visually impaired individuals when interacting with vending machines.
分类号: tp3-53
- 相关文献
[1]MGRFormer: A Multimodal Transformer Approach for Surgical Gesture Recognition. Kevin Feghoul,Deise Santana Maia,Mehdi El Amrani,Mohamed Daoudi,Ali Amad. 2024
[2]One-step reverse transcription loop-mediated isothermal amplification assay for rapid detection of melon yellow spot virus. Zeng, Rong,Xu, Li-hui,Gao, Shi-gang,Dai, Fu-ming,Ni, Xiu-hong,Chen, Chun-lei,Chen, Jian-cai.
[3]Virtual Visualization System for Growth of Tobacco Root. Xi, Lei,Ren, Yanna,Wang, Qiang,Zhang, Longlong,Ma, Xinming,Xiong, Shuping,Ma, Xinming,Yang, Juan. 2011
[4]Group behavior of UAVs in obstacles presence. D. Kucherov,A. Kozub,O. Kostyna. 2016
[5]Proportional Controller-Based Algorithm Ensuring Safe Avoidance of Obstacles for Autonomous Tractors. Gülşah Demirhan Aydın,Arda Günay,Mehmet Küçükosmanoğlu. 2024
[6]Design and Implementation of a QoL Improvement System for Visually Impaired Patients. Roy Abi Zeid Daou,Jad Beaino,Johnny Hawat,Ramy Ibrahim,Ali Hayek,Josef Boercsoek,Jose Javier Serrano Olmedo. 2023
[7]Virtual Visualization System for Growth of Tobacco Root. Lei Xi,Shuping Xiong,Yanna Ren,Qiang Wang,Juan Yang. 2011
[8]Design and Implementation of a Smart Human Posture Monitoring Device Using a Wearable Vest. Roy Abi Zeid Daou,Elio Geha,Youssef Aoun,Ali Hayek,Josef Boercsoek,Jose Javier Serrano Olmedo. 2023
[9]Visualizing Complexity: A Dynamic Approach to Reverse Engineering. Ketki Balde,Lalji Prasad,Rashmi Yadav. 2024
[10]Research and Application of Pig Iris Recognition Technology. Shipu Xu,Guoqing Liu,Yong Liu,Yunsheng Wang. 2024
[11]Building Common Ground: An Inter-Institutional Computing & Engineering Education Transfer Learning Community. Danyelle Tauryce Ireland,Rebecca Zarch,Ilana Hipshman,Ashley Clark. 2021
[12]A Comparative Study of Various Learning Models for Object Detection in Contextual Scene Interpretation. Taranpreet Singh,Dr.Hemang Shrivastava. 2023
[13]Hybrid Confidentiality Framework for Secured Cloud Computing. Gaurav Shrivastava,Sachin Patel. 2022
[14]An Innovative Method for Authenticating and Accounting for Cloud-based Financial Transactions is to Publicly Disseminate the User's Private Key. Pravin R. Nerkar,Manoj K. Ramaiya. 2023
[15]Blockchain Cloud Computing: Comparative study on DDoS, MITM and SQL Injection Attack. Mamta Swarnkar,Shekh Kulsum Almas,Nagendra Singh,Harsh Pratap Singh,Anuprita Mishra,Anula Khare. 2024
[16]A Systematic Literature Review on Developing Job Profiles and Training Content for Open Data-Driven Smart Cities. Koukounidou Vasiliki,Kokkinaki Angelika,Osta Alain,Tsakiris Theodoros. 2024
[17]Revolutionizing Healthcare with Federated Learning: A Comprehensive Review. Snehlata Mishra,Ritu Tondon,Narendra Pal Singh Rathore. 2024
[18]Student’s Feedback by emotion and speech recognition through Deep Learning. Ati Jain,Hare Ram Sah. 2021
作者其他论文 更多>>
-
Comparative Study of Two Sky Hook Strategies analyzed from a control theory perspective
作者:Fouad Farah;Xavier Moreau;Roy Abi Zeid Daou
关键词:Vibrations;Suspensions (mechanical systems);Sensitivity;Transfer functions;Wheels;Control theory;Safety
-
Impact of Pretraining Datasets on Point-MAE Performance in Point Cloud Classification
作者:Rita Younes;Roy Abi Zeid Daou;Grace El Khoury;Jalal Possik;Charles Yaacoub
关键词:3D modeling;Performance benchmarking;Point cloud classification;Point-MAE;Self-supervised learning
-
Design and Implementation of a QR-Enabled Autonomous Bartender Using a User-Friendly Interface
作者:Joseph El Chartouni;Elio El Ghaoui;Gaby Abou Haidar;Roy Abi Zeid Daou
关键词:Automation;Costs;Accuracy;Service robots;QR codes;Beverage industry;Time factors
-
Design and Implementation of a Smart Human Posture Monitoring Device Using a Wearable Vest
作者:Roy Abi Zeid Daou;Elio Geha;Youssef Aoun;Ali Hayek;Josef Boercsoek;Jose Javier Serrano Olmedo
关键词:Visualization;Pain;System performance;Electrical safety;Assistive devices;Biomedical monitoring;Monitoring
-
Novel Image Processing Technique for Detection of Brain Inflammatory Diseases Using MRI Images
作者:Mohammad Marwan El Sidani;Wassim Kehdi;Charles Yaacoub;Mirna Jreije;Roy Abi Zeid Daou;Rita Younes
关键词:Pathology;Image segmentation;Machine learning algorithms;Magnetic resonance imaging;Approximation algorithms;Classification algorithms;Lesions
-
Design of an IOT Intra-Venious System for Patient Monitoring
作者:Tanios Tawk;Antonio El Sarrouh;Roy Abi Zeid Daou
关键词:Wireless communication;Patient monitoring;Medical services;Transforms;Real-time systems;Safety;Internet of Things
-
Design of a Novel Safe Approach to Monitor Drivers While Operating Their Cars
作者:Aseel Elhawawsha;Carla Zeine;Roy Abi Zeid Daou;Dominik Kalinowski;Joseph Khattar;Samer Telawi;Josef Boercsoek
关键词:Road accidents;Road traffic;Behavioral sciences;Safety;Automobiles;Biomedical monitoring;Monitoring