Visually Impaired Aid using Convolutional Neural Networks, Transfer Learning, and Particle Competition and Cooperation

Registro completo de metadados
MetadadosDescriçãoIdioma
Autor(es): dc.contributorUniversidade Estadual Paulista (Unesp)-
Autor(es): dc.creatorBreve, Fabricio [UNESP]-
Autor(es): dc.creatorFischer, Carlos N. [UNESP]-
Data de aceite: dc.date.accessioned2022-02-22T00:44:08Z-
Data de disponibilização: dc.date.available2022-02-22T00:44:08Z-
Data de envio: dc.date.issued2021-06-25-
Data de envio: dc.date.issued2021-06-25-
Data de envio: dc.date.issued2020-07-01-
Fonte completa do material: dc.identifierhttp://dx.doi.org/10.1109/IJCNN48605.2020.9207606-
Fonte completa do material: dc.identifierhttp://hdl.handle.net/11449/205368-
Fonte: dc.identifier.urihttp://educapes.capes.gov.br/handle/11449/205368-
Descrição: dc.descriptionNavigation and mobility are some of the major problems faced by visually impaired people in their daily lives. Advances in computer vision led to the proposal of some navigation systems. However, most of them require expensive and/or heavy hardware. In this paper we propose the use of convolutional neural networks (CNN), transfer learning, and semi-supervised learning (SSL) to build a framework aimed at the visually impaired aid. It has low computational costs and, therefore, may be implemented on current smartphones, without relying on any additional equipment. The smartphone camera can be used to automatically take pictures of the path ahead. Then, they will be immediately classified, providing almost instantaneous feedback to the user. We also propose a dataset to train the classifiers, including indoor and outdoor situations with different types of light, floor, and obstacles. Many different CNN architectures are evaluated as feature extractors and classifiers, by fine-tuning weights pre-trained on a much larger dataset. The graph-based SSL method, known as particle competition and cooperation, is also used for classification, allowing feedback from the user to be incorporated without retraining the underlying network. 92% and 80% classification accuracy is achieved in the proposed dataset in the best supervised and SSL scenarios, respectively.-
Descrição: dc.descriptionSão Paulo State University (UNESP) Institute of Geosciences and Exact Sciences-
Descrição: dc.descriptionSão Paulo State University (UNESP) Institute of Geosciences and Exact Sciences-
Idioma: dc.languageen-
Relação: dc.relationProceedings of the International Joint Conference on Neural Networks-
???dc.source???: dc.sourceScopus-
Palavras-chave: dc.subjectConvolutional Neural Networks-
Palavras-chave: dc.subjectParticle Competition and Cooperation-
Palavras-chave: dc.subjectSemi-Supervised Learning-
Palavras-chave: dc.subjectTransfer Learning-
Título: dc.titleVisually Impaired Aid using Convolutional Neural Networks, Transfer Learning, and Particle Competition and Cooperation-
Aparece nas coleções:Repositório Institucional - Unesp

Não existem arquivos associados a este item.