Fine-Tuning Dropout Regularization in Energy-Based Deep Learning

Registro completo de metadados
MetadadosDescriçãoIdioma
Autor(es): dc.contributorUniversidade Estadual Paulista (UNESP)-
Autor(es): dc.creatorde Rosa, Gustavo H.-
Autor(es): dc.creatorRoder, Mateus-
Autor(es): dc.creatorPapa, João P.-
Data de aceite: dc.date.accessioned2025-08-21T16:03:27Z-
Data de disponibilização: dc.date.available2025-08-21T16:03:27Z-
Data de envio: dc.date.issued2022-05-01-
Data de envio: dc.date.issued2022-05-01-
Data de envio: dc.date.issued2020-12-31-
Fonte completa do material: dc.identifierhttp://dx.doi.org/10.1007/978-3-030-93420-0_10-
Fonte completa do material: dc.identifierhttp://hdl.handle.net/11449/234115-
Fonte: dc.identifier.urihttp://educapes.capes.gov.br/handle/11449/234115-
Descrição: dc.descriptionDeep Learning architectures have been extensively studied in the last years, mainly due to their discriminative power in Computer Vision. However, one problem related to such models concerns their number of parameters and hyperparameters, which can easily reach hundreds of thousands. Additional drawbacks consist of their need for extensive training datasets and their high probability of overfitting. Recently, a naïve idea of disconnecting neurons from a network, known as Dropout, has shown to be a promising solution though it requires an adequate hyperparameter setting. Therefore, this work addresses finding suitable Dropout ratios through meta-heuristic optimization in the task of image reconstruction. Several energy-based Deep Learning architectures, such as Restricted Boltzmann Machines, Deep Belief Networks, and several meta-heuristic techniques, such as Particle Swarm Optimization, Bat Algorithm, Firefly Algorithm, Cuckoo Search, were employed in such a context. The experimental results describe the feasibility of using meta-heuristic optimization to find suitable Dropout parameters in three literature datasets and reinforce bio-inspired optimization as an alternative to empirically choosing regularization-based hyperparameters.-
Descrição: dc.descriptionDepartment of Computing São Paulo State University-
Descrição: dc.descriptionDepartment of Computing São Paulo State University-
Formato: dc.format99-108-
Idioma: dc.languageen-
Relação: dc.relationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)-
???dc.source???: dc.sourceScopus-
Palavras-chave: dc.subjectDeep learning-
Palavras-chave: dc.subjectMachine learning-
Palavras-chave: dc.subjectMeta-heuristic optimization-
Palavras-chave: dc.subjectRegularization methods-
Título: dc.titleFine-Tuning Dropout Regularization in Energy-Based Deep Learning-
Tipo de arquivo: dc.typeaula digital-
Aparece nas coleções:Repositório Institucional - Unesp

Não existem arquivos associados a este item.