Learning Streamed Attention Network from Descriptor Images for Cross-Resolution 3D Face Recognition

Registro completo de metadados
MetadadosDescriçãoIdioma
Autor(es): dc.contributorSão Paulo State Technological College (FATEC)-
Autor(es): dc.contributorUniversity of Parma-
Autor(es): dc.contributorUniversidade Estadual Paulista (UNESP)-
Autor(es): dc.contributorUniversity of Florence-
Autor(es): dc.creatorNeto, João Baptista Cardia-
Autor(es): dc.creatorFerrari, Claudio-
Autor(es): dc.creatorMarana, Aparecido Nilceu-
Autor(es): dc.creatorBerretti, Stefano-
Autor(es): dc.creatorDel Bimbo, Alberto-
Data de aceite: dc.date.accessioned2025-08-21T18:02:47Z-
Data de disponibilização: dc.date.available2025-08-21T18:02:47Z-
Data de envio: dc.date.issued2023-07-29-
Data de envio: dc.date.issued2023-07-29-
Data de envio: dc.date.issued2023-01-22-
Fonte completa do material: dc.identifierhttp://dx.doi.org/10.1145/3527158-
Fonte completa do material: dc.identifierhttp://hdl.handle.net/11449/249658-
Fonte: dc.identifier.urihttp://educapes.capes.gov.br/handle/11449/249658-
Descrição: dc.descriptionIn this article, we propose a hybrid framework for cross-resolution 3D face recognition which utilizes a Streamed Attention Network (SAN) that combines handcrafted features with Convolutional Neural Networks (CNNs). It consists of two main stages: first, we process the depth images to extract low-level surface descriptors and derive the corresponding Descriptor Images (DIs), represented as four-channel images. To build the DIs, we propose a variation of the 3D Local Binary Pattern (3DLBP) operator that encodes depth differences using a sigmoid function. Then, we design a CNN that learns from these DIs. The peculiarity of our solution consists in processing each channel of the input image separately, and fusing the contribution of each channel by means of both self- and cross-attention mechanisms. This strategy showed two main advantages over the direct application of Deep-CNN to depth images of the face; on the one hand, the DIs can reduce the diversity between high- and low-resolution data by encoding surface properties that are robust to resolution differences. On the other, it allows a better exploitation of the richer information provided by low-level features, resulting in improved recognition. We evaluated the proposed architecture in a challenging cross-dataset, cross-resolution scenario. To this aim, we first train the network on scanner-resolution 3D data. Next, we utilize the pre-trained network as feature extractor on low-resolution data, where the output of the last fully connected layer is used as face descriptor. Other than standard benchmarks, we also perform experiments on a newly collected dataset of paired high- and low-resolution 3D faces. We use the high-resolution data as gallery, while low-resolution faces are used as probe, allowing us to assess the real gap existing between these two types of data. Extensive experiments on low-resolution 3D face benchmarks show promising results with respect to state-of-the-art methods.-
Descrição: dc.descriptionSão Paulo State Technological College (FATEC), Rua Maranhão, 898, Catanduva-
Descrição: dc.descriptionDepartment of Architecture and Engineering University of Parma, Parco Area delle Scienze, 181/A-
Descrição: dc.descriptionRecogna Laboratory São Paulo State University (UNESP), Av. Eng. Luís Edmundo Carrijo Coube-
Descrição: dc.descriptionMicc University of Florence, Viale Giovanni Battista Morgagni, 65-
Descrição: dc.descriptionRecogna Laboratory São Paulo State University (UNESP), Av. Eng. Luís Edmundo Carrijo Coube-
Idioma: dc.languageen-
Relação: dc.relationACM Transactions on Multimedia Computing, Communications and Applications-
???dc.source???: dc.sourceScopus-
Palavras-chave: dc.subject3D face recognition-
Palavras-chave: dc.subjectconvolutional neural networks-
Palavras-chave: dc.subjectfeature descriptors-
Palavras-chave: dc.subjectself- and cross-attention-
Título: dc.titleLearning Streamed Attention Network from Descriptor Images for Cross-Resolution 3D Face Recognition-
Tipo de arquivo: dc.typelivro digital-
Aparece nas coleções:Repositório Institucional - Unesp

Não existem arquivos associados a este item.