A SYSTEM PROPOSAL FOR AUTOMATED DATA CLEANING ENVIRONMENT

Registro completo de metadados
MetadadosDescriçãoIdioma
Autor(es): dc.contributorUniversidade Estadual Paulista (UNESP)-
Autor(es): dc.contributorFederal University of Fluminense-UFF-
Autor(es): dc.creatorValêncio, Carlos Roberto-
Autor(es): dc.creatorJardini, Toni-
Autor(es): dc.creatorMartins, Victor Hugo Penhalves-
Autor(es): dc.creatorColombini, Angelo Cesar-
Autor(es): dc.creatorFortes, Márcio Zamboti-
Data de aceite: dc.date.accessioned2025-08-21T19:04:38Z-
Data de disponibilização: dc.date.available2025-08-21T19:04:38Z-
Data de envio: dc.date.issued2025-04-29-
Data de envio: dc.date.issued2020-10-29-
Fonte completa do material: dc.identifierhttp://dx.doi.org/10.5935/jetia.v6i25.685-
Fonte completa do material: dc.identifierhttps://hdl.handle.net/11449/308816-
Fonte: dc.identifier.urihttp://educapes.capes.gov.br/handle/11449/308816-
Descrição: dc.descriptionOne of the great challenges to obtaining knowledge from data sources is to ensure consistency and non-duplication of stored information. Many techniques have been proposed to minimize the work cost and to allow data to be analyzed and properly corrected. However, there are still other essential aspects for the success of data cleaning process that involve many technological areas: performance, semantic and autonomy of the process. Against this backdrop, we developed an automated configurable data cleaning environment based on training and physical-semantic data similarity, aiming to provide a more efficient and extensible tool for performing information correction which covers problems not yet explored such as semantic and autonomy of the cleaning implementation process. The developed work has, among its objectives, the reduction of user interaction in the process of analyzing and correcting data inconsistencies and duplications. With a properly calibrated environment, the efficiency is significant, covering approximately 90% of inconsistencies in the database, with a 0% percentage of false-positive cases. Approaches were also demonstrated to show that besides detecting and treating information inconsistencies and duplication of positive cases, they also addressed cases of detected false-positives and the negative impacts they may have on the data cleaning process, whether manual or automated, which is not yet widely discussed in literature. The most significant contribution of this work refers to the developed tool that, without user interaction, is automatically able to analyze and eliminate 90% of the inconsistencies and duplications of information contained in a database, with no occurrence of false-positives. The results of the tests proved the effectiveness of all the developed features, relevant to each module of the proposed architecture. In several scenarios the experiments demonstrated the effectiveness of the tool.-
Descrição: dc.descriptionSão Paulo State University-UNESP, São Paulo-
Descrição: dc.descriptionFederal University of Fluminense-UFF, Rio de Janeiro-
Descrição: dc.descriptionSão Paulo State University-UNESP, São Paulo-
Formato: dc.format4-15-
Idioma: dc.languageen-
Relação: dc.relationJournal of Engineering and Technology for Industrial Applications-
???dc.source???: dc.sourceScopus-
Palavras-chave: dc.subjectData analysis-
Palavras-chave: dc.subjectData cleaning-
Palavras-chave: dc.subjectKnowledge Discovery in Databases (KDD)-
Palavras-chave: dc.subjectSemantic-
Título: dc.titleA SYSTEM PROPOSAL FOR AUTOMATED DATA CLEANING ENVIRONMENT-
Tipo de arquivo: dc.typelivro digital-
Aparece nas coleções:Repositório Institucional - Unesp

Não existem arquivos associados a este item.