A comparison of different database technologies for the CMS AsyncStageOut transfer database

Registro completo de metadados
MetadadosDescriçãoIdioma
Autor(es): dc.contributorUniversidade Estadual Paulista (UNESP)-
Autor(es): dc.contributorCalifornia Institute of Technology-
Autor(es): dc.contributorINFN Sezione di Trieste-
Autor(es): dc.contributorINFN Sezione di Perugia-
Autor(es): dc.contributorFermi National Accelerator Laboratory-
Autor(es): dc.contributorVilnius University-
Autor(es): dc.contributorUniversity of Sofia St. Kliment Ohridski-
Autor(es): dc.contributorCERN-
Autor(es): dc.contributorCIEMAT-
Autor(es): dc.creatorCiangottini, D.-
Autor(es): dc.creatorBalcas, J.-
Autor(es): dc.creatorMascheroni, M.-
Autor(es): dc.creatorRupeika, E. A.-
Autor(es): dc.creatorVaandering, E.-
Autor(es): dc.creatorRiahi, H.-
Autor(es): dc.creatorSilva, J. M.D. [UNESP]-
Autor(es): dc.creatorHernandez, J. M.-
Autor(es): dc.creatorBelforte, S.-
Autor(es): dc.creatorIvanov, T. T.-
Data de aceite: dc.date.accessioned2022-08-04T22:06:51Z-
Data de disponibilização: dc.date.available2022-08-04T22:06:51Z-
Data de envio: dc.date.issued2022-04-28-
Data de envio: dc.date.issued2022-04-28-
Data de envio: dc.date.issued2017-11-23-
Fonte completa do material: dc.identifierhttp://dx.doi.org/10.1088/1742-6596/898/4/042048-
Fonte completa do material: dc.identifierhttp://hdl.handle.net/11449/220984-
Fonte: dc.identifier.urihttp://educapes.capes.gov.br/handle/11449/220984-
Descrição: dc.descriptionAsyncStageOut (ASO) is the component of the CMS distributed data analysis system (CRAB) that manages users transfers in a centrally controlled way using the File Transfer System (FTS3) at CERN. It addresses a major weakness of the previous, decentralized model, namely that the transfer of the user's output data to a single remote site was part of the job execution, resulting in inefficient use of job slots and an unacceptable failure rate. Currently ASO manages up to 600k files of various sizes per day from more than 500 users per month, spread over more than 100 sites. ASO uses a NoSQL database (CouchDB) as internal bookkeeping and as way to communicate with other CRAB components. Since ASO/CRAB were put in production in 2014, the number of transfers constantly increased up to a point where the pressure to the central CouchDB instance became critical, creating new challenges for the system scalability, performance, and monitoring. This forced a re-engineering of the ASO application to increase its scalability and lowering its operational effort. In this contribution we present a comparison of the performance of the current NoSQL implementation and a new SQL implementation, and how their different strengths and features influenced the design choices and operational experience. We also discuss other architectural changes introduced in the system to handle the increasing load and latency in delivering output to the user.-
Descrição: dc.descriptionUniversidade Estadual Paulista-
Descrição: dc.descriptionCalifornia Institute of Technology-
Descrição: dc.descriptionINFN Sezione di Trieste-
Descrição: dc.descriptionINFN Sezione di Perugia-
Descrição: dc.descriptionFermi National Accelerator Laboratory-
Descrição: dc.descriptionVilnius University-
Descrição: dc.descriptionUniversity of Sofia St. Kliment Ohridski-
Descrição: dc.descriptionCERN-
Descrição: dc.descriptionCIEMAT-
Descrição: dc.descriptionUniversidade Estadual Paulista-
Idioma: dc.languageen-
Relação: dc.relationJournal of Physics: Conference Series-
???dc.source???: dc.sourceScopus-
Título: dc.titleA comparison of different database technologies for the CMS AsyncStageOut transfer database-
Aparece nas coleções:Repositório Institucional - Unesp

Não existem arquivos associados a este item.