ÚTEFČVUT Ústav technické a experimentální fyziky ČVUT v PrazeInstitute of Experimental and Applied Physics, CTU in Prague

Total Cost of Ownership and Evaluation of Google Cloud Resources for the ATLAS Experiment at the LHC

NázevTitle
Total Cost of Ownership and Evaluation of Google Cloud Resources for the ATLAS Experiment at the LHCTotal Cost of Ownership and Evaluation of Google Cloud Resources for the ATLAS Experiment at the LHC
Druh výsledkuResult type
Článek v časopiseJournal article
AutořiAuthors
L. Zwalinski, W. Zou, O. Zormpa, T.G. Zorbas, O. Zaplatílek, P. Vokáč, V. Vacek, A. Sopczak, K. Smolek, S. Pospíšil, V. Petousis, L. Novotný, M. Myška, S. Mondal, Z. Hubáček, P. Fiedler, H. Day-Hall, B. Bergmann, K. Augsten, B. Ali
Klíčová slovaKeywords
lhc, atlas
ExperimentCollaboration
ATLAS
DOIDOI
10.1007/s41781-024-00128-x
Časopis / citaceJournal / citation
Computing and Software for Big Science 9(1), 2 (2025) · ISSN 2510-2036
RokYear
2025
JazykLanguage
eng
ZáznamyRecords
ProjektProject
Výzkum základních stavebních kamenů hmoty s využitím špičkových technologiíFundamental constituents of matter through frontier technologies; CERN-CZ III - Výzkumná infrastruktura pro experimenty v CERN - LM2023040 (2023–2026)CERN-CZ III - Výzkumná infrastruktura pro experimenty v CERN - LM2023040 (2023–2026); Institucionální podpora na rozvoj výzkumné org.Institucionální podpora na rozvoj výzkumné org.
CitovánoCited by
7 (INSPIRE-HEP)
2024: 42025: 22026: 1
Citace ke staženíDownload citation
TXT · BibTeX

AbstraktAbstract

The ATLAS Google Project was established as part of an ongoing evaluation of the use of commercial clouds by the ATLAS Collaboration, in anticipation of the potential future adoption of such resources by WLCG grid sites to fulfil or complement their computing pledges. Seamless integration of Google cloud resources into the worldwide ATLAS distributed computing infrastructure was achieved at large scale and for an extended period of time, and hence cloud resources are shown to be an effective mechanism to provide additional, flexible computing capacity to ATLAS. For the first time a total cost of ownership analysis has been performed, to identify the dominant cost drivers and explore effective mechanisms for cost control. Network usage significantly impacts the costs of certain ATLAS workflows, underscoring the importance of implementing such mechanisms. Resource bursting has been successfully demonstrated, whilst exposing the true cost of this type of activity. A follow-up to the project is underway to investigate methods for improving the integration of cloud resources in data-intensive distributed computing environments and reducing costs related to network connectivity, which represents the primary expense when extensively utilising cloud resources.

The ATLAS Google Project was established as part of an ongoing evaluation of the use of commercial clouds by the ATLAS Collaboration, in anticipation of the potential future adoption of such resources by WLCG grid sites to fulfil or complement their computing pledges. Seamless integration of Google cloud resources into the worldwide ATLAS distributed computing infrastructure was achieved at large scale and for an extended period of time, and hence cloud resources are shown to be an effective mechanism to provide additional, flexible computing capacity to ATLAS. For the first time a total cost of ownership analysis has been performed, to identify the dominant cost drivers and explore effective mechanisms for cost control. Network usage significantly impacts the costs of certain ATLAS workflows, underscoring the importance of implementing such mechanisms. Resource bursting has been successfully demonstrated, whilst exposing the true cost of this type of activity. A follow-up to the project is underway to investigate methods for improving the integration of cloud resources in data-intensive distributed computing environments and reducing costs related to network connectivity, which represents the primary expense when extensively utilising cloud resources.

↑ NahoruTop