Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium
Drabent A, Freyermuth O, Giffels M, Hoeft M, Künsemöller J, Roland B, Schwarz D, Wissing C (2024)
In: EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023). EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences, 295. EDP Sciences .
Konferenzbeitrag
| Veröffentlicht | Englisch
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Drabent, Alexander;
Freyermuth, Oliver;
Giffels, Manuel;
Hoeft, Matthias;
Künsemöller, JörnUniBi;
Roland, Benoit;
Schwarz, DominikUniBi ;
Wissing, Christoph
Einrichtung
Abstract / Bemerkung
PUNCH4NFDI, funded by the Germany Research Foundation initially for five years, is a diverse consortium of particle, astro-, astroparticle, hadron and nuclear physics embedded in the National Research Data Infrastructure initiative. In order to provide seamless and federated access to the huge variety of compute and storage systems provided by the participating communities covering their very diverse needs, the Compute4PUNCH and Storage4PUNCH concepts have been developed. Both concepts comprise state-of-the-art technologies such as a token-based AAI for standardized access to compute and storage resources. The community supplied heterogeneous HPC, HTC and Cloud compute resources are dynamically and transparently integrated into one federated HTCondor-based overlay batch system using the COBalD/TARDIS resource meta-scheduler. Traditional login nodes and a JupyterHub provide entry points into the entire landscape of available compute resources, while container technologies and the CERN Virtual Machine File System (CVMFS) ensure a scalable provisioning of community-specific software environments. In Storage4PUNCH, community supplied storage systems mainly based on dCache or XRootD technology are being federated in a common infrastructure employing methods that are well established in the wider HEP community. Furthermore existing technologies for caching as well as metadata handling are being evaluated with the aim for a deeper integration. The combined Compute4PUNCH and Storage4PUNCH environment will allow a large variety of researchers to carry out resource-demanding analysis tasks. In this contribution we will present the Compute4PUNCH and Storage4PUNCH concepts, the current status of the developments as well as first experiences with scientific applications being executed on the available prototypes.
Erscheinungsjahr
2024
Titel des Konferenzbandes
EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023)
Serien- oder Zeitschriftentitel
EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences
Band
295
Art.-Nr.
07020
Konferenz
26th International Conference on Computing in High Energy and Nuclear Physics (CHEP)
Konferenzort
Norfolk, VA
Konferenzdatum
2023-05-08 – 2023-05-12
eISSN
2100-014X
Page URI
https://pub.uni-bielefeld.de/record/2992527
Zitieren
Drabent A, Freyermuth O, Giffels M, et al. Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium. In: EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023). EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences. Vol 295. EDP Sciences ; 2024.
Drabent, A., Freyermuth, O., Giffels, M., Hoeft, M., Künsemöller, J., Roland, B., Schwarz, D., et al. (2024). Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium. EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023), EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences, 295 EDP Sciences . https://doi.org/10.1051/epjconf/202429507020
Drabent, Alexander, Freyermuth, Oliver, Giffels, Manuel, Hoeft, Matthias, Künsemöller, Jörn, Roland, Benoit, Schwarz, Dominik, and Wissing, Christoph. 2024. “Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium”. In EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023). Vol. 295. EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences. EDP Sciences : 07020.
Drabent, A., Freyermuth, O., Giffels, M., Hoeft, M., Künsemöller, J., Roland, B., Schwarz, D., and Wissing, C. (2024). “Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium” in EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023) EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences, vol. 295, (EDP Sciences ).
Drabent, A., et al., 2024. Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium. In EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023). EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences. no.295 EDP Sciences .
A. Drabent, et al., “Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium”, EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023), EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences, vol. 295, EDP Sciences , 2024.
Drabent, A., Freyermuth, O., Giffels, M., Hoeft, M., Künsemöller, J., Roland, B., Schwarz, D., Wissing, C.: Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium. EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023). EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences. 295, EDP Sciences (2024).
Drabent, Alexander, Freyermuth, Oliver, Giffels, Manuel, Hoeft, Matthias, Künsemöller, Jörn, Roland, Benoit, Schwarz, Dominik, and Wissing, Christoph. “Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium”. EPJ Web of Conf. 26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2023). EDP Sciences , 2024.Vol. 295. EPJ Web of Conferences : Open-Access Proceedings in Physics and Related Sciences.
Export
Markieren/ Markierung löschen
Markierte Publikationen
Web of Science
Dieser Datensatz im Web of Science®Suchen in