Beyond HEP: Photon and accelerator science computing infrastructure at DESY

التفاصيل البيبلوغرافية
العنوان: Beyond HEP: Photon and accelerator science computing infrastructure at DESY
المؤلفون: Beyer, Christoph, Bujack, Stefan, Reppin, Johannes, Kemp, Yves, Lewendel, Birgit, Schluenzen, Frank, Schuh, Michael, Sternberger, Sven, Voss, Christian, Wengert, Markus, Dietrich, Stefan, Finnern, Thomas, Flemming, Martin, Fuhrmann, Patrick, Gasthuber, Martin, Gellrich, Andreas, Guelzow, Volker, Hartmann, Thomas
المصدر: The European physical journal / Web of Conferences 245, 07036 (2020). doi:10.1051/epjconf/202024507036 ; 24th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2019), CHEP 2019, Adelaide, Australia, 2019-11-04 - 2019-11-08
بيانات النشر: EDP Sciences
سنة النشر: 2020
المجموعة: DESY Publication Database (PUBDB)
مصطلحات موضوعية: info:eu-repo/classification/ddc/530, activity report, DESY PETRA Stor, Grid computing, programming, data management, DESY Lab, computer: network, data compilation
جغرافية الموضوع: DE
الوصف: DESY is one of the largest accelerator laboratories in Europe. It develops and operates state of the art accelerators for fundamental science in the areas of high energy physics, photon science and accelerator development. While for decades high energy physics (HEP) has been the most prominent user of the DESY compute, storage and network infrastructure, various scientific areas as science with photons and accelerator development have caught up and are now dominating the demands on the DESY infrastructure resources, with significant consequences for the IT resource provisioning. In this contribution, we will present an overview of the computational, storage and network resources covering the various physics communities on site.Ranging from high-throughput computing (HTC) batch-like offline processing in the Grid and the interactive user analyses resources in the National Analysis Factory (NAF) for the HEP community, to the computing needs of accelerator development or of photon sciences such as PETRA III or the European XFEL. Since DESY is involved in these experiments and their data taking, their requirements include fast low-latency online processing for data taking and calibration as well as offline processing, thus high-performance computing (HPC) workloads, that are run on the dedicated Maxwell HPC cluster.As all communities face significant challenges due to changing environments and increasing data rates in the following years, we will discuss how this will reflect in necessary changes to the computing and storage infrastructures.We will present DESY compute cloud and container orchestration plans as a basis for infrastructure and platform services. We will show examples of Jupyter notebooks for small scale interactive analysis, as well as its integration into large scale resources such as batch systems or Spark clusters.To overcome the fragmentation of the various resources for all scientific communities at DESY, we explore how to integrate them into a seamless user experience in an Interdisciplinary ...
نوع الوثيقة: conference object
اللغة: English
Relation: info:eu-repo/semantics/altIdentifier/issn/2101-6275; info:eu-repo/semantics/altIdentifier/issn/2100-014X; https://bib-pubdb1.desy.de/record/452127; https://bib-pubdb1.desy.de/search?p=id:%22PUBDB-2020-04519%22
الاتاحة: https://bib-pubdb1.desy.de/record/452127
https://bib-pubdb1.desy.de/search?p=id:%22PUBDB-2020-04519%22
Rights: info:eu-repo/semantics/openAccess
رقم الانضمام: edsbas.6510AB04
قاعدة البيانات: BASE