PoS - Proceedings of Science
Volume 415 - International Symposium on Grids & Clouds 2022 (ISGC2022) - Network, Security, Infrastructure & Operations Session
Supporting Multiple Concurrent Usage Patterns on the HTCondor-Based HTC Computing System at IHEP
X. Jiang*, R. Du, Q. Hu, G. Sun, J. Shi, L. Xia and X. Liu
Full text: pdf
Published on: September 28, 2022
Abstract
IHEP is a multi-disciplinary research institution which is hosting or attending about 15 experiments in the field of high energy physics, including LHAASO, BES, JUNO, HEPS, DYW, ALI, GECAM, ATLAS, CMS, LHCb, etc[1]. Corresponding to these diverse experiments, also in the computing system, a range of usage scenarios has to be considered and the technologies employed should be suitable for the different requirements from these experiments and applications. The technological architectures and the corresponding scenarios are: 1. a local sharing pool for massive offline data processing; 2. a unified sharing pool with a special resource policy for WLCG (Worldwide LHC Computing Grid) and JUNO distributed computing grid; 3. a dHTC (distributed High Throughput Computing) pool for resources sharing between HTC (High Throughput Computing) and HPC (High Performance Computing) and between sites; 4. a near-real-time computing pool for astrophysics streaming data processing; 5. customized clusters for the cooperating institutions or universities. HTCondor[2] is a popular distributed batch system in HEP computing. This paper will discuss an HTC computing system supporting different usage scenarios, based on HTCondor at IHEP, including local batch computing, distributed computing and near-real-time computing. Currently, the whole computing system is managing about 50,000 CPU cores (including x86-arch CPU and arm-arch CPU) and some GPU cards.
DOI: https://doi.org/10.22323/1.415.0010
How to cite

Metadata are provided both in "article" format (very similar to INSPIRE) as this helps creating very compact bibliographies which can be beneficial to authors and readers, and in "proceeding" format which is more detailed and complete.

Open Access
Creative Commons LicenseCopyright owned by the author(s) under the term of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.