PoS - Proceedings of Science
Volume 434 - International Symposium on Grids & Clouds (ISGC) 2023 in conjunction with HEPiX Spring 2023 Workshop (ISGC&HEPiX2023) - Data Management & Big Data
Distributed Data Management System at IHEP
X. Zhang*, X. Zhang, H. Li, Y. Bi, H. Hu and H. Wang
Full text: pdf
Published on: October 25, 2023
Abstract
A distributed grid data management system has been established at the Institute of High Energy Physics (IHEP) since 2014, leveraging the DIRAC data management system. This system has been effectively utilized by the BESIII, JUNO, and CEPC experiments. To address the diverse data scales and intricate data management requirements associated with data production, IHEP developers have embarked on endeavors to create a more adaptable and experiment-oriented grid data management system based on Rucio, owing to its proven reliability, scalability, and automation capabilities. As a result, a production system for Monte Carlo (MC) data production has been implemented, relying on the DIRAC Data Management System (DMS) solution. Furthermore, work is underway to develop Rucio data transfer daemon plugins to facilitate non-grid data transfer for upcoming experiments at IHEP. Supporting infrastructure for distributed data management has also been established, encompassing StoRM and EOS storage elements, an IAM authentication service, as well as a third-party-copy active probing system.
DOI: https://doi.org/10.22323/1.434.0027
How to cite

Metadata are provided both in "article" format (very similar to INSPIRE) as this helps creating very compact bibliographies which can be beneficial to authors and readers, and in "proceeding" format which is more detailed and complete.

Open Access
Creative Commons LicenseCopyright owned by the author(s) under the term of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.