Volume 476 - 42nd International Conference on High Energy Physics (ICHEP2024) - Computing and Data Handling Posters
Optimization of fast parallel operations with large disk arrays for the AMBER experiment
M. Zemko*, D. Ecker, V. Frolov, S.J. Huber, V. Jary, I. Konorov, J. Novy, B.M. Veit and M. Virius
*: corresponding author
Full text: pdf
Supplementary files:
Pre-published on: January 06, 2025
Published on: April 29, 2025
Abstract
This contribution addresses the need for reliable and efficient data storage in the high-energy physics experiment called AMBER. The experiment generates sustained data rates of up to 10 GB/s, requiring optimization of data storage. The study investigates single-disk performance, including random and sequential disk operations, highlighting the impact of parallel access and disk geometry. A comparison with SSD drives reveals important differences. Various RAID configurations are assessed, considering their reliability, data rates, and capacity. Probability analysis is used to evaluate the RAID rebuilding procedure in the event of disk failure. In addition, an innovative approach of alternating disk access is proposed to ensure uninterrupted performance. Finally, the study identifies the most suitable RAID configuration for the AMBER experiment. The results of this study contribute to the design of high-performance storage solutions for data-intensive scientific experiments.
DOI: https://doi.org/10.22323/1.476.1044
How to cite

Metadata are provided both in article format (very similar to INSPIRE) as this helps creating very compact bibliographies which can be beneficial to authors and readers, and in proceeding format which is more detailed and complete.

Open Access
Creative Commons LicenseCopyright owned by the author(s) under the term of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.