Challenges faced by researchers in multi-messenger astroparticle physics include: computing-intensive search and preprocessing related to the diversity of content and formats of the data from different observatories as well as to data fragmentation over separate storage locations; inconsistencies in user interfaces for data retrieval; lack of the united infrastructure solutions suitable for both data gathering and online analysis, e.g. analyses employing deep neural networks.
In order to address solving these issues, the German-Russian Astroparticle Data Life Cycle Initiative (GRADLCI) was created. In addition, we support activities for communicating our research field to the public.
The approaches proposed by the project are based on the concept of data life cycle, which assumes a particular pipeline of data curation used for every unit of the data from the moment of its retrieval or creation through the stages of data preprocessing, analysis, publishing and archival. The movement towards unified data curation schemes is essential to increase the benefits gained in the analysis of geographically distributed or content-diverse data.
Within the project, an infrastructure for effective astroparticle data curation and online analysis was developed. Using it, first results on deep-learning based analysis were obtained.