Virgo Kick-Off Meeting on Computing
Thursday, February 21, 2019 -
9:30 AM
Monday, February 18, 2019
Tuesday, February 19, 2019
Wednesday, February 20, 2019
Thursday, February 21, 2019
9:30 AM
LVC collaboration
LVC collaboration
9:30 AM - 10:00 AM
How do Virgo and Ligo share/compete for resources - Who can take decissions on sw, data management, sites... - For example, should virgo use ligo's git? - Offline sw is shared amongst both collaborations? - How is the analysis sw developed? Who 'owns' the sw?
10:00 AM
SW management
SW management
10:00 AM - 11:00 AM
Current sw management rules at: https://wiki.virgo-gw.eu/Software_Management/WebHome Which sw is managed? - Online? - Framework? - User analisis? Role of the existing Ligo-Virgo Software Configuration Control Board (SCCB) in this game: https://wiki.ligo.org/Computing/SCCB /virgoApps more than 900 packages! - Review product/module breakdown Is there a "Testing environment"?, useful/needed to decouple from the operational one. - Not only for data analysis pipelines, but also at ‘framework’ level; e.g. to test Rucio, DIRAC, data exchange, bookkeeping, workload… How are the main pipelines developed? Internal group effort or collab effort? - Which are developed by Virgo? - Which are coming external to Virgo? SW distribution - Conda (Review of the corresponding proposal https://tds.virgo-gw.eu/ql/?c=13967) - Cvmfs - Singularity Newer toolings available - Git - If/when/how - CMT not maintained - Can we take the conda migration as an opportunity to replace cmt with something else? CMake, bazel… Automated release, packaging and distribution possible? - Roadmap
11:00 AM
Coffee break
Coffee break
11:00 AM - 11:15 AM
11:15 AM
Offline activities
Offline activities
11:15 AM - 1:00 PM
Two main topics: - Data management - Workload management Tools to fit Virgo needs (Rucio/DIRAC/others) LIGO goes to Rucio - thus Virgo should, at least, be able to handle it. Pros-cons of tools to have an overall picture and ideally take a decision and run with it. Running LIGO-Virgo analyses on Virgo computing resources: status & plans Data storage - Which data is stored where? Virgo raw only in cascina? h(t) everywhere? Rewiew of the current relationship with Computing Centers.
1:00 PM
Lunch
Lunch
1:00 PM - 2:30 PM
2:30 PM
Online processing
Online processing
2:30 PM - 4:00 PM
Clarifications on data flow diagrams and processing modules - Computing just on raw Virgo data, or also on raw LIGO data? - Just on h(t), both LIGO+Virgo?. - DetChar/Quality: just on raw Virgo? Also on LIGO? - Processing raw data generates h(t), and also veto? - General review of data flow diagram to identify possible problems or limitations Migration/upgrade processes ongoing: storage, Kafka, etc. - Deadlines, tracking system, etc - For the Open Public Alerts (OPA) machinery (gracedb, gwcelery, lvalert, …) we are fully relying on Ligo, are we happy about it? - Bulk data handling (envision the future Data Transfer and Access integrated solution based on a EGI/OSG Framework) - GraceDB is managed by Ligo, are we happy with that?
4:00 PM
Coffee break
Coffee break
4:00 PM - 4:15 PM
4:15 PM
Wrap-up and actions to be taken
Wrap-up and actions to be taken
4:15 PM - 5:30 PM