Difference between revisions of "Atlas"
| Ligne 38: | Ligne 38: | ||
|| | || | ||
[https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Download&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-CC&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | [https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Download&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-CC&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | ||
| + | |||
| + | |- | ||
| + | | Production upload || | ||
| + | [https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Upload&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-LAPP&var-dst_site=IN2P3-LAPP-MWTEST&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | ||
| + | || | ||
| + | [https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Upload&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-LPSC&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | ||
| + | || | ||
| + | [https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Upload&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-CC&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | ||
|- | |- | ||
| Ligne 46: | Ligne 54: | ||
|| | || | ||
[https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Input&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-CC&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | [https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Input&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-CC&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | ||
| + | |||
| + | |- | ||
| + | | Production output || | ||
| + | [https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Output&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-LAPP&var-dst_site=IN2P3-LAPP-MWTEST&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | ||
| + | || | ||
| + | [https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Output&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-LPSC&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | ||
| + | || | ||
| + | [https://monit-grafana.cern.ch/d/NppG4Rhiz/atlas-ddm-dashboard-latest-data?orgId=17&from=now-7d&to=now&var-groupby=src_endpoint&var-binning=$__auto_interval_binning&var-activity=Production%20Output&var-src_country=All&var-src_site=All&var-dst_country=All&var-dst_site=IN2P3-CC&var-measurement=ddm_transfer&var-retention_policy=raw&var-columns=dst_cloud&var-rows=src_cloud| Link] | ||
|- | |- | ||
Version du 16:25, 15 septembre 2018
Bienvenue sur la page Atlas LCG-France
Welcome to the LCG-France Atlas page
DOMA_FR tests
- Global transfers from/ to (same site dest/source site excluded)
| Header text | LAPP | LPSC | CC |
|---|---|---|---|
| From | |||
| To |
- Data access monitorings per WN
| Destination of access | LAPP | LPSC | CC |
|---|---|---|---|
| Production download | |||
| Production upload | |||
| Production input | |||
| Production output | |||
| Analysis Download | |||
| Analysis Direct Access |
- Current conclusion
- Enabling direct access creates much more network usage -> Is it usefull for ATLAS ? (processing urgent request faster ?)
- Job brokering prefers direct access than Rucio/FTS transfer
- 10 Gb/s connection LAPP-CC (used for all LAPP WAN transfers to any site) can get saturated if huge amount of jobs starting at same time (No smoothing by Panda)
- Next steps
- Deploy Rucio 1.17 to use protocol priority defined in AGIS (bug in 1.16). Solving bug : use most trusted protocol and would help to control srm decreasing usage
- Monitor job efficiency vs RTT between SE and WN -> Identify when cache does not have impact (assuming no network bandwidth limitation)
- Understand the ATLAS job borkering algorithm
