Atlas:SC4-May07
Sommaire
T0-T1-T2 transfer tests
- A new DDM version (called 0.3) is under test. The first goal is to reach a steady transfer from CERN (T0) to T1s.
- A new Arda monitoring from DDM 0.3 is accessible at this address
- A Twiki page is maintained for the whole transfers
- DDM 0.2 (MC production transfers) and DDM 0.3 (T0_T1-T2 transfers) run concurently. Both use the same FTS instance in LYON.
T0-LYON tests
General remarks
- Lyon participated to the T0-T1 test since the beginning (beginning of May).
- The main problems was Castor stability at CERN
- Datasets exists during 24 hours. After 24 hours, the datasets are deleted but not the physical files and the LFC entries.
- As a consequence of previous point, since 16 May, subscriptions T0->T1 of datasets older than 12 hours are removed
- Files are kept 8 hours in dcache disk area (cleaning managed by dcache team)
- No Tape driver is dedicated to this exercise (used also for production). Dedicated drivers will come with the new robot in LYON (end june ?)
DDM Live Plots
- Transfer rates to all T1s (MB/s) (Tx->T1) http://dashb-atlas-data-test.cern.ch/dashboard/templates/plots/OVERVIEW.throughput.86400.png
- Transfer rates to all components of FR cloud http://dashb-atlas-data-test.cern.ch/dashboard/templates/plots/LYON.throughput.86400.png
=== Network live plots
- CC-> LYON NRD : http://netstat.in2p3.fr/weathermap/graphiques/lyo-nrd.html
- LYON -> Paris (Renater network) : http://www.renater.fr/supervision/map-Renater4/level0/reseau-map-Renater4.gif
- France -> International (Paris network): http://www.renater.fr/supervision/map-IDF/level0/reseau-map-IDF.gif
Logbook
- Transfers started mid-April
- Status plot with one bin per day (15 May)
LYON-T2 tests
General remarks
- Only AOD datasets are transfered to T2s. Each dataset include one file of 3.6 GB.
- A cron script is run from LAPP to request
- transfer of datasets to each T2/T3 site
- delete files and LFC entries when the dataset transfer is complete or the dataset disappeared (operated by CERN)
- Files have to be transfered before the files (in LYON) and the datasets (at CERN) disappear. So from time to time, no datasets fullfill these constraints
Logbook
- 12 May First tests of LYON->T2. These tests should not affect T0->T2 transfers (dcache load)
- 15 May: Status plot for (15 May)
- First comments (15 May):
- CPPM, LAPP, LAL, SACLAY, LPNHE, LPC : OK
- NIPNE_02, NIPNE_07 : Seems to have network limitations
- TOKYO : Many transfers pending with DDM 0.2. Big fight between both DDM versions
- BEIJING : Problem to get TURL
- First comments (15 May):
- Transfers from LYON to T2s are probably affected by the saturation of the line between Computing Center and the NRD (RENATER node)[link]. All T1->T2 transfers go through this line.
- 16 May:
- TURL problem with BEIJING solved. Now problem of access right
- FTS T1->T2 behaves much better when CC->NRD link is not saturated
- 17 May :
- LYON->T2 transfers subscribed but not treated by DDM 0.3. Request help from DDM team.
- 21 May :
- LYON->T2 restarted after intervention of DDM team at CERN
- Problems : Access write in BEIJING, does not accept Miguel's certificate in NIPNE 07
- Lyon->Paris and Paris-> International link busy (no detailed monitoring)