Difference between revisions of "Atlas:SC4-May07"

Un article de lcgwiki.
Jump to: navigation, search
M (General remarks)
M (T0-T1-T2 transfer tests)
Ligne 14: Ligne 14:
 
* No Tape driver is dedicated to this exercise (used also for production). Dedicated drivers will come with the new robot in LYON (end june ?)
 
* No Tape driver is dedicated to this exercise (used also for production). Dedicated drivers will come with the new robot in LYON (end june ?)
  
=== Live Plots ===
+
=== DDM Live Plots ===
 
* Transfer rates to all T1s (MB/s) (Tx->T1) http://dashb-atlas-data-test.cern.ch/dashboard/templates/plots/OVERVIEW.throughput.86400.png
 
* Transfer rates to all T1s (MB/s) (Tx->T1) http://dashb-atlas-data-test.cern.ch/dashboard/templates/plots/OVERVIEW.throughput.86400.png
 
* Transfer rates to all components of FR cloud http://dashb-atlas-data-test.cern.ch/dashboard/templates/plots/LYON.throughput.86400.png
 
* Transfer rates to all components of FR cloud http://dashb-atlas-data-test.cern.ch/dashboard/templates/plots/LYON.throughput.86400.png
  
 +
=== Network live plots
 +
* CC-> LYON NRD : http://netstat.in2p3.fr/weathermap/graphiques/lyo-nrd.html
 +
* LYON -> Paris (Renater network) : http://www.renater.fr/supervision/map-Renater4/level0/reseau-map-Renater4.gif
 +
* France -> International (Paris network): http://www.renater.fr/supervision/map-IDF/level0/reseau-map-IDF.gif
 +
 
=== Logbook ===
 
=== Logbook ===
 
* Transfers started mid-April  
 
* Transfers started mid-April  
Ligne 49: Ligne 54:
 
* 17 May :
 
* 17 May :
 
** LYON->T2 transfers subscribed but not treated by DDM 0.3. Request help from DDM team.
 
** LYON->T2 transfers subscribed but not treated by DDM 0.3. Request help from DDM team.
 +
 +
* 21 May :
 +
** LYON->T2 restarted after intervention of DDM team at CERN
 +
** Problems : Access write in BEIJING, does not accept Miguel's certificate in NIPNE 07
 +
** Lyon->Paris and Paris-> International link busy (no detailed monitoring)

Version du 16:44, 21 mai 2007

T0-T1-T2 transfer tests

  • A new DDM version (called 0.3) is under test. The first goal is to reach a steady transfer from CERN (T0) to T1s.
  • A new Arda monitoring from DDM 0.3 is accessible at this address
  • A Twiki page is maintained for the whole transfers
  • DDM 0.2 (MC production transfers) and DDM 0.3 (T0_T1-T2 transfers) run concurently. Both use the same FTS instance in LYON.

T0-LYON tests

General remarks

  • Lyon participated to the T0-T1 test since the beginning (beginning of May).
  • The main problems was Castor stability at CERN
  • Datasets exists during 24 hours. After 24 hours, the datasets are deleted but not the physical files and the LFC entries.
  • As a consequence of previous point, since 16 May, subscriptions T0->T1 of datasets older than 12 hours are removed
  • Files are kept 8 hours in dcache disk area (cleaning managed by dcache team)
  • No Tape driver is dedicated to this exercise (used also for production). Dedicated drivers will come with the new robot in LYON (end june ?)

DDM Live Plots

=== Network live plots

Logbook

  • Transfers started mid-April
  • Status plot with one bin per day (15 May)

OVERVIEW.throughput.2592000-150507.png

LYON-T2 tests

General remarks

  • Only AOD datasets are transfered to T2s. Each dataset include one file of 3.6 GB.
  • A cron script is run from LAPP to request
    • transfer of datasets to each T2/T3 site
    • delete files and LFC entries when the dataset transfer is complete or the dataset disappeared (operated by CERN)
  • Files have to be transfered before the files (in LYON) and the datasets (at CERN) disappear. So from time to time, no datasets fullfill these constraints

Logbook

  • 12 May First tests of LYON->T2. These tests should not affect T0->T2 transfers (dcache load)
  • 15 May: Status plot for (15 May)

LYON.T2.total bytes.86400.png

    • First comments (15 May):
      • CPPM, LAPP, LAL, SACLAY, LPNHE, LPC : OK
      • NIPNE_02, NIPNE_07 : Seems to have network limitations
      • TOKYO : Many transfers pending with DDM 0.2. Big fight between both DDM versions
      • BEIJING : Problem to get TURL
  • Transfers from LYON to T2s are probably affected by the saturation of the line between Computing Center and the NRD (RENATER node)[link]. All T1->T2 transfers go through this line.

Lyo-nrd-monthly-150507.gif

  • 16 May:
    • TURL problem with BEIJING solved. Now problem of access right
    • FTS T1->T2 behaves much better when CC->NRD link is not saturated
  • 17 May :
    • LYON->T2 transfers subscribed but not treated by DDM 0.3. Request help from DDM team.
  • 21 May :
    • LYON->T2 restarted after intervention of DDM team at CERN
    • Problems : Access write in BEIJING, does not accept Miguel's certificate in NIPNE 07
    • Lyon->Paris and Paris-> International link busy (no detailed monitoring)