Difference between revisions of "Atlas:SC4-May07"

Un article de lcgwiki.
Jump to: navigation, search
M (LYON-T2 tests)
M (T0-T1-T2 tests)
Ligne 3: Ligne 3:
 
* A new Arda monitoring fro DDM 0.3 is accessible at this [http://dashb-atlas-data-test.cern.ch/dashboard/request.py/site address]  
 
* A new Arda monitoring fro DDM 0.3 is accessible at this [http://dashb-atlas-data-test.cern.ch/dashboard/request.py/site address]  
 
* A [https://twiki.cern.ch/twiki/bin/view/Atlas/DDMMorningMeetings Twiki page] is maintained for the whole transfers
 
* A [https://twiki.cern.ch/twiki/bin/view/Atlas/DDMMorningMeetings Twiki page] is maintained for the whole transfers
 +
* DDM 0.2 (MC production transfers) and DDM 0.3 (T0_T1-T2 transfers) run concurently. Both use the same FTS instance in LYON.
  
 
=== T0-LYON tests  ===
 
=== T0-LYON tests  ===
 
+
==== General remarks ====
 
* Lyon participated to the T0-T1 test since the beginning (beginning of May).  
 
* Lyon participated to the T0-T1 test since the beginning (beginning of May).  
 
* The main problems was Castor stability at CERN
 
* The main problems was Castor stability at CERN
 
* Datasets exists during 24 hours. After 24 hours, the datasets are deleted but not the physical files and the LFC entries.
 
* Datasets exists during 24 hours. After 24 hours, the datasets are deleted but not the physical files and the LFC entries.
 
* Files are kept 8 hours in dcache disk area (cleaning managed by dcache team)
 
* Files are kept 8 hours in dcache disk area (cleaning managed by dcache team)
 +
==== Logbook ====
 +
* Transfers started mid-April
 
* Status plot with one bin per day (15 May)
 
* Status plot with one bin per day (15 May)
 
[[Image:OVERVIEW.throughput.2592000-150507.png]]
 
[[Image:OVERVIEW.throughput.2592000-150507.png]]
Ligne 18: Ligne 21:
 
** transfer of datasets to each T2/T3 site
 
** transfer of datasets to each T2/T3 site
 
** delete files and LFC entries when the dataset transfer is complete or the dataset disappeared (operated by CERN)
 
** delete files and LFC entries when the dataset transfer is complete or the dataset disappeared (operated by CERN)
* Files have to be transfered before the files and the datasets disappeared.
+
* Files have to be transfered before the files (in LYON) and the datasets (at CERN) disappear. So from time to time, no datasets fullfill these constraints
 
==== Logbook ====
 
==== Logbook ====
* 12 May First tests of LYON->T2
+
* 12 May First tests of LYON->T2. These tests should not affect T0->T2 transfers (dcache load)
 
* 15 May: Status plot for (15 May)
 
* 15 May: Status plot for (15 May)
 
[[Image:LYON.T2.total_bytes.86400.png]]
 
[[Image:LYON.T2.total_bytes.86400.png]]
 +
** First comments (15 May):
 +
*** CPPM, LAPP, LAL, SACLAY, LPNHE, LPC : OK
 +
*** NIPNE_02, NIPNE_07 : Seems to have network limitations
 +
*** TOKYO : Many transfers pending with DDM 0.2. Big fight between both DDM versions
 +
*** BEIJING : Problem to get TURL

Version du 20:25, 15 mai 2007

T0-T1-T2 tests

  • A new DDM version (called 0.3) is under test. The first goal is to reach a steady transfer from CERN (T0) to T1s.
  • A new Arda monitoring fro DDM 0.3 is accessible at this address
  • A Twiki page is maintained for the whole transfers
  • DDM 0.2 (MC production transfers) and DDM 0.3 (T0_T1-T2 transfers) run concurently. Both use the same FTS instance in LYON.

T0-LYON tests

General remarks

  • Lyon participated to the T0-T1 test since the beginning (beginning of May).
  • The main problems was Castor stability at CERN
  • Datasets exists during 24 hours. After 24 hours, the datasets are deleted but not the physical files and the LFC entries.
  • Files are kept 8 hours in dcache disk area (cleaning managed by dcache team)

Logbook

  • Transfers started mid-April
  • Status plot with one bin per day (15 May)

OVERVIEW.throughput.2592000-150507.png

LYON-T2 tests

General remarks

  • A cron script is run from LAPP to request
    • transfer of datasets to each T2/T3 site
    • delete files and LFC entries when the dataset transfer is complete or the dataset disappeared (operated by CERN)
  • Files have to be transfered before the files (in LYON) and the datasets (at CERN) disappear. So from time to time, no datasets fullfill these constraints

Logbook

  • 12 May First tests of LYON->T2. These tests should not affect T0->T2 transfers (dcache load)
  • 15 May: Status plot for (15 May)

LYON.T2.total bytes.86400.png

    • First comments (15 May):
      • CPPM, LAPP, LAL, SACLAY, LPNHE, LPC : OK
      • NIPNE_02, NIPNE_07 : Seems to have network limitations
      • TOKYO : Many transfers pending with DDM 0.2. Big fight between both DDM versions
      • BEIJING : Problem to get TURL