Difference between revisions of "Atlas:Analysis ST 2009"

Un article de lcgwiki.
Jump to: navigation, search
(= Input DS available)
Ligne 4: Ligne 4:
 
   LPSC : ready to be tested but only 16 DS available
 
   LPSC : ready to be tested but only 16 DS available
 
   BEIJING : Validation on-going - Available DS on MCDISK 68  
 
   BEIJING : Validation on-going - Available DS on MCDISK 68  
 +
* File access comparison : 209-01-29 16:00 UTC
 +
http://gangarobot.cern.ch/st/test_124/  50 jobs Posix I/O
 +
http://gangarobot.cern.ch/st/test_125/  50 jobs FileStager
 
* Optimization and Site Stress test: On demand and dedicated to sites which are interrested.  
 
* Optimization and Site Stress test: On demand and dedicated to sites which are interrested.  
 
  GRIF : GRIFOPN test (as soon as it is available) Total of 1000 jobs will
 
  GRIF : GRIFOPN test (as soon as it is available) Total of 1000 jobs will

Version du 10:22, 29 janvier 2009

29.01.09

FR Cloud ST (2009 plans)

  • Weekly ST : 50 jobs per site - all sites involved
 LPSC : ready to be tested but only 16 DS available
 BEIJING : Validation on-going - Available DS on MCDISK 68 
  • File access comparison : 209-01-29 16:00 UTC

http://gangarobot.cern.ch/st/test_124/ 50 jobs Posix I/O http://gangarobot.cern.ch/st/test_125/ 50 jobs FileStager

  • Optimization and Site Stress test: On demand and dedicated to sites which are interrested.
GRIF : GRIFOPN test (as soon as it is available) Total of 1000 jobs will
be distributed to ATLAS CEs with following DS available being accessed
from LAL, SACLAY and LPNHE
       - GRIF-SACLAY_MCDISK: 332
       - GRIF-LPNHE_MCDISK: 334
       - GRIF-LAL_MCDISK: 457
LPC : to be planned when new storage arrays installation and network  
      upgrade done
      DS available on IN2P3-LPC_MCDISK: 326
LAPP-CPPM : interrested by a stress test ~130 DS available there
TOKYO : Input DS available on TOKYO-LCG2_MCDISK: 1000

Input DS available

  • Thanks to Stéphane, followong DS available at sites (27/01/09):
{'TOKYO-LCG2_MCDISK': 1038, 'IN2P3-LPC_MCDISK': 342,
'IN2P3-CPPM_MCDISK': 185, 'GRIF-SACLAY_MCDISK': 369,
'GRIF-LPNHE_MCDISK': 380, 'IN2P3-LAPP_MCDISK': 284,
'IN2P3-LPSC_MCDISK': 143, 'GRIF-LAL_MCDISK': 493,
'RO-02-NIPNE_MCDISK': 184, 'BEIJING-LCG2_MCDISK': 129,
'RO-07-NIPNE_MCDISK': 171}

File access modes used by Ganga Jobs

Currently if users are submitting Ganga jobs with the LCG backend, the posix I/O access is the default method to access files (j.inputdata.type='DQ2_LOCAL')

One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area. (j.inputdata.type='FILE_STAGER') This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance at some (but not all) sites. Two access modes may be used during ST tests.