Difference between revisions of "Atlas:Analysis ST 2009"

Un article de lcgwiki.
Jump to: navigation, search
(FR Cloud ST (2009 plans))
Ligne 1: Ligne 1:
 
29.01.09
 
29.01.09
 +
 
==== FR Cloud ST (2009 plans) ====
 
==== FR Cloud ST (2009 plans) ====
 +
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_Challenge_ST  Details of Site Stress test] : procedure, test conditions and targets
 
* Weekly ST : 50 jobs per site - all sites involved
 
* Weekly ST : 50 jobs per site - all sites involved
 
** LPSC : included (tested during http://gangarobot.cern.ch/st/test_117/)
 
** LPSC : included (tested during http://gangarobot.cern.ch/st/test_117/)
Ligne 21: Ligne 23:
  
 
  TOKYO : Input DS available on TOKYO-LCG2_MCDISK: 1000
 
  TOKYO : Input DS available on TOKYO-LCG2_MCDISK: 1000
 
 
==== Input DS available ====
 
==== Input DS available ====
 
* Thanks to Stéphane, followong DS available at sites (27/01/09):
 
* Thanks to Stéphane, followong DS available at sites (27/01/09):
Ligne 34: Ligne 35:
 
posix I/O access is the default method to access files
 
posix I/O access is the default method to access files
 
'''(j.inputdata.type='DQ2_LOCAL')'''
 
'''(j.inputdata.type='DQ2_LOCAL')'''
 
 
One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area.
 
One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area.
 
'''(j.inputdata.type='FILE_STAGER')'''  
 
'''(j.inputdata.type='FILE_STAGER')'''  
 
This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance at some (but not all) sites.
 
This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance at some (but not all) sites.
 
Two access modes may be used during ST tests.
 
Two access modes may be used during ST tests.

Version du 10:54, 29 janvier 2009

29.01.09

FR Cloud ST (2009 plans)

GRIF : GRIFOPN test - Total of 1000 jobs will
be distributed to ATLAS CEs with following DS available being accessed
from LAL, SACLAY and LPNHE
       - GRIF-SACLAY_MCDISK: 332
       - GRIF-LPNHE_MCDISK: 334
       - GRIF-LAL_MCDISK: 457
LAPP-CPPM : interrested by a stress test ~200-300 jobs 
LPSC : interrested by a stress test ~200-300 jobs  
TOKYO : Input DS available on TOKYO-LCG2_MCDISK: 1000

Input DS available

  • Thanks to Stéphane, followong DS available at sites (27/01/09):
{'TOKYO-LCG2_MCDISK': 1038, 'IN2P3-LPC_MCDISK': 342,
'IN2P3-CPPM_MCDISK': 185, 'GRIF-SACLAY_MCDISK': 369,
'GRIF-LPNHE_MCDISK': 380, 'IN2P3-LAPP_MCDISK': 284,
'IN2P3-LPSC_MCDISK': 143, 'GRIF-LAL_MCDISK': 493,
'RO-02-NIPNE_MCDISK': 184, 'BEIJING-LCG2_MCDISK': 129,
'RO-07-NIPNE_MCDISK': 171}

File access modes used by Ganga Jobs

Currently if users are submitting Ganga jobs with the LCG backend, the posix I/O access is the default method to access files (j.inputdata.type='DQ2_LOCAL') One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area. (j.inputdata.type='FILE_STAGER') This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance at some (but not all) sites. Two access modes may be used during ST tests.