Difference between revisions of "Atlas:Analysis ST 2009"

Un article de lcgwiki.
Jump to: navigation, search
(File access modes used by Ganga Jobs)
(File access modes used by Ganga Jobs)
Ligne 31: Ligne 31:
 
  'RO-07-NIPNE_MCDISK': 171}
 
  'RO-07-NIPNE_MCDISK': 171}
 
=== File access modes used by Ganga Jobs ===
 
=== File access modes used by Ganga Jobs ===
* Currently if users are submitting Ganga jobs with the LCG backend, the
+
* '''(j.inputdata.type='DQ2_LOCAL')''' : Currently if users are submitting Ganga jobs with the LCG backend, the posix I/O access is the default method to access files  
posix I/O access is the default method to access files
+
* '''(j.inputdata.type='FILE_STAGER')''' : One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area. This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance during ST at some (but not all) sites.
'''(j.inputdata.type='DQ2_LOCAL')'''
 
* One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area.
 
'''(j.inputdata.type='FILE_STAGER')'''
 
This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance at some (but not all) sites.
 
 
Two access modes may be used during ST tests.
 
Two access modes may be used during ST tests.

Version du 12:30, 29 janvier 2009

29.01.09

FR Cloud ST (2009 plans)

GRIF : GRIFOPN test - Total of 1000 jobs will
be distributed to ATLAS CEs with following DS available being accessed
from LAL, SACLAY and LPNHE
       - GRIF-SACLAY_MCDISK: 332
       - GRIF-LPNHE_MCDISK: 334
       - GRIF-LAL_MCDISK: 457
LAPP-CPPM : interrested by a stress test ~200-300 jobs 
LPSC : interrested by a stress test ~200-300 jobs  
TOKYO : Input DS available on TOKYO-LCG2_MCDISK: 1000

Input DS available

  • Thanks to Stéphane, followong DS available at sites (27/01/09):
{'TOKYO-LCG2_MCDISK': 1038, 'IN2P3-LPC_MCDISK': 342,
'IN2P3-CPPM_MCDISK': 185, 'GRIF-SACLAY_MCDISK': 369,
'GRIF-LPNHE_MCDISK': 380, 'IN2P3-LAPP_MCDISK': 284,
'IN2P3-LPSC_MCDISK': 143, 'GRIF-LAL_MCDISK': 493,
'RO-02-NIPNE_MCDISK': 184, 'BEIJING-LCG2_MCDISK': 129,
'RO-07-NIPNE_MCDISK': 171}

File access modes used by Ganga Jobs

  • (j.inputdata.type='DQ2_LOCAL') : Currently if users are submitting Ganga jobs with the LCG backend, the posix I/O access is the default method to access files
  • (j.inputdata.type='FILE_STAGER') : One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area. This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance during ST at some (but not all) sites.

Two access modes may be used during ST tests.