Difference between revisions of "Atlas:Analysis ST 2009"

Un article de lcgwiki.
Jump to: navigation, search
(FR Cloud ST (2009 plans))
(ATLAS Contacts)
 
(56 intermediate revisions by 2 users not shown)
Ligne 1: Ligne 1:
29.01.09
+
--[[User:Chollet|Chollet]] 11:59, 17 avril 2009 (CET)
==== FR Cloud ST (2009 plans) ====
+
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_Challenge_ST  Details of Site Stress test] : procedure, test conditions, file access modes, targets..
* Weekly ST : 50 jobs per site - all sites involved
+
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_ST_2009_Errors  Errors follow-up and known issues] : wiki page for comments, errors seen, site feedback
** LPSC : included (tested during http://gangarobot.cern.ch/st/test_117/)
+
== STEP09==
** BEIJING : switch to SE dpm ccsrm.ihep.ac.cn (tested during http://gangarobot.cern.ch/st/test_117/)- VO_ATLAS_DEFAULT_SE value (srm.ihep.ac.cn) to be changed, should be OK now
+
* https://twiki.cern.ch/twiki/bin/view/Atlas/StressTestJobs
** RO-02-NIPNE : contact e-mail atgrid@ifin.nipne.ro, Site admins : Gabriel Stoicea & Serban Constantinescu
+
== Results and Summary  ==
* File access comparison : 2009-01-29 / 2009-01-31
+
* ATLAS ST results : http://gangarobot.cern.ch/st/all.html
**http://gangarobot.cern.ch/st/test_124/  50 jobs - Posix I/O - Start Time 16:00 UTC
+
* ATLAS ST summary : http://gangarobot.cern.ch/st/summary.html
**http://gangarobot.cern.ch/st/test_125/  50 jobs - FileStager - Start Time 16:30 UTC
+
* '''Results of on-going ST Tests on FR Cloud'''
**'''MC Production : FR Cloud ON'''
+
Number of jobs per site (~ 15 % of job slots) :
* Optimization and Site Stress test: on demand and dedicated to sites which are interrested.
+
    IN2P3-CC_MCDISK: 200 jobs
** Feb 4-5 (to be planned)
+
    IN2P3-LPC_MCDISK: 100 jobs
GRIF : GRIFOPN test (as soon as it is available) Total of 1000 jobs will
+
    GRIF-LAL_MCDISK: 200 jobs
be distributed to ATLAS CEs with following DS available being accessed
+
    GRIF-SACLAY_MCDISK: 80 jobs
from LAL, SACLAY and LPNHE
+
    GRIF-LPNHE_MCDISK: 100 jobs
        - GRIF-SACLAY_MCDISK: 332
+
    IN2P3-LAPP_MCDISK: 100 jobs
        - GRIF-LPNHE_MCDISK: 334
+
    TOKYO-LCG2_MCDISK: 200 jobs
        - GRIF-LAL_MCDISK: 457
+
    BEIJING-LCG2_MCDISK: 80 jobs
LAPP-CPPM : interrested by a stress test ~200-300 jobs  
+
    RO-02-NIPNE_MCDISK: 50 jobs
LPSC : interrested by a stress test ~200-300 jobs
+
    RO-07-NIPNE_MCDISK: 50 jobs
 +
    IN2P3-CPPM_MCDISK: 50 jobs
 +
    IN2P3-LPSC_MCDISK: 50 jobs
  
  TOKYO : Input DS available on TOKYO-LCG2_MCDISK: 1000
+
[http://lcg.in2p3.fr/wiki/images/ST_192-220-stat.pdf http://lcg.in2p3.fr/wiki/images/ATLAS-ongoingST.png]
 +
* [http://lcg.in2p3.fr/wiki/images/ST_124-188-stat.pdf '''Results of ST Tests (50 jobs per site) 124 to 188 on FR Cloud''' ]
 +
== ATLAS Contacts ==
 +
* LPC : Nabil Ghodbane - Nabil.Ghodbane@cern.ch
 +
* LAL : Nicolas Makovec
 +
* LAPP : Stéphane Jézéquel
 +
* CPPM : Emmanuel Le Guirriec
 +
* LPSC : Sabine Crepe
 +
* LPNHE : Tristan Beau
 +
* CC-T2 : Catherine, Ghita
  
==== Input DS available ====
+
== Input DS available ==
* Thanks to Stéphane, followong DS available at sites (27/01/09):
+
* DS available at sites (10/04/09)
  {'TOKYO-LCG2_MCDISK': 1038, 'IN2P3-LPC_MCDISK': 342,
+
  'TOKYO-LCG2_MCDISK': 1068, 'IN2P3-LPC_MCDISK': 166,
  'IN2P3-CPPM_MCDISK': 185, 'GRIF-SACLAY_MCDISK': 369,
+
  'IN2P3-CPPM_MCDISK': 281, 'GRIF-SACLAY_MCDISK': 335,
  'GRIF-LPNHE_MCDISK': 380, 'IN2P3-LAPP_MCDISK': 284,
+
  'GRIF-LPNHE_MCDISK': 374, 'IN2P3-LAPP_MCDISK': 563,
  'IN2P3-LPSC_MCDISK': 143, 'GRIF-LAL_MCDISK': 493,
+
  'IN2P3-LPSC_MCDISK': 204, 'GRIF-LAL_MCDISK': 426,
  'RO-02-NIPNE_MCDISK': 184, 'BEIJING-LCG2_MCDISK': 129,
+
  'RO-02-NIPNE_MCDISK': 202, 'BEIJING-LCG2_MCDISK': 129,
  'RO-07-NIPNE_MCDISK': 171}
+
  'RO-07-NIPNE_MCDISK': 189
==== File access modes used by Ganga Jobs ====
 
Currently if users are submitting Ganga jobs with the LCG backend, the
 
posix I/O access is the default method to access files
 
'''(j.inputdata.type='DQ2_LOCAL')'''
 
 
 
One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area.
 
'''(j.inputdata.type='FILE_STAGER')'''
 
This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance at some (but not all) sites.
 
Two access modes may be used during ST tests.
 

Latest revision as of 14:45, 19 octobre 2009

--Chollet 11:59, 17 avril 2009 (CET)

STEP09

Results and Summary

Number of jobs per site (~ 15 % of job slots) :
   IN2P3-CC_MCDISK: 200 jobs
   IN2P3-LPC_MCDISK: 100 jobs
   GRIF-LAL_MCDISK: 200 jobs
   GRIF-SACLAY_MCDISK: 80 jobs
   GRIF-LPNHE_MCDISK: 100 jobs
   IN2P3-LAPP_MCDISK: 100 jobs
   TOKYO-LCG2_MCDISK: 200 jobs
   BEIJING-LCG2_MCDISK: 80 jobs
   RO-02-NIPNE_MCDISK: 50 jobs
   RO-07-NIPNE_MCDISK: 50 jobs
   IN2P3-CPPM_MCDISK: 50 jobs
   IN2P3-LPSC_MCDISK: 50 jobs

http://lcg.in2p3.fr/wiki/images/ATLAS-ongoingST.png

ATLAS Contacts

  • LPC : Nabil Ghodbane - Nabil.Ghodbane@cern.ch
  • LAL : Nicolas Makovec
  • LAPP : Stéphane Jézéquel
  • CPPM : Emmanuel Le Guirriec
  • LPSC : Sabine Crepe
  • LPNHE : Tristan Beau
  • CC-T2 : Catherine, Ghita

Input DS available

  • DS available at sites (10/04/09)
'TOKYO-LCG2_MCDISK': 1068, 'IN2P3-LPC_MCDISK': 166,
'IN2P3-CPPM_MCDISK': 281, 'GRIF-SACLAY_MCDISK': 335,
'GRIF-LPNHE_MCDISK': 374, 'IN2P3-LAPP_MCDISK': 563,
'IN2P3-LPSC_MCDISK': 204, 'GRIF-LAL_MCDISK': 426,
'RO-02-NIPNE_MCDISK': 202, 'BEIJING-LCG2_MCDISK': 129,
'RO-07-NIPNE_MCDISK': 189