Atlas:Analysis ST 2009: Difference between revisions

Un article de lcgwiki.
Jump to navigation Jump to search
← Différence précédente
Chollet (talk | contribs)
2,458 edits
No edit summary
Chollet (talk | contribs)
2,458 edits
 
(65 intermediate revisions by 2 users not shown)
Ligne 1: Ligne 1:
29.01.09
--[[User:Chollet|Chollet]] 11:59, 17 avril 2009 (CET)
==== FR Cloud ST (2009 plans) ====
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_Challenge_ST  Details of Site Stress test] : procedure, test conditions, file access modes, targets..
* Weekly ST : 50 jobs per site - all sites involved
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_ST_2009_Errors  Errors follow-up and known issues] : wiki page for comments, errors seen, site feedback
** LPSC : included (tested during http://gangarobot.cern.ch/st/test_117/)
== STEP09==
** BEIJING : switch to SE dpm ccsrm.ihep.ac.cn (tested during test 117)
* https://twiki.cern.ch/twiki/bin/view/Atlas/StressTestJobs
  test 117 has shown missmatch with VO_ATLAS_DEFAULT_SE: srm.ihep.ac.cn
== Results and Summary  ==
  should be OK now
* ATLAS ST results : http://gangarobot.cern.ch/st/all.html
* ATLAS ST summary : http://gangarobot.cern.ch/st/summary.html
* '''Results of on-going ST Tests on FR Cloud'''
Number of jobs per site (~ 15 % of job slots) :
    IN2P3-CC_MCDISK: 200 jobs
    IN2P3-LPC_MCDISK: 100 jobs
    GRIF-LAL_MCDISK: 200 jobs
    GRIF-SACLAY_MCDISK: 80 jobs
    GRIF-LPNHE_MCDISK: 100 jobs
    IN2P3-LAPP_MCDISK: 100 jobs
    TOKYO-LCG2_MCDISK: 200 jobs
    BEIJING-LCG2_MCDISK: 80 jobs
    RO-02-NIPNE_MCDISK: 50 jobs
    RO-07-NIPNE_MCDISK: 50 jobs
    IN2P3-CPPM_MCDISK: 50 jobs
    IN2P3-LPSC_MCDISK: 50 jobs


* File access comparison : 209-01-29 16:00 UTC
[http://lcg.in2p3.fr/wiki/images/ST_192-220-stat.pdf http://lcg.in2p3.fr/wiki/images/ATLAS-ongoingST.png]
**http://gangarobot.cern.ch/st/test_124/ 50 jobs Posix I/O
* [http://lcg.in2p3.fr/wiki/images/ST_124-188-stat.pdf '''Results of ST Tests (50 jobs per site) 124 to 188 on FR Cloud''' ]
**http://gangarobot.cern.ch/st/test_125/  50 jobs FileStager
== ATLAS Contacts ==
* Optimization and Site Stress test: On demand and dedicated to sites which are interrested.  
* LPC : Nabil Ghodbane - Nabil.Ghodbane@cern.ch
GRIF : GRIFOPN test (as soon as it is available) Total of 1000 jobs will
* LAL : Nicolas Makovec
be distributed to ATLAS CEs with following DS available being accessed
* LAPP : Stéphane Jézéquel
from LAL, SACLAY and LPNHE
* CPPM : Emmanuel Le Guirriec
        - GRIF-SACLAY_MCDISK: 332
* LPSC : Sabine Crepe
        - GRIF-LPNHE_MCDISK: 334
* LPNHE : Tristan Beau
        - GRIF-LAL_MCDISK: 457
* CC-T2 : Catherine, Ghita
LPC : to be planned when new storage arrays installation and network 
      upgrade done
      DS available on IN2P3-LPC_MCDISK: 326
LAPP-CPPM : interrested by a stress test ~130 DS available there
TOKYO : Input DS available on TOKYO-LCG2_MCDISK: 1000


==== Input DS available ====
== Input DS available ==
* Thanks to Stéphane, followong DS available at sites (27/01/09):
* DS available at sites (10/04/09)
  {'TOKYO-LCG2_MCDISK': 1038, 'IN2P3-LPC_MCDISK': 342,
  'TOKYO-LCG2_MCDISK': 1068, 'IN2P3-LPC_MCDISK': 166,
  'IN2P3-CPPM_MCDISK': 185, 'GRIF-SACLAY_MCDISK': 369,
  'IN2P3-CPPM_MCDISK': 281, 'GRIF-SACLAY_MCDISK': 335,
  'GRIF-LPNHE_MCDISK': 380, 'IN2P3-LAPP_MCDISK': 284,
  'GRIF-LPNHE_MCDISK': 374, 'IN2P3-LAPP_MCDISK': 563,
  'IN2P3-LPSC_MCDISK': 143, 'GRIF-LAL_MCDISK': 493,
  'IN2P3-LPSC_MCDISK': 204, 'GRIF-LAL_MCDISK': 426,
  'RO-02-NIPNE_MCDISK': 184, 'BEIJING-LCG2_MCDISK': 129,
  'RO-02-NIPNE_MCDISK': 202, 'BEIJING-LCG2_MCDISK': 129,
  'RO-07-NIPNE_MCDISK': 171}
  'RO-07-NIPNE_MCDISK': 189
==== File access modes used by Ganga Jobs ====
Currently if users are submitting Ganga jobs with the LCG backend, the
posix I/O access is the default method to access files
'''(j.inputdata.type='DQ2_LOCAL')'''
 
One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area.
'''(j.inputdata.type='FILE_STAGER')'''
This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance at some (but not all) sites.
Two access modes may be used during ST tests.

Latest revision as of 15:45, 19 octobre 2009

--Chollet 11:59, 17 avril 2009 (CET)

STEP09

Results and Summary

Number of jobs per site (~ 15 % of job slots) :
   IN2P3-CC_MCDISK: 200 jobs
   IN2P3-LPC_MCDISK: 100 jobs
   GRIF-LAL_MCDISK: 200 jobs
   GRIF-SACLAY_MCDISK: 80 jobs
   GRIF-LPNHE_MCDISK: 100 jobs
   IN2P3-LAPP_MCDISK: 100 jobs
   TOKYO-LCG2_MCDISK: 200 jobs
   BEIJING-LCG2_MCDISK: 80 jobs
   RO-02-NIPNE_MCDISK: 50 jobs
   RO-07-NIPNE_MCDISK: 50 jobs
   IN2P3-CPPM_MCDISK: 50 jobs
   IN2P3-LPSC_MCDISK: 50 jobs

http://lcg.in2p3.fr/wiki/images/ATLAS-ongoingST.png

ATLAS Contacts

  • LPC : Nabil Ghodbane - Nabil.Ghodbane@cern.ch
  • LAL : Nicolas Makovec
  • LAPP : Stéphane Jézéquel
  • CPPM : Emmanuel Le Guirriec
  • LPSC : Sabine Crepe
  • LPNHE : Tristan Beau
  • CC-T2 : Catherine, Ghita

Input DS available

  • DS available at sites (10/04/09)
'TOKYO-LCG2_MCDISK': 1068, 'IN2P3-LPC_MCDISK': 166,
'IN2P3-CPPM_MCDISK': 281, 'GRIF-SACLAY_MCDISK': 335,
'GRIF-LPNHE_MCDISK': 374, 'IN2P3-LAPP_MCDISK': 563,
'IN2P3-LPSC_MCDISK': 204, 'GRIF-LAL_MCDISK': 426,
'RO-02-NIPNE_MCDISK': 202, 'BEIJING-LCG2_MCDISK': 129,
'RO-07-NIPNE_MCDISK': 189
Récupérée de « https://lcg.in2p3.fr/index.php?title=Atlas:Analysis_ST_2009&oldid=5414 »