Difference between revisions of "Atlas:Analysis ST 2009"

Un article de lcgwiki.
Jump to: navigation, search
(ATLAS Contacts)
 
(51 intermediate revisions by 2 users not shown)
Ligne 1: Ligne 1:
 +
--[[User:Chollet|Chollet]] 11:59, 17 avril 2009 (CET)
 +
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_Challenge_ST  Details of Site Stress test] : procedure, test conditions, file access modes, targets..
 +
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_ST_2009_Errors  Errors follow-up and known issues] : wiki page for comments, errors seen, site feedback
 +
== STEP09==
 +
* https://twiki.cern.ch/twiki/bin/view/Atlas/StressTestJobs
 +
== Results and Summary  ==
 +
* ATLAS ST results : http://gangarobot.cern.ch/st/all.html
 +
* ATLAS ST summary : http://gangarobot.cern.ch/st/summary.html
 +
* '''Results of on-going ST Tests on FR Cloud'''
 +
Number of jobs per site (~ 15 % of job slots) :
 +
    IN2P3-CC_MCDISK: 200 jobs
 +
    IN2P3-LPC_MCDISK: 100 jobs
 +
    GRIF-LAL_MCDISK: 200 jobs
 +
    GRIF-SACLAY_MCDISK: 80 jobs
 +
    GRIF-LPNHE_MCDISK: 100 jobs
 +
    IN2P3-LAPP_MCDISK: 100 jobs
 +
    TOKYO-LCG2_MCDISK: 200 jobs
 +
    BEIJING-LCG2_MCDISK: 80 jobs
 +
    RO-02-NIPNE_MCDISK: 50 jobs
 +
    RO-07-NIPNE_MCDISK: 50 jobs
 +
    IN2P3-CPPM_MCDISK: 50 jobs
 +
    IN2P3-LPSC_MCDISK: 50 jobs
  
29.01.09
+
[http://lcg.in2p3.fr/wiki/images/ST_192-220-stat.pdf http://lcg.in2p3.fr/wiki/images/ATLAS-ongoingST.png]
=== FR Cloud ST (2009 plans) ===
+
* [http://lcg.in2p3.fr/wiki/images/ST_124-188-stat.pdf '''Results of ST Tests (50 jobs per site) 124 to 188 on FR Cloud''' ]
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_Challenge_ST  Details of Site Stress test] : procedure, test conditions and targets
+
== ATLAS Contacts ==
* Weekly ST : 50 jobs per site - all sites involved
+
* LPC : Nabil Ghodbane - Nabil.Ghodbane@cern.ch
** LPSC : included (tested during http://gangarobot.cern.ch/st/test_117/)
+
* LAL : Nicolas Makovec
** BEIJING : switch to SE dpm ccsrm.ihep.ac.cn (tested during http://gangarobot.cern.ch/st/test_117/)- VO_ATLAS_DEFAULT_SE value (srm.ihep.ac.cn) to be changed, should be OK now
+
* LAPP : Stéphane Jézéquel
** RO-02-NIPNE : contact e-mail atgrid@ifin.nipne.ro, Site admins : Gabriel Stoicea & Serban Constantinescu
+
* CPPM : Emmanuel Le Guirriec
* File access comparison : 2009-01-29 / 2009-01-31
+
* LPSC : Sabine Crepe
**http://gangarobot.cern.ch/st/test_124/ 50 jobs - Posix I/O - Start Time 16:00 UTC
+
* LPNHE : Tristan Beau
**http://gangarobot.cern.ch/st/test_125/ 50 jobs - FileStager - Start Time 16:30 UTC
+
* CC-T2 : Catherine, Ghita
**'''MC Production : FR Cloud ON'''
 
* Optimization and Site Stress test: on demand and dedicated to sites which are interrested.  
 
** Feb 4-5 (to be planned)
 
GRIF : GRIFOPN test - Total of 1000 jobs will
 
be distributed to ATLAS CEs with following DS available being accessed
 
from LAL, SACLAY and LPNHE
 
        - GRIF-SACLAY_MCDISK: 332
 
        - GRIF-LPNHE_MCDISK: 334
 
        - GRIF-LAL_MCDISK: 457
 
LAPP-CPPM : interrested by a stress test ~200-300 jobs
 
LPSC : interrested by a stress test ~200-300 jobs 
 
  
TOKYO : Input DS available on TOKYO-LCG2_MCDISK: 1000
+
== Input DS available ==
=== Input DS available ===
+
* DS available at sites (10/04/09)
* Thanks to Stéphane, followong DS available at sites (27/01/09):
+
  'TOKYO-LCG2_MCDISK': 1068, 'IN2P3-LPC_MCDISK': 166,
  {'TOKYO-LCG2_MCDISK': 1038, 'IN2P3-LPC_MCDISK': 342,
+
  'IN2P3-CPPM_MCDISK': 281, 'GRIF-SACLAY_MCDISK': 335,
  'IN2P3-CPPM_MCDISK': 185, 'GRIF-SACLAY_MCDISK': 369,
+
  'GRIF-LPNHE_MCDISK': 374, 'IN2P3-LAPP_MCDISK': 563,
  'GRIF-LPNHE_MCDISK': 380, 'IN2P3-LAPP_MCDISK': 284,
+
  'IN2P3-LPSC_MCDISK': 204, 'GRIF-LAL_MCDISK': 426,
  'IN2P3-LPSC_MCDISK': 143, 'GRIF-LAL_MCDISK': 493,
+
  'RO-02-NIPNE_MCDISK': 202, 'BEIJING-LCG2_MCDISK': 129,
  'RO-02-NIPNE_MCDISK': 184, 'BEIJING-LCG2_MCDISK': 129,
+
  'RO-07-NIPNE_MCDISK': 189
  'RO-07-NIPNE_MCDISK': 171}
 
=== File access modes used by Ganga Jobs ===
 
Currently if users are submitting Ganga jobs with the LCG backend, the
 
posix I/O access is the default method to access files
 
'''(j.inputdata.type='DQ2_LOCAL')'''
 
One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area.
 
'''(j.inputdata.type='FILE_STAGER')'''
 
<br>
 
This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance at some (but not all) sites.
 
Two access modes may be used during ST tests.
 

Latest revision as of 14:45, 19 octobre 2009

--Chollet 11:59, 17 avril 2009 (CET)

STEP09

Results and Summary

Number of jobs per site (~ 15 % of job slots) :
   IN2P3-CC_MCDISK: 200 jobs
   IN2P3-LPC_MCDISK: 100 jobs
   GRIF-LAL_MCDISK: 200 jobs
   GRIF-SACLAY_MCDISK: 80 jobs
   GRIF-LPNHE_MCDISK: 100 jobs
   IN2P3-LAPP_MCDISK: 100 jobs
   TOKYO-LCG2_MCDISK: 200 jobs
   BEIJING-LCG2_MCDISK: 80 jobs
   RO-02-NIPNE_MCDISK: 50 jobs
   RO-07-NIPNE_MCDISK: 50 jobs
   IN2P3-CPPM_MCDISK: 50 jobs
   IN2P3-LPSC_MCDISK: 50 jobs

http://lcg.in2p3.fr/wiki/images/ATLAS-ongoingST.png

ATLAS Contacts

  • LPC : Nabil Ghodbane - Nabil.Ghodbane@cern.ch
  • LAL : Nicolas Makovec
  • LAPP : Stéphane Jézéquel
  • CPPM : Emmanuel Le Guirriec
  • LPSC : Sabine Crepe
  • LPNHE : Tristan Beau
  • CC-T2 : Catherine, Ghita

Input DS available

  • DS available at sites (10/04/09)
'TOKYO-LCG2_MCDISK': 1068, 'IN2P3-LPC_MCDISK': 166,
'IN2P3-CPPM_MCDISK': 281, 'GRIF-SACLAY_MCDISK': 335,
'GRIF-LPNHE_MCDISK': 374, 'IN2P3-LAPP_MCDISK': 563,
'IN2P3-LPSC_MCDISK': 204, 'GRIF-LAL_MCDISK': 426,
'RO-02-NIPNE_MCDISK': 202, 'BEIJING-LCG2_MCDISK': 129,
'RO-07-NIPNE_MCDISK': 189