Difference between revisions of "Atlas:Analysis ST 2009"

Un article de lcgwiki.
Jump to: navigation, search
(→‎ATLAS Contacts)
 
(40 intermediate revisions by 2 users not shown)
Ligne 1: Ligne 1:
−
29.01.09
+
--[[User:Chollet|Chollet]] 11:59, 17 avril 2009 (CET)
−
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_Challenge_ST  Details of Site Stress test] : procedure, test conditions and targets
+
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_Challenge_ST  Details of Site Stress test] : procedure, test conditions, file access modes, targets..
−
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_ST_2009#section=3 File access modes used by ST]  
+
* [http://lcg.in2p3.fr/wiki/index.php/Atlas:Analysis_ST_2009_Errors Errors follow-up and known issues] : wiki page for comments, errors seen, site feedback
−
== FR Cloud ST (2009 plans) ==
+
== STEP09==
−
* '''Weekly ST''' : 50 jobs per site - all sites involved - '''MC Production : FR Cloud ON'''
+
* https://twiki.cern.ch/twiki/bin/view/Atlas/StressTestJobs
−
** LPSC : included (tested during http://gangarobot.cern.ch/st/test_117/)
+
== Results and Summary  ==
−
** BEIJING : switch to SE dpm ccsrm.ihep.ac.cn (tested during http://gangarobot.cern.ch/st/test_117/)- VO_ATLAS_DEFAULT_SE value (srm.ihep.ac.cn) to be changed, should be OK now
+
* ATLAS ST results : http://gangarobot.cern.ch/st/all.html
−
** RO-02-NIPNE : contact e-mail atgrid@ifin.nipne.ro, Site admins : Gabriel Stoicea & Serban Constantinescu
+
* ATLAS ST summary : http://gangarobot.cern.ch/st/summary.html
−
* '''File access comparison''' : 2009-01-29 / 2009-01-31 '''MC Production : FR Cloud ON'''
+
* '''Results of on-going ST Tests on FR Cloud'''
−
**http://gangarobot.cern.ch/st/test_124/ 50 jobs - Posix I/O - Start Time 16:00 UTC
+
Number of jobs per site (~ 15 % of job slots) :
−
**http://gangarobot.cern.ch/st/test_125/ 50 jobs - FileStager - Start Time 16:30 UTC
+
    IN2P3-CC_MCDISK: 200 jobs
−
* '''Optimization and Site Stress test''': on demand and dedicated to sites which are interrested - '''MC Production : FR Cloud OFF'''
+
    IN2P3-LPC_MCDISK: 100 jobs
−
** Feb 4-5 (in preparation - to be confirmed)
+
    GRIF-LAL_MCDISK: 200 jobs
−
GRIF : GRIFOPN test - Total of 1000 jobs will
+
    GRIF-SACLAY_MCDISK: 80 jobs
−
be distributed to ATLAS CEs with following DS available being accessed
+
    GRIF-LPNHE_MCDISK: 100 jobs
−
from LAL, SACLAY and LPNHE
+
    IN2P3-LAPP_MCDISK: 100 jobs
−
        - GRIF-SACLAY_MCDISK: 332
+
    TOKYO-LCG2_MCDISK: 200 jobs
−
        - GRIF-LPNHE_MCDISK: 334
+
    BEIJING-LCG2_MCDISK: 80 jobs
−
        - GRIF-LAL_MCDISK: 457
+
    RO-02-NIPNE_MCDISK: 50 jobs
−
LAPP-CPPM : interrested by a stress test ~200-300 jobs
+
    RO-07-NIPNE_MCDISK: 50 jobs
−
LPSC : interrested by a stress test ~200-300 jobs
+
    IN2P3-CPPM_MCDISK: 50 jobs
 +
    IN2P3-LPSC_MCDISK: 50 jobs
 +
 
 +
[http://lcg.in2p3.fr/wiki/images/ST_192-220-stat.pdf http://lcg.in2p3.fr/wiki/images/ATLAS-ongoingST.png]
 +
* [http://lcg.in2p3.fr/wiki/images/ST_124-188-stat.pdf  '''Results of ST Tests (50 jobs per site) 124 to 188 on FR Cloud''' ]
 +
== ATLAS Contacts ==
 +
* LPC : Nabil Ghodbane - Nabil.Ghodbane@cern.ch
 +
* LAL : Nicolas Makovec
 +
* LAPP : Stéphane Jézéquel
 +
* CPPM : Emmanuel Le Guirriec
 +
* LPSC : Sabine Crepe
 +
* LPNHE : Tristan Beau
 +
* CC-T2 : Catherine, Ghita
  
 
== Input DS available ==
 
== Input DS available ==
−
* Thanks to Stéphane, followong DS available at sites (27/01/09):
+
* DS available at sites (10/04/09)
−
  {'TOKYO-LCG2_MCDISK': 1038, 'IN2P3-LPC_MCDISK': 342,
+
  'TOKYO-LCG2_MCDISK': 1068, 'IN2P3-LPC_MCDISK': 166,
−
  'IN2P3-CPPM_MCDISK': 185, 'GRIF-SACLAY_MCDISK': 369,
+
  'IN2P3-CPPM_MCDISK': 281, 'GRIF-SACLAY_MCDISK': 335,
−
  'GRIF-LPNHE_MCDISK': 380, 'IN2P3-LAPP_MCDISK': 284,
+
  'GRIF-LPNHE_MCDISK': 374, 'IN2P3-LAPP_MCDISK': 563,
−
  'IN2P3-LPSC_MCDISK': 143, 'GRIF-LAL_MCDISK': 493,
+
  'IN2P3-LPSC_MCDISK': 204, 'GRIF-LAL_MCDISK': 426,
−
  'RO-02-NIPNE_MCDISK': 184, 'BEIJING-LCG2_MCDISK': 129,
+
  'RO-02-NIPNE_MCDISK': 202, 'BEIJING-LCG2_MCDISK': 129,
−
  'RO-07-NIPNE_MCDISK': 171}
+
  'RO-07-NIPNE_MCDISK': 189
−
== File access modes used by Ganga Jobs ==
 
−
Two access modes may be used during ST tests.
 
−
* '''(j.inputdata.type='DQ2_LOCAL')''' : Currently if users are submitting Ganga jobs with the LCG backend, the posix I/O access is the default method to access files
 
−
* '''(j.inputdata.type='FILE_STAGER')''' : One of the alternative access mode used by ST tests is the FileStager mode, which copies the input files in a background thread of the athena event loop usinglcg-cp from the local SE to the worker node tmp area. This mode still needs a bit of improvements to gain full stability, but as demonstrated good performance during ST at some (but not all) sites.
 

Latest revision as of 14:45, 19 octobre 2009

--Chollet 11:59, 17 avril 2009 (CET)

STEP09

Results and Summary

Number of jobs per site (~ 15 % of job slots) :
   IN2P3-CC_MCDISK: 200 jobs
   IN2P3-LPC_MCDISK: 100 jobs
   GRIF-LAL_MCDISK: 200 jobs
   GRIF-SACLAY_MCDISK: 80 jobs
   GRIF-LPNHE_MCDISK: 100 jobs
   IN2P3-LAPP_MCDISK: 100 jobs
   TOKYO-LCG2_MCDISK: 200 jobs
   BEIJING-LCG2_MCDISK: 80 jobs
   RO-02-NIPNE_MCDISK: 50 jobs
   RO-07-NIPNE_MCDISK: 50 jobs
   IN2P3-CPPM_MCDISK: 50 jobs
   IN2P3-LPSC_MCDISK: 50 jobs

http://lcg.in2p3.fr/wiki/images/ATLAS-ongoingST.png

ATLAS Contacts

  • LPC : Nabil Ghodbane - Nabil.Ghodbane@cern.ch
  • LAL : Nicolas Makovec
  • LAPP : Stéphane Jézéquel
  • CPPM : Emmanuel Le Guirriec
  • LPSC : Sabine Crepe
  • LPNHE : Tristan Beau
  • CC-T2 : Catherine, Ghita

Input DS available

  • DS available at sites (10/04/09)
'TOKYO-LCG2_MCDISK': 1068, 'IN2P3-LPC_MCDISK': 166,
'IN2P3-CPPM_MCDISK': 281, 'GRIF-SACLAY_MCDISK': 335,
'GRIF-LPNHE_MCDISK': 374, 'IN2P3-LAPP_MCDISK': 563,
'IN2P3-LPSC_MCDISK': 204, 'GRIF-LAL_MCDISK': 426,
'RO-02-NIPNE_MCDISK': 202, 'BEIJING-LCG2_MCDISK': 129,
'RO-07-NIPNE_MCDISK': 189
Récupérée de « http://lcg.in2p3.fr/wiki/index.php?title=Atlas:Analysis_ST_2009&oldid=5414 »