Difference between revisions of "MUPJ"
(→Support of Multi-user pilot jobs (MUPJ) for LHC VOs) |
|||
| (17 intermediate revisions by the same user not shown) | |||
| Ligne 1: | Ligne 1: | ||
--[[User:Chollet|Chollet]] 11:41, 27 janvier 2010 (CET) | --[[User:Chollet|Chollet]] 11:41, 27 janvier 2010 (CET) | ||
| − | In December 09, the WLCG Management Board asked the WLCG Technical Forum | + | == [https://wlcg-tf.hep.ac.uk/wiki/Multi_User_Pilot_Jobs Pilot jobs working group of the Technical Forum (wiki)] == |
| − | provide recommendations on the use of multi-user pilot jobs, in particular on | + | |
| − | the deployment and configuration of glexec and its usage by the experiment | + | == Support of Multi-user pilot jobs (MUPJ) for LHC VOs == |
| + | |||
| + | In December 09, the [http://lcg.web.cern.ch/LCG/mb.htm WLCG Management Board] asked the [https://twiki.cern.ch/twiki/bin/view/LCG/WLCGTechnicalForum WLCG Technical Forum] to provide recommendations on the use of multi-user pilot jobs, in particular on the deployment and configuration of glexec and its usage by the experiment | ||
frameworks. | frameworks. | ||
| − | + | * Document that describes what pilot jobs are, their benefits, disadvantages and other aspects that sites and experiments may need to be aware of, is available here : https://wlcg-tf.hep.ac.uk/wiki/Multi_User_Pilot_Jobs (IGTF certificate required) | |
| − | pilot jobs are, their benefits, disadvantages and other aspects that sites | + | |
| − | and experiments may need to be aware of. | + | * "Traceability and Logging" and "Grid Pilot Jobs" policies available at http://www.jspg.org/wiki/JSPG_Docs |
| + | |||
| + | * Questionnaire for site admins : https://wlcg-tf.hep.ac.uk/wiki/Multi_User_Pilot_Jobs#Questionnaire | ||
| + | |||
| + | * See [http://indico.in2p3.fr/conferenceDisplay.py?confId=2601 T2-T3 Technical Meeting, January 22] | ||
| + | ** [http://indico.in2p3.fr/getFile.py/access?contribId=3&resId=1&materialId=slides&confId=2601 Pierre Girard's presentation] (restricted access to t2t3 group) | ||
| + | ** [http://indico.in2p3.fr/materialDisplay.py?materialId=0&confId=2601 Collective answer from sites]sent to Maarten Litmaath has been attached to the meeting agenda as well (restricted access to t2t3 group) | ||
| + | [[Image:MUPJ-SupportFR-2.png]] | ||
| − | + | * [http://indico.cern.ch/getFile.py/access?sessionId=7&resId=1&materialId=0&confId=84636 Status report@March 2010 GDB] | |
| + | - MUPJ in principle supported | ||
| + | - Most of the sites/resources compatible with glexec setuid | ||
| + | o many sites require it in the medium terms | ||
| + | o strongly preferred by CMS and ATLAS | ||
| + | - Many sites prohibit bypassing glexec on internal errors (with some tolerance for the time being) | ||
| + | - Site concerns : | ||
| + | Batch jobs clean-up (complications of), some incompatibilities with afs in setuid mode, | ||
| + | how can local users gets special share/priorities ?, strong concerns about MUPJ concept expresseb bu NorduGrid | ||
| + | - Proposed actions : | ||
| + | o sites should configure glexec with SCAS/Argus/GUMS backend and advertise it with GlueCECapability : glexec | ||
| + | glexec/SCAS testing chain in validation - new ops/role=pilot - will be integrated in the next release of national nagios | ||
| + | o experiments should try out their glexec workflows at such sites as they become available | ||
| + | o sites that do not support the setuid mode would no longer receive MUPJ | ||
| + | o others technologies (such as virtualization) may affect medium-term strategies | ||
| + | - In conclusion, MB agrreed that a detailed plan for glexec deployment in setuid mode in WLCG sites is required | ||
| + | - Milestone for T0/T1 sites | ||
| − | + | == Links == | |
| − | + | * Glasgow wiki page (glexec and SCAS installation and configuration) | |
| + | https://www.scotgrid.ac.uk/wiki/index.php/Glasgow_GLite_gLExec_installation_and_configuration | ||
| + | * http://glite.web.cern.ch/glite/packages/R3.2/sl5_x86_64/deployment/glite-GLEXEC_wn/glite-GLEXEC_wn.asp | ||
Latest revision as of 16:22, 14 avril 2010
--Chollet 11:41, 27 janvier 2010 (CET)
Pilot jobs working group of the Technical Forum (wiki)
Support of Multi-user pilot jobs (MUPJ) for LHC VOs
In December 09, the WLCG Management Board asked the WLCG Technical Forum to provide recommendations on the use of multi-user pilot jobs, in particular on the deployment and configuration of glexec and its usage by the experiment frameworks.
- Document that describes what pilot jobs are, their benefits, disadvantages and other aspects that sites and experiments may need to be aware of, is available here : https://wlcg-tf.hep.ac.uk/wiki/Multi_User_Pilot_Jobs (IGTF certificate required)
- "Traceability and Logging" and "Grid Pilot Jobs" policies available at http://www.jspg.org/wiki/JSPG_Docs
- Questionnaire for site admins : https://wlcg-tf.hep.ac.uk/wiki/Multi_User_Pilot_Jobs#Questionnaire
- See T2-T3 Technical Meeting, January 22
- Pierre Girard's presentation (restricted access to t2t3 group)
- Collective answer from sitessent to Maarten Litmaath has been attached to the meeting agenda as well (restricted access to t2t3 group)
- MUPJ in principle supported
- Most of the sites/resources compatible with glexec setuid
o many sites require it in the medium terms
o strongly preferred by CMS and ATLAS
- Many sites prohibit bypassing glexec on internal errors (with some tolerance for the time being)
- Site concerns :
Batch jobs clean-up (complications of), some incompatibilities with afs in setuid mode,
how can local users gets special share/priorities ?, strong concerns about MUPJ concept expresseb bu NorduGrid
- Proposed actions :
o sites should configure glexec with SCAS/Argus/GUMS backend and advertise it with GlueCECapability : glexec
glexec/SCAS testing chain in validation - new ops/role=pilot - will be integrated in the next release of national nagios
o experiments should try out their glexec workflows at such sites as they become available
o sites that do not support the setuid mode would no longer receive MUPJ
o others technologies (such as virtualization) may affect medium-term strategies
- In conclusion, MB agrreed that a detailed plan for glexec deployment in setuid mode in WLCG sites is required
- Milestone for T0/T1 sites
Links
- Glasgow wiki page (glexec and SCAS installation and configuration)
https://www.scotgrid.ac.uk/wiki/index.php/Glasgow_GLite_gLExec_installation_and_configuration
