Difference between revisions of "Atlas:StorageRequirements"
Ligne 36: | Ligne 36: | ||
| [[#ATLASMCDISK|ATLASMCDISK]] | | [[#ATLASMCDISK|ATLASMCDISK]] | ||
| /atlas/Role=production | | /atlas/Role=production | ||
− | | 15TB <br> (60TB for 100% AOD)[[#ATLASMCDISK|see below*]] | + | | 15TB <br> (60TB for 100% AOD) [[#ATLASMCDISK|see below*]] |
| /home/atlas/atlasmcdisk <br> write permission only to atlas/Role=production | | /home/atlas/atlasmcdisk <br> write permission only to atlas/Role=production | ||
|----- | |----- | ||
| [[#ATLASPRODDISK|ATLASPRODDISK]] | | [[#ATLASPRODDISK|ATLASPRODDISK]] | ||
| /atlas/Role=production | | /atlas/Role=production | ||
− | | 2TB[[#ATLASPRODDISK|see below*]] | + | | 2TB ([[#ATLASPRODDISK|see below*]]) |
| /home/atlas/atlasproddisk <br> write permission only to atlas/Role=production | | /home/atlas/atlasproddisk <br> write permission only to atlas/Role=production | ||
|----- | |----- | ||
| [[#ATLASGROUPDISK|ATLASGROUPDISK]] | | [[#ATLASGROUPDISK|ATLASGROUPDISK]] | ||
| /atlas | | /atlas | ||
− | | | + | | 6TB ([[#ATLASGROUPDISK|see below*]]) |
| /home/atlas/atlasgroupdisk/phys-exotics <br> write permission to atlas/Role=production, /atlas/phys-exotics/Role=production | | /home/atlas/atlasgroupdisk/phys-exotics <br> write permission to atlas/Role=production, /atlas/phys-exotics/Role=production | ||
<br><br> /home/atlas/atlasgroupdisk/phys-higgs <br> write permission to atlas/Role=production, /atlas/phys-higgs/Role=production | <br><br> /home/atlas/atlasgroupdisk/phys-higgs <br> write permission to atlas/Role=production, /atlas/phys-higgs/Role=production | ||
Ligne 52: | Ligne 52: | ||
<br><br> /home/atlas/atlasgroupdisk/phys-beauty<br> write permission to atlas/Role=production, /atlas/phys-beauty/Role=production | <br><br> /home/atlas/atlasgroupdisk/phys-beauty<br> write permission to atlas/Role=production, /atlas/phys-beauty/Role=production | ||
<br><br> /home/atlas/atlasgroupdisk/phys-sm<br> write permission to atlas/Role=production, /atlas/phys-sm/Role=production | <br><br> /home/atlas/atlasgroupdisk/phys-sm<br> write permission to atlas/Role=production, /atlas/phys-sm/Role=production | ||
+ | |----- | ||
+ | | [[#ATLASUSERDISK|ATLASUSERDISK]] | ||
+ | | /atlas | ||
+ | | 5TB ([[#ATLASUSERDISK|see below*]]) | ||
+ | | /atlas/user <br> write permission to all ATLAS users | ||
+ | |----- | ||
+ | | [[#ATLASUSERDISK|ATLASUSERDISK]] | ||
+ | | /atlas/<locality>, <locality>=fr,ro,cn,jp,... | ||
+ | | sites to decide | ||
+ | | /atlas/<locality>/user <br> write permission to local ATLAS users | ||
|} | |} | ||
Ligne 127: | Ligne 137: | ||
* 5TB for a typical T2 with ~500 CPU’s and ~100 TB disk | * 5TB for a typical T2 with ~500 CPU’s and ~100 TB disk | ||
* namespaces to be created and their ACLs: /atlas/user, write permission to all ATLAS users | * namespaces to be created and their ACLs: /atlas/user, write permission to all ATLAS users | ||
− | ** dpns-mkdir lcg-se01.icepp.jp:/dpm/icepp.jp/home/atlas/user | + | * Usually, sites already have this namespace created by user analysis jobs so far. |
− | ** dpns-setacl -m g:atlas:rwx,m:rwx,d:g: lcg-se01.icepp.jp:/dpm/icepp.jp/home/atlas/ | + | * example commands |
− | <pre> | + | ** <code>dpns-mkdir lcg-se01.icepp.jp:/dpm/icepp.jp/home/atlas/user</code> |
+ | ** <code>dpns-setacl -m g:atlas:rwx,m:rwx,d:g:atlas:r-x lcg-se01.icepp.jp:/dpm/icepp.jp/home/atlas/user</code> | ||
+ | ** <code>dpns-getacl /dpm/icepp.jp/home/atlas/user</code><pre> | ||
+ | # file: /dpm/icepp.jp/home/atlas/user | ||
+ | # owner: root | ||
+ | # group: atlas | ||
user::rwx | user::rwx | ||
group::rwx #effective:rwx | group::rwx #effective:rwx | ||
− | |||
− | |||
group:atlas/Role=production:rwx #effective:rwx | group:atlas/Role=production:rwx #effective:rwx | ||
mask::rwx | mask::rwx | ||
other::r-x | other::r-x | ||
default:user::rwx | default:user::rwx | ||
− | default:group:: | + | default:group::r-x |
− | |||
default:group:atlas/Role=production:rwx | default:group:atlas/Role=production:rwx | ||
default:mask::rwx | default:mask::rwx | ||
default:other::r-x | default:other::r-x | ||
</pre> | </pre> | ||
+ | |||
== ATLASLOCALGROUPDISK == | == ATLASLOCALGROUPDISK == | ||
+ | * size to be decided by sites. | ||
+ | * the resources not included in the pledge. | ||
+ | * name space: /atlas/fr/user (or /atlas/ro/user, /atlas/cn/user, /atlas/jp/user, etc.) | ||
+ | * ACL: write permission only to /atlas/fr group (or /atlas/ro, /atlas/cn, /atlas/jp correspondingly) | ||
+ | * example ACL: |
Version du 14:11, 7 juillet 2008
Sommaire
Introduction
- Information only for T2s.
- Information only for DPM for the moment.
- There is still an uncertainty with ATLASGROUPDISK
- Atlas official requirements in http://indico.cern.ch/materialDisplay.py?contribId=1&materialId=slides&confId=37181
- but contents are not final yet.
- There is a technical limitation in DPM. Atlas has contacted DPM developpers. The proper implementation is expected to be available in September?.
2008
The size is for a typical T2 with ~500 CPU’s
space token | voms group to be associated | space to be reserved | namespace to be created |
ATLASDATADISK | /atlas/Role=production | see below* | /home/atlas/atlasdatadisk # group: atlas/Role=production user::rwx group::rwx #effective:rwx group:atlas/Role=production:rwx #effective:rwx mask::rwx other::r-x default:user::rwx default:group::rwx default:group:atlas/Role=production:rwx default:mask::rwx default:other::r-x |
ATLASMCDISK | /atlas/Role=production | 15TB (60TB for 100% AOD) see below* |
/home/atlas/atlasmcdisk write permission only to atlas/Role=production |
ATLASPRODDISK | /atlas/Role=production | 2TB (see below*) | /home/atlas/atlasproddisk write permission only to atlas/Role=production |
ATLASGROUPDISK | /atlas | 6TB (see below*) | /home/atlas/atlasgroupdisk/phys-exotics write permission to atlas/Role=production, /atlas/phys-exotics/Role=production
|
ATLASUSERDISK | /atlas | 5TB (see below*) | /atlas/user write permission to all ATLAS users |
ATLASUSERDISK | /atlas/<locality>, <locality>=fr,ro,cn,jp,... | sites to decide | /atlas/<locality>/user write permission to local ATLAS users |
ATLAS top directory
- below it is represented by
/atlas
. Each site should replace it according to their local structure.- eg. It is
lapp-se01.in2p3.fr:/dpm/in2p3.fr/home/atlas
for lapp.
- eg. It is
- this top directory is recommended to be configured so that an ordinary user cannot create a file/directory directly underneath.
- the default ACL of this top directory is recommended to have write permission to /atlas/Role=production and /atlas/Role=lcgadmin.
ATLASDATADISK
- Estimation of size comes later
- group associated with the space token: /atlas/Role=production
- namespace to be created: /atlas/atlasdatadisk
- namespace acl:
# group: atlas/Role=production user::rwx group::rwx #effective:rwx group:atlas/Role=production:rwx #effective:rwx mask::rwx other::r-x default:user::rwx default:group::rwx default:group:atlas/Role=production:rwx default:mask::rwx default:other::r-x
ATLASMCDISK
- 15TB for a typical T2 with ~500 CPU’s and ~100 TB disk
- 60TB for a T2 requesting for 100% AOD.
- The size may increase in case D1PD comes in this space.
- Namespace ACL:
# group: atlas/Role=production user::rwx group::rwx #effective:r-x group:atlas/Role=production:rwx #effective:rwx mask::rwx other::r-x default:user::rwx default:group::rwx default:group:atlas/Role=production:rwx default:mask::rwx default:other::r-x
ATLASPRODDISK
- 2TB for a typical T2 with ~500 CPU’s (the size is to be re-visited)
- Namespace to be created and its ACL: /atlas/atlasproddisk, write permission only to /atlas/Role=production
# group: atlas/Role=production user::rwx group::rwx #effective:rwx group:atlas/Role=production:rwx #effective:rwx mask::rwx other::r-x default:user::rwx default:group::rwx default:group:atlas/Role=production:rwx default:mask::rwx default:other::r-x
ATLASGROUPDISK
- 6TB for a typical T2 with ~500 CPU’s and ~100 TB disk
- The size may decrease in case D1PD goes into ATLASMCDISK.
- namespaces to be created and their ACLs:
- /atlas/atlasgroupdisk, write permission only to /atlas/Role=production
- /atlas/atlasgroupdisk/phys-exotics, write permission to atlas/Role=production, /atlas/phys-exotics/Role=production
- etc...
ATLASUSERDISK
- 5TB for a typical T2 with ~500 CPU’s and ~100 TB disk
- namespaces to be created and their ACLs: /atlas/user, write permission to all ATLAS users
- Usually, sites already have this namespace created by user analysis jobs so far.
- example commands
dpns-mkdir lcg-se01.icepp.jp:/dpm/icepp.jp/home/atlas/user
dpns-setacl -m g:atlas:rwx,m:rwx,d:g:atlas:r-x lcg-se01.icepp.jp:/dpm/icepp.jp/home/atlas/user
dpns-getacl /dpm/icepp.jp/home/atlas/user
# file: /dpm/icepp.jp/home/atlas/user # owner: root # group: atlas user::rwx group::rwx #effective:rwx group:atlas/Role=production:rwx #effective:rwx mask::rwx other::r-x default:user::rwx default:group::r-x default:group:atlas/Role=production:rwx default:mask::rwx default:other::r-x
ATLASLOCALGROUPDISK
- size to be decided by sites.
- the resources not included in the pledge.
- name space: /atlas/fr/user (or /atlas/ro/user, /atlas/cn/user, /atlas/jp/user, etc.)
- ACL: write permission only to /atlas/fr group (or /atlas/ro, /atlas/cn, /atlas/jp correspondingly)
- example ACL: