Atlas:Instructions to sites - Revision history

Chollet at 11:20, 18 février 2010

2010-02-18T11:20:25Z

← Version précédente		Version du 13:20, 18 février 2010
Ligne 1:		Ligne 1:
	--[[User:Chollet\|Chollet]] 15:37, 11 mars 2009 (CET)		--[[User:Chollet\|Chollet]] 15:37, 11 mars 2009 (CET)
	== Operational Instructions and Recipies to ATLAS sites ==		== Operational Instructions and Recipies to ATLAS sites ==
			=== Data check LFC vs. SE consistency requires site intervention (SE dump -> XML file )===
	* Get dumps of ATLAS SE to remove dark - data check LFC vs. SE consistency requires site intervention (SE dump -> XML file )		*Get dumps of ATLAS SE to remove dark -
	Tool to get a dump of a DPM SE documented in :		Tool to get a dump of a DPM SE documented in :
	https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperationsScripts#Dump_of_SE).		https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperationsScripts#Dump_of_SE).
	* [[LPC:DUMP_SE \| Procedure used by Emmanuel@LPC to generate the dump ]]		* [[LPC:DUMP_SE \| Procedure used by Emmanuel@LPC to generate the dump ]]
			=== Site Exclusion Policy ===
			* Operational procedures for site exclusion : https://twiki.cern.ch/twiki/pub/Atlas/AtlasDistributedComputing/SiteExclusion_v8b.pdf

Chollet: /* Operational Instructions and Recipies to ATLAS sites */

2010-02-18T10:34:27Z

Operational Instructions and Recipies to ATLAS sites

← Version précédente		Version du 12:34, 18 février 2010
Ligne 2:		Ligne 2:
	== Operational Instructions and Recipies to ATLAS sites ==		== Operational Instructions and Recipies to ATLAS sites ==

	* Get dumps of ATLAS SE to remove dark data		* Get dumps of ATLAS SE to remove dark - data check LFC vs. SE consistency requires site intervention (SE dump -> XML file )
	Tool to get a dump of a DPM SE documented in :		Tool to get a dump of a DPM SE documented in :
	https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperationsScripts#Dump_of_SE).		https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperationsScripts#Dump_of_SE).
	* [[LPC:DUMP_SE \| Procedure used by Emmanuel@LPC to generate the dump ]]		* [[LPC:DUMP_SE \| Procedure used by Emmanuel@LPC to generate the dump ]]

Chollet at 10:31, 18 février 2010

2010-02-18T10:31:18Z

@@ Ligne 5: / Ligne 5: @@
 Tool to get a dump of a DPM SE documented in :
 https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperationsScripts#Dump_of_SE).
-* Procedure used by Emmanuel@LPC to generate the dump
+* [[LPC:DUMP_SE | Procedure used by Emmanuel@LPC to generate the dump ]]

Chollet: /* Operational Instructions and Recipies to ATLAS sites */

2010-02-18T10:27:34Z

Operational Instructions and Recipies to ATLAS sites

← Version précédente		Version du 12:27, 18 février 2010
Ligne 1:		Ligne 1:
	--[[User:Chollet\|Chollet]] 15:37, 11 mars 2009 (CET)		--[[User:Chollet\|Chollet]] 15:37, 11 mars 2009 (CET)
	== Operational Instructions and Recipies to ATLAS sites ==		== Operational Instructions and Recipies to ATLAS sites ==

			* Get dumps of ATLAS SE to remove dark data
			Tool to get a dump of a DPM SE documented in :
			https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperationsScripts#Dump_of_SE).
			* Procedure used by Emmanuel@LPC to generate the dump
			The script given on that page is not completely correct, names may be
			partially/wrongly generated as it depends on the scan order.
			**1st step: Snapshot of the Cns_file_metadata table

			/usr/bin/mysql -u root -p... -A > output << EOF
			use cns_db;
			select fileid, parent_fileid,name,filesize,filemode from Cns_file_metadata
			EOF

			**2nd step: Convert in XML format with full filename.

			DATE=`date --iso-8601`

			cat > atlas.syncat.xml << EOF
			<?xml version="1.0" encoding="iso-8859-1" ?>
			<dump recorded=" ${DATE} ">
			<for>vo:atlas</for>
			<entry-set>
			EOF

			awk '
			BEGIN { Cache[0]=""; }

			function FullName(id)
			{
			if (!(id in Cache)) {
			if (Parent[id] == 0)
			Cache[id]= IDName[id];
			else
			Cache[id]= FullName(Parent[id]) "/" IDName[id];
			}
			return Cache[id]; }

			/^[0-9]/ { FILEID=$1; PARENTID=$2; NAME=$3; SIZE=$4; FILEMODE=$5;
			Parent[FILEID]=PARENTID;
			IDName[FILEID]=NAME;
			Taille[FILEID]=SIZE;
			Mode[FILEID]=FILEMODE;
			}
			END { for (id in Mode)
			if (Mode[id] > 30000)
			print FullName(id), Taille[id];
			}' output > output2

			# Generate files under /dpm/in2p3.fr/home/atlas
			awk '// { print "<entry name=\"" substr($1, 2) "\"> <size>\"" $2
			"\"</size> <checksum></checksum> </entry>"; }' output2 \| grep
			"/dpm/in2p3.fr/home/atlas" >> atlas.syncat.xml

			cat >> atlas.syncat.xml << EOF
			</entry-set></dump>
			EOF

Chollet at 14:41, 11 mars 2009

2009-03-11T14:41:55Z

← Version précédente		Version du 16:41, 11 mars 2009
Ligne 1:		Ligne 1:
	--[[User:Chollet\|Chollet]] 15:37, 11 mars 2009 (CET)		--[[User:Chollet\|Chollet]] 15:37, 11 mars 2009 (CET)
	== Operational Instructions and Recipies to ATLAS sites ==		== Operational Instructions and Recipies to ATLAS sites ==

Chollet: /* Instructions and Recipies to ATLAS sites */

2009-03-11T14:41:31Z

Instructions and Recipies to ATLAS sites

← Version précédente		Version du 16:41, 11 mars 2009
Ligne 1:		Ligne 1:
	--[[User:Chollet\|Chollet]] 15:37, 11 mars 2009 (CET)		--[[User:Chollet\|Chollet]] 15:37, 11 mars 2009 (CET)
	== Instructions and Recipies to ATLAS sites ==		== Operational Instructions and Recipies to ATLAS sites ==

Chollet at 14:37, 11 mars 2009

2009-03-11T14:37:39Z

Nouvelle page

--[[User:Chollet|Chollet]] 15:37, 11 mars 2009 (CET)
== Instructions and Recipies to ATLAS sites ==