Atlas:Functionnal-test-lyon-oct06 - Revision history

84.7.32.103: /* News and actions */

2006-10-29T17:17:31Z

News and actions

← Version précédente		Version du 19:17, 29 octobre 2006
Ligne 7:		Ligne 7:
	** Problem of BNL-LYON resolved (pending since 18 October)		** Problem of BNL-LYON resolved (pending since 18 October)
	** All FTS submissions are blocked in 'Submit' mode. Requested intervention by LYON team		** All FTS submissions are blocked in 'Submit' mode. Requested intervention by LYON team
	* 26 October : D. Cameron corrected DDM monitoring because files already transfered during T0->T1 are not monitored when doing T2->T1. But induced a bug in the speed transfer (80 MB/s LYON->T2 is wrong). Bug is corrected		* 26 October :
			** D. Cameron corrected DDM monitoring because files already transfered during T0->T1 are not monitored when doing T2->T1. But induced a bug in the speed transfer (80 MB/s LYON->T2 is wrong). Bug is corrected
	but not yet validated.		but not yet validated.
	* 25 October :		* 25 October :

84.7.32.103: /* News and actions */

2006-10-29T17:17:00Z

News and actions

← Version précédente		Version du 19:17, 29 octobre 2006
Ligne 4:		Ligne 4:
	== News and actions ==		== News and actions ==

	* ~~Check disk space availability in LYONDISK~~ (~~300 GB~~) ~~and Tier2S~~ (~~100~~-~~200 GB~~)		* 27 October:
			** Problem of BNL-LYON resolved (pending since 18 October)
			** All FTS submissions are blocked in 'Submit' mode. Requested intervention by LYON team
			* 26 October : D. Cameron corrected DDM monitoring because files already transfered during T0->T1 are not monitored when doing T2->T1. But induced a bug in the speed transfer (80 MB/s LYON->T2 is wrong). Bug is corrected
			but not yet validated.
	* 25 October :		* 25 October :
	** It looks that T2->T1 transfers went well. But no measurement because of limitation in DDM monitoring		** It looks that T2->T1 transfers went well. But no measurement because of limitation in DDM monitoring

88.137.251.176: /* News and actions */

2006-10-26T21:46:26Z

News and actions

← Version précédente		Version du 23:46, 26 octobre 2006
Ligne 5:		Ligne 5:

	* Check disk space availability in LYONDISK (300 GB) and Tier2S (100-200 GB)		* Check disk space availability in LYONDISK (300 GB) and Tier2S (100-200 GB)
			* 25 October :
			** It looks that T2->T1 transfers went well. But no measurement because of limitation in DDM monitoring
			** Transfer of 3 GB files from CERN to T1s. OK for LYON but problems in dcache for files > 2 GB appeared
			(ls -l says 1 B) and dccp does not work in BNL.
	* 24 October :		* 24 October :
	** FTS server in Lyon seems to be overloaded (appear 'File exists' in T2)		** FTS server in Lyon seems to be overloaded (appear 'File exists' in T2)

84.7.36.29: /* News and actions */

2006-10-24T20:54:34Z

News and actions

← Version précédente		Version du 22:54, 24 octobre 2006
Ligne 7:		Ligne 7:
	* 24 October :		* 24 October :
	** FTS server in Lyon seems to be overloaded (appear 'File exists' in T2)		** FTS server in Lyon seems to be overloaded (appear 'File exists' in T2)
	** ~~Dcache server~~ cannot sustain the load ('gridftp errors')		** One of the dcache servers for LYONDISK (but were are the data of this test) cannot sustain the load ('gridftp errors')
	** Results for the FR cloud:		** Results for the FR cloud:
	LYON - 396 files transferred		LYON - 396 files transferred

84.7.36.29: /* News and actions */

2006-10-24T20:52:46Z

News and actions

← Version précédente		Version du 22:52, 24 octobre 2006
Ligne 8:		Ligne 8:
	** FTS server in Lyon seems to be overloaded (appear 'File exists' in T2)		** FTS server in Lyon seems to be overloaded (appear 'File exists' in T2)
	** Dcache server cannot sustain the load ('gridftp errors')		** Dcache server cannot sustain the load ('gridftp errors')
			** Results for the FR cloud:
			LYON - 396 files transferred
			Beijing, LAL done
			CPPM 50% done (50% ASSIGNED)
			LAPP 70% done (30% in progress)
			LPC 30% (70%)
			LPNHE 20% (80%)
			SACLAY60% (40%)
			TOKYO 70% (30%)
	* 23 October :		* 23 October :
	** BNL accessible again (routing problem in Lyon)		** BNL accessible again (routing problem in Lyon)

134.158.97.69: /* News and actions */

2006-10-24T14:49:45Z

News and actions

← Version précédente		Version du 16:49, 24 octobre 2006
Ligne 5:		Ligne 5:

	* Check disk space availability in LYONDISK (300 GB) and Tier2S (100-200 GB)		* Check disk space availability in LYONDISK (300 GB) and Tier2S (100-200 GB)
			* 24 October :
			** FTS server in Lyon seems to be overloaded (appear 'File exists' in T2)
			** Dcache server cannot sustain the load ('gridftp errors')
	* 23 October :		* 23 October :
	** BNL accessible again (routing problem in Lyon)		** BNL accessible again (routing problem in Lyon)

84.7.128.84: /* News and actions */

2006-10-23T20:17:45Z

News and actions

← Version précédente		Version du 22:17, 23 octobre 2006
Ligne 5:		Ligne 5:

	* Check disk space availability in LYONDISK (300 GB) and Tier2S (100-200 GB)		* Check disk space availability in LYONDISK (300 GB) and Tier2S (100-200 GB)
	* 15 October : Start of the test		* 23 October :
			** BNL accessible again (routing problem in Lyon)
			** All ddmf1 files reached LYONDISK ( ~40 files per dataset)
			* 22 October : Start of the test
			* 21 October :
			** No possible transfer between T2s and Lyon T1 (all FTS jobs in Pending mode)
			** No contact with BNL from LYON (FTS, srm-get-metadata, afs). Not the case for TRIUMF or if test is done from CERN
	* 19 October : Available disk space:		* 19 October : Available disk space:
	** sedpm.mrs.grid.cnrs.fr : 188 GB		** sedpm.mrs.grid.cnrs.fr : 188 GB
Ligne 15:		Ligne 21:
	** dgse0.icepp.jp: 6760 GB		** dgse0.icepp.jp: 6760 GB
	** atlasse01.ihep.ac.cn: 1018 GB		** atlasse01.ihep.ac.cn: 1018 GB
	* 21 October :
	** No possible transfer between T2s and Lyon T1 (all FTS jobs in Pending mode)
	** No contact with BNL from LYON (FTS, srm-get-metadata, afs). Not the case for TRIUMF or if test is done
	~~from CERN~~

	== [http://lcg2.in2p3.fr/wiki/index.php/Atlas#Resources_monitoring Ressource monitoring] ==		== [http://lcg2.in2p3.fr/wiki/index.php/Atlas#Resources_monitoring Ressource monitoring] ==

88.137.143.183: /* News and actions */

2006-10-22T08:12:48Z

News and actions

← Version précédente		Version du 10:12, 22 octobre 2006
Ligne 15:		Ligne 15:
	** dgse0.icepp.jp: 6760 GB		** dgse0.icepp.jp: 6760 GB
	** atlasse01.ihep.ac.cn: 1018 GB		** atlasse01.ihep.ac.cn: 1018 GB
			* 21 October :
			** No possible transfer between T2s and Lyon T1 (all FTS jobs in Pending mode)
			** No contact with BNL from LYON (FTS, srm-get-metadata, afs). Not the case for TRIUMF or if test is done
			from CERN

	== [http://lcg2.in2p3.fr/wiki/index.php/Atlas#Resources_monitoring Ressource monitoring] ==		== [http://lcg2.in2p3.fr/wiki/index.php/Atlas#Resources_monitoring Ressource monitoring] ==

88.136.254.226: /* News and actions */

2006-10-19T21:35:14Z

News and actions

← Version précédente		Version du 23:35, 19 octobre 2006
Ligne 6:		Ligne 6:
	* Check disk space availability in LYONDISK (300 GB) and Tier2S (100-200 GB)		* Check disk space availability in LYONDISK (300 GB) and Tier2S (100-200 GB)
	* 15 October : Start of the test		* 15 October : Start of the test
			* 19 October : Available disk space:
			** sedpm.mrs.grid.cnrs.fr : 188 GB
			** lpnse1.in2p3.fr : 2790 GB
			** lapp-se01.in2p3.fr 804 GB
			** clrlcgse03.in2p3.fr: 2270 GB
			** grid05.lal.in2p3.fr: 1159 GB
			** node12.datagrid.cea.fr 3760 GB
			** dgse0.icepp.jp: 6760 GB
			** atlasse01.ihep.ac.cn: 1018 GB

	== [http://lcg2.in2p3.fr/wiki/index.php/Atlas#Resources_monitoring Ressource monitoring] ==		== [http://lcg2.in2p3.fr/wiki/index.php/Atlas#Resources_monitoring Ressource monitoring] ==

84.7.11.177: /* Summary */

2006-10-07T20:05:23Z

Summary

← Version précédente		Version du 22:05, 7 octobre 2006
Ligne 13:		Ligne 13:

	* The next DDM functional test is scheduled for October 2006 after SC4		* The next DDM functional test is scheduled for October 2006 after SC4

	* We will start to generate data in a week from now (Oct 15th)		* We will start to generate data in a week from now (Oct 15th)

	* Please update table 'Sites' (DDM ops WiKi Functional test) for your site. Data will be generated only for the sites listed in the table. (DDM ops WiKi : https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperations)		* Please update table 'Sites' (DDM ops WiKi Functional test) for your site. Data will be generated only for the sites listed in the table. (DDM ops WiKi : https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperations)

	*Test duration 7 - 10 days		*Test duration 7 - 10 days

	*The test scope (preliminary) :		*The test scope (preliminary) :

	:repeat Step1 and Step2 of the previous test		:repeat Step1 and Step2 of the previous test
	:Step 1: CERN->Tier1->Tier2s data transfer		:Step 1: CERN->Tier1->Tier2s data transfer
Ligne 33:		Ligne 29:
	*Evaluation of data transfer robustness vs dataset size		*Evaluation of data transfer robustness vs dataset size
	*FTS open access (data transfer between different clouds)		*FTS open access (data transfer between different clouds)

	*Two more functional tests are already scheduled Year 2006 (week 47-48, TBC), and Jan 2007. Probably in January we will try to evaluate data transfer performance.		*Two more functional tests are already scheduled Year 2006 (week 47-48, TBC), and Jan 2007. Probably in January we will try to evaluate data transfer performance.


	* several suggestions, comments, questions		* several suggestions, comments, questions

	** will we use DDM ops mailing list to discuss test scope or HyperNews ?		** will we use DDM ops mailing list to discuss test scope or HyperNews ?

	** Tier-1s will need 200-300GB disk space for the October test		** Tier-1s will need 200-300GB disk space for the October test

	** Tier-2s (if they will participate in bulk data transfer) will need 100-200 GB disk space for the October test		** Tier-2s (if they will participate in bulk data transfer) will need 100-200 GB disk space for the October test

	** There are no special requirements for the SW installation. Run what you are using for SC4		** There are no special requirements for the SW installation. Run what you are using for SC4

	==[[Atlas \| Page principale du Twiki ATLAS]]==		==[[Atlas \| Page principale du Twiki ATLAS]]==