Atlas:SC4-Sept06 - Revision history

88.137.252.133: /* Logbook */

2006-10-18T20:58:24Z

Logbook

← Version précédente		Version du 22:58, 18 octobre 2006
Ligne 10:		Ligne 10:
	* 18 October		* 18 October
	** End of SC4 test. Switch to site Functionnal test the friday after.		** End of SC4 test. Switch to site Functionnal test the friday after.
			** As soon as T0-T1 transfers stopped, the T1-T2 total rate reached 60 MB/s
	* 17 October		* 17 October
	** Good transfer rate between during the night and morning but only to LYONTAPE. In the afternoon, DDM tried to transfer only to LYONDISK. Rate is much lower but not a lot of errors		** Good transfer rate between during the night and morning but only to LYONTAPE. In the afternoon, DDM tried to transfer only to LYONDISK. Rate is much lower but not a lot of errors

88.137.137.107: /* Logbook */

2006-10-17T20:08:30Z

Logbook

← Version précédente		Version du 22:08, 17 octobre 2006
Ligne 8:		Ligne 8:
	== Logbook ==		== Logbook ==
	* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.		* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.
			* 18 October
			** End of SC4 test. Switch to site Functionnal test the friday after.
	* 17 October		* 17 October
	** Good transfer rate between during the night and morning but only to LYONTAPE. In the afternoon, DDM tried to transfer only to LYONDISK. Rate is much lower but not a lot of errors		** Good transfer rate between during the night and morning but only to LYONTAPE. In the afternoon, DDM tried to transfer only to LYONDISK. Rate is much lower but not a lot of errors

88.137.137.107 at 20:07, 17 octobre 2006

2006-10-17T20:07:46Z

← Version précédente		Version du 22:07, 17 octobre 2006
Ligne 9:		Ligne 9:
	* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.		* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.
	* 17 October		* 17 October
			** Good transfer rate between during the night and morning but only to LYONTAPE. In the afternoon, DDM tried to transfer only to LYONDISK. Rate is much lower but not a lot of errors
			** New tool to ask for replications from T1 to T2s using dataset only once (could be possible that each dataset is sent to N sites). But the global rate is not that good
			** According to Lionel, dcache gridftp connections needs to be reinitiliased from time to time (not more than once per day)
			* 14 October
	** Small summary on the DDM problems: Number of processes increasing continuously on the VObox until the VO hangs		** Small summary on the DDM problems: Number of processes increasing continuously on the VObox until the VO hangs
	** and needs to be rebooted.		** and needs to be rebooted.

85.186.208.43: /* Logbook */

2006-10-17T08:22:45Z

Logbook

← Version précédente		Version du 10:22, 17 octobre 2006
Ligne 8:		Ligne 8:
	== Logbook ==		== Logbook ==
	* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.		* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.
			* 17 October
			** Small summary on the DDM problems: Number of processes increasing continuously on the VObox until the VO hangs
			** and needs to be rebooted.
			Problem is related to the CRON managing the different processes of DDM file transfer; Some processes are getting so slow that other processes are send before the previous one was finished and there is accumulation which
			** increases rapidly with time. Still trying to understand the causes.
	* 13 October		* 13 October
	** Still transfers from other VOs (also in other sites.). Need monitoring tools especially for T1-T2		** Still transfers from other VOs (also in other sites.). Need monitoring tools especially for T1-T2

84.7.39.167: /* Logbook */

2006-10-13T20:11:22Z

Logbook

← Version précédente		Version du 22:11, 13 octobre 2006
Ligne 11:		Ligne 11:
	** Still transfers from other VOs (also in other sites.). Need monitoring tools especially for T1-T2		** Still transfers from other VOs (also in other sites.). Need monitoring tools especially for T1-T2
	** Tried to transfer to LAL only. Reached 5 MB/s		** Tried to transfer to LAL only. Reached 5 MB/s
	** IN2P3-GRIF channel is shared equally between 5 VOs (LHC+ops) with 3 concurrent files in FTS. Number of concurrent files was increased to 10 and ATLAS share was increased.		** IN2P3-GRIF channel is shared equally between 5 VOs (LHC+ops) with 3 concurrent files in FTS. Number of concurrent files was increased to 10 and ATLAS share was increased. But simultaneous transfer to 3 GRIFs sites not working. '' Need to do a test with one GRIF site only. ''
	** Miguel Branco gives high priority to T0-T1 transfer in DDM. No T1-T2 transfer so no test of LAL with new FTS configuration		** Miguel Branco gives high priority to T0-T1 transfer in DDM. No T1-T2 transfer so no test of LAL with new FTS configuration
	** SC4 will continue one more week then one week of SF test then restart SC4 to reach the 800 MB/s target.		** SC4 will continue one more week then one week of SF test then restart SC4 to reach the 800 MB/s target.

84.7.39.167: /* Logbook */

2006-10-13T19:33:32Z

Logbook

← Version précédente		Version du 21:33, 13 octobre 2006
Ligne 8:		Ligne 8:
	== Logbook ==		== Logbook ==
	* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.		* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.
			* 13 October
			** Still transfers from other VOs (also in other sites.). Need monitoring tools especially for T1-T2
			** Tried to transfer to LAL only. Reached 5 MB/s
			** IN2P3-GRIF channel is shared equally between 5 VOs (LHC+ops) with 3 concurrent files in FTS. Number of concurrent files was increased to 10 and ATLAS share was increased.
			** Miguel Branco gives high priority to T0-T1 transfer in DDM. No T1-T2 transfer so no test of LAL with new FTS configuration
			** SC4 will continue one more week then one week of SF test then restart SC4 to reach the 800 MB/s target.
	* 12 October		* 12 October
	** Again T1-T2 transfers. Again CPPM is full and again bad transfer rate to GRIF		** Again T1-T2 transfers. Again CPPM is full and again bad transfer rate to GRIF

84.7.139.242: /* Logbook */

2006-10-12T21:29:23Z

Logbook

← Version précédente		Version du 23:29, 12 octobre 2006
Ligne 8:		Ligne 8:
	== Logbook ==		== Logbook ==
	* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.		* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.
			* 12 October
			** Again T1-T2 transfers. Again CPPM is full and again bad transfer rate to GRIF
			** According to DDM team, FTS transfer queues between T0 and LYON are full but the rate is low (50-60 MB/s). FTS parameters were changed to cope with 3 VOs transfering to Lyon (ATLAS,ALICE and CMS). All dcache gridftp were not used for ATLAS pool but was used for CMS. The CMS share was decreased to adapt to the dcache configuration in Lyon for each VO.
	* 11 October : Another chaotic day		* 11 October : Another chaotic day
	* DDM seemed to be stuck		** DDM seemed to be stuck
	* Mail of Ghita to DDM expert about the python implementation		** Mail of Ghita to DDM expert about the python implementation
	* VOBOX in LYON rebooted		** VOBOX in LYON rebooted
	* Transfered data publication done in short periods		** Transfered data publication done in short periods
	* Around 22:00, DDM was running again but nothing is published		** Around 22:00, DDM was running again but nothing is published
	* Stop T1-T2 transfers untill all SC4 files on T2s are removed		** Stop T1-T2 transfers untill all SC4 files on T2s are removed
	* 10 October		* 10 October
	** Smooth transfers during the night.		** Smooth transfers during the night.
Ligne 20:		Ligne 23:
	** No efficient FTS transfer to GRIF (LAL and LPNHE)		** No efficient FTS transfer to GRIF (LAL and LPNHE)
	** HPSS in maintenance in LYON (should not affect dcache if does not last too long)		** HPSS in maintenance in LYON (should not affect dcache if does not last too long)
	** Around 12:00, FTS server in Lyon was not able to get the status of the job. After some time, the transfers		** Around 12:00, FTS server in Lyon was not able to get the status of the job. After some time, the transfers were automatically resubmitted but failed because the physical files already existed.
	were automatically resubmitted but failed because the physical files already existed.
	** 2 TB added for ATLAS in Saclay but FTS was not able to access the 1.8 TB opened to all VOs.		** 2 TB added for ATLAS in Saclay but FTS was not able to access the 1.8 TB opened to all VOs.
	* 9 October		* 9 October

84.7.14.214: /* Logbook */

2006-10-11T21:20:49Z

Logbook

← Version précédente		Version du 23:20, 11 octobre 2006
Ligne 8:		Ligne 8:
	== Logbook ==		== Logbook ==
	* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.		* In LYONDISK, files older than 24 hours are deleted (not LFC entries). Since datasets are destroyed at CERN 24 hours after its creation, subscription to T2s are done only if datasets are younger than 0.8 days.
			* 11 October : Another chaotic day
			* DDM seemed to be stuck
			* Mail of Ghita to DDM expert about the python implementation
			* VOBOX in LYON rebooted
			* Transfered data publication done in short periods
			* Around 22:00, DDM was running again but nothing is published
			* Stop T1-T2 transfers untill all SC4 files on T2s are removed
	* 10 October		* 10 October
	** Smooth transfers during the night.		** Smooth transfers during the night.

134.158.97.69: /* Logbook */

2006-10-10T14:16:07Z

Logbook

← Version précédente		Version du 16:16, 10 octobre 2006
Ligne 13:		Ligne 13:
	** No efficient FTS transfer to GRIF (LAL and LPNHE)		** No efficient FTS transfer to GRIF (LAL and LPNHE)
	** HPSS in maintenance in LYON (should not affect dcache if does not last too long)		** HPSS in maintenance in LYON (should not affect dcache if does not last too long)
			** Around 12:00, FTS server in Lyon was not able to get the status of the job. After some time, the transfers
			were automatically resubmitted but failed because the physical files already existed.
			** 2 TB added for ATLAS in Saclay but FTS was not able to access the 1.8 TB opened to all VOs.
	* 9 October		* 9 October
	** No transfer T0-T1 since 8:00. Reason is '' Failed to get proxy certificate from myproxy-fts.cern.ch . Reason is ERROR from server: Credentials do not existUnable to retrieve credential information ''		** No transfer T0-T1 since 8:00. Reason is '' Failed to get proxy certificate from myproxy-fts.cern.ch . Reason is ERROR from server: Credentials do not existUnable to retrieve credential information ''

134.158.97.69 at 08:07, 10 octobre 2006

2006-10-10T08:07:01Z

← Version précédente		Version du 10:07, 10 octobre 2006
Ligne 12:		Ligne 12:
	** Problems with CPPM (FTS says the disk is fullbut the publication says different thing)		** Problems with CPPM (FTS says the disk is fullbut the publication says different thing)
	** No efficient FTS transfer to GRIF (LAL and LPNHE)		** No efficient FTS transfer to GRIF (LAL and LPNHE)
			** HPSS in maintenance in LYON (should not affect dcache if does not last too long)
	* 9 October		* 9 October
	** No transfer T0-T1 since 8:00. Reason is '' Failed to get proxy certificate from myproxy-fts.cern.ch . Reason is ERROR from server: Credentials do not existUnable to retrieve credential information ''		** No transfer T0-T1 since 8:00. Reason is '' Failed to get proxy certificate from myproxy-fts.cern.ch . Reason is ERROR from server: Credentials do not existUnable to retrieve credential information ''