Storage-Benches - Revision history

Barbet: /* Procedures */

2016-09-22T06:11:55Z

Procedures

← Version précédente		Version du 08:11, 22 septembre 2016
Ligne 6:		Ligne 6:

	= Procedures =		= Procedures =

			* Describe the hardware
			* Indicate filesystem options (at filesystem creation and mount options)
			* Indicate System parameters regarding I/O
			* Execute each test 3 times, report the average and standard deviation
			* For each test report FIO parameters
			* Publish your result (format to be defined) with date and person to contact

	= Results =		= Results =

Barbet: /* External links */

2016-09-22T06:07:21Z

External links

← Version précédente		Version du 08:07, 22 septembre 2016
Ligne 13:		Ligne 13:

	= External links =		= External links =

			[http://git.kernel.dk/cgit/fio/tree/README FIO]

Barbet: /* Results */

2016-09-22T06:06:37Z

Results

← Version précédente		Version du 08:06, 22 septembre 2016
Ligne 9:		Ligne 9:
	= Results =		= Results =

	* [https://indico.in2p3.fr/event/11617/session/5/contribution/30/material/slides/0.pdf DELL R730xd with 6TB disks]		* [https://indico.in2p3.fr/event/11617/session/5/contribution/30/material/slides/0.pdf DELL R730xd with 6TB disks] with XIO
	* [https://indico.in2p3.fr/event/11973/session/10/contribution/27/material/slides/0.pdf DELL R730xd with 8TB disks]		* [https://indico.in2p3.fr/event/11973/session/10/contribution/27/material/slides/0.pdf DELL R730xd with 8TB disks] with XIO

	= External links =		= External links =

Barbet: /* Tools */

2016-09-22T06:05:56Z

Tools

← Version précédente		Version du 08:05, 22 septembre 2016
Ligne 3:		Ligne 3:
	= Tools =		= Tools =

	The XIO software developed at CC-IN2P3 ~~is commonly~~ used to bench the storage. A presentation of this tool has been given in [https://indico.in2p3.fr/event/4340/session/2/contribution/3/material/slides/0.pdf this talk].		The XIO software developed at CC-IN2P3 have been used to bench the storage. A presentation of this tool has been given in [https://indico.in2p3.fr/event/4340/session/2/contribution/3/material/slides/0.pdf this talk]. Now it is advised to move to [http://git.kernel.dk/cgit/fio/tree/README FIO] with a set of agreed parameters (work in progress).

	= Procedures =		= Procedures =

Pansanel at 11:52, 24 juin 2016

2016-06-24T11:52:02Z

← Version précédente		Version du 13:52, 24 juin 2016
Ligne 2:		Ligne 2:

	= Tools =		= Tools =

			The XIO software developed at CC-IN2P3 is commonly used to bench the storage. A presentation of this tool has been given in [https://indico.in2p3.fr/event/4340/session/2/contribution/3/material/slides/0.pdf this talk].

	= Procedures =		= Procedures =

	= Results =		= Results =

			* [https://indico.in2p3.fr/event/11617/session/5/contribution/30/material/slides/0.pdf DELL R730xd with 6TB disks]
			* [https://indico.in2p3.fr/event/11973/session/10/contribution/27/material/slides/0.pdf DELL R730xd with 8TB disks]

			= External links =

Pansanel at 10:39, 24 juin 2016

2016-06-24T10:39:09Z

← Version précédente		Version du 12:39, 24 juin 2016
Ligne 1:		Ligne 1:
	~~= Storage Benchmarking =~~

	Storage benchmarking and [[TCP-Tuning\|tuning]] depends upon several parameters like file systems, kernel parameters, RAID configuration, network parameters, etc. This page aims to provide benchmarking tools and procedures for LCG Storage Element, as well as some results for particular hardware solutions.		Storage benchmarking and [[TCP-Tuning\|tuning]] depends upon several parameters like file systems, kernel parameters, RAID configuration, network parameters, etc. This page aims to provide benchmarking tools and procedures for LCG Storage Element, as well as some results for particular hardware solutions.

	== Tools ==		= Tools =

	== Procedures ==		= Procedures =

	== Results ==		= Results =

Pansanel at 10:38, 24 juin 2016

2016-06-24T10:38:38Z

@@ Ligne 1: / Ligne 1: @@
-Storage benchmarking and tuning depends upon several parameters like file systems, kernel parameters, RAID configuration, network parameters, etc. This page aims to provide benchmarking tools and procedures for LCG Storage Element, as well as some tuning hints for particular hardware solutions.
+= Storage Benchmarking =
-= Tuning =
+Storage benchmarking and [[TCP-Tuning|tuning]] depends upon several parameters like file systems, kernel parameters, RAID configuration, network parameters, etc. This page aims to provide benchmarking tools and procedures for LCG Storage Element, as well as some results for particular hardware solutions.
-== DELL Systems ==
+== Tools ==
-*FS xfs avec alignement des partitions et montage avec l'option "noatime"
+== Procedures ==
-Exemple:
+== Results ==

LEROY: /* DELL Systems */

2011-06-08T15:26:22Z

DELL Systems

← Version précédente		Version du 17:26, 8 juin 2011
Ligne 6:		Ligne 6:

	== DELL Systems ==		== DELL Systems ==
			=== R510 + PowerVault MD1200 ===
			*RAID avec stripe size de 1m et règle « lecture anticipée adaptative »

			*FS xfs avec alignement des partitions et montage avec l'option "noatime"

			Exemple:
			#parted /dev/sdb mklabel gpt
			#parted /dev/sdb mkpart primary xfs 1m 50%
			#parted /dev/sdb mkpart primary xfs 50% 100%
			#######
			mkfs.xfs -d su=1m,sw=10 /dev/sdb1 -L R510_sdb1
			mkfs.xfs -d su=1m,sw=10 /dev/sdb2 -L R510_sdb2
			#######
			# cat /etc/fstab \| grep noatime
			LABEL=R510_sdb1 /fs1 xfs defaults,noatime 0 0
			LABEL=R510_sdb2 /fs2 xfs defaults,noatime 0 0


			*kernel:
			**Utilisation du Read ahead system
			**modif du scheduleur par défaut et du nombre de requete en queue

			# tail -6 /etc/rc.d/rc.local
			blockdev --setra 16384 /dev/sdb
			blockdev --setra 16384 /dev/sdc
			echo 512 > /sys/block/sdb/queue/nr_requests
			echo 512 > /sys/block/sdc/queue/nr_requests
			echo deadline > /sys/block/sdb/queue/scheduler
			echo deadline > /sys/block/sdc/queue/scheduler

	== HP Systems ==		== HP Systems ==

Pansanel: /* HP Systems */

2011-05-31T12:29:27Z

HP Systems

← Version précédente		Version du 14:29, 31 mai 2011
Ligne 8:		Ligne 8:

	== HP Systems ==		== HP Systems ==

			=== MDS 600 based system ===

			In order to enhance the performance of the MDS 600 based systems, the following tunings have been applied:
			* Upgrading the hard disk firmware (HPD3). All hard disks should have the same firmware version.
			* Changing the power management profile (max cpu power).
			* Using the following system parameters for each disk:
			<pre>
			echo "cfq" > /sys/block/cciss\!${disk}/queue/scheduler
			echo 256 > /sys/block/cciss\!${disk}/queue/nr_requests
			echo 4096 > /sys/block/cciss\!${disk}/queue/read_ahead_kb
			</pre>
			* Using XFS filesystem aligned with the RAID strip
			* Using RAID units composed of 5 disks wisely selected on different columns.

Pansanel at 08:35, 15 avril 2011

2011-04-15T08:35:19Z

Nouvelle page

Storage benchmarking and tuning depends upon several parameters like file systems, kernel parameters, RAID configuration, network parameters, etc. This page aims to provide benchmarking tools and procedures for LCG Storage Element, as well as some tuning hints for particular hardware solutions.

= Benchmarking =

= Tuning =

== DELL Systems ==

== HP Systems ==