From: Dallas Clement <dallas.a.clement@gmail.com>
To: Mark Knecht <markknecht@gmail.com>
Cc: Phil Turmel <philip@turmel.org>, Linux-RAID <linux-raid@vger.kernel.org>
Subject: Re: best base / worst case RAID 5,6 write speeds
Date: Fri, 11 Dec 2015 09:44:06 -0600 [thread overview]
Message-ID: <CAE9DZURK+bZ=4czbGojzW815Du1ascr5vzAPtQBw4ZDGyq0MAQ@mail.gmail.com> (raw)
In-Reply-To: <CAK2H+ec-zMbhxoFyHXLkdM-z-9cYYzNbPFhn19XjTHqrOMDZKQ@mail.gmail.com>
On Thu, Dec 10, 2015 at 8:50 PM, Mark Knecht <markknecht@gmail.com> wrote:
>
>
> On Thu, Dec 10, 2015 at 5:19 PM, Dallas Clement <dallas.a.clement@gmail.com>
> wrote:
>>
>> <SNIP>
>> >> One thing I didn't see in this thread was a check to make sure your
>> >> alignment is on the physical sector alignment if you're using 4K
>> >> sectors
>> >> which I assume drives this large are using.
>> >
>> > Yes, these drives surely use 4K sectors. But I haven't checked for
>> > sector alignment issues. Any tips on how to do that?
>>
>> According to parted, my disk partition is aligned.
>>
>> (parted) align-check
>> alignment type(min/opt) [optimal]/minimal?
>> Partition number? 6
>> 6 aligned
>>
>> Partition Table: gpt
>>
>> Number Start End Size File system Name Flags
>> 1 2048s 10002431s 10000384s primary
>> 2 10002432s 42002431s 32000000s primary
>> 3 42002432s 42004479s 2048s primary
>> bios_grub
>> 4 42004480s 42006527s 2048s primary
>> 5 42006528s 50008063s 8001536s primary
>> > 6 50008064s 7796883455s 7746875392s primary
>>
>> 50008064 / 4096 = 12209
>
> I think you want to divide by 8 as 8*512 = 4096 but you're likely ok
> on all of them. Partitioning tools are better about that these days.
>
> Looking back I didn't see what sort of controller/s you have all these
> drives attached to. If you're spinning in IO loops then it could be a
> driver issue.
>
> I would suggest googling for causes of iowait cycles and post
> back additional questions.
>
> Good luck,
> Mark
Hi Mark. I have three different controllers on this motherboard. A
Marvell 9485 controls 8 of the disks. And an Intel Cougar Point
controls the 4 remaining disks.
> If you're spinning in IO loops then it could be a driver issue.
It sure is looking like that. I will try to profile the kernel
threads today and maybe use blktrace as Phil recommended to see what
is going on there.
This is pretty sad that 12 single threaded fio jobs can bring this
system to its knees.
next prev parent reply other threads:[~2015-12-11 15:44 UTC|newest]
Thread overview: 60+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-12-10 1:34 best base / worst case RAID 5,6 write speeds Dallas Clement
2015-12-10 6:36 ` Alexander Afonyashin
2015-12-10 14:38 ` Dallas Clement
2015-12-10 15:14 ` John Stoffel
2015-12-10 18:40 ` Dallas Clement
[not found] ` <CAK2H+ed+fe5Wr0B=h5AzK5_=ougQtW_6cJcUG_S_cg+WfzDb=Q@mail.gmail.com>
2015-12-10 19:26 ` Dallas Clement
2015-12-10 19:33 ` John Stoffel
2015-12-10 22:19 ` Wols Lists
2015-12-10 19:28 ` John Stoffel
2015-12-10 22:23 ` Wols Lists
2015-12-10 20:06 ` Phil Turmel
2015-12-10 20:09 ` Dallas Clement
2015-12-10 20:29 ` Phil Turmel
2015-12-10 21:14 ` Dallas Clement
2015-12-10 21:32 ` Phil Turmel
[not found] ` <CAK2H+ednN7dCGzcOt8TxgNdhdDA1mN6Xr5P8vQ+Y=-uRoxRksw@mail.gmail.com>
2015-12-11 0:02 ` Dallas Clement
[not found] ` <CAK2H+efF2dM1BsM7kzfTxMdQEHvbWRaVe7zJLTGcPZzafn2M6A@mail.gmail.com>
2015-12-11 0:41 ` Dallas Clement
2015-12-11 1:19 ` Dallas Clement
[not found] ` <CAK2H+ec-zMbhxoFyHXLkdM-z-9cYYzNbPFhn19XjTHqrOMDZKQ@mail.gmail.com>
2015-12-11 15:44 ` Dallas Clement [this message]
2015-12-11 16:32 ` John Stoffel
2015-12-11 16:47 ` Dallas Clement
2015-12-11 19:34 ` John Stoffel
2015-12-11 21:24 ` Dallas Clement
2015-12-11 23:30 ` Dallas Clement
2015-12-12 0:00 ` Dallas Clement
2015-12-12 0:38 ` Phil Turmel
2015-12-12 2:55 ` Dallas Clement
2015-12-12 4:47 ` Phil Turmel
2015-12-14 20:14 ` Dallas Clement
[not found] ` <CAK2H+edazVORrVovWDeTA8DmqUL+5HRH-AcRwg8KkMas=o+Cog@mail.gmail.com>
2015-12-14 20:55 ` Dallas Clement
[not found] ` <CAK2H+ed-3Z8SR20t8rpt3Fb48c3X2Jft=qZoiY9emC2nQww1xQ@mail.gmail.com>
2015-12-14 21:20 ` Dallas Clement
2015-12-14 22:05 ` Dallas Clement
2015-12-14 22:31 ` Tommy Apel
[not found] ` <CAK2H+ecMvDLdYLhMtMQbP7Ygw-VohG7LGZ2n7H+LAXQ1waJK3A@mail.gmail.com>
2015-12-14 23:25 ` Dallas Clement
2015-12-15 2:36 ` Dallas Clement
2015-12-15 13:53 ` Phil Turmel
2015-12-15 14:09 ` Robert Kierski
2015-12-15 15:14 ` John Stoffel
2015-12-15 17:30 ` Dallas Clement
2015-12-15 19:22 ` Phil Turmel
2015-12-15 19:44 ` Dallas Clement
2015-12-15 19:52 ` Phil Turmel
2015-12-15 21:54 ` John Stoffel
2015-12-15 23:07 ` Dallas Clement
2015-12-16 15:31 ` Dallas Clement
[not found] ` <CAK2H+eeD2k4yzuvL4uF_qKycp6A=XPe8pVF_J-7Agi8Ze89PPQ@mail.gmail.com>
2015-12-17 5:57 ` Dallas Clement
2015-12-17 13:41 ` Phil Turmel
2015-12-17 21:08 ` Dallas Clement
2015-12-17 22:40 ` Phil Turmel
2015-12-17 23:28 ` Dallas Clement
2015-12-18 0:54 ` Dallas Clement
[not found] ` <CAFx4rwT8xgwZ0OWaLLsZvhMskiwmY54MzHgnnEPaswByeRrXxQ@mail.gmail.com>
2015-12-22 6:15 ` Doug Dumitru
2015-12-22 14:34 ` Robert Kierski
2015-12-22 16:48 ` Dallas Clement
2015-12-22 18:33 ` Doug Dumitru
2016-01-04 18:56 ` Robert Kierski
2016-01-04 19:13 ` Doug Dumitru
2016-01-04 19:33 ` Robert Kierski
2016-01-04 19:43 ` Doug Dumitru
2016-01-15 16:53 ` Robert Kierski
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CAE9DZURK+bZ=4czbGojzW815Du1ascr5vzAPtQBw4ZDGyq0MAQ@mail.gmail.com' \
--to=dallas.a.clement@gmail.com \
--cc=linux-raid@vger.kernel.org \
--cc=markknecht@gmail.com \
--cc=philip@turmel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.