* mdadm 3.2.5: Assemble doesn't scale correctly
@ 2012-10-15 16:13 Sebastian Riemer
2012-10-16 11:44 ` Sebastian Riemer
0 siblings, 1 reply; 2+ messages in thread
From: Sebastian Riemer @ 2012-10-15 16:13 UTC (permalink / raw)
To: Linux RAID; +Cc: Sebastian Riemer
Hi list,
the mdadm 3.2.5 assemble command doesn't scale correctly.
First, I've tested simple stuff with "strace" like this one:
# mdadm -A /dev/md0 /dev/loop0 /dev/loop1
This also scans imsm superblocks by reading files from "/sys/bus/pci".
Let's set it explicitly to 1.2:
# mdadm -A /dev/md0 -e 1.2 /dev/loop0 /dev/loop1
This results in approx. 100 lines less strace output.
But now the big performance killer:
Assemble()->open_dev_excl()->dev_open("%d:%d")->map_dev()
Why does this have to scan the whole "/dev" directory - not finding any
device with the same/wanted major:minor? Isn't there a better method?
It takes longer and longer the more devices are in /dev.
Cheers,
Sebastian
--
Sebastian Riemer
Linux Kernel Developer - Storage
^ permalink raw reply [flat|nested] 2+ messages in thread
* Re: mdadm 3.2.5: Assemble doesn't scale correctly
2012-10-15 16:13 mdadm 3.2.5: Assemble doesn't scale correctly Sebastian Riemer
@ 2012-10-16 11:44 ` Sebastian Riemer
0 siblings, 0 replies; 2+ messages in thread
From: Sebastian Riemer @ 2012-10-16 11:44 UTC (permalink / raw)
To: Linux RAID; +Cc: Sebastian Riemer
Hi list,
we solved this by custom patches once again.
We added a parameter to "dev_open" to select whether we want "map_dev"
to be called or not.
In "create_mddev" from mdopen.c we trigger that "map_dev" isn't called
if the device name is /dev/mdX.
If such a device is already running is checked before in /proc/mdstat.
The SCSI tape driver has got the same major but as a char device - we
don't use it anyway. So there isn't much risk for us at least.
Because there could be cases we haven't thought of and the
implementation is possibly not the best way, it remains a custom fix and
I'm not sending any patches.
Btw.: The strace of the assembly dropped from >2000 to approx. 300 lines
on my PC.
Cheers,
Sebastian
On 15.10.2012 18:13, Sebastian Riemer wrote:
> Hi list,
>
> the mdadm 3.2.5 assemble command doesn't scale correctly.
>
> First, I've tested simple stuff with "strace" like this one:
>
> # mdadm -A /dev/md0 /dev/loop0 /dev/loop1
>
> This also scans imsm superblocks by reading files from "/sys/bus/pci".
> Let's set it explicitly to 1.2:
>
> # mdadm -A /dev/md0 -e 1.2 /dev/loop0 /dev/loop1
>
> This results in approx. 100 lines less strace output.
>
>
> But now the big performance killer:
>
> Assemble()->open_dev_excl()->dev_open("%d:%d")->map_dev()
>
> Why does this have to scan the whole "/dev" directory - not finding any
> device with the same/wanted major:minor? Isn't there a better method?
>
> It takes longer and longer the more devices are in /dev.
>
> Cheers,
> Sebastian
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2012-10-16 11:44 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-10-15 16:13 mdadm 3.2.5: Assemble doesn't scale correctly Sebastian Riemer
2012-10-16 11:44 ` Sebastian Riemer
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.