* Regression with crc32c selection?
@ 2018-07-23 14:13 Holger Hoffstätte
2018-07-23 14:39 ` Patrik Lundquist
2018-07-23 16:50 ` Regression with crc32c selection? David Sterba
0 siblings, 2 replies; 5+ messages in thread
From: Holger Hoffstätte @ 2018-07-23 14:13 UTC (permalink / raw)
To: linux-btrfs
Hi,
While backporting a bunch of fixes to my own 4.16.x tree
(4.17 had a few too many bugs for my taste) I also ended up merging:
df91f56adce1f: libcrc32c: Add crc32c_impl function
9678c54388b6a: btrfs: Remove custom crc32c init code
..which AFAIK went into 4.17 and seemed harmless enough; after fixing up
a trivial context conflict it builds, runs, all good..except that btrfs
(apprently?) no longer uses the preferred crc32c-intel module, but the
crc32c-generic one instead.
In order to rule out any mistakes on my part I built 4.18.0-rc6 and it
seems to have the same problem:
Jul 23 15:55:09 ragnarok kernel: raid6: sse2x1 gen() 11267 MB/s
Jul 23 15:55:09 ragnarok kernel: raid6: sse2x1 xor() 8110 MB/s
Jul 23 15:55:09 ragnarok kernel: raid6: sse2x2 gen() 13409 MB/s
Jul 23 15:55:09 ragnarok kernel: raid6: sse2x2 xor() 9137 MB/s
Jul 23 15:55:09 ragnarok kernel: raid6: sse2x4 gen() 15884 MB/s
Jul 23 15:55:09 ragnarok kernel: raid6: sse2x4 xor() 10579 MB/s
Jul 23 15:55:09 ragnarok kernel: raid6: using algorithm sse2x4 gen() 15884 MB/s
Jul 23 15:55:09 ragnarok kernel: raid6: .... xor() 10579 MB/s, rmw enabled
Jul 23 15:55:09 ragnarok kernel: raid6: using ssse3x2 recovery algorithm
Jul 23 15:55:09 ragnarok kernel: xor: automatically using best checksumming function avx
Jul 23 15:55:09 ragnarok kernel: Btrfs loaded, crc32c=crc32c-generic
I understand that the new crc32c_impl() function changed from
crypto_tfm_alg_driver_name() to crypto_shash_driver_name() - could this
be the reason? The module is loaded just fine, but apprently not used:
$lsmod | grep crc32
crc32_pclmul 16384 0
crc32c_intel 24576 0
In other words, is this supposed to happen or is my kernel config somehow
no longer right? It worked before and doesn't look too wrong:
$grep CRC /etc/kernels/kernel-config-x86_64-4.18.0-rc6
# CONFIG_PCIE_ECRC is not set
CONFIG_CRYPTO_CRC32C=y
CONFIG_CRYPTO_CRC32C_INTEL=m
CONFIG_CRYPTO_CRC32=m
CONFIG_CRYPTO_CRC32_PCLMUL=m
# CONFIG_CRYPTO_CRCT10DIF is not set
CONFIG_CRC_CCITT=m
CONFIG_CRC16=y
# CONFIG_CRC_T10DIF is not set
CONFIG_CRC_ITU_T=y
CONFIG_CRC32=y
# CONFIG_CRC32_SELFTEST is not set
CONFIG_CRC32_SLICEBY8=y
# CONFIG_CRC32_SLICEBY4 is not set
# CONFIG_CRC32_SARWATE is not set
# CONFIG_CRC32_BIT is not set
# CONFIG_CRC4 is not set
# CONFIG_CRC7 is not set
CONFIG_LIBCRC32C=y
# CONFIG_CRC8 is not set
Ultimately btrfs (and everything else) works, but the process of how
the kernel selects a crc32c implementation seems rather mysterious to me. :/
Any insights welcome. If it's a regression I can gladly test fixes.
cheers
Holger
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Regression with crc32c selection?
2018-07-23 14:13 Regression with crc32c selection? Holger Hoffstätte
@ 2018-07-23 14:39 ` Patrik Lundquist
2018-07-23 15:11 ` Regression with crc32c selection? (solved - pilot error) Holger Hoffstätte
2018-07-23 16:50 ` Regression with crc32c selection? David Sterba
1 sibling, 1 reply; 5+ messages in thread
From: Patrik Lundquist @ 2018-07-23 14:39 UTC (permalink / raw)
To: holger; +Cc: linux-btrfs
$ uname -a
Linux nas 4.17.0-1-amd64 #1 SMP Debian 4.17.8-1 (2018-07-20) x86_64 GNU/Linux
$ dmesg | grep Btrfs
[ 8.168408] Btrfs loaded, crc32c=crc32c-intel
$ lsmod | grep crc32
crc32_pclmul 16384 0
libcrc32c 16384 1 btrfs
crc32c_generic 16384 0
crc32c_intel 24576 2
$ grep CRC /boot/config-4.17.0-1-amd64
# CONFIG_PCIE_ECRC is not set
# CONFIG_W1_SLAVE_DS2433_CRC is not set
CONFIG_CRYPTO_CRC32C=m
CONFIG_CRYPTO_CRC32C_INTEL=m
CONFIG_CRYPTO_CRC32=m
CONFIG_CRYPTO_CRC32_PCLMUL=m
CONFIG_CRYPTO_CRCT10DIF=y
CONFIG_CRYPTO_CRCT10DIF_PCLMUL=m
CONFIG_CRC_CCITT=m
CONFIG_CRC16=m
CONFIG_CRC_T10DIF=y
CONFIG_CRC_ITU_T=m
CONFIG_CRC32=y
# CONFIG_CRC32_SELFTEST is not set
CONFIG_CRC32_SLICEBY8=y
# CONFIG_CRC32_SLICEBY4 is not set
# CONFIG_CRC32_SARWATE is not set
# CONFIG_CRC32_BIT is not set
# CONFIG_CRC4 is not set
CONFIG_CRC7=m
CONFIG_LIBCRC32C=m
CONFIG_CRC8=m
On Mon, 23 Jul 2018 at 16:14, Holger Hoffstätte
<holger@applied-asynchrony.com> wrote:
>
> Hi,
>
> While backporting a bunch of fixes to my own 4.16.x tree
> (4.17 had a few too many bugs for my taste) I also ended up merging:
>
> df91f56adce1f: libcrc32c: Add crc32c_impl function
> 9678c54388b6a: btrfs: Remove custom crc32c init code
>
> ..which AFAIK went into 4.17 and seemed harmless enough; after fixing up
> a trivial context conflict it builds, runs, all good..except that btrfs
> (apprently?) no longer uses the preferred crc32c-intel module, but the
> crc32c-generic one instead.
>
> In order to rule out any mistakes on my part I built 4.18.0-rc6 and it
> seems to have the same problem:
>
> Jul 23 15:55:09 ragnarok kernel: raid6: sse2x1 gen() 11267 MB/s
> Jul 23 15:55:09 ragnarok kernel: raid6: sse2x1 xor() 8110 MB/s
> Jul 23 15:55:09 ragnarok kernel: raid6: sse2x2 gen() 13409 MB/s
> Jul 23 15:55:09 ragnarok kernel: raid6: sse2x2 xor() 9137 MB/s
> Jul 23 15:55:09 ragnarok kernel: raid6: sse2x4 gen() 15884 MB/s
> Jul 23 15:55:09 ragnarok kernel: raid6: sse2x4 xor() 10579 MB/s
> Jul 23 15:55:09 ragnarok kernel: raid6: using algorithm sse2x4 gen() 15884 MB/s
> Jul 23 15:55:09 ragnarok kernel: raid6: .... xor() 10579 MB/s, rmw enabled
> Jul 23 15:55:09 ragnarok kernel: raid6: using ssse3x2 recovery algorithm
> Jul 23 15:55:09 ragnarok kernel: xor: automatically using best checksumming function avx
> Jul 23 15:55:09 ragnarok kernel: Btrfs loaded, crc32c=crc32c-generic
>
> I understand that the new crc32c_impl() function changed from
> crypto_tfm_alg_driver_name() to crypto_shash_driver_name() - could this
> be the reason? The module is loaded just fine, but apprently not used:
>
> $lsmod | grep crc32
> crc32_pclmul 16384 0
> crc32c_intel 24576 0
>
> In other words, is this supposed to happen or is my kernel config somehow
> no longer right? It worked before and doesn't look too wrong:
>
> $grep CRC /etc/kernels/kernel-config-x86_64-4.18.0-rc6
> # CONFIG_PCIE_ECRC is not set
> CONFIG_CRYPTO_CRC32C=y
> CONFIG_CRYPTO_CRC32C_INTEL=m
> CONFIG_CRYPTO_CRC32=m
> CONFIG_CRYPTO_CRC32_PCLMUL=m
> # CONFIG_CRYPTO_CRCT10DIF is not set
> CONFIG_CRC_CCITT=m
> CONFIG_CRC16=y
> # CONFIG_CRC_T10DIF is not set
> CONFIG_CRC_ITU_T=y
> CONFIG_CRC32=y
> # CONFIG_CRC32_SELFTEST is not set
> CONFIG_CRC32_SLICEBY8=y
> # CONFIG_CRC32_SLICEBY4 is not set
> # CONFIG_CRC32_SARWATE is not set
> # CONFIG_CRC32_BIT is not set
> # CONFIG_CRC4 is not set
> # CONFIG_CRC7 is not set
> CONFIG_LIBCRC32C=y
> # CONFIG_CRC8 is not set
>
> Ultimately btrfs (and everything else) works, but the process of how
> the kernel selects a crc32c implementation seems rather mysterious to me. :/
>
> Any insights welcome. If it's a regression I can gladly test fixes.
>
> cheers
> Holger
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Regression with crc32c selection? (solved - pilot error)
2018-07-23 14:39 ` Patrik Lundquist
@ 2018-07-23 15:11 ` Holger Hoffstätte
0 siblings, 0 replies; 5+ messages in thread
From: Holger Hoffstätte @ 2018-07-23 15:11 UTC (permalink / raw)
To: Patrik Lundquist; +Cc: linux-btrfs
On 07/23/18 16:39, Patrik Lundquist wrote:
> $ uname -a
> Linux nas 4.17.0-1-amd64 #1 SMP Debian 4.17.8-1 (2018-07-20) x86_64 GNU/Linux
>
> $ dmesg | grep Btrfs
> [ 8.168408] Btrfs loaded, crc32c=crc32c-intel
>
> $ lsmod | grep crc32
> crc32_pclmul 16384 0
> libcrc32c 16384 1 btrfs
> crc32c_generic 16384 0
> crc32c_intel 24576 2
Ooohh..thanks for that. I wouldn't be surprised it's because my libcrc
is built-in (probably because of built-in xfs) and at initialization time
doesn't see any modules, so it always selects the generic impl.
Since btrfs is only ever loaded last, the previous btrfs init code could
properly detect/load/use the crc32c-intel module.
I switched the crc32c impls to built-in and what do you know:
Jul 23 17:04:26 ragnarok kernel: Btrfs loaded, crc32c=crc32c-intel
\o/
Thanks Patrick!
Holger
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Regression with crc32c selection?
2018-07-23 14:13 Regression with crc32c selection? Holger Hoffstätte
2018-07-23 14:39 ` Patrik Lundquist
@ 2018-07-23 16:50 ` David Sterba
2018-07-23 17:45 ` Holger Hoffstätte
1 sibling, 1 reply; 5+ messages in thread
From: David Sterba @ 2018-07-23 16:50 UTC (permalink / raw)
To: Holger Hoffstätte; +Cc: linux-btrfs
On Mon, Jul 23, 2018 at 04:13:26PM +0200, Holger Hoffstätte wrote:
> While backporting a bunch of fixes to my own 4.16.x tree
> (4.17 had a few too many bugs for my taste) I also ended up merging:
Curious, bugs in btrfs or the whole 4.17 kernel? And if bugs, real
breakage or backported fixes?
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Regression with crc32c selection?
2018-07-23 16:50 ` Regression with crc32c selection? David Sterba
@ 2018-07-23 17:45 ` Holger Hoffstätte
0 siblings, 0 replies; 5+ messages in thread
From: Holger Hoffstätte @ 2018-07-23 17:45 UTC (permalink / raw)
To: dsterba, linux-btrfs
On 07/23/18 18:50, David Sterba wrote:
> On Mon, Jul 23, 2018 at 04:13:26PM +0200, Holger Hoffstätte wrote:
>> While backporting a bunch of fixes to my own 4.16.x tree
>> (4.17 had a few too many bugs for my taste) I also ended up merging:
>
> Curious, bugs in btrfs or the whole 4.17 kernel? And if bugs, real
> breakage or backported fixes?
Overall. I don't remember specifics but skimming lkml at the time
didn't inspire a lot of confidence, and since I already had a large
number of hand-picked & backported patches from 4.17/4.18/4.19 :) for
btrfs, xfs, net, blk-mq & drivers - just the stuff I care about - I skipped
it instead of upgrading & rebasing everything. Might well be that the latest
4.17-stable works reliably, but 4.18 is already around the corner, so..
no really good reason. :)
cheers
Holger
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2018-07-23 18:47 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-07-23 14:13 Regression with crc32c selection? Holger Hoffstätte
2018-07-23 14:39 ` Patrik Lundquist
2018-07-23 15:11 ` Regression with crc32c selection? (solved - pilot error) Holger Hoffstätte
2018-07-23 16:50 ` Regression with crc32c selection? David Sterba
2018-07-23 17:45 ` Holger Hoffstätte
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.