All of lore.kernel.org
 help / color / mirror / Atom feed
* read time tree block corruption detected
@ 2020-02-12 21:58 Samir Benmendil
  2020-02-13  0:26 ` Qu Wenruo
  0 siblings, 1 reply; 75+ messages in thread
From: Samir Benmendil @ 2020-02-12 21:58 UTC (permalink / raw)
  To: linux-btrfs

[-- Attachment #1: Type: text/plain, Size: 1272 bytes --]

Hello,

I've been getting the following "BTRFS errors" for a while now, the wiki 
[0] advises to report such occurrences to this list.

BTRFS critical (device sda2): corrupt leaf: root=466 block=194756837376 slot=72 ino=1359622 file_offset=475136, extent end overflow, have file offset 475136 extent num bytes 18446744073709486080
BTRFS error (device sda2): block=194756837376 read time tree block corruption detected
BTRFS critical (device sda2): corrupt leaf: root=466 block=194756837376 slot=72 ino=1359622 file_offset=475136, extent end overflow, have file offset 475136 extent num bytes 18446744073709486080
BTRFS error (device sda2): block=194756837376 read time tree block corruption detected
BTRFS critical (device sda2): corrupt leaf: root=466 block=194347958272 slot=131 ino=1357455 file_offset=1044480, extent end overflow, have file offset 1044480 extent num bytes 18446744073708908544
BTRFS error (device sda2): block=194347958272 read time tree block corruption detected

I can reproduce these errors consistently by running `updatedb`, I 
suppose some tree block in one of the file it reads is corrupted.

Thanks in advance for your help,
Regards,
Samir

[0] https://btrfs.wiki.kernel.org/index.php/Tree-checker#How_to_handle_such_error

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

^ permalink raw reply	[flat|nested] 75+ messages in thread
* read time tree block corruption detected
@ 2021-11-22  5:26 x8062
  2021-11-22  7:24 ` Nikolay Borisov
  0 siblings, 1 reply; 75+ messages in thread
From: x8062 @ 2021-11-22  5:26 UTC (permalink / raw)
  To: linux-btrfs

Hello,
 I got periodic warns in my linux console. in dmesg it is the following pasted text.
At https://btrfs.wiki.kernel.org/index.php/Tree-checker I learned it may be a error, so i send the message. Hopefully it could help, Thanks in advance!

[  513.900852] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465

[  513.900869] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected
[  513.901534] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465
[  513.901550] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected
[  513.912414] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465
[  513.912433] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected
[  611.835932] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465
[  611.835950] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected
[  611.836594] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465
[  611.836603] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected
[  611.847484] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465
[  611.847500] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected
[  708.354174] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465
[  708.354186] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected
[  708.354833] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465
[  708.354841] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected
[  708.357409] BTRFS critical (device sdb3): corrupt leaf: root=381 block=71928348672 slot=74 ino=2394634 file_offset=0, invalid ram_bytes for uncompressed inline extent, have 393 expect 131465
[  708.357420] BTRFS error (device sdb3): block=71928348672 read time tree block corruption detected

BTW: my mount option is (rw,relatime,space_cache,commit=90,subvolid=5,subvol=/), I'm using btrfs upon /dev/sdb3 and /dev/sda4, with btrfs raid0 support.
$ uname -a
Linux XXXP 5.15.3-arch1-1 #1 SMP PREEMPT Thu, 18 Nov 2021 22:23:08 +0000 x86_64 GNU/Linux
$ pacman -Qi btrfs-progs
Name            : btrfs-progs
Version         : 5.15-1
Description     : Btrfs filesystem utilities
Architecture    : x86_64
URL             : https://btrfs.wiki.kernel.org
Licenses        : GPL2
Groups          : None
Provides        : btrfs-progs-unstable
Depends On      : glibc  util-linux-libs  lzo  zlib  zstd  libgcrypt
Optional Deps   : python: libbtrfsutil python bindings [installed]
                  e2fsprogs: btrfs-convert [installed]
                  reiserfsprogs: btrfs-convert [installed]
Required By     : None
Optional For    : None
Conflicts With  : btrfs-progs-unstable
Replaces        : btrfs-progs-unstable
Installed Size  : 4.80 MiB
Packager        : Tobias Powalowski <tpowa@archlinux.org>
Build Date      : Sun 07 Nov 2021 02:56:20 AM CST
Install Date    : Tue 09 Nov 2021 01:10:11 PM CST
Install Reason  : Explicitly installed
Install Script  : Yes
Validated By    : Signature


^ permalink raw reply	[flat|nested] 75+ messages in thread
* Read time tree block corruption detected
@ 2021-07-17  1:45 pepperpoint
  2021-07-17  7:05 ` Qu Wenruo
       [not found] ` <162650555086.7.16811903270475408953.10183708@simplelogin.co>
  0 siblings, 2 replies; 75+ messages in thread
From: pepperpoint @ 2021-07-17  1:45 UTC (permalink / raw)
  To: linux-btrfs

Hello,

I see this message on dmesg:

[ 2452.256756] BTRFS critical (device dm-0): corrupt leaf: root=363 block=174113599488 slot=9 ino=7415, invalid nlink: has 2 expect no more than 1 for dir
[ 2452.256776] BTRFS error (device dm-0): block=174113599488 read time tree block corruption detected

When I run btrfs scrub and btrfs check, no error was detected.
I am running Linux 5.12.15-arch1-1 and btrfs-progs v5.12.1

How should I fix this error?


^ permalink raw reply	[flat|nested] 75+ messages in thread
* read time tree block corruption detected
@ 2021-04-16 19:35 Gervais, Francois
  2021-04-17  1:01 ` Qu Wenruo
  0 siblings, 1 reply; 75+ messages in thread
From: Gervais, Francois @ 2021-04-16 19:35 UTC (permalink / raw)
  To: linux-btrfs

We are using btrfs on one of our embedded devices and we got filesystem corruption on one of them.

This product undergo a lot of tests on our side and apparently it's the first it happened so it seems to be a pretty rare occurrence. However we still want to get to the bottom of this to ensure it doesn't happen in the future.

Some background:
- The corruption happened on kernel v5.4.72.
- On the debug device I'm on master (v5.12.0-rc7) hoping it might help to have all the latest patches.

Here what kernel v5.12.0-rc7 tells me when trying to mount the partition:

Apr 16 19:31:45 buildroot kernel: BTRFS info (device loop0p3): disk space caching is enabled
Apr 16 19:31:45 buildroot kernel: BTRFS info (device loop0p3): has skinny extents
Apr 16 19:31:45 buildroot kernel: BTRFS info (device loop0p3): start tree-log replay
Apr 16 19:31:45 buildroot kernel: BTRFS critical (device loop0p3): corrupt leaf: root=18446744073709551610 block=790151168 slot=5 ino=5007, inode ref overflow, ptr 15853 end 15861 namelen 294
Apr 16 19:31:45 buildroot kernel: BTRFS error (device loop0p3): block=790151168 read time tree block corruption detected
Apr 16 19:31:45 buildroot kernel: BTRFS critical (device loop0p3): corrupt leaf: root=18446744073709551610 block=790151168 slot=5 ino=5007, inode ref overflow, ptr 15853 end 15861 namelen 294
Apr 16 19:31:45 buildroot kernel: BTRFS error (device loop0p3): block=790151168 read time tree block corruption detected
Apr 16 19:31:45 buildroot kernel: BTRFS: error (device loop0p3) in btrfs_recover_log_trees:6246: errno=-5 IO failure (Couldn't read tree log root.)
Apr 16 19:31:45 buildroot kernel: BTRFS: error (device loop0p3) in btrfs_replay_log:2341: errno=-5 IO failure (Failed to recover log tree)
Apr 16 19:31:45 buildroot e512c123daaa[468]: mount: /root/mnt: can't read superblock on /dev/loop0p3.
Apr 16 19:31:45 buildroot kernel: BTRFS error (device loop0p3): open_ctree failed: -5

Any suggestions?

^ permalink raw reply	[flat|nested] 75+ messages in thread
[parent not found: <CAJheHN0FUe-ijMco1ZOc6iKF2zbPocOw+iiVNeTT1r-JuXOJww@mail.gmail.com>]
* read time tree block corruption detected
@ 2020-01-16 13:40 Peter Luladjiev
  2020-01-16 16:12 ` Nikolay Borisov
  0 siblings, 1 reply; 75+ messages in thread
From: Peter Luladjiev @ 2020-01-16 13:40 UTC (permalink / raw)
  To: linux-btrfs

[-- Attachment #1: Type: text/plain, Size: 1175 bytes --]

Hello,

I'm having a "read time tree block corruption detected" error after
upgrading to kernel 5.4, reverting to kernel 5.3 fixes the problem.
I'm using openSuse Tumbleweed, btrfs-progs v5.4

Here is the dmesg output:

[   57.817776] BTRFS critical (device dm-1): corrupt leaf:
block=52197507072 slot=74 extent bytenr=1497022464 len=4096 invalid
extent refs, have 1 expect >= inline 3087007745
[   57.817778] BTRFS error (device dm-1): block=52197507072 read time
tree block corruption detected
[   57.817783] BTRFS: error (device dm-1) in
btrfs_run_delayed_refs:2188: errno=-5 IO failure
[   57.817785] BTRFS info (device dm-1): forced readonly

btrfs fi show

Label: none  uuid: 9639a3e6-cd08-4270-b4d1-d2946d2b8d2e
        Total devices 1 FS bytes used 49.85GiB
        devid    1 size 70.00GiB used 54.04GiB path /dev/mapper/system-root

btrfs fi df /

Data, single: total=52.01GiB, used=48.40GiB
System, single: total=32.00MiB, used=16.00KiB
Metadata, single: total=2.00GiB, used=1.44GiB
GlobalReserve, single: total=123.92MiB, used=0.00B

I'm attaching the output of btrfs ins dump-tree -b 52197507072
/dev/mapper/system-root

What are my options?

Thanks in advance!

[-- Attachment #2: dump-tree.txt --]
[-- Type: text/plain, Size: 27666 bytes --]

btrfs-progs v5.4 
leaf 52197507072 items 139 free space 4636 generation 538071 owner EXTENT_TREE
leaf 52197507072 flags 0x1(WRITTEN) backref revision 1
fs uuid 9639a3e6-cd08-4270-b4d1-d2946d2b8d2e
chunk uuid 004aeeba-bb0d-4915-b7c1-c15fb4745c4f
	item 0 key (1495171072 EXTENT_ITEM 8192) itemoff 16181 itemsize 102
		refs 6 gen 500598 flags DATA
		shared data backref parent 51538460672 count 1
		shared data backref parent 988725248 count 1
		shared data backref parent 897351680 count 1
		shared data backref parent 821608448 count 1
		shared data backref parent 587972608 count 1
		shared data backref parent 508870656 count 1
	item 1 key (1495179264 EXTENT_ITEM 4096) itemoff 16092 itemsize 89
		refs 5 gen 403758 flags DATA
		shared data backref parent 52216168448 count 1
		shared data backref parent 52140294144 count 1
		shared data backref parent 51774226432 count 1
		shared data backref parent 980254720 count 1
		shared data backref parent 218169344 count 1
	item 2 key (1495183360 EXTENT_ITEM 8192) itemoff 16039 itemsize 53
		refs 1 gen 292437 flags DATA
		extent data backref root 260 objectid 698805 offset 0 count 1
	item 3 key (1495191552 EXTENT_ITEM 8192) itemoff 15921 itemsize 118
		refs 6 gen 113455 flags DATA
		extent data backref root 1338 objectid 2699311 offset 0 count 1
		shared data backref parent 52132085760 count 1
		shared data backref parent 51829489664 count 1
		shared data backref parent 51288211456 count 1
		shared data backref parent 505987072 count 1
		shared data backref parent 180977664 count 1
	item 4 key (1495199744 EXTENT_ITEM 16384) itemoff 15816 itemsize 105
		refs 5 gen 501446 flags DATA
		extent data backref root 1338 objectid 4646245 offset 0 count 1
		shared data backref parent 51833847808 count 1
		shared data backref parent 51359678464 count 1
		shared data backref parent 936361984 count 1
		shared data backref parent 415236096 count 1
	item 5 key (1495216128 EXTENT_ITEM 12288) itemoff 15711 itemsize 105
		refs 5 gen 501446 flags DATA
		extent data backref root 1338 objectid 4646255 offset 0 count 1
		shared data backref parent 51833798656 count 1
		shared data backref parent 51359760384 count 1
		shared data backref parent 936394752 count 1
		shared data backref parent 415219712 count 1
	item 6 key (1495228416 EXTENT_ITEM 8192) itemoff 15658 itemsize 53
		refs 1 gen 292032 flags DATA
		extent data backref root 258 objectid 1754582 offset 0 count 1
	item 7 key (1495236608 EXTENT_ITEM 4096) itemoff 15621 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51376160768 count 1
	item 8 key (1495240704 EXTENT_ITEM 12288) itemoff 15503 itemsize 118
		refs 6 gen 113455 flags DATA
		extent data backref root 1338 objectid 2699310 offset 0 count 1
		shared data backref parent 52132085760 count 1
		shared data backref parent 51829489664 count 1
		shared data backref parent 51288211456 count 1
		shared data backref parent 505987072 count 1
		shared data backref parent 180977664 count 1
	item 9 key (1495252992 EXTENT_ITEM 20480) itemoff 15385 itemsize 118
		refs 6 gen 113455 flags DATA
		extent data backref root 1338 objectid 2699312 offset 0 count 1
		shared data backref parent 52132085760 count 1
		shared data backref parent 51829489664 count 1
		shared data backref parent 51288211456 count 1
		shared data backref parent 505987072 count 1
		shared data backref parent 180977664 count 1
	item 10 key (1495273472 EXTENT_ITEM 8192) itemoff 15267 itemsize 118
		refs 6 gen 113455 flags DATA
		extent data backref root 1338 objectid 2699313 offset 0 count 1
		shared data backref parent 52132085760 count 1
		shared data backref parent 51829489664 count 1
		shared data backref parent 51288211456 count 1
		shared data backref parent 505987072 count 1
		shared data backref parent 180977664 count 1
	item 11 key (1495281664 EXTENT_ITEM 8192) itemoff 15214 itemsize 53
		refs 1 gen 521727 flags DATA
		extent data backref root 258 objectid 2177295 offset 0 count 1
	item 12 key (1495289856 EXTENT_ITEM 77824) itemoff 15177 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51300941824 count 1
	item 13 key (1495367680 EXTENT_ITEM 4096) itemoff 15124 itemsize 53
		refs 1 gen 288275 flags DATA
		extent data backref root 260 objectid 680046 offset 0 count 1
	item 14 key (1495371776 EXTENT_ITEM 4096) itemoff 15071 itemsize 53
		refs 1 gen 288214 flags DATA
		extent data backref root 260 objectid 679425 offset 8192 count 1
	item 15 key (1495375872 EXTENT_ITEM 24576) itemoff 15018 itemsize 53
		refs 1 gen 288035 flags DATA
		extent data backref root 260 objectid 678605 offset 0 count 1
	item 16 key (1495400448 EXTENT_ITEM 20480) itemoff 14965 itemsize 53
		refs 1 gen 288035 flags DATA
		extent data backref root 260 objectid 678606 offset 0 count 1
	item 17 key (1495420928 EXTENT_ITEM 24576) itemoff 14912 itemsize 53
		refs 1 gen 288035 flags DATA
		extent data backref root 260 objectid 678607 offset 0 count 1
	item 18 key (1495445504 EXTENT_ITEM 118784) itemoff 14859 itemsize 53
		refs 5 gen 288212 flags DATA
		extent data backref root 260 objectid 679426 offset 0 count 5
	item 19 key (1495564288 EXTENT_ITEM 65536) itemoff 14806 itemsize 53
		refs 1 gen 288212 flags DATA
		extent data backref root 260 objectid 679425 offset 0 count 1
	item 20 key (1495629824 EXTENT_ITEM 20480) itemoff 14753 itemsize 53
		refs 1 gen 288213 flags DATA
		extent data backref root 260 objectid 679460 offset 0 count 1
	item 21 key (1495650304 EXTENT_ITEM 4096) itemoff 14700 itemsize 53
		refs 1 gen 288275 flags DATA
		extent data backref root 260 objectid 680098 offset 0 count 1
	item 22 key (1495654400 EXTENT_ITEM 36864) itemoff 14663 itemsize 37
		refs 1 gen 400951 flags DATA
		shared data backref parent 51916881920 count 1
	item 23 key (1495691264 EXTENT_ITEM 12288) itemoff 14558 itemsize 105
		refs 5 gen 501446 flags DATA
		extent data backref root 1338 objectid 4646266 offset 0 count 1
		shared data backref parent 51833798656 count 1
		shared data backref parent 51359760384 count 1
		shared data backref parent 936394752 count 1
		shared data backref parent 415219712 count 1
	item 24 key (1495703552 EXTENT_ITEM 12288) itemoff 14521 itemsize 37
		refs 1 gen 360665 flags DATA
		shared data backref parent 51275005952 count 1
	item 25 key (1495715840 EXTENT_ITEM 8192) itemoff 14468 itemsize 53
		refs 1 gen 422702 flags DATA
		extent data backref root 260 objectid 919536 offset 12288 count 1
	item 26 key (1495724032 EXTENT_ITEM 4096) itemoff 14431 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51376160768 count 1
	item 27 key (1495728128 EXTENT_ITEM 225280) itemoff 14378 itemsize 53
		refs 1 gen 108502 flags DATA
		extent data backref root 260 objectid 530211 offset 0 count 1
	item 28 key (1495953408 EXTENT_ITEM 36864) itemoff 14328 itemsize 50
		refs 2 gen 270767 flags DATA
		shared data backref parent 51854098432 count 1
		shared data backref parent 218349568 count 1
	item 29 key (1495990272 EXTENT_ITEM 8192) itemoff 14275 itemsize 53
		refs 1 gen 422705 flags DATA
		extent data backref root 260 objectid 919420 offset 0 count 1
	item 30 key (1495998464 EXTENT_ITEM 12288) itemoff 14222 itemsize 53
		refs 1 gen 472554 flags DATA
		extent data backref root 260 objectid 974375 offset 0 count 1
	item 31 key (1496010752 EXTENT_ITEM 4096) itemoff 14169 itemsize 53
		refs 1 gen 472554 flags DATA
		extent data backref root 260 objectid 974414 offset 0 count 1
	item 32 key (1496014848 EXTENT_ITEM 8192) itemoff 14116 itemsize 53
		refs 1 gen 292437 flags DATA
		extent data backref root 260 objectid 698839 offset 0 count 1
	item 33 key (1496023040 EXTENT_ITEM 24576) itemoff 14079 itemsize 37
		refs 1 gen 450713 flags DATA
		shared data backref parent 51439534080 count 1
	item 34 key (1496047616 EXTENT_ITEM 8192) itemoff 14042 itemsize 37
		refs 1 gen 450713 flags DATA
		shared data backref parent 51920568320 count 1
	item 35 key (1496055808 EXTENT_ITEM 16384) itemoff 13937 itemsize 105
		refs 5 gen 501446 flags DATA
		extent data backref root 1338 objectid 4646272 offset 0 count 1
		shared data backref parent 51833798656 count 1
		shared data backref parent 51359760384 count 1
		shared data backref parent 936394752 count 1
		shared data backref parent 415219712 count 1
	item 36 key (1496072192 EXTENT_ITEM 12288) itemoff 13835 itemsize 102
		refs 6 gen 500598 flags DATA
		shared data backref parent 51538460672 count 1
		shared data backref parent 988725248 count 1
		shared data backref parent 897351680 count 1
		shared data backref parent 821608448 count 1
		shared data backref parent 587972608 count 1
		shared data backref parent 508870656 count 1
	item 37 key (1496084480 EXTENT_ITEM 24576) itemoff 13782 itemsize 53
		refs 1 gen 131540 flags DATA
		extent data backref root 260 objectid 567818 offset 0 count 1
	item 38 key (1496109056 EXTENT_ITEM 94208) itemoff 13745 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51300515840 count 1
	item 39 key (1496203264 EXTENT_ITEM 8192) itemoff 13708 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 222543872 count 1
	item 40 key (1496211456 EXTENT_ITEM 8192) itemoff 13655 itemsize 53
		refs 1 gen 292437 flags DATA
		extent data backref root 260 objectid 698847 offset 0 count 1
	item 41 key (1496219648 EXTENT_ITEM 20480) itemoff 13550 itemsize 105
		refs 5 gen 501446 flags DATA
		extent data backref root 1338 objectid 4646246 offset 0 count 1
		shared data backref parent 51833847808 count 1
		shared data backref parent 51359678464 count 1
		shared data backref parent 936361984 count 1
		shared data backref parent 415236096 count 1
	item 42 key (1496240128 EXTENT_ITEM 4096) itemoff 13513 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51376160768 count 1
	item 43 key (1496244224 EXTENT_ITEM 8192) itemoff 13476 itemsize 37
		refs 1 gen 392397 flags DATA
		shared data backref parent 1076494336 count 1
	item 44 key (1496252416 EXTENT_ITEM 208896) itemoff 13423 itemsize 53
		refs 1 gen 292028 flags DATA
		extent data backref root 258 objectid 1752577 offset 0 count 1
	item 45 key (1496461312 EXTENT_ITEM 4096) itemoff 13370 itemsize 53
		refs 1 gen 473090 flags DATA
		extent data backref root 260 objectid 984975 offset 0 count 1
	item 46 key (1496465408 EXTENT_ITEM 8192) itemoff 13317 itemsize 53
		refs 1 gen 473090 flags DATA
		extent data backref root 260 objectid 984976 offset 0 count 1
	item 47 key (1496473600 EXTENT_ITEM 4096) itemoff 13280 itemsize 37
		refs 1 gen 392397 flags DATA
		shared data backref parent 1077231616 count 1
	item 48 key (1496477696 EXTENT_ITEM 28672) itemoff 13175 itemsize 105
		refs 5 gen 501446 flags DATA
		extent data backref root 1338 objectid 4646256 offset 0 count 1
		shared data backref parent 51833798656 count 1
		shared data backref parent 51359760384 count 1
		shared data backref parent 936394752 count 1
		shared data backref parent 415219712 count 1
	item 49 key (1496506368 EXTENT_ITEM 8192) itemoff 13122 itemsize 53
		refs 1 gen 292437 flags DATA
		extent data backref root 260 objectid 698849 offset 0 count 1
	item 50 key (1496514560 EXTENT_ITEM 8192) itemoff 13085 itemsize 37
		refs 1 gen 435902 flags DATA
		shared data backref parent 52115750912 count 1
	item 51 key (1496522752 EXTENT_ITEM 8192) itemoff 13048 itemsize 37
		refs 1 gen 435902 flags DATA
		shared data backref parent 52115750912 count 1
	item 52 key (1496530944 EXTENT_ITEM 86016) itemoff 13011 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51300515840 count 1
	item 53 key (1496616960 EXTENT_ITEM 8192) itemoff 12974 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 222543872 count 1
	item 54 key (1496625152 EXTENT_ITEM 12288) itemoff 12739 itemsize 235
		refs 15 gen 185300 flags DATA
		extent data backref root 1338 objectid 3452741 offset 0 count 1
		shared data backref parent 52073168896 count 1
		shared data backref parent 52042973184 count 1
		shared data backref parent 51914752000 count 1
		shared data backref parent 51798016000 count 1
		shared data backref parent 51570212864 count 1
		shared data backref parent 51487080448 count 1
		shared data backref parent 51324616704 count 1
		shared data backref parent 51299778560 count 1
		shared data backref parent 997015552 count 1
		shared data backref parent 904347648 count 1
		shared data backref parent 550174720 count 1
		shared data backref parent 388661248 count 1
		shared data backref parent 223444992 count 1
		shared data backref parent 103546880 count 1
	item 55 key (1496637440 EXTENT_ITEM 143360) itemoff 12686 itemsize 53
		refs 1 gen 527818 flags DATA
		extent data backref root 258 objectid 2242165 offset 0 count 1
	item 56 key (1496780800 EXTENT_ITEM 12288) itemoff 12633 itemsize 53
		refs 1 gen 537609 flags DATA
		extent data backref root 1338 objectid 4788704 offset 0 count 1
	item 57 key (1496793088 EXTENT_ITEM 4096) itemoff 12583 itemsize 50
		refs 2 gen 435905 flags DATA
		shared data backref parent 52144455680 count 1
		shared data backref parent 51798720512 count 1
	item 58 key (1496797184 EXTENT_ITEM 53248) itemoff 12530 itemsize 53
		refs 1 gen 292030 flags DATA
		extent data backref root 258 objectid 1753023 offset 0 count 1
	item 59 key (1496850432 EXTENT_ITEM 8192) itemoff 12477 itemsize 53
		refs 1 gen 473090 flags DATA
		extent data backref root 260 objectid 984977 offset 0 count 1
	item 60 key (1496858624 EXTENT_ITEM 53248) itemoff 12440 itemsize 37
		refs 1 gen 400951 flags DATA
		shared data backref parent 70762496 count 1
	item 61 key (1496911872 EXTENT_ITEM 8192) itemoff 12387 itemsize 53
		refs 1 gen 537609 flags DATA
		extent data backref root 1338 objectid 4788723 offset 0 count 1
	item 62 key (1496920064 EXTENT_ITEM 4096) itemoff 12350 itemsize 37
		refs 1 gen 400938 flags DATA
		shared data backref parent 51236257792 count 1
	item 63 key (1496924160 EXTENT_ITEM 8192) itemoff 12300 itemsize 50
		refs 2 gen 138497 flags DATA
		shared data backref parent 51306774528 count 1
		shared data backref parent 1033256960 count 1
	item 64 key (1496932352 EXTENT_ITEM 8192) itemoff 12247 itemsize 53
		refs 1 gen 392402 flags DATA
		extent data backref root 258 objectid 4159 offset 1048576 count 1
	item 65 key (1496940544 EXTENT_ITEM 4096) itemoff 12194 itemsize 53
		refs 1 gen 394519 flags DATA
		extent data backref root 258 objectid 46599 offset 742244352 count 1
	item 66 key (1496944640 EXTENT_ITEM 8192) itemoff 12141 itemsize 53
		refs 1 gen 423224 flags DATA
		extent data backref root 260 objectid 920886 offset 0 count 1
	item 67 key (1496952832 EXTENT_ITEM 36864) itemoff 11900 itemsize 241
		refs 13 gen 400951 flags DATA
		extent data backref root 1338 objectid 4284886 offset 0 count 1
		extent data backref root 1310 objectid 4284886 offset 0 count 1
		extent data backref root 1312 objectid 4284886 offset 0 count 1
		shared data backref parent 52220051456 count 1
		shared data backref parent 51942096896 count 1
		shared data backref parent 51859947520 count 1
		shared data backref parent 51690700800 count 1
		shared data backref parent 51331710976 count 1
		shared data backref parent 386252800 count 1
		shared data backref parent 304005120 count 1
		shared data backref parent 247447552 count 1
		shared data backref parent 71696384 count 1
		shared data backref parent 70762496 count 1
	item 68 key (1496989696 EXTENT_ITEM 12288) itemoff 11847 itemsize 53
		refs 1 gen 292549 flags DATA
		extent data backref root 260 objectid 701302 offset 0 count 1
	item 69 key (1497001984 EXTENT_ITEM 4096) itemoff 11794 itemsize 53
		refs 1 gen 292555 flags DATA
		extent data backref root 260 objectid 701342 offset 0 count 1
	item 70 key (1497006080 EXTENT_ITEM 4096) itemoff 11757 itemsize 37
		refs 1 gen 17889 flags DATA
		shared data backref parent 51611369472 count 1
	item 71 key (1497010176 EXTENT_ITEM 4096) itemoff 11720 itemsize 37
		refs 1 gen 17890 flags DATA
		shared data backref parent 51611369472 count 1
	item 72 key (1497014272 EXTENT_ITEM 4096) itemoff 11683 itemsize 37
		refs 1 gen 17892 flags DATA
		shared data backref parent 51611369472 count 1
	item 73 key (1497018368 EXTENT_ITEM 4096) itemoff 11646 itemsize 37
		refs 72057183177116417 gen 17894 flags DATA
		shared data backref parent 51611369472 count 1
	item 74 key (1497022464 EXTENT_ITEM 4096) itemoff 11609 itemsize 37
		refs 1 gen 17896 flags DATA
		shared data backref parent 51611369472 count 3087007745
	item 75 key (1497026560 EXTENT_ITEM 32768) itemoff 11572 itemsize 37
		refs 1 gen 450713 flags DATA
		shared data backref parent 51439534080 count 1
	item 76 key (1497059328 EXTENT_ITEM 4096) itemoff 11535 itemsize 37
		refs 1 gen 450713 flags DATA
		shared data backref parent 51455557632 count 1
	item 77 key (1497063424 EXTENT_ITEM 229376) itemoff 11482 itemsize 53
		refs 1 gen 58759 flags DATA
		extent data backref root 260 objectid 278424 offset 0 count 1
	item 78 key (1497292800 EXTENT_ITEM 8192) itemoff 11380 itemsize 102
		refs 6 gen 500598 flags DATA
		shared data backref parent 51538460672 count 1
		shared data backref parent 988725248 count 1
		shared data backref parent 897351680 count 1
		shared data backref parent 821608448 count 1
		shared data backref parent 587972608 count 1
		shared data backref parent 508870656 count 1
	item 79 key (1497300992 EXTENT_ITEM 4096) itemoff 11291 itemsize 89
		refs 5 gen 403758 flags DATA
		shared data backref parent 52216168448 count 1
		shared data backref parent 52140294144 count 1
		shared data backref parent 51774226432 count 1
		shared data backref parent 980254720 count 1
		shared data backref parent 218169344 count 1
	item 80 key (1497305088 EXTENT_ITEM 147456) itemoff 11238 itemsize 53
		refs 1 gen 111262 flags DATA
		extent data backref root 258 objectid 994234 offset 0 count 1
	item 81 key (1497452544 EXTENT_ITEM 61440) itemoff 11120 itemsize 118
		refs 6 gen 400951 flags DATA
		extent data backref root 1338 objectid 4284778 offset 0 count 1
		shared data backref parent 52106543104 count 1
		shared data backref parent 277561344 count 1
		shared data backref parent 252542976 count 1
		shared data backref parent 169377792 count 1
		shared data backref parent 28966912 count 1
	item 82 key (1497513984 EXTENT_ITEM 4096) itemoff 11083 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51376160768 count 1
	item 83 key (1497518080 EXTENT_ITEM 12288) itemoff 11046 itemsize 37
		refs 1 gen 400938 flags DATA
		shared data backref parent 51233325056 count 1
	item 84 key (1497530368 EXTENT_ITEM 8192) itemoff 10993 itemsize 53
		refs 1 gen 292437 flags DATA
		extent data backref root 260 objectid 698850 offset 0 count 1
	item 85 key (1497538560 EXTENT_ITEM 24576) itemoff 10888 itemsize 105
		refs 5 gen 501446 flags DATA
		extent data backref root 1338 objectid 4646264 offset 0 count 1
		shared data backref parent 51833798656 count 1
		shared data backref parent 51359760384 count 1
		shared data backref parent 936394752 count 1
		shared data backref parent 415219712 count 1
	item 86 key (1497563136 EXTENT_ITEM 4096) itemoff 10851 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51376160768 count 1
	item 87 key (1497567232 EXTENT_ITEM 4096) itemoff 10798 itemsize 53
		refs 1 gen 292555 flags DATA
		extent data backref root 260 objectid 701344 offset 0 count 1
	item 88 key (1497571328 EXTENT_ITEM 4096) itemoff 10761 itemsize 37
		refs 1 gen 501446 flags DATA
		shared data backref parent 51376209920 count 1
	item 89 key (1497575424 EXTENT_ITEM 16384) itemoff 10708 itemsize 53
		refs 1 gen 116513 flags DATA
		extent data backref root 258 objectid 932671 offset 4128768 count 1
	item 90 key (1497591808 EXTENT_ITEM 4096) itemoff 10655 itemsize 53
		refs 1 gen 292555 flags DATA
		extent data backref root 260 objectid 701345 offset 0 count 1
	item 91 key (1497595904 EXTENT_ITEM 4096) itemoff 10602 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70213 offset 0 count 1
	item 92 key (1497600000 EXTENT_ITEM 8192) itemoff 10549 itemsize 53
		refs 1 gen 15911 flags DATA
		extent data backref root 260 objectid 73333 offset 12288 count 1
	item 93 key (1497608192 EXTENT_ITEM 4096) itemoff 10496 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70218 offset 0 count 1
	item 94 key (1497612288 EXTENT_ITEM 12288) itemoff 10443 itemsize 53
		refs 1 gen 15911 flags DATA
		extent data backref root 260 objectid 73263 offset 139264 count 1
	item 95 key (1497624576 EXTENT_ITEM 16384) itemoff 10390 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70208 offset 0 count 1
	item 96 key (1497640960 EXTENT_ITEM 8192) itemoff 10337 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70214 offset 0 count 1
	item 97 key (1497649152 EXTENT_ITEM 8192) itemoff 10284 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70215 offset 0 count 1
	item 98 key (1497657344 EXTENT_ITEM 8192) itemoff 10231 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70216 offset 0 count 1
	item 99 key (1497665536 EXTENT_ITEM 8192) itemoff 10178 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70217 offset 0 count 1
	item 100 key (1497673728 EXTENT_ITEM 57344) itemoff 10125 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70220 offset 0 count 1
	item 101 key (1497731072 EXTENT_ITEM 8192) itemoff 10072 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70223 offset 0 count 1
	item 102 key (1497739264 EXTENT_ITEM 8192) itemoff 10019 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70224 offset 0 count 1
	item 103 key (1497747456 EXTENT_ITEM 8192) itemoff 9966 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70227 offset 0 count 1
	item 104 key (1497755648 EXTENT_ITEM 24576) itemoff 9913 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70228 offset 0 count 1
	item 105 key (1497780224 EXTENT_ITEM 24576) itemoff 9860 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 70229 offset 0 count 1
	item 106 key (1497804800 EXTENT_ITEM 12288) itemoff 9807 itemsize 53
		refs 1 gen 15914 flags DATA
		extent data backref root 260 objectid 73718 offset 0 count 1
	item 107 key (1497817088 EXTENT_ITEM 4096) itemoff 9754 itemsize 53
		refs 1 gen 15918 flags DATA
		extent data backref root 260 objectid 73703 offset 45056 count 1
	item 108 key (1497821184 EXTENT_ITEM 8192) itemoff 9701 itemsize 53
		refs 1 gen 15796 flags DATA
		extent data backref root 260 objectid 69911 offset 12288 count 1
	item 109 key (1497829376 EXTENT_ITEM 12288) itemoff 9648 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73263 offset 57344 count 1
	item 110 key (1497841664 EXTENT_ITEM 12288) itemoff 9595 itemsize 53
		refs 1 gen 15911 flags DATA
		extent data backref root 260 objectid 73259 offset 0 count 1
	item 111 key (1497853952 EXTENT_ITEM 4096) itemoff 9542 itemsize 53
		refs 1 gen 15911 flags DATA
		extent data backref root 260 objectid 73259 offset 122880 count 1
	item 112 key (1497858048 EXTENT_ITEM 8192) itemoff 9489 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73332 offset 0 count 1
	item 113 key (1497866240 EXTENT_ITEM 8192) itemoff 9436 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73349 offset 0 count 1
	item 114 key (1497874432 EXTENT_ITEM 12288) itemoff 9383 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73350 offset 0 count 1
	item 115 key (1497886720 EXTENT_ITEM 8192) itemoff 9330 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73351 offset 0 count 1
	item 116 key (1497894912 EXTENT_ITEM 126976) itemoff 9277 itemsize 53
		refs 1 gen 15854 flags DATA
		extent data backref root 260 objectid 70597 offset 0 count 1
	item 117 key (1498021888 EXTENT_ITEM 24576) itemoff 9224 itemsize 53
		refs 1 gen 15911 flags DATA
		extent data backref root 260 objectid 73263 offset 106496 count 1
	item 118 key (1498046464 EXTENT_ITEM 24576) itemoff 9171 itemsize 53
		refs 1 gen 15911 flags DATA
		extent data backref root 260 objectid 73672 offset 0 count 1
	item 119 key (1498071040 EXTENT_ITEM 8192) itemoff 9118 itemsize 53
		refs 1 gen 422730 flags DATA
		extent data backref root 260 objectid 920176 offset 0 count 1
	item 120 key (1498079232 EXTENT_ITEM 131072) itemoff 9065 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73342 offset 0 count 1
	item 121 key (1498210304 EXTENT_ITEM 8192) itemoff 9012 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73352 offset 0 count 1
	item 122 key (1498218496 EXTENT_ITEM 4096) itemoff 8959 itemsize 53
		refs 1 gen 15911 flags DATA
		extent data backref root 260 objectid 73263 offset 0 count 1
	item 123 key (1498222592 EXTENT_ITEM 4096) itemoff 8906 itemsize 53
		refs 1 gen 15918 flags DATA
		extent data backref root 260 objectid 73703 offset 57344 count 1
	item 124 key (1498226688 EXTENT_ITEM 8192) itemoff 8853 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73273 offset 0 count 1
	item 125 key (1498234880 EXTENT_ITEM 8192) itemoff 8800 itemsize 53
		refs 1 gen 15911 flags DATA
		extent data backref root 260 objectid 73263 offset 32768 count 1
	item 126 key (1498243072 EXTENT_ITEM 8192) itemoff 8747 itemsize 53
		refs 1 gen 15916 flags DATA
		extent data backref root 260 objectid 73777 offset 12288 count 1
	item 127 key (1498251264 EXTENT_ITEM 12288) itemoff 8694 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73272 offset 12288 count 1
	item 128 key (1498263552 EXTENT_ITEM 12288) itemoff 8641 itemsize 53
		refs 1 gen 15914 flags DATA
		extent data backref root 260 objectid 73726 offset 0 count 1
	item 129 key (1498275840 EXTENT_ITEM 24576) itemoff 8588 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73272 offset 65536 count 1
	item 130 key (1498300416 EXTENT_ITEM 16384) itemoff 8535 itemsize 53
		refs 1 gen 15910 flags DATA
		extent data backref root 260 objectid 73278 offset 4096 count 1
	item 131 key (1498316800 EXTENT_ITEM 20480) itemoff 8482 itemsize 53
		refs 1 gen 15914 flags DATA
		extent data backref root 260 objectid 73697 offset 0 count 1
	item 132 key (1498337280 EXTENT_ITEM 20480) itemoff 8429 itemsize 53
		refs 1 gen 15914 flags DATA
		extent data backref root 260 objectid 73733 offset 0 count 1
	item 133 key (1498357760 EXTENT_ITEM 20480) itemoff 8376 itemsize 53
		refs 1 gen 15914 flags DATA
		extent data backref root 260 objectid 73735 offset 0 count 1
	item 134 key (1498378240 EXTENT_ITEM 12288) itemoff 8323 itemsize 53
		refs 1 gen 15918 flags DATA
		extent data backref root 260 objectid 73703 offset 0 count 1
	item 135 key (1498390528 EXTENT_ITEM 4096) itemoff 8270 itemsize 53
		refs 1 gen 15918 flags DATA
		extent data backref root 260 objectid 73703 offset 69632 count 1
	item 136 key (1498394624 EXTENT_ITEM 24576) itemoff 8217 itemsize 53
		refs 1 gen 15912 flags DATA
		extent data backref root 260 objectid 73694 offset 0 count 1
	item 137 key (1498419200 EXTENT_ITEM 28672) itemoff 8164 itemsize 53
		refs 1 gen 15912 flags DATA
		extent data backref root 260 objectid 73695 offset 0 count 1
	item 138 key (1498447872 EXTENT_ITEM 20480) itemoff 8111 itemsize 53
		refs 1 gen 15916 flags DATA
		extent data backref root 260 objectid 73764 offset 0 count 1

^ permalink raw reply	[flat|nested] 75+ messages in thread
* read time tree block corruption detected
@ 2019-12-29 20:43 Patrick Erley
  2019-12-29 22:07 ` Chris Murphy
  2019-12-30  0:46 ` Qu Wenruo
  0 siblings, 2 replies; 75+ messages in thread
From: Patrick Erley @ 2019-12-29 20:43 UTC (permalink / raw)
  To: linux-btrfs

On a system where I've been tinkering with linux-next for years, my /
has got some errors.  When migrating from 5.1 to 5.2, I saw these
errors, but just ignored them and went back to 5.1, and continued my
tinkering.  Over the holidays, I decided to try to upgrade the kernel,
saw the errors again, and decided to look into them, finding the
tree-checker page on the kernel docs, and am writing this e-mail.

My / does not contain anything sensitive or important, as /home and
/usr/src are both subvolumes on a separate larger drive.

btrfs fi show:
Label: none  uuid: 815266d6-a8b9-4f63-a593-02fde178263f
Total devices 2 FS bytes used 93.81GiB
devid    1 size 115.12GiB used 115.11GiB path /dev/nvme0n1p2
devid    3 size 115.12GiB used 115.11GiB path /dev/sda3

Label: none  uuid: 4bd97711-b63c-40cb-bfa5-aa9c2868cf98
Total devices 1 FS bytes used 536.48GiB
devid    1 size 834.63GiB used 833.59GiB path /dev/sda5

Booting a more recent kernel, I get spammed with:
[    8.243899] BTRFS critical (device nvme0n1p2): corrupt leaf: root=5
block=303629811712 slot=30 ino=5380870, invalid inode generation: has
13221446351398931016 expect [0, 2997884]
[    8.243902] BTRFS error (device nvme0n1p2): block=303629811712 read
time tree block corruption detected

There are 6 corrupted inodes:
cat dmesg.foo  | grep "BTRFS critical" | sed -re
's:.*block=([0-9]*).*ino=([0-9]+).*:\1 \2:' | sort | uniq
303629811712 5380870
303712501760 3277548
303861395456 5909140
304079065088 2228479
304573444096 3539224
305039556608 1442149

and they all have the same value for the inode generation.  Before I
reboot into a livecd and btrfs check --repair, is there anything
interesting that a snapshot of the state would show?  I have 800gb
unpartitioned on the nvme, so backing up before is already in the
plans, and I could just as easily grab an image of the partitions
while I'm at it.

^ permalink raw reply	[flat|nested] 75+ messages in thread

end of thread, other threads:[~2021-11-23  5:56 UTC | newest]

Thread overview: 75+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-02-12 21:58 read time tree block corruption detected Samir Benmendil
2020-02-13  0:26 ` Qu Wenruo
2020-02-13 13:04   ` Samir Benmendil
2020-02-13 14:01   ` Qu Wenruo
2020-02-15 15:34     ` Samir Benmendil
  -- strict thread matches above, loose matches on Subject: below --
2021-11-22  5:26 x8062
2021-11-22  7:24 ` Nikolay Borisov
2021-11-22 10:07   ` x8062
2021-11-22 10:36     ` Nikolay Borisov
2021-11-23  2:42       ` x8062
2021-11-23  5:56         ` Nikolay Borisov
2021-07-17  1:45 Read " pepperpoint
2021-07-17  7:05 ` Qu Wenruo
     [not found] ` <162650555086.7.16811903270475408953.10183708@simplelogin.co>
2021-07-17  7:51   ` pepperpoint
     [not found]   ` <162650826457.7.1050455337652772013.10184548@mb.ardentcoding.com>
2021-07-17  8:14     ` Qu Wenruo
     [not found]     ` <162650966150.7.11743767259405124657.10185986@simplelogin.co>
2021-07-17  8:57       ` pepperpoint
2021-07-17 10:12         ` Qu Wenruo
     [not found]         ` <162651674065.6.7912816287233908759.10188327@simplelogin.co>
2021-07-17 10:34           ` pepperpoint
     [not found]           ` <162651809235.7.7061042874033963922.10188873@mb.ardentcoding.com>
2021-07-17 10:48             ` Qu Wenruo
     [not found]             ` <162651892663.6.17938009695497100557.10189169@simplelogin.co>
2021-07-17 12:51               ` pepperpoint
     [not found]               ` <CQeY09U34m7SrT6nTAlkSQrbLJtmyKF1tDfuGDtKUkwJqujMI_nZU4MpGiU4F_Q1U3Lk1aWD1mFCT5SlsOsOcILWECflIw7EhVQTQpy_1Ts=@email.ardentcoding.com>
2021-07-18  5:26                 ` pepperpoint
2021-07-18  7:15                   ` Qu Wenruo
     [not found]                     ` <162659327011.8.12718249358254503695.10218325@simplelogin.co>
2021-07-18  8:46                       ` pepperpoint
     [not found]                       ` <162659797656.6.14385932343235367381.10220447@mb.ardentcoding.com>
2021-07-18  9:32                         ` Qu Wenruo
     [not found]                         ` <162660074747.7.3300740266059717894.10221270@simplelogin.co>
2021-07-18 10:34                           ` pepperpoint
     [not found]                           ` <162660447733.8.9782212603273165785.10222524@mb.ardentcoding.com>
2021-07-18 11:13                             ` Qu Wenruo
     [not found]                             ` <162660684635.8.12423097770824212671.10223516@simplelogin.co>
2021-07-18 12:16                               ` pepperpoint
2021-04-16 19:35 read " Gervais, Francois
2021-04-17  1:01 ` Qu Wenruo
2021-04-19 13:20   ` Gervais, Francois
2021-04-19 13:33     ` Qu Wenruo
2021-04-19 14:56       ` Gervais, Francois
2021-04-20  1:34         ` Qu Wenruo
2021-04-20 14:19           ` Gervais, Francois
2021-04-20 23:47             ` Qu Wenruo
2021-04-21 14:17               ` Gervais, Francois
2021-04-21 23:01                 ` Qu Wenruo
2021-04-22 14:26                   ` Gervais, Francois
2021-05-26 23:03                     ` Gervais, Francois
2021-05-26 23:25                       ` Qu Wenruo
     [not found] <CAJheHN0FUe-ijMco1ZOc6iKF2zbPocOw+iiVNeTT1r-JuXOJww@mail.gmail.com>
2020-05-06 21:54 ` Fwd: Read " Tyler Richmond
2020-05-06 23:55   ` Chris Murphy
2020-05-07  0:51     ` Tyler Richmond
2020-05-07  1:06       ` Chris Murphy
2020-01-16 13:40 read " Peter Luladjiev
2020-01-16 16:12 ` Nikolay Borisov
     [not found]   ` <CA+ZCqs5=N5Hdf3NxZAmPCnA8wbcJPrcH8zM-fRbt-w8tL+TjUQ@mail.gmail.com>
2020-01-17  7:34     ` Nikolay Borisov
2020-01-17  7:51       ` Peter Luladjiev
2020-01-17  7:54         ` Peter Luladjiev
2020-01-17  7:59           ` Qu Wenruo
2020-01-17  8:14           ` Nikolay Borisov
2020-01-17  8:22             ` Peter Luladjiev
2020-01-17  9:10               ` Nikolay Borisov
2020-01-17 12:04                 ` Peter Luladjiev
2019-12-29 20:43 Patrick Erley
2019-12-29 22:07 ` Chris Murphy
2019-12-29 22:27   ` Patrick Erley
2019-12-29 22:32     ` Chris Murphy
2019-12-29 22:36       ` Patrick Erley
2019-12-29 23:11         ` Chris Murphy
2019-12-29 23:19           ` Patrick Erley
2019-12-29 23:24             ` Chris Murphy
2019-12-29 23:26               ` Patrick Erley
2019-12-30  0:46 ` Qu Wenruo
2019-12-30  5:36   ` Patrick Erley
2019-12-30  5:43     ` Qu Wenruo
2019-12-30  5:47       ` Patrick Erley
2019-12-30  5:50         ` Patrick Erley
2019-12-30  5:58           ` Qu Wenruo
2019-12-30  6:07             ` Patrick Erley
2019-12-30  6:09               ` Qu Wenruo
2019-12-30  8:14                 ` Patrick Erley
2019-12-30  8:54                   ` Qu Wenruo
2019-12-30  9:01                     ` Patrick Erley
2019-12-30  9:09                       ` Qu Wenruo
2019-12-30  9:21                         ` Patrick Erley
2019-12-30  9:27                           ` Qu Wenruo
2019-12-30 10:06                             ` Patrick Erley

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.