From: Zygo Blaxell <ce3g8jdj@umail.furryterror.org>
To: Josef Bacik <josef@toxicpanda.com>
Cc: Marc MERLIN <marc@merlins.org>,
"linux-btrfs@vger.kernel.org" <linux-btrfs@vger.kernel.org>
Subject: Re: figuring out why transient double raid failure caused a fair amount of btrfs corruption
Date: Thu, 7 Apr 2022 08:27:54 -0400 [thread overview]
Message-ID: <Yk7YyhQ/CdcMfoS7@hungrycats.org> (raw)
In-Reply-To: <CAEzrpqdLm+Kwp9AWtPvxEBHXXm3wb_NhGLnhxsAsEXhufstPPw@mail.gmail.com>
On Wed, Apr 06, 2022 at 04:51:14PM -0400, Josef Bacik wrote:
> On Wed, Apr 6, 2022 at 4:38 PM Marc MERLIN <marc@merlins.org> wrote:
> >
> > This is an interesting discussion, so let's make a new thread out of it.
> > TL;DR: I think btrfs may have failed to go read only earlier, causing
> > more damage than needed to be, or some block layers just held enough
> > data in flight that partial data got written, causing more damage than
> > expected.
> > Figuring out the underlying problem would be good to avoid this again.
> We can't do anything about the disks lying to us. If a disk has a
> wonky FUA/FLUSH implementation then we're just sort of screwed.
> Unfortunately because our metadata moves around a lot we're waaaaay
> more susceptible to this failure case than ext4 or xfs, their metadata
> is relatively static they can put humpty dumpty back together again
> relatively simply.
Disks are pretty good at FUA/FLUSH bugs these days, though you can
still buy new old drives that have them.
SSDs have a whole lot of bugs, especially if they get old. have a few bits
fail, and try to recover themselves, but blow up the whole filesystem
by losing a few pages. These ones get through firmware qualification
testing because they only misbehave when they're a year or two old.
> Btrfs needs to
>
> 1. Go whole hog on error injection testing. I only barely scratched
> the surface with my bpf error injection stuff. This is on our roadmap
> and I plan on devoting developer time to this, but clearly that
> doesn't help you right now.
> 2. Put a lot more effort into disaster recovery. What I've written
> for you is an idea I've had in my head for a while. Some of this
> failures aren't catastrophic, we can generally pretty easily put back
> together a file system that resembles something sane by simply
> stitching together blocks that we find that are close enough to what
> we wanted. Unfortunately this gets back-burnered because in reality
> this doesn't happen that often.
This does seem to be an important missing piece at the moment.
In practice, when we see "parent transid verify failed," we go directly
to mkfs + restore backups, as none of the existing tools will touch it.
They all want intact interior nodes in some tree to work, and that's
the one thing that FUA/FLUSH bugs destroy.
It doesn't solve the underlying problem--the drive will still trash
the filesystem every other month until its write ordering gets fixed or
worked around--but at least it lets users fix the filesystem in place
without mkfs + restoring a full set of backups.
> 3. Test these btrfs+dmcrypt+mdraid setups. Every time I notice one of
> these catastrophic failures it generally involves btrfs+<something
> else>. This is likely just because it's a timing thing, you put more
> layers you get a wider window in per-io races, you're more likely to
> be sad in the event of a failure. However it would be good to make
> sure these layers are doing the correct thing themselves.
bcache and dmcache layers in series with the underlying storage multiply
the failure rates (including software regressions) of the individual
components, and mdadm blends firmware bugs from all the drives together.
Statistically we're always going to see more problems if there are more
moving parts in the system, especially if they aggregate risks and break
fault isolation.
FWIW I'm not seeing a difference in failure rate between "btrfs +
mdadm" and "btrfs alone", but I'm intentionally avoiding the many mdadm
configurations that introduce new failure modes by design (e.g. raid5
without ppl or journal, raid1 without component device integrity, or
single/raid1 SSD cache in writeback mode running over multiple drives).
There isn't a fix for those except to not use them. In most cases
there's a better way to do the same thing, though there are some gaps
(e.g. there's no working solution for writeback SSD caching on raid5).
Thought experiment: if you have 2 drives from vendor A and 2 drives
from vendor B, and you want to build two filesystems that replicate
to each other, where do you put the drives if you know one vendor has
a firmware bug but you don't know which one? With mdadm, you build
filesystems with AA and BB drives, because that way a firmware bug
corrupts one filesystems and leaves the other intact. With btrfs, you
build two filesystems with AB and AB drives, because that way a firmware
bug gets autocorrected by btrfs and both filesystems remain intact.
If you put btrfs on mdadm on AB drives, you combine the risk from both
vendors, lose both filesystems, and skew the failure statistics.
> We need to be better about this scenario, both in making sure we don't
> have bugs that contribute to the problem, but also that we have the
> tools necessary to recover when things go wrong. Thanks,
>
> Josef
next prev parent reply other threads:[~2022-04-07 12:28 UTC|newest]
Thread overview: 479+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-07-17 20:32 btrfs check (not lowmem) and OOM-like hangs (4.17.6) Marc MERLIN
2018-07-17 20:59 ` Marc MERLIN
2018-07-18 0:05 ` Qu Wenruo
2018-07-18 0:24 ` Marc MERLIN
2018-07-19 9:22 ` Qu Wenruo
2019-10-18 2:56 ` 5.1.21: fs/btrfs/extent-tree.c:7100 __btrfs_free_extent+0x18b/0x921 Marc MERLIN
2019-10-19 3:07 ` Marc MERLIN
2019-10-23 0:55 ` Marc MERLIN
2019-10-26 3:36 ` Marc MERLIN
2020-05-24 21:30 ` 5.5 kernel and btrfs-progs v5.6 create and cannot fix 'root 204162 inode 14058737 errors 1000, some csum missing' Marc MERLIN
2020-05-25 3:01 ` Marc MERLIN
2020-05-25 16:37 ` Chris Murphy
2020-05-25 20:16 ` Marc MERLIN
2020-05-25 20:24 ` Chris Murphy
2020-05-25 20:39 ` Marc MERLIN
2020-05-25 22:47 ` Chris Murphy
2020-05-25 22:51 ` Chris Murphy
2020-05-26 0:13 ` Marc MERLIN
2020-07-07 3:55 ` 5.6 pretty massive unexplained btrfs corruption: parent transid verify failed + open_ctree failed Marc MERLIN
2020-07-07 14:31 ` Josef Bacik
2020-07-07 17:25 ` Marc MERLIN
2020-07-08 3:44 ` Zygo Blaxell
2020-07-08 4:10 ` Marc MERLIN
2020-07-08 5:49 ` Zygo Blaxell
2020-07-08 17:41 ` Marc MERLIN
2020-07-08 17:44 ` Roman Mamedov
2020-07-08 22:47 ` Zygo Blaxell
2022-03-29 17:18 ` Marc MERLIN
2022-03-30 5:38 ` Andrei Borzenkov
2022-03-30 14:39 ` Marc MERLIN
2022-03-31 17:19 ` Rebuilding 24TB Raid5 array (was btrfs corruption: parent transid verify failed + open_ctree failed) Marc MERLIN
2022-04-03 23:33 ` Josef Bacik
2022-04-04 1:01 ` Marc MERLIN
2022-04-04 15:08 ` Marc MERLIN
2022-04-04 17:18 ` Josef Bacik
2022-04-04 17:43 ` Marc MERLIN
2022-04-04 17:53 ` Josef Bacik
2022-04-04 18:10 ` Marc MERLIN
2022-04-04 18:46 ` Josef Bacik
2022-04-04 19:04 ` Marc MERLIN
2022-04-04 19:52 ` Josef Bacik
2022-04-04 20:33 ` Marc MERLIN
2022-04-04 21:04 ` Josef Bacik
2022-04-04 21:29 ` Marc MERLIN
2022-04-04 21:40 ` Josef Bacik
2022-04-04 22:09 ` Marc MERLIN
2022-04-04 22:34 ` Josef Bacik
2022-04-04 22:45 ` Marc MERLIN
2022-04-04 22:52 ` Josef Bacik
2022-04-04 23:18 ` Marc MERLIN
2022-04-04 23:24 ` Josef Bacik
2022-04-04 23:42 ` Marc MERLIN
2022-04-05 0:08 ` Josef Bacik
2022-04-05 0:13 ` Marc MERLIN
2022-04-05 0:15 ` Josef Bacik
2022-04-05 0:18 ` Marc MERLIN
2022-04-05 0:24 ` Josef Bacik
2022-04-05 0:28 ` Marc MERLIN
2022-04-05 0:39 ` Josef Bacik
2022-04-05 0:58 ` Marc MERLIN
2022-04-05 1:06 ` Josef Bacik
2022-04-05 1:16 ` Marc MERLIN
2022-04-05 1:22 ` Josef Bacik
2022-04-05 1:42 ` Marc MERLIN
2022-04-05 1:55 ` Josef Bacik
2022-04-05 2:07 ` Marc MERLIN
2022-04-05 14:11 ` Josef Bacik
2022-04-05 15:53 ` Marc MERLIN
2022-04-05 15:55 ` Josef Bacik
2022-04-05 17:41 ` Josef Bacik
2022-04-05 18:11 ` Marc MERLIN
2022-04-05 18:36 ` Josef Bacik
2022-04-05 19:51 ` Marc MERLIN
2022-04-05 19:56 ` Josef Bacik
2022-04-05 19:59 ` Marc MERLIN
2022-04-05 20:05 ` Josef Bacik
2022-04-05 20:08 ` Marc MERLIN
2022-04-05 20:24 ` Josef Bacik
2022-04-05 20:37 ` Marc MERLIN
2022-04-05 21:07 ` Josef Bacik
2022-04-05 21:14 ` Marc MERLIN
2022-04-05 21:19 ` Josef Bacik
2022-04-05 21:25 ` Marc MERLIN
2022-04-05 21:26 ` Marc MERLIN
2022-04-05 21:35 ` Josef Bacik
2022-04-05 21:43 ` Marc MERLIN
2022-04-05 22:41 ` Josef Bacik
2022-04-05 22:58 ` Marc MERLIN
2022-04-06 0:23 ` Josef Bacik
2022-04-06 0:30 ` Marc MERLIN
2022-04-06 0:35 ` Marc MERLIN
2022-04-06 0:39 ` Josef Bacik
2022-04-06 1:08 ` Josef Bacik
2022-04-06 1:14 ` Marc MERLIN
2022-04-06 3:12 ` Marc MERLIN
2022-04-06 3:34 ` Marc MERLIN
2022-04-06 15:20 ` Josef Bacik
2022-04-06 18:54 ` Marc MERLIN
2022-04-06 18:57 ` Josef Bacik
2022-04-06 19:16 ` Marc MERLIN
2022-04-06 19:53 ` Josef Bacik
2022-04-06 20:34 ` Marc MERLIN
2022-04-06 20:38 ` Josef Bacik
2022-04-06 20:56 ` Marc MERLIN
2022-04-06 21:05 ` Josef Bacik
2022-04-07 1:08 ` Marc MERLIN
2022-04-07 1:18 ` Josef Bacik
2022-04-07 4:37 ` Marc MERLIN
2022-04-07 4:40 ` Marc MERLIN
2022-04-07 7:30 ` Martin Steigerwald
2022-04-07 5:20 ` Marc MERLIN
2022-04-07 16:29 ` Marc MERLIN
2022-04-07 17:07 ` Josef Bacik
2022-04-07 19:11 ` Martin Steigerwald
2022-04-07 22:09 ` Josef Bacik
2022-04-07 22:33 ` Marc MERLIN
2022-04-08 10:22 ` Marc MERLIN
2022-04-08 10:23 ` Josef Bacik
2022-04-08 20:09 ` Josef Bacik
2022-04-11 1:37 ` Marc MERLIN
2022-04-05 23:51 ` Zygo Blaxell
2022-04-06 0:08 ` Marc MERLIN
2022-04-06 1:40 ` Zygo Blaxell
2022-04-06 4:09 ` Marc MERLIN
2022-04-06 18:07 ` Zygo Blaxell
2022-04-06 19:13 ` Marc MERLIN
2022-04-06 19:45 ` Zygo Blaxell
2022-04-06 20:38 ` figuring out why transient double raid failure caused a fair amount of btrfs corruption Marc MERLIN
2022-04-06 20:51 ` Josef Bacik
2022-04-06 21:14 ` Marc MERLIN
2022-04-07 12:27 ` Zygo Blaxell [this message]
2022-04-22 18:48 ` Rebuilding 24TB Raid5 array (was btrfs corruption: parent transid verify failed + open_ctree failed) Marc MERLIN
2022-04-22 19:46 ` Josef Bacik
2022-04-22 20:01 ` Marc MERLIN
2022-04-23 20:12 ` Marc MERLIN
2022-04-23 20:53 ` Josef Bacik
2022-04-24 16:20 ` Josef Bacik
2022-04-24 16:24 ` Marc MERLIN
2022-04-24 17:09 ` Josef Bacik
2022-04-24 18:43 ` Marc MERLIN
2022-04-24 19:17 ` Josef Bacik
2022-04-24 19:44 ` Marc MERLIN
2022-04-24 20:01 ` Josef Bacik
2022-04-24 20:31 ` Marc MERLIN
2022-04-24 20:32 ` Josef Bacik
2022-04-24 20:54 ` Marc MERLIN
2022-04-24 21:01 ` Josef Bacik
[not found] ` <20220424210732.GC29107@merlins.org>
[not found] ` <CAEzrpqcMV+paWShgAnF8d9WaSQ1Fd5R_DZPRQp-+VNsJGDoASg@mail.gmail.com>
[not found] ` <20220424212058.GD29107@merlins.org>
[not found] ` <CAEzrpqcBvh0MC6WeXQ+-80igZhg6t68OcgZnKi6xu+r=njifeA@mail.gmail.com>
2022-04-24 22:38 ` Marc MERLIN
2022-04-24 22:56 ` Josef Bacik
2022-04-24 23:14 ` Marc MERLIN
2022-04-24 23:27 ` Josef Bacik
2022-04-25 0:24 ` Marc MERLIN
2022-04-25 0:36 ` Josef Bacik
2022-04-26 0:28 ` Marc MERLIN
2022-04-26 20:43 ` Marc MERLIN
2022-04-26 21:20 ` Josef Bacik
2022-04-26 21:36 ` Josef Bacik
2022-04-27 3:54 ` Marc MERLIN
2022-04-27 14:44 ` Josef Bacik
2022-04-27 16:34 ` Marc MERLIN
2022-04-27 17:49 ` Josef Bacik
2022-04-27 18:24 ` Marc MERLIN
2022-04-27 20:21 ` Josef Bacik
2022-04-27 21:02 ` Marc MERLIN
2022-04-27 21:11 ` Josef Bacik
2022-04-27 21:20 ` Marc MERLIN
2022-04-27 21:27 ` Josef Bacik
2022-04-27 22:59 ` Marc MERLIN
2022-04-27 23:02 ` Josef Bacik
2022-04-27 23:21 ` Josef Bacik
2022-04-28 0:18 ` Marc MERLIN
2022-04-28 0:44 ` Josef Bacik
2022-04-28 3:00 ` Marc MERLIN
2022-04-28 3:08 ` Josef Bacik
2022-04-28 3:11 ` Marc MERLIN
2022-04-28 4:03 ` Josef Bacik
2022-04-28 4:12 ` Marc MERLIN
2022-04-28 15:30 ` Josef Bacik
2022-04-28 16:27 ` Marc MERLIN
2022-04-28 20:13 ` Josef Bacik
2022-04-28 20:22 ` Marc MERLIN
2022-04-28 20:28 ` Josef Bacik
2022-04-28 20:57 ` Marc MERLIN
2022-04-28 20:58 ` Josef Bacik
2022-04-28 21:42 ` Marc MERLIN
2022-04-28 21:54 ` Josef Bacik
2022-04-28 22:27 ` Marc MERLIN
2022-04-28 23:24 ` Josef Bacik
2022-04-29 0:56 ` Marc MERLIN
2022-04-29 1:11 ` Josef Bacik
2022-04-29 1:34 ` Marc MERLIN
2022-04-29 1:38 ` Josef Bacik
2022-04-29 4:03 ` Marc MERLIN
2022-04-29 12:41 ` Josef Bacik
2022-04-29 15:16 ` Marc MERLIN
2022-04-29 15:27 ` Josef Bacik
2022-04-29 17:16 ` Marc MERLIN
2022-04-29 17:52 ` Josef Bacik
2022-04-29 18:58 ` Marc MERLIN
2022-04-29 19:40 ` Josef Bacik
2022-04-30 2:24 ` Marc MERLIN
2022-04-30 3:13 ` Josef Bacik
2022-04-30 13:07 ` Marc MERLIN
2022-04-30 16:40 ` Josef Bacik
2022-04-30 23:11 ` Marc MERLIN
2022-05-01 2:48 ` Josef Bacik
2022-05-01 4:54 ` Marc MERLIN
2022-05-01 11:28 ` Josef Bacik
2022-05-01 15:22 ` Marc MERLIN
2022-05-01 23:09 ` Josef Bacik
2022-05-02 1:25 ` Marc MERLIN
2022-05-02 16:41 ` Josef Bacik
2022-05-02 17:34 ` Marc MERLIN
2022-05-02 19:07 ` Josef Bacik
2022-05-02 20:08 ` Marc MERLIN
2022-05-02 21:03 ` Josef Bacik
2022-05-02 21:49 ` Marc MERLIN
2022-05-02 23:16 ` Josef Bacik
2022-05-02 23:41 ` Marc MERLIN
2022-05-03 1:06 ` Josef Bacik
2022-05-03 1:26 ` Marc MERLIN
2022-05-03 2:38 ` Josef Bacik
2022-05-03 4:02 ` Marc MERLIN
2022-05-03 4:13 ` Josef Bacik
2022-05-03 4:55 ` Marc MERLIN
2022-05-03 16:00 ` Josef Bacik
2022-05-03 17:24 ` Marc MERLIN
2022-05-05 15:08 ` Marc MERLIN
2022-05-05 15:27 ` Josef Bacik
2022-05-06 3:19 ` Marc MERLIN
2022-05-07 0:25 ` Josef Bacik
2022-05-07 1:15 ` Josef Bacik
2022-05-07 15:39 ` Marc MERLIN
2022-05-07 18:58 ` Josef Bacik
2022-05-07 19:36 ` Marc MERLIN
2022-05-08 19:45 ` Marc MERLIN
2022-05-08 19:55 ` Josef Bacik
2022-05-08 20:52 ` Marc MERLIN
2022-05-08 21:20 ` Marc MERLIN
2022-05-08 21:49 ` Josef Bacik
2022-05-08 22:14 ` Marc MERLIN
2022-05-09 0:22 ` Josef Bacik
2022-05-09 0:46 ` Marc MERLIN
2022-05-09 16:17 ` Josef Bacik
2022-05-09 17:00 ` Marc MERLIN
2022-05-09 17:09 ` Josef Bacik
2022-05-09 17:19 ` Marc MERLIN
2022-05-10 1:04 ` Josef Bacik
2022-05-10 1:08 ` Marc MERLIN
2022-05-10 1:18 ` Josef Bacik
2022-05-10 1:32 ` Marc MERLIN
2022-05-10 2:03 ` Josef Bacik
2022-05-10 2:19 ` Marc MERLIN
2022-05-10 13:21 ` Josef Bacik
2022-05-10 14:37 ` Marc MERLIN
2022-05-10 15:20 ` Josef Bacik
2022-05-10 16:06 ` Marc MERLIN
2022-05-10 16:14 ` Josef Bacik
2022-05-10 16:44 ` Marc MERLIN
2022-05-10 21:15 ` Marc MERLIN
2022-05-10 23:38 ` Josef Bacik
2022-05-11 0:08 ` Marc MERLIN
2022-05-11 0:28 ` Josef Bacik
2022-05-11 1:48 ` Marc MERLIN
2022-05-11 11:43 ` Josef Bacik
2022-05-11 15:03 ` Marc MERLIN
2022-05-11 15:21 ` Josef Bacik
2022-05-11 16:00 ` Marc MERLIN
2022-05-11 16:05 ` Josef Bacik
2022-05-11 18:00 ` Goffredo Baroncelli
2022-05-12 2:39 ` Zygo Blaxell
2022-05-11 18:58 ` Marc MERLIN
[not found] ` <20220513144113.GA16501@merlins.org>
[not found] ` <CAEzrpqfYg=Zf_GYjyvc+WZsnoCjiPTAS-08C_rB=gey74DGUqA@mail.gmail.com>
2022-05-15 2:57 ` Marc MERLIN
2022-05-15 14:02 ` Josef Bacik
2022-05-15 14:41 ` Marc MERLIN
2022-05-15 15:24 ` Josef Bacik
2022-05-15 15:33 ` Marc MERLIN
2022-05-15 15:35 ` Josef Bacik
2022-05-15 15:41 ` Marc MERLIN
2022-05-15 15:48 ` Josef Bacik
2022-05-15 21:29 ` Marc MERLIN
2022-05-15 23:01 ` Marc MERLIN
2022-05-16 0:01 ` Josef Bacik
2022-05-16 0:57 ` Marc MERLIN
2022-05-16 14:50 ` Josef Bacik
2022-05-16 15:16 ` Marc MERLIN
2022-05-16 15:31 ` Josef Bacik
2022-05-16 15:36 ` Marc MERLIN
2022-05-16 16:53 ` Marc MERLIN
2022-05-16 16:55 ` Josef Bacik
2022-05-17 19:49 ` Josef Bacik
2022-05-17 20:27 ` Marc MERLIN
2022-05-17 20:39 ` Josef Bacik
2022-05-17 21:22 ` Marc MERLIN
2022-05-18 18:26 ` Josef Bacik
2022-05-18 19:12 ` Marc MERLIN
2022-05-18 19:17 ` Josef Bacik
2022-05-19 22:28 ` Marc MERLIN
2022-05-24 1:13 ` Marc MERLIN
2022-05-24 18:26 ` Josef Bacik
2022-05-24 19:13 ` Marc MERLIN
2022-05-25 14:35 ` Josef Bacik
2022-05-26 17:10 ` Marc MERLIN
2022-05-26 17:12 ` Josef Bacik
2022-05-26 17:31 ` Marc MERLIN
2022-05-26 17:44 ` Josef Bacik
2022-05-26 18:12 ` Marc MERLIN
2022-05-26 18:54 ` Josef Bacik
2022-05-26 19:15 ` Marc MERLIN
2022-05-26 19:55 ` Josef Bacik
2022-05-26 21:39 ` Marc MERLIN
2022-05-26 23:23 ` Josef Bacik
2022-05-27 1:16 ` Marc MERLIN
2022-05-27 18:35 ` Josef Bacik
2022-05-27 23:26 ` Marc MERLIN
2022-05-28 0:13 ` Josef Bacik
2022-05-28 20:08 ` Josef Bacik
2022-05-28 22:56 ` Marc MERLIN
2022-05-29 1:00 ` Josef Bacik
2022-05-29 3:51 ` Marc MERLIN
2022-05-29 15:00 ` Josef Bacik
2022-05-29 15:33 ` Marc MERLIN
2022-05-29 17:32 ` Josef Bacik
2022-05-29 18:05 ` Marc MERLIN
2022-05-29 18:58 ` Josef Bacik
2022-05-29 19:42 ` Marc MERLIN
2022-05-29 19:49 ` Josef Bacik
2022-05-29 20:04 ` Marc MERLIN
2022-05-29 20:32 ` Josef Bacik
2022-05-30 0:37 ` Marc MERLIN
2022-05-30 1:14 ` Josef Bacik
2022-05-30 19:18 ` Marc MERLIN
2022-05-30 20:53 ` Josef Bacik
2022-05-31 1:12 ` Marc MERLIN
2022-05-31 20:57 ` Josef Bacik
2022-05-31 22:49 ` Marc MERLIN
2022-06-01 0:14 ` Josef Bacik
2022-06-01 0:25 ` Marc MERLIN
2022-06-01 1:26 ` Josef Bacik
2022-06-01 1:29 ` Marc MERLIN
2022-06-01 2:10 ` Josef Bacik
2022-06-01 3:15 ` Marc MERLIN
2022-06-01 13:56 ` Josef Bacik
2022-06-01 16:39 ` Marc MERLIN
2022-06-01 18:00 ` Josef Bacik
2022-06-01 18:08 ` Marc MERLIN
2022-06-01 18:42 ` Josef Bacik
2022-06-01 18:50 ` Marc MERLIN
2022-06-01 19:01 ` Josef Bacik
2022-06-01 20:57 ` Josef Bacik
2022-06-01 21:40 ` Marc MERLIN
2022-06-01 22:34 ` Josef Bacik
2022-06-01 22:36 ` Marc MERLIN
2022-06-01 22:54 ` Josef Bacik
2022-06-01 22:56 ` Marc MERLIN
2022-06-01 23:04 ` Josef Bacik
2022-06-01 23:10 ` Marc MERLIN
2022-06-02 0:04 ` Josef Bacik
2022-06-02 0:06 ` Marc MERLIN
2022-06-02 1:23 ` Josef Bacik
2022-06-02 1:55 ` Marc MERLIN
2022-06-02 2:03 ` Josef Bacik
2022-06-02 2:16 ` Marc MERLIN
2022-06-02 14:07 ` Josef Bacik
2022-06-02 14:21 ` Marc MERLIN
2022-06-02 14:27 ` Josef Bacik
2022-06-02 14:36 ` Marc MERLIN
2022-06-02 18:43 ` Josef Bacik
2022-06-02 19:08 ` Marc MERLIN
2022-06-02 19:35 ` Josef Bacik
2022-06-02 19:51 ` Marc MERLIN
2022-06-02 19:53 ` Josef Bacik
2022-06-02 19:56 ` Marc MERLIN
2022-06-02 20:06 ` Josef Bacik
2022-06-02 20:32 ` Marc MERLIN
2022-06-03 2:20 ` Josef Bacik
2022-06-03 14:47 ` Marc MERLIN
2022-06-03 16:17 ` Josef Bacik
2022-06-03 16:42 ` Marc MERLIN
2022-06-03 17:07 ` Marc MERLIN
2022-06-03 18:34 ` Josef Bacik
2022-06-03 18:39 ` Marc MERLIN
2022-06-04 12:49 ` Josef Bacik
2022-06-04 13:48 ` Marc MERLIN
2022-06-04 23:10 ` Josef Bacik
2022-06-05 0:13 ` Marc MERLIN
2022-06-05 19:37 ` Josef Bacik
2022-06-05 20:11 ` Marc MERLIN
2022-06-05 20:58 ` Josef Bacik
2022-06-05 21:26 ` Marc MERLIN
2022-06-05 21:43 ` Josef Bacik
2022-06-05 21:50 ` Marc MERLIN
2022-06-05 23:03 ` Josef Bacik
2022-06-06 0:05 ` Marc MERLIN
2022-06-06 1:11 ` Josef Bacik
2022-06-06 1:22 ` Marc MERLIN
2022-06-06 20:42 ` Josef Bacik
2022-06-06 21:08 ` Marc MERLIN
2022-06-06 21:19 ` Josef Bacik
2022-06-06 21:23 ` Marc MERLIN
2022-06-06 21:39 ` Josef Bacik
2022-06-06 21:50 ` Marc MERLIN
2022-06-06 22:00 ` Josef Bacik
2022-06-06 22:17 ` Marc MERLIN
2022-06-07 2:28 ` Josef Bacik
2022-06-07 2:37 ` Marc MERLIN
2022-06-07 2:57 ` Josef Bacik
2022-06-07 3:22 ` Marc MERLIN
2022-06-07 14:51 ` Josef Bacik
2022-06-07 14:53 ` Marc MERLIN
2022-06-07 15:00 ` Josef Bacik
2022-06-07 15:18 ` Marc MERLIN
2022-06-07 15:21 ` Josef Bacik
2022-06-07 15:32 ` Marc MERLIN
2022-06-07 17:56 ` Josef Bacik
2022-06-07 18:27 ` Marc MERLIN
2022-06-07 19:46 ` Josef Bacik
2022-06-07 19:57 ` Marc MERLIN
2022-06-07 20:10 ` Josef Bacik
2022-06-07 20:25 ` Marc MERLIN
2022-06-07 20:44 ` Marc MERLIN
2022-06-07 20:58 ` Josef Bacik
2022-06-07 21:25 ` Marc MERLIN
2022-06-07 23:33 ` Josef Bacik
2022-06-07 23:37 ` Marc MERLIN
2022-06-07 23:41 ` Josef Bacik
2022-06-08 0:07 ` Marc MERLIN
2022-06-08 0:32 ` Josef Bacik
2022-06-08 0:42 ` Marc MERLIN
2022-06-08 1:31 ` Josef Bacik
2022-06-08 2:12 ` Marc MERLIN
2022-06-08 20:57 ` Josef Bacik
2022-06-08 21:30 ` Marc MERLIN
2022-06-08 21:33 ` Josef Bacik
2022-06-08 21:38 ` Marc MERLIN
2022-06-08 22:46 ` Josef Bacik
2022-06-09 3:01 ` Marc MERLIN
2022-06-09 20:46 ` Josef Bacik
2022-06-09 21:15 ` Marc MERLIN
2022-06-10 18:47 ` Josef Bacik
2022-06-10 19:11 ` Marc MERLIN
2022-06-10 19:55 ` Josef Bacik
2022-06-11 0:14 ` Marc MERLIN
2022-06-11 14:59 ` Josef Bacik
2022-06-12 17:06 ` Marc MERLIN
2022-06-12 20:05 ` Josef Bacik
2022-06-12 21:19 ` Marc MERLIN
2022-06-12 22:32 ` Josef Bacik
2022-06-12 17:37 ` Marc MERLIN
2022-06-12 20:06 ` Josef Bacik
2022-06-12 21:14 ` Marc MERLIN
2022-06-13 17:56 ` Marc MERLIN
2022-06-13 18:28 ` Marc MERLIN
2022-06-13 18:29 ` Josef Bacik
2022-06-13 20:46 ` Marc MERLIN
2022-06-13 22:19 ` Josef Bacik
2022-06-13 23:52 ` Marc MERLIN
2022-06-15 1:44 ` Josef Bacik
2022-06-15 14:29 ` Marc MERLIN
2022-06-15 14:55 ` Marc MERLIN
2022-06-15 21:18 ` Josef Bacik
2022-06-15 21:53 ` Marc MERLIN
2022-06-15 23:16 ` Josef Bacik
2022-06-15 23:21 ` Marc MERLIN
2022-06-15 23:26 ` Eldon
2022-06-16 0:22 ` Sweet Tea Dorminy
2022-06-16 20:16 ` Neal Gompa
2022-04-05 16:22 ` Roman Mamedov
2022-04-05 22:06 ` Marc MERLIN
2022-04-05 18:38 ` Zygo Blaxell
2022-04-05 19:31 ` Marc MERLIN
2020-08-12 22:34 ` 5.6 pretty massive unexplained btrfs corruption: parent transid verify failed + open_ctree failed Marc MERLIN
2020-08-13 7:39 ` Roman Mamedov
2020-08-13 15:07 ` Marc MERLIN
2020-08-14 2:19 ` Zygo Blaxell
2020-08-14 1:43 ` Zygo Blaxell
2020-08-15 4:41 ` Marc MERLIN
2018-07-18 19:42 ` btrfs check (not lowmem) and OOM-like hangs (4.17.6) Andrei Borzenkov
2018-07-18 21:56 ` Marc MERLIN
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=Yk7YyhQ/CdcMfoS7@hungrycats.org \
--to=ce3g8jdj@umail.furryterror.org \
--cc=josef@toxicpanda.com \
--cc=linux-btrfs@vger.kernel.org \
--cc=marc@merlins.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.