From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.3 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D8E2BC433E0 for ; Tue, 16 Feb 2021 11:50:49 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id A10F564DDA for ; Tue, 16 Feb 2021 11:50:49 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230201AbhBPLup (ORCPT ); Tue, 16 Feb 2021 06:50:45 -0500 Received: from mx2.suse.de ([195.135.220.15]:49866 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230310AbhBPLsw (ORCPT ); Tue, 16 Feb 2021 06:48:52 -0500 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 0AF90AF9F; Tue, 16 Feb 2021 11:48:08 +0000 (UTC) Received: by ds.suse.cz (Postfix, from userid 10065) id D5105DA6EF; Tue, 16 Feb 2021 12:46:11 +0100 (CET) Date: Tue, 16 Feb 2021 12:46:11 +0100 From: David Sterba To: Naohiro Aota Cc: Johannes Thumshirn , "linux-btrfs@vger.kernel.org" , "dsterba@suse.com" , "hare@suse.com" , "linux-fsdevel@vger.kernel.org" , Damien Le Moal Subject: Re: [PATCH v15 00/42] btrfs: zoned block device support Message-ID: <20210216114611.GM1993@suse.cz> Reply-To: dsterba@suse.cz Mail-Followup-To: dsterba@suse.cz, Naohiro Aota , Johannes Thumshirn , "linux-btrfs@vger.kernel.org" , "dsterba@suse.com" , "hare@suse.com" , "linux-fsdevel@vger.kernel.org" , Damien Le Moal References: <20210210195829.GW1993@twin.jikos.cz> <20210211151901.GD1993@twin.jikos.cz> <20210211154627.GE1993@twin.jikos.cz> <20210216043247.cjxybi7dudpgvvyg@naota-xeon> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210216043247.cjxybi7dudpgvvyg@naota-xeon> User-Agent: Mutt/1.5.23.1-rc1 (2014-03-12) Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org On Tue, Feb 16, 2021 at 01:33:28PM +0900, Naohiro Aota wrote: > On Mon, Feb 15, 2021 at 04:58:05PM +0000, Johannes Thumshirn wrote: > > On 11/02/2021 16:48, David Sterba wrote: > > > On Thu, Feb 11, 2021 at 03:26:04PM +0000, Johannes Thumshirn wrote: > > >> On 11/02/2021 16:21, David Sterba wrote: > > >>> On Thu, Feb 11, 2021 at 09:58:09AM +0000, Johannes Thumshirn wrote: > > >>>> On 10/02/2021 21:02, David Sterba wrote: > > >>>>>> This series implements superblock log writing. It uses two zones as a > > >>>>>> circular buffer to write updated superblocks. Once the first zone is filled > > >>>>>> up, start writing into the second zone. The first zone will be reset once > > >>>>>> both zones are filled. We can determine the postion of the latest > > >>>>>> superblock by reading the write pointer information from a device. > > >>>>> > > >>>>> About that, in this patchset it's still leaving superblock at the fixed > > >>>>> zone number while we want it at a fixed location, spanning 2 zones > > >>>>> regardless of their size. > > >>>> > > >>>> We'll always need 2 zones or otherwise we won't be powercut safe. > > >>> > > >>> Yes we do, that hasn't changed. > > >> > > >> OK that I don't understand, with the log structured superblocks on a zoned > > >> filesystem, we're writing a new superblock until the 1st zone is filled. > > >> Then we advance to the second zone. As soon as we wrote a superblock to > > >> the second zone we can reset the first. > > >> If we only use one zone, > > > > > > No, that can't work and nobody suggests that. > > > > > >> we would need to write until it's end, reset and > > >> start writing again from the beginning. But if a powercut happens between > > >> reset and first write after the reset, we end up with no superblock. > > > > > > What I'm saying and what we discussed on slack in December, we can't fix > > > the zone number for the 1st and 2nd copy of superblock like it is now in > > > sb_zone_number. > > > > > > The primary superblock must be there for any reference and to actually > > > let the tools learn about the incompat bits. > > > > > > The 1st copy is now fixed zone 16, which depends on the zone size. The > > > idea is to define the superblock offsets to start at given offsets, > > > where the ring buffer has the two consecutive zones, regardless of their > > > size. > > > > > > primary: 0 > > > 1st copy: 16G > > > 2nd copy: 256G > > > > > > Due to the variability of the zones in future devices, we'll reserve a > > > space at the superblock interval, assuming the zone sizes can grow up to > > > several gigabytes. Current working number is 1G, with some safety margin > > > the reserved ranges would be (eg. for a 4G zone size): > > > > > > primary: 0 up to 8G > > > 1st copy: 16G up to 24G > > > 2nd copy: 256G up to 262G > > > > > > It is wasteful but we want to be future proof and expecting disk sizes > > > from tens of terabytes to a hundred terabytes, it's not significant > > > loss of space. > > > > > > If the zone sizes can be expected higher than 4G, the 1st copy can be > > > defined at 64G, that would leave us some margin until somebody thinks > > > that 32G zones are a great idea. > > > > > > > We've been talking about this today and our proposal would be as follows: > > Primary SB is two zones starting at LBA 0 > > Seconday SB the two zones starting with the zone that contains the address 16G > > For the secondary SB on a file system < 16GB, how do you think of > using the last two zones (or zones #2, #3 will do)? Then, we can > assure to have two SB copies even on such a file system. For real hardware I think this is not relevant but for the emulated mode we need to deal with that case. The reserved size is wasteful and this will become noticeable for devices < 16G but I'd rather keep the logic simple and not care much about this corner case. So, the superblock range would be reserved and if there's not enough to store the secondary sb, then don't.