All of lore.kernel.org
 help / color / mirror / Atom feed
From: Josef Bacik <jbacik@fb.com>
To: Dave Chinner <david@fromorbit.com>
Cc: <linux-btrfs@vger.kernel.org>, <linux-fsdevel@vger.kernel.org>,
	<dm-devel@redhat.com>, <zab@redhat.com>,
	<fstests@vger.kernel.org>
Subject: Re: [PATCH 1/3] dm: log writes target
Date: Tue, 7 Apr 2015 10:43:08 -0400	[thread overview]
Message-ID: <5523ECFC.9030506@fb.com> (raw)
In-Reply-To: <20150321215051.GP10105@dastard>

On 03/21/2015 05:50 PM, Dave Chinner wrote:
> On Thu, Mar 19, 2015 at 04:31:08PM -0400, Josef Bacik wrote:
>> This creates a new target that is meant for file system developers to test file
>> system integrity at particular points in the life of a file system.  We capture
>> all write requests and the data and log the requests and the data to a separate
>> device for later replay.  There is a userspace utility to do this replay.  The
>> idea behind this is to give file system developers to verify that the file
>> system is always consistent.  Thanks,
>>
>> Signed-off-by: Josef Bacik <jbacik@fb.com>
>> ---
>>   Documentation/device-mapper/dm-log-writes.txt | 136 +++++
>>   drivers/md/Kconfig                            |  16 +
>>   drivers/md/Makefile                           |   1 +
>>   drivers/md/dm-log-writes.c                    | 809 ++++++++++++++++++++++++++
>>   4 files changed, 962 insertions(+)
>>   create mode 100644 Documentation/device-mapper/dm-log-writes.txt
>>   create mode 100644 drivers/md/dm-log-writes.c
>>
>> diff --git a/Documentation/device-mapper/dm-log-writes.txt b/Documentation/device-mapper/dm-log-writes.txt
>> new file mode 100644
>> index 0000000..f3a9fa2
>> --- /dev/null
>> +++ b/Documentation/device-mapper/dm-log-writes.txt
>> @@ -0,0 +1,136 @@
>> +dm-log-writes
>> +=============
>> +
>> +This target takes 2 devices, one to pass all IO to normally, and one to log all
>> +of the write operations to.  This is intended for file system developers wishing
>> +to verify the integrity of metadata or data as the file system is written to.
>> +There is a log_writes_entry written for every WRITE request and the target is
>> +able to take arbitrary data from userspace to insert into the log.  The data
>> +that is in the WRITE requests is copied into the log to make the replay happen
>> +exactly as it happened originally.
>
> Hmm - terminology thing here - "log writes" have specific meaning to
> any application that does write ahead logging. E.g. journalling
> filesystems, databases, etc. So I find this name extremely confusing
> because a dm-log-write device has nothing to do with write ahead
> logging, log writes or journalling...
>
> I'm sure lots of other people are going to have the same problem
> understanding what this device is for because of that.
>
> I know this is effectively bikeshedding, but I think a less
> ambiguous name would be a good thing to have. e.g. dm-iotracer.
> Nobody will get confused that way....
>

Hey Dave,

Sorry I sent this patch and then promptly went on vacation.  Mike has 
already pulled the patch in and I've already gotten all this tooling 
built around the original name.  It is probably a little confusing, but 
since only a few of us are going to mess with it and it's mostly going 
to be used in an xfstests context I'm not too worried about it.  Thanks,

Josef


WARNING: multiple messages have this Message-ID (diff)
From: Josef Bacik <jbacik@fb.com>
To: Dave Chinner <david@fromorbit.com>
Cc: linux-btrfs@vger.kernel.org, linux-fsdevel@vger.kernel.org,
	dm-devel@redhat.com, zab@redhat.com, fstests@vger.kernel.org
Subject: Re: [PATCH 1/3] dm: log writes target
Date: Tue, 7 Apr 2015 10:43:08 -0400	[thread overview]
Message-ID: <5523ECFC.9030506@fb.com> (raw)
In-Reply-To: <20150321215051.GP10105@dastard>

On 03/21/2015 05:50 PM, Dave Chinner wrote:
> On Thu, Mar 19, 2015 at 04:31:08PM -0400, Josef Bacik wrote:
>> This creates a new target that is meant for file system developers to test file
>> system integrity at particular points in the life of a file system.  We capture
>> all write requests and the data and log the requests and the data to a separate
>> device for later replay.  There is a userspace utility to do this replay.  The
>> idea behind this is to give file system developers to verify that the file
>> system is always consistent.  Thanks,
>>
>> Signed-off-by: Josef Bacik <jbacik@fb.com>
>> ---
>>   Documentation/device-mapper/dm-log-writes.txt | 136 +++++
>>   drivers/md/Kconfig                            |  16 +
>>   drivers/md/Makefile                           |   1 +
>>   drivers/md/dm-log-writes.c                    | 809 ++++++++++++++++++++++++++
>>   4 files changed, 962 insertions(+)
>>   create mode 100644 Documentation/device-mapper/dm-log-writes.txt
>>   create mode 100644 drivers/md/dm-log-writes.c
>>
>> diff --git a/Documentation/device-mapper/dm-log-writes.txt b/Documentation/device-mapper/dm-log-writes.txt
>> new file mode 100644
>> index 0000000..f3a9fa2
>> --- /dev/null
>> +++ b/Documentation/device-mapper/dm-log-writes.txt
>> @@ -0,0 +1,136 @@
>> +dm-log-writes
>> +=============
>> +
>> +This target takes 2 devices, one to pass all IO to normally, and one to log all
>> +of the write operations to.  This is intended for file system developers wishing
>> +to verify the integrity of metadata or data as the file system is written to.
>> +There is a log_writes_entry written for every WRITE request and the target is
>> +able to take arbitrary data from userspace to insert into the log.  The data
>> +that is in the WRITE requests is copied into the log to make the replay happen
>> +exactly as it happened originally.
>
> Hmm - terminology thing here - "log writes" have specific meaning to
> any application that does write ahead logging. E.g. journalling
> filesystems, databases, etc. So I find this name extremely confusing
> because a dm-log-write device has nothing to do with write ahead
> logging, log writes or journalling...
>
> I'm sure lots of other people are going to have the same problem
> understanding what this device is for because of that.
>
> I know this is effectively bikeshedding, but I think a less
> ambiguous name would be a good thing to have. e.g. dm-iotracer.
> Nobody will get confused that way....
>

Hey Dave,

Sorry I sent this patch and then promptly went on vacation.  Mike has 
already pulled the patch in and I've already gotten all this tooling 
built around the original name.  It is probably a little confusing, but 
since only a few of us are going to mess with it and it's mostly going 
to be used in an xfstests context I'm not too worried about it.  Thanks,

Josef


  reply	other threads:[~2015-04-07 14:43 UTC|newest]

Thread overview: 22+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-03-19 20:31 [PATCH 0/3] Device mapper log writes patches Josef Bacik
2015-03-19 20:31 ` Josef Bacik
2015-03-19 20:31 ` [PATCH 1/3] dm: log writes target Josef Bacik
2015-03-19 20:31   ` Josef Bacik
2015-03-19 23:16   ` Zach Brown
2015-03-20 14:50     ` [PATCH 1/3] dm: log writes target V2 Josef Bacik
2015-03-20 14:50       ` Josef Bacik
2015-03-20 16:31       ` Zach Brown
2015-03-24 15:33       ` Mike Snitzer
2015-04-07 14:41         ` Josef Bacik
2015-04-07 14:41           ` Josef Bacik
2015-03-21 21:50   ` [PATCH 1/3] dm: log writes target Dave Chinner
2015-04-07 14:43     ` Josef Bacik [this message]
2015-04-07 14:43       ` Josef Bacik
2015-03-23 18:02   ` [dm-devel] " Vivek Goyal
2015-04-07 14:45     ` Josef Bacik
2015-04-07 14:45       ` Josef Bacik
2015-03-19 20:31 ` [PATCH 2/3] fstests: add dm-log-writes test and supporting code Josef Bacik
2015-03-19 20:31   ` Josef Bacik
2015-03-19 20:31 ` [PATCH 3/3] fstests: btrfs balance with dm log writes test Josef Bacik
2015-03-19 20:31   ` Josef Bacik
2015-03-25 10:35   ` Filipe David Manana

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5523ECFC.9030506@fb.com \
    --to=jbacik@fb.com \
    --cc=david@fromorbit.com \
    --cc=dm-devel@redhat.com \
    --cc=fstests@vger.kernel.org \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=zab@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.