Linux-Block Archive on lore.kernel.org
 help / Atom feed
* [git pull] device mapper changes for 5.2
@ 2019-05-13 18:59 Mike Snitzer
  2019-05-16 14:32 ` [git pull v2] " Mike Snitzer
  2019-05-16 23:25 ` [git pull] " pr-tracker-bot
  0 siblings, 2 replies; 5+ messages in thread
From: Mike Snitzer @ 2019-05-13 18:59 UTC (permalink / raw)
  To: Linus Torvalds
  Cc: dm-devel, linux-block, Alasdair G Kergon, Bryan Gurney,
	Christoph Hellwig, Colin Ian King, Damien Le Moal, Dan Carpenter,
	Helen Koike, Huaisheng Ye, Martin Wilck, Mike Snitzer,
	Mikulas Patocka, Nikos Tsironis, Peng Wang, YueHaibing, Yufen Yu

Hi Linus,

The following changes since commit dc4060a5dc2557e6b5aa813bf5b73677299d62d2:

  Linux 5.1-rc5 (2019-04-14 15:17:41 -0700)

are available in the Git repository at:

  git://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm.git tags/for-5.2/dm-changes

for you to fetch changes up to 05d6909ea9d62bb357846177a84842e09fc15914:

  dm integrity: whitespace, coding style and dead code cleanup (2019-05-09 16:00:31 -0400)

----------------------------------------------------------------
- Improve DM snapshot target's scalability by using finer grained
  locking.  Requires some list_bl interface improvements.

- Add ability for DM integrity to use a bitmap mode, that tracks regions
  where data and metadata are out of sync, instead of using a journal.

- Improve DM thin provisioning target to not write metadata changes to
  disk if the thin-pool and associated thin devices are merely
  activated but not used.  This avoids metadata corruption due to
  concurrent activation of thin devices across different OS instances
  (e.g. split brain scenarios, which ultimately would be avoided if
  proper device filters were used -- but not having proper filtering has
  proven a very common configuration mistake)

- Fix missing call to path selector type->end_io in DM multipath.  This
  fixes reported performance problems due to inaccurate path selector IO
  accounting causing an imbalance of IO (e.g. avoiding issuing IO to
  particular path due to it seemingly being heavily used).

- Fix bug in DM cache metadata's loading of its discard bitset that
  could lead to all cache blocks being discarded if the very first cache
  block was discarded (thankfully in practice the first cache block is
  generally in use; be it FS superblock, partition table, disk label,
  etc).

- Add testing-only DM dust target which simulates a device that has
  failing sectors and/or read failures.

- Various small fixes to DM init, DM multipath, DM zoned, and DM crypt.

----------------------------------------------------------------
Bryan Gurney (1):
      dm: add dust target

Christoph Hellwig (1):
      dm crypt: fix endianness annotations around org_sector_of_dmreq

Colin Ian King (1):
      dm dust: remove redundant unsigned comparison to less than zero

Damien Le Moal (1):
      dm zoned: Fix zone report handling

Dan Carpenter (1):
      dm zoned: Silence a static checker warning

Helen Koike (1):
      dm init: fix max devices/targets checks

Huaisheng Ye (3):
      dm writecache: remove needless dereferences in __writecache_writeback_pmem()
      dm writecache: add unlikely for returned value of rb_next/prev
      dm writecache: remove unused member page_offset in writeback_struct

Martin Wilck (1):
      dm mpath: always free attached_handler_name in parse_path()

Mike Snitzer (5):
      dm space map common: zero entire ll_disk
      dm thin metadata: check __commit_transaction()'s return
      dm thin metadata: add wrappers for managing write locking of metadata
      dm thin metadata: do not write metadata if no changes occurred
      dm integrity: whitespace, coding style and dead code cleanup

Mikulas Patocka (13):
      dm delay: fix a crash when invalid device is specified
      dm writecache: avoid unnecessary lookups in writecache_find_entry()
      dm integrity: correctly calculate the size of metadata area
      dm integrity: don't check null pointer before kvfree and vfree
      dm integrity: don't report unused options
      dm integrity: update documentation
      dm integrity: introduce rw_journal_sectors()
      dm ingerity: pass size to dm_integrity_alloc_page_list()
      dm integrity: allow large ranges to be described
      dm integrity: introduce a function add_new_range_and_wait()
      dm integrity: add a bitmap mode
      dm integrity: handle machine reboot in bitmap mode
      dm integrity: implement synchronous mode for reboot handling

Nikos Tsironis (7):
      dm cache metadata: Fix loading discard bitset
      list: Don't use WRITE_ONCE() in hlist_add_behind()
      list_bl: Add hlist_bl_add_before/behind helpers
      dm snapshot: Don't sleep holding the snapshot lock
      dm snapshot: Replace mutex with rw semaphore
      dm snapshot: Make exception tables scalable
      dm snapshot: Use fine-grained locking scheme

Peng Wang (1):
      dm: only initialize md->dax_dev if CONFIG_DAX_DRIVER is enabled

YueHaibing (1):
      dm dust: Make dm_dust_init and dm_dust_exit static

Yufen Yu (1):
      dm mpath: fix missing call of path selector type->end_io

 Documentation/device-mapper/dm-dust.txt          | 272 +++++++++
 Documentation/device-mapper/dm-integrity.txt     |  32 +-
 drivers/md/Kconfig                               |   9 +
 drivers/md/Makefile                              |   1 +
 drivers/md/dm-cache-metadata.c                   |   9 +-
 drivers/md/dm-crypt.c                            |   8 +-
 drivers/md/dm-delay.c                            |   3 +-
 drivers/md/dm-dust.c                             | 515 ++++++++++++++++
 drivers/md/dm-exception-store.h                  |   3 +-
 drivers/md/dm-init.c                             |   8 +-
 drivers/md/dm-integrity.c                        | 717 ++++++++++++++++++++---
 drivers/md/dm-mpath.c                            |  19 +-
 drivers/md/dm-rq.c                               |   8 +-
 drivers/md/dm-snap.c                             | 359 ++++++++----
 drivers/md/dm-target.c                           |   3 +-
 drivers/md/dm-thin-metadata.c                    | 139 +++--
 drivers/md/dm-writecache.c                       |  29 +-
 drivers/md/dm-zoned-metadata.c                   |   5 +
 drivers/md/dm-zoned-target.c                     |   3 +-
 drivers/md/dm.c                                  |   6 +-
 drivers/md/persistent-data/dm-space-map-common.c |   2 +
 include/linux/device-mapper.h                    |   3 +-
 include/linux/list.h                             |   2 +-
 include/linux/list_bl.h                          |  26 +
 24 files changed, 1895 insertions(+), 286 deletions(-)
 create mode 100644 Documentation/device-mapper/dm-dust.txt
 create mode 100644 drivers/md/dm-dust.c

^ permalink raw reply	[flat|nested] 5+ messages in thread

* [git pull v2] device mapper changes for 5.2
  2019-05-13 18:59 [git pull] device mapper changes for 5.2 Mike Snitzer
@ 2019-05-16 14:32 ` " Mike Snitzer
  2019-05-16 22:59   ` Linus Torvalds
  2019-05-16 23:25   ` pr-tracker-bot
  2019-05-16 23:25 ` [git pull] " pr-tracker-bot
  1 sibling, 2 replies; 5+ messages in thread
From: Mike Snitzer @ 2019-05-16 14:32 UTC (permalink / raw)
  To: Linus Torvalds
  Cc: dm-devel, linux-block, Alasdair G Kergon, Bryan Gurney,
	Christoph Hellwig, Colin Ian King, Damien Le Moal, Dan Carpenter,
	Helen Koike, Huaisheng Ye, Martin Wilck, Mike Snitzer,
	Mikulas Patocka, Milan Broz, Nikos Tsironis, Peng Wang,
	Sheetal Singala, YueHaibing, Yufen Yu

Hi Linus,

Seems you haven't pulled my 'for-5.2/dm-changes' tag from earlier this
week so I've added 4 additional simple commits to this v2 pull.

(Last commit being trivial janitor patch but I'm being hen-pecked about
it by the author on LKML so figured I'd include it while getting you the
3 additional substantive fixes).

The following changes since commit dc4060a5dc2557e6b5aa813bf5b73677299d62d2:

  Linux 5.1-rc5 (2019-04-14 15:17:41 -0700)

are available in the Git repository at:

  git://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm.git tags/for-5.2/dm-changes-v2

for you to fetch changes up to 8454fca4f53bbe5e0a71613192674c8ce5c52318:

  dm: fix a couple brace coding style issues (2019-05-16 10:09:21 -0400)

Please pull, thanks!
Mike

----------------------------------------------------------------
- Improve DM snapshot target's scalability by using finer grained
  locking.  Requires some list_bl interface improvements.

- Add ability for DM integrity to use a bitmap mode, that tracks regions
  where data and metadata are out of sync, instead of using a journal.

- Improve DM thin provisioning target to not write metadata changes to
  disk if the thin-pool and associated thin devices are merely
  activated but not used.  This avoids metadata corruption due to
  concurrent activation of thin devices across different OS instances
  (e.g. split brain scenarios, which ultimately would be avoided if
  proper device filters were used -- but not having proper filtering has
  proven a very common configuration mistake)

- Fix missing call to path selector type->end_io in DM multipath.  This
  fixes reported performance problems due to inaccurate path selector IO
  accounting causing an imbalance of IO (e.g. avoiding issuing IO to
  particular path due to it seemingly being heavily used).

- Fix bug in DM cache metadata's loading of its discard bitset that
  could lead to all cache blocks being discarded if the very first cache
  block was discarded (thankfully in practice the first cache block is
  generally in use; be it FS superblock, partition table, disk label,
  etc).

- Add testing-only DM dust target which simulates a device that has
  failing sectors and/or read failures.

- Fix a DM init error path reference count hang that caused boot hangs
  if user supplied malformed input on kernel commandline.

- Fix a couple issues with DM crypt target's logging being overly
  verbose or lacking context.

- Various other small fixes to DM init, DM multipath, DM zoned, and DM
  crypt.

----------------------------------------------------------------
Bryan Gurney (1):
      dm: add dust target

Christoph Hellwig (1):
      dm crypt: fix endianness annotations around org_sector_of_dmreq

Colin Ian King (1):
      dm dust: remove redundant unsigned comparison to less than zero

Damien Le Moal (1):
      dm zoned: Fix zone report handling

Dan Carpenter (1):
      dm zoned: Silence a static checker warning

Helen Koike (2):
      dm init: fix max devices/targets checks
      dm ioctl: fix hang in early create error condition

Huaisheng Ye (3):
      dm writecache: remove needless dereferences in __writecache_writeback_pmem()
      dm writecache: add unlikely for returned value of rb_next/prev
      dm writecache: remove unused member page_offset in writeback_struct

Martin Wilck (1):
      dm mpath: always free attached_handler_name in parse_path()

Mike Snitzer (5):
      dm space map common: zero entire ll_disk
      dm thin metadata: check __commit_transaction()'s return
      dm thin metadata: add wrappers for managing write locking of metadata
      dm thin metadata: do not write metadata if no changes occurred
      dm integrity: whitespace, coding style and dead code cleanup

Mikulas Patocka (13):
      dm delay: fix a crash when invalid device is specified
      dm writecache: avoid unnecessary lookups in writecache_find_entry()
      dm integrity: correctly calculate the size of metadata area
      dm integrity: don't check null pointer before kvfree and vfree
      dm integrity: don't report unused options
      dm integrity: update documentation
      dm integrity: introduce rw_journal_sectors()
      dm ingerity: pass size to dm_integrity_alloc_page_list()
      dm integrity: allow large ranges to be described
      dm integrity: introduce a function add_new_range_and_wait()
      dm integrity: add a bitmap mode
      dm integrity: handle machine reboot in bitmap mode
      dm integrity: implement synchronous mode for reboot handling

Milan Broz (2):
      dm crypt: move detailed message into debug level
      dm crypt: print device name in integrity error message

Nikos Tsironis (7):
      dm cache metadata: Fix loading discard bitset
      list: Don't use WRITE_ONCE() in hlist_add_behind()
      list_bl: Add hlist_bl_add_before/behind helpers
      dm snapshot: Don't sleep holding the snapshot lock
      dm snapshot: Replace mutex with rw semaphore
      dm snapshot: Make exception tables scalable
      dm snapshot: Use fine-grained locking scheme

Peng Wang (1):
      dm: only initialize md->dax_dev if CONFIG_DAX_DRIVER is enabled

Sheetal Singala (1):
      dm: fix a couple brace coding style issues

YueHaibing (1):
      dm dust: Make dm_dust_init and dm_dust_exit static

Yufen Yu (1):
      dm mpath: fix missing call of path selector type->end_io

 Documentation/device-mapper/dm-dust.txt          | 272 +++++++++
 Documentation/device-mapper/dm-integrity.txt     |  32 +-
 drivers/md/Kconfig                               |   9 +
 drivers/md/Makefile                              |   1 +
 drivers/md/dm-cache-metadata.c                   |   9 +-
 drivers/md/dm-crypt.c                            |  26 +-
 drivers/md/dm-delay.c                            |   3 +-
 drivers/md/dm-dust.c                             | 515 ++++++++++++++++
 drivers/md/dm-exception-store.h                  |   3 +-
 drivers/md/dm-init.c                             |   8 +-
 drivers/md/dm-integrity.c                        | 717 ++++++++++++++++++++---
 drivers/md/dm-ioctl.c                            |   6 +-
 drivers/md/dm-mpath.c                            |  19 +-
 drivers/md/dm-rq.c                               |   8 +-
 drivers/md/dm-snap.c                             | 359 ++++++++----
 drivers/md/dm-target.c                           |   3 +-
 drivers/md/dm-thin-metadata.c                    | 139 +++--
 drivers/md/dm-writecache.c                       |  29 +-
 drivers/md/dm-zoned-metadata.c                   |   5 +
 drivers/md/dm-zoned-target.c                     |   3 +-
 drivers/md/dm.c                                  |  12 +-
 drivers/md/persistent-data/dm-space-map-common.c |   2 +
 include/linux/device-mapper.h                    |   3 +-
 include/linux/list.h                             |   2 +-
 include/linux/list_bl.h                          |  26 +
 25 files changed, 1915 insertions(+), 296 deletions(-)
 create mode 100644 Documentation/device-mapper/dm-dust.txt
 create mode 100644 drivers/md/dm-dust.c

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [git pull v2] device mapper changes for 5.2
  2019-05-16 14:32 ` [git pull v2] " Mike Snitzer
@ 2019-05-16 22:59   ` Linus Torvalds
  2019-05-16 23:25   ` pr-tracker-bot
  1 sibling, 0 replies; 5+ messages in thread
From: Linus Torvalds @ 2019-05-16 22:59 UTC (permalink / raw)
  To: Mike Snitzer
  Cc: dm-devel, linux-block, Alasdair G Kergon, Bryan Gurney,
	Christoph Hellwig, Colin Ian King, Damien Le Moal, Dan Carpenter,
	Helen Koike, Huaisheng Ye, Martin Wilck, Mikulas Patocka,
	Milan Broz, Nikos Tsironis, Peng Wang, Sheetal Singala,
	YueHaibing, Yufen Yu

On Thu, May 16, 2019 at 7:32 AM Mike Snitzer <snitzer@redhat.com> wrote:
>
> Seems you haven't pulled my 'for-5.2/dm-changes' tag from earlier this
> week so I've added 4 additional simple commits to this v2 pull.

Hmm. Strange. I see your email from three days ago now that you
mention it, but I don't recall having ever seen it before.

I must have fat-fingered it when it came in, and it was marked as
"read" without having ever been seen. Possibly because I was traveling
for my daughter's graduation, and being on mobile.

Anyway, good that you re-sent, updates and all. Now pulled

                  Linus

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [git pull] device mapper changes for 5.2
  2019-05-13 18:59 [git pull] device mapper changes for 5.2 Mike Snitzer
  2019-05-16 14:32 ` [git pull v2] " Mike Snitzer
@ 2019-05-16 23:25 ` " pr-tracker-bot
  1 sibling, 0 replies; 5+ messages in thread
From: pr-tracker-bot @ 2019-05-16 23:25 UTC (permalink / raw)
  To: Mike Snitzer
  Cc: Linus Torvalds, dm-devel, linux-block, Alasdair G Kergon,
	Bryan Gurney, Christoph Hellwig, Colin Ian King, Damien Le Moal,
	Dan Carpenter, Helen Koike, Huaisheng Ye, Martin Wilck,
	Mike Snitzer, Mikulas Patocka, Nikos Tsironis, Peng Wang,
	YueHaibing, Yufen Yu

The pull request you sent on Mon, 13 May 2019 14:59:48 -0400:

> git://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm.git tags/for-5.2/dm-changes

has been merged into torvalds/linux.git:
https://git.kernel.org/torvalds/c/0f41fcf78849c902ddca564f99a8e23ccfc80333

Thank you!

-- 
Deet-doot-dot, I am a bot.
https://korg.wiki.kernel.org/userdoc/prtracker

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [git pull v2] device mapper changes for 5.2
  2019-05-16 14:32 ` [git pull v2] " Mike Snitzer
  2019-05-16 22:59   ` Linus Torvalds
@ 2019-05-16 23:25   ` pr-tracker-bot
  1 sibling, 0 replies; 5+ messages in thread
From: pr-tracker-bot @ 2019-05-16 23:25 UTC (permalink / raw)
  To: Mike Snitzer
  Cc: Linus Torvalds, dm-devel, linux-block, Alasdair G Kergon,
	Bryan Gurney, Christoph Hellwig, Colin Ian King, Damien Le Moal,
	Dan Carpenter, Helen Koike, Huaisheng Ye, Martin Wilck,
	Mike Snitzer, Mikulas Patocka, Milan Broz, Nikos Tsironis,
	Peng Wang, Sheetal Singala, YueHaibing, Yufen Yu

The pull request you sent on Thu, 16 May 2019 10:32:07 -0400:

> git://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm.git tags/for-5.2/dm-changes-v2

has been merged into torvalds/linux.git:
https://git.kernel.org/torvalds/c/311f71281ff4b24f86a39c60c959f485c68a6d36

Thank you!

-- 
Deet-doot-dot, I am a bot.
https://korg.wiki.kernel.org/userdoc/prtracker

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, back to index

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-05-13 18:59 [git pull] device mapper changes for 5.2 Mike Snitzer
2019-05-16 14:32 ` [git pull v2] " Mike Snitzer
2019-05-16 22:59   ` Linus Torvalds
2019-05-16 23:25   ` pr-tracker-bot
2019-05-16 23:25 ` [git pull] " pr-tracker-bot

Linux-Block Archive on lore.kernel.org

Archives are clonable:
	git clone --mirror https://lore.kernel.org/linux-block/0 linux-block/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 linux-block linux-block/ https://lore.kernel.org/linux-block \
		linux-block@vger.kernel.org linux-block@archiver.kernel.org
	public-inbox-index linux-block


Newsgroup available over NNTP:
	nntp://nntp.lore.kernel.org/org.kernel.vger.linux-block


AGPL code for this site: git clone https://public-inbox.org/ public-inbox