Btrfs progs release 5.2

Btrfs progs release 5.2

[David Sterba]

Hi,

btrfs-progs version 5.2 have been released.

Changes:

Scrub status has been reworked:

  UUID:             bf8720e0-606b-4065-8320-b48df2e8e669
  Scrub started:    Fri Jun 14 12:00:00 2019
  Status:           running
  Duration:         0:14:11
  Time left:        0:04:04
  ETA:              Fri Jun 14 12:18:15 2019
  Total to scrub:   182.55GiB
  Bytes scrubbed:   141.80GiB
  Rate:             170.63MiB/s
  Error summary:    csum=7
    Corrected:      0
    Uncorrectable:  7
    Unverified:     0

And subvolume show now prints the qgroup information:

 subv1
         Name:                   subv1
         UUID:                   58aa0df4-6bde-3e4e-b9f6-631d9c23578f
         Parent UUID:            -
         Received UUID:          -
         Creation time:          2019-06-19 12:34:56 +0200
         Subvolume ID:           258
         Generation:             9
         Gen at creation:        9
         Parent ID:              5
         Top level ID:           5
         Flags:                  -
         Snapshot(s):
         Quota group:            0/258
           Limit referenced:     -
           Limit exclusive:      1.00GiB
           Usage referenced:     16.00KiB
           Usage exclusive:      16.00KiB

Tweaks to the formatting are possible but I think we have our style now, this
is used by mkfs already so there should be no big surprise.

The JSON formatting output is not added to any command, only the infrastructure
code.

For developers to notice, I've moved files into cmds/ and common/. Git rebase
is smart enough to recognize that and rebased patches will follow the new path.

Changelog:

  * subvol show: print qgroup information when available
  * scrub:
    * status: show ETA, revamp the whole output
    * fix reading/writing of last position on resume/cancel, potentially
      skipping part of the filesystem on next resume
  * dump-tree: add new option --noscan to use only devices given on the
    commandline
  * all-in-one binary (busybox style) with mkfs.btrfs, btrfs-image,
    btrfs-convert, btrfstune
  * image: fix hang when there are more than 32 cpus online and compression is
    requested
  * convert: fix some false ENOSPC errors when --rootdir is used
  * build: fix gcc9 warnings
  * core changes
    * command handling cleanups
    * dead code removal
    * cmds-* files moved to cmds/
    * other shared userspace files moved to common/
    * utils.c split into more files
    * preparatory work for more output formats
    * libbtrfsutil: fix unaligned access
  * other
    * new and updated tests
    * fix tests so CI passes again
    * sb-mod can modify more superblock items

Tarballs: https://www.kernel.org/pub/linux/kernel/people/kdave/btrfs-progs/
Git: git://git.kernel.org/pub/scm/linux/kernel/git/kdave/btrfs-progs.git

Shortlog:

Anand Jain (1):
      btrfs-progs: dump-tree: add noscan option

David Sterba (76):
      btrfs-progs: pass whole key to btrfs_uuid_to_key
      btrfs-progs: build: disable -Waddress-of-packed-member by default
      btrfs-progs: docs: add reference of section 5 page
      btrfs-progs: pass cmd_struct to usage_unknown_option()
      btrfs-progs: subvol show: reformat qgroup information
      btrfs-progs: subvol show: don't return error if quotas are not enabled
      btrfs-progs: tests: simple test for subvol show output
      btrfs-progs: move get_df to utils.c
      btrfs-progs: sync btrfs_raid_attr from kernel
      btrfs-progs: scrub: improve output of status
      btrfs-progs: build: support per-file CFLAGS located in directories
      btrfs-progs: move cmds-quota.c to cmds/
      btrfs-progs: move cmds-qgroup.c to cmds/
      btrfs-progs: move cmds-rescue.c to cmds/
      btrfs-progs: move cmds/property.c to cmds/
      btrfs-progs: move and rename chunk-recover.c cmds/
      btrfs-progs: move and rename super-recover.c cmds/
      btrfs-progs: move cmds-replace.c to cmds/
      btrfs-progs: move cmds-device.c to cmds/
      btrfs-progs: move cmds-restore.c to cmds/
      btrfs-progs: move cmds-balance.c to cmds/
      btrfs-progs: move cmds-receive.c to cmds/
      btrfs-progs: move cmds-scrub.c to cmds/
      btrfs-progs: move cmds-subvolume.c to cmds/
      btrfs-progs: move all cmds-inspect*.c to cmds/
      btrfs-progs: move all cmds-fi*.c to cmds/
      btrfs-progs: move cmds-send.c to cmds/
      btrfs-progs: move internal.h to common/
      btrfs-progs: move messages.[ch] to common/
      btrfs-progs: move task-utils.[ch] to common/
      btrfs-progs: move help.[ch] to common/
      btrfs-progs: move commonh to common/
      btrfs-progs: move fsfeatures.[ch] to common/
      btrfs-progs: move string-table.[ch] to common/
      btrfs-progs: move utils.[ch] to common/
      btrfs-progs: build: drop kernel-lib from -I and update paths
      btrfs-progs: move rbtree-utils.[ch] to common/
      btrfs-progs: fix helpinfo formats, short and options separation
      btrfs-progs: help: add helpinfo marker for global options
      btrfs-progs: define new output format: json
      btrfs-progs: help: define helper for command with flags
      btrfs-progs: output formatter infrastructure
      btrfs-progs: utils: split path related utils to own file
      btrfs-progs: path-utils: rename is_block_device
      btrfs-progs: path-utils: rename is_reg_file
      btrfs-progs: path-utils: rename is_mount_point
      btrfs-progs: path-utils: rename is_path_exist
      btrfs-progs: path-utils: rename is_existing_blk_or_reg_file
      btrfs-progs: path-utils: rename test_isdir
      btrfs-progs: utils: split device handling functions to own file
      btrfs-progs: utils: split device scanning functions to own file
      btrfs-progs: send: add gcc9 workaround for root item reset
      btrfs-progs: ci: rename travis/ to ci/
      btrfs-progs: tests: add helper to compare kernel versions
      btrfs-progs: tests: don't print dd transfer info
      btrfs-progs: tests: misc/021 run fs check with SUDO_HELPER
      btrfs-progs: test: add simple test for defrag recursion depth
      btrfs-progs: docs: update defrag regarding recursion
      btrfs-progs: docs: update fi du regarding recursion
      btrfs-progs: test: add simple test for 'fi du' recursion depth
      btrfs-progs: build most common tools into one binary (busybox style)
      btrfs-progs: document the new all-in-one binary
      btrfs-progs: tests: use common loop device helpers in misc-tests/021
      btrfs-progs: tests: common: add shell missing quotes
      btrfs-progs: tests: drop keyword function
      btrfs-progs: tests: add helper to compare kernel versions
      btrfs-progs: tests: request minimum kernel version for misc-tests/034-metadata-uuid
      btrfs-progs: kerncompat: define __always_inline conditionally
      btrfs-progs: build: add stub makefile to image and mkfs
      btrfs-progs: sb-mod: add remaining integer value types
      btrfs-progs: sb-mod: add remaining superblock integer items
      btrfs-progs: tests: make test-clean work without built binaries
      libbtrfsutil: add accessors for search header items
      libbtrfsutil: subvolume: use helpers to access search header
      btrfs-progs: update CHANGES for v5.2
      Btrfs progs v5.2

Graham R. Cobb (1):
      btrfs-progs: scrub: Fix scrub cancel/resume not to skip most of the disk

Grzegorz Kowal (1):
      btrfs-progs: scrub: show the scrubbing rate and estimated time to finish

Jeff Mahoney (12):
      btrfs-progs: qgroups: introduce and use info and limit structures
      btrfs-progs: qgroups: introduce btrfs_qgroup_query
      btrfs-progs: subvolume: add quota info to btrfs sub show
      btrfs-progs: help: convert ints used as bools to bool
      btrfs-progs: reorder placement of help declarations for send/receive
      btrfs-progs: filesystem balance: split out special handling
      btrfs-progs: use cmd_struct as command entry point
      btrfs-progs: pass cmd_struct to command callback function
      btrfs-progs: pass cmd_struct to clean_args_no_options{,_relaxed}
      btrfs-progs: pass cmd_struct to usage()
      btrfs-progs: handle command groups directly for common case
      btrfs-progs: add support for output formats

Nikolay Borisov (4):
      btrfs-progs: Remove redundant if
      btrfs-progs: Remove old commented code
      btrfs-progs: Remove old send buffer copy implementation
      btrfs-progs: check: Remove duplicated and commented functions

Qu Wenruo (10):
      btrfs-progs: image: Use SZ_* to replace intermediate size
      btrfs-progs: image: Fix a indent misalign
      btrfs-progs: image: Fix a access-beyond-boundary bug when there are 32 online CPUs
      btrfs-progs: image: Verify the superblock before restore
      btrfs-progs: Fix false ENOSPC alert by tracking used space correctly
      btrfs-progs: delayed-ref: Fix memory leak and use-after-free caused by wrong condition to free delayed ref/head.
      btrfs-progs: constify extent buffer reader
      btrfs-progs: Fix -Waddress-of-packed-member warning in btrfs_dev_stats_values callers
      btrfs-progs: Remove unnecessary fallthrough attribute in test_num_disk_vs_raid()
      btrfs-progs: Fix Wformat-overflow warning in cmds-receive.c

Su Yue (1):
      btrfs-progs: misc-tests/029: exit manually after run_mayfail()

pjw91 (1):
      btrfs-progs: restore: Fix input buffer handling