[PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Hans de Goede]

Hello Everyone,

Here is a resend of the 12th version of my cleaned-up / refactored version
of the VirtualBox shared-folder VFS driver. It seems that for some reason
only the cover letter of my initial-posting of v12 has made it to the list.

This version hopefully addresses all issues pointed out in David Howell's
review of v11 (thank you for the review David):

Changes in v12:
-Move make_kuid / make_kgid calls to option parsing time and add
 uid_valid / gid_valid checks.
-In init_fs_context call current_uid_gid() to init uid and gid
-Validate dmode, fmode, dmask and fmask options during option parsing
-Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
-Some small coding-style tweaks

For changes in older versions see the change log in the patch.

This version has been used by several distributions (arch, Fedora) for a
while now, so hopefully we can get this upstream soonish, please review.

Regards,

Hans

Re: [PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Randy Dunlap]

On 8/11/19 6:38 AM, Hans de Goede wrote:
> Hello Everyone,
> 
> Here is a resend of the 12th version of my cleaned-up / refactored version
> of the VirtualBox shared-folder VFS driver. It seems that for some reason
> only the cover letter of my initial-posting of v12 has made it to the list.
> 
> This version hopefully addresses all issues pointed out in David Howell's
> review of v11 (thank you for the review David):
> 
> Changes in v12:
> -Move make_kuid / make_kgid calls to option parsing time and add
>  uid_valid / gid_valid checks.
> -In init_fs_context call current_uid_gid() to init uid and gid
> -Validate dmode, fmode, dmask and fmask options during option parsing
> -Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
> -Some small coding-style tweaks
> 
> For changes in older versions see the change log in the patch.
> 
> This version has been used by several distributions (arch, Fedora) for a
> while now, so hopefully we can get this upstream soonish, please review.

Hi,
Still looks like patch 1/1 is not hitting the mailing list.
How large is it?

-- 
~Randy

Re: [PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Hans de Goede]

Hi,

On 8/11/19 5:07 PM, Randy Dunlap wrote:
> On 8/11/19 6:38 AM, Hans de Goede wrote:
>> Hello Everyone,
>>
>> Here is a resend of the 12th version of my cleaned-up / refactored version
>> of the VirtualBox shared-folder VFS driver. It seems that for some reason
>> only the cover letter of my initial-posting of v12 has made it to the list.
>>
>> This version hopefully addresses all issues pointed out in David Howell's
>> review of v11 (thank you for the review David):
>>
>> Changes in v12:
>> -Move make_kuid / make_kgid calls to option parsing time and add
>>   uid_valid / gid_valid checks.
>> -In init_fs_context call current_uid_gid() to init uid and gid
>> -Validate dmode, fmode, dmask and fmask options during option parsing
>> -Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
>> -Some small coding-style tweaks
>>
>> For changes in older versions see the change log in the patch.
>>
>> This version has been used by several distributions (arch, Fedora) for a
>> while now, so hopefully we can get this upstream soonish, please review.
> 
> Hi,
> Still looks like patch 1/1 is not hitting the mailing list.
> How large is it?

Thank you for catching this:

[hans@dhcp-44-196 linux]$ wc 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
   3754  14479 100991 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch

Regards,

Hans

Re: [PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Randy Dunlap]

On 8/11/19 8:09 AM, Hans de Goede wrote:
> Hi,
> 
> On 8/11/19 5:07 PM, Randy Dunlap wrote:
>> On 8/11/19 6:38 AM, Hans de Goede wrote:
>>> Hello Everyone,
>>>
>>> Here is a resend of the 12th version of my cleaned-up / refactored version
>>> of the VirtualBox shared-folder VFS driver. It seems that for some reason
>>> only the cover letter of my initial-posting of v12 has made it to the list.
>>>
>>> This version hopefully addresses all issues pointed out in David Howell's
>>> review of v11 (thank you for the review David):
>>>
>>> Changes in v12:
>>> -Move make_kuid / make_kgid calls to option parsing time and add
>>>   uid_valid / gid_valid checks.
>>> -In init_fs_context call current_uid_gid() to init uid and gid
>>> -Validate dmode, fmode, dmask and fmask options during option parsing
>>> -Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
>>> -Some small coding-style tweaks
>>>
>>> For changes in older versions see the change log in the patch.
>>>
>>> This version has been used by several distributions (arch, Fedora) for a
>>> while now, so hopefully we can get this upstream soonish, please review.
>>
>> Hi,
>> Still looks like patch 1/1 is not hitting the mailing list.
>> How large is it?
> 
> Thank you for catching this:
> 
> [hans@dhcp-44-196 linux]$ wc 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
>   3754  14479 100991 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch

That size shouldn't be a problem AFAIK.
Maybe there is something else in the patch that vger doesn't like.

  http://vger.kernel.org/majordomo-taboos.txt

-- 
~Randy

Re: [PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Randy Dunlap]

On 8/11/19 8:16 AM, Randy Dunlap wrote:
> On 8/11/19 8:09 AM, Hans de Goede wrote:
>> Hi,
>>
>> On 8/11/19 5:07 PM, Randy Dunlap wrote:
>>> On 8/11/19 6:38 AM, Hans de Goede wrote:
>>>> Hello Everyone,
>>>>
>>>> Here is a resend of the 12th version of my cleaned-up / refactored version
>>>> of the VirtualBox shared-folder VFS driver. It seems that for some reason
>>>> only the cover letter of my initial-posting of v12 has made it to the list.
>>>>
>>>> This version hopefully addresses all issues pointed out in David Howell's
>>>> review of v11 (thank you for the review David):
>>>>
>>>> Changes in v12:
>>>> -Move make_kuid / make_kgid calls to option parsing time and add
>>>>   uid_valid / gid_valid checks.
>>>> -In init_fs_context call current_uid_gid() to init uid and gid
>>>> -Validate dmode, fmode, dmask and fmask options during option parsing
>>>> -Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
>>>> -Some small coding-style tweaks
>>>>
>>>> For changes in older versions see the change log in the patch.
>>>>
>>>> This version has been used by several distributions (arch, Fedora) for a
>>>> while now, so hopefully we can get this upstream soonish, please review.
>>>
>>> Hi,
>>> Still looks like patch 1/1 is not hitting the mailing list.
>>> How large is it?
>>
>> Thank you for catching this:
>>
>> [hans@dhcp-44-196 linux]$ wc 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
>>   3754  14479 100991 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
> 
> That size shouldn't be a problem AFAIK.
> Maybe there is something else in the patch that vger doesn't like.
> 
>   http://vger.kernel.org/majordomo-taboos.txt
> 

"Message size exceeding 100 000 characters causes blocking."
from:  http://vger.kernel.org/majordomo-info.html

I thought the limit was higher than that.

-- 
~Randy

Re: [PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Hans de Goede]

Hi,

On 8/11/19 5:16 PM, Randy Dunlap wrote:
> On 8/11/19 8:09 AM, Hans de Goede wrote:
>> Hi,
>>
>> On 8/11/19 5:07 PM, Randy Dunlap wrote:
>>> On 8/11/19 6:38 AM, Hans de Goede wrote:
>>>> Hello Everyone,
>>>>
>>>> Here is a resend of the 12th version of my cleaned-up / refactored version
>>>> of the VirtualBox shared-folder VFS driver. It seems that for some reason
>>>> only the cover letter of my initial-posting of v12 has made it to the list.
>>>>
>>>> This version hopefully addresses all issues pointed out in David Howell's
>>>> review of v11 (thank you for the review David):
>>>>
>>>> Changes in v12:
>>>> -Move make_kuid / make_kgid calls to option parsing time and add
>>>>    uid_valid / gid_valid checks.
>>>> -In init_fs_context call current_uid_gid() to init uid and gid
>>>> -Validate dmode, fmode, dmask and fmask options during option parsing
>>>> -Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
>>>> -Some small coding-style tweaks
>>>>
>>>> For changes in older versions see the change log in the patch.
>>>>
>>>> This version has been used by several distributions (arch, Fedora) for a
>>>> while now, so hopefully we can get this upstream soonish, please review.
>>>
>>> Hi,
>>> Still looks like patch 1/1 is not hitting the mailing list.
>>> How large is it?
>>
>> Thank you for catching this:
>>
>> [hans@dhcp-44-196 linux]$ wc 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
>>    3754  14479 100991 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
> 
> That size shouldn't be a problem AFAIK.
> Maybe there is something else in the patch that vger doesn't like.
> 
>    http://vger.kernel.org/majordomo-taboos.txt

I don't see anything there which is in the patch AFAICT :|

Regards,

Hans

Re: [PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Randy Dunlap]

On 8/11/19 8:31 AM, Randy Dunlap wrote:
> On 8/11/19 8:16 AM, Randy Dunlap wrote:
>> On 8/11/19 8:09 AM, Hans de Goede wrote:
>>> Hi,
>>>
>>> On 8/11/19 5:07 PM, Randy Dunlap wrote:
>>>> On 8/11/19 6:38 AM, Hans de Goede wrote:
>>>>> Hello Everyone,
>>>>>
>>>>> Here is a resend of the 12th version of my cleaned-up / refactored version
>>>>> of the VirtualBox shared-folder VFS driver. It seems that for some reason
>>>>> only the cover letter of my initial-posting of v12 has made it to the list.
>>>>>
>>>>> This version hopefully addresses all issues pointed out in David Howell's
>>>>> review of v11 (thank you for the review David):
>>>>>
>>>>> Changes in v12:
>>>>> -Move make_kuid / make_kgid calls to option parsing time and add
>>>>>   uid_valid / gid_valid checks.
>>>>> -In init_fs_context call current_uid_gid() to init uid and gid
>>>>> -Validate dmode, fmode, dmask and fmask options during option parsing
>>>>> -Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
>>>>> -Some small coding-style tweaks
>>>>>
>>>>> For changes in older versions see the change log in the patch.
>>>>>
>>>>> This version has been used by several distributions (arch, Fedora) for a
>>>>> while now, so hopefully we can get this upstream soonish, please review.
>>>>
>>>> Hi,
>>>> Still looks like patch 1/1 is not hitting the mailing list.
>>>> How large is it?
>>>
>>> Thank you for catching this:
>>>
>>> [hans@dhcp-44-196 linux]$ wc 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
>>>   3754  14479 100991 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
>>
>> That size shouldn't be a problem AFAIK.
>> Maybe there is something else in the patch that vger doesn't like.
>>
>>   http://vger.kernel.org/majordomo-taboos.txt
>>
> 
> "Message size exceeding 100 000 characters causes blocking."
> from:  http://vger.kernel.org/majordomo-info.html
> 
> I thought the limit was higher than that.
> 

Looks like it is higher for linux-kernel@vger.kernel.org but maybe not
for other mailing lists.
I certainly see larger messages on lkml.

-- 
~Randy

Re: [PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Hans de Goede]

Hi,

On 8/11/19 5:31 PM, Randy Dunlap wrote:
> On 8/11/19 8:16 AM, Randy Dunlap wrote:
>> On 8/11/19 8:09 AM, Hans de Goede wrote:
>>> Hi,
>>>
>>> On 8/11/19 5:07 PM, Randy Dunlap wrote:
>>>> On 8/11/19 6:38 AM, Hans de Goede wrote:
>>>>> Hello Everyone,
>>>>>
>>>>> Here is a resend of the 12th version of my cleaned-up / refactored version
>>>>> of the VirtualBox shared-folder VFS driver. It seems that for some reason
>>>>> only the cover letter of my initial-posting of v12 has made it to the list.
>>>>>
>>>>> This version hopefully addresses all issues pointed out in David Howell's
>>>>> review of v11 (thank you for the review David):
>>>>>
>>>>> Changes in v12:
>>>>> -Move make_kuid / make_kgid calls to option parsing time and add
>>>>>    uid_valid / gid_valid checks.
>>>>> -In init_fs_context call current_uid_gid() to init uid and gid
>>>>> -Validate dmode, fmode, dmask and fmask options during option parsing
>>>>> -Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
>>>>> -Some small coding-style tweaks
>>>>>
>>>>> For changes in older versions see the change log in the patch.
>>>>>
>>>>> This version has been used by several distributions (arch, Fedora) for a
>>>>> while now, so hopefully we can get this upstream soonish, please review.
>>>>
>>>> Hi,
>>>> Still looks like patch 1/1 is not hitting the mailing list.
>>>> How large is it?
>>>
>>> Thank you for catching this:
>>>
>>> [hans@dhcp-44-196 linux]$ wc 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
>>>    3754  14479 100991 0001-fs-Add-VirtualBox-guest-shared-folder-vboxsf-support.patch
>>
>> That size shouldn't be a problem AFAIK.
>> Maybe there is something else in the patch that vger doesn't like.
>>
>>    http://vger.kernel.org/majordomo-taboos.txt
>>
> 
> "Message size exceeding 100 000 characters causes blocking."
> from:  http://vger.kernel.org/majordomo-info.html
> 
> I thought the limit was higher than that.

Thank you for this info. I've trimmed the changelog below the ---
in the commit messages, moving it to the coverletter, this
brings the size down to aprox. 96000 chars and I've done another
resend. Can you please let me know (offlist) if this one has
successfully made it to the list?

Regards,

Hans

[PATCH v12 resend 0/1] fs: Add VirtualBox guest shared folder (vboxsf)

[Hans de Goede]

Hello Everyone,

Here is a second resend of the 12th version of my cleaned-up / refactored
version of the VirtualBox shared-folder VFS driver. It seems that the list
does not like patches being over 100000 char, so this time I've trimmed
the changelog below the --- in the commit messages, if you still want to
see the full changelog, see the end of this coverletter.

This version hopefully addresses all issues pointed out in David Howell's
review of v11 (thank you for the review David):

Changes in v12:
-Move make_kuid / make_kgid calls to option parsing time and add
 uid_valid / gid_valid checks.
-In init_fs_context call current_uid_gid() to init uid and gid
-Validate dmode, fmode, dmask and fmask options during option parsing
-Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
-Some small coding-style tweaks

This version has been used by several distributions (arch, Fedora) for a
while now, so hopefully we can get this upstream soonish, please review.

Regards,

Hans

---

Full changelog:

Changes in v12:
-Move make_kuid / make_kgid calls to option parsing time and add
 uid_valid / gid_valid checks.
-In init_fs_context call current_uid_gid() to init uid and gid
-Validate dmode, fmode, dmask and fmask options during option parsing
-Use correct types for various mount option variables (kuid_t, kgid_t, umode_t)
-Some small coding-style tweaks

Changes in v11:
-Convert to the new Documentation/filesystems/mount_api.txt mount API
-Fixed all the function kerneldoc comments to have things in the proper order
-Change type of d_type variable passed as type to dir_emit from int to
 unsigned int
-Replaced the fake-ino overflow test with the one suggested by David Howells
-Fixed various coding style issues

Changes in v10:
-Code-style fixes and remove some unneeded checks as suggested by Al Viro
-Stop handle reuse between sf_create_aux and sf_reg_open, the code for this
 was racy and the re-use meant the O_APPEND was not passed to the host for
 newly created files with O_APPEND set
-Use idr to generate unique inode number, modelled after the kernfs code
-Only read and write the contents of the passed in offset pointer once in
 sf_reg_write
-Keep a list of refcounted open handles in the inode, so that writepage can
 get a writeable handle this way. This replaces the old very racy code which
 was just storing a pointer to the last opened struct file inside the inode.
 This is modelled after how the cifs and fuse code do this

Changes in v9:
-Change license from GPL-2.0 or CDDL-1.0 to MIT, following upstream's
 license change from: https://www.virtualbox.org/changeset/72627/vbox
 I've gotten permission by email from VirtualBox upstream to retro-actively
 apply the license-change to my "fork" of the vboxsf code
-Fix not being able to mount any shared-folders when built with gcc9
-Adjust for recent vboxguest changes
-Fix potential buffer overrun in vboxsf_nlscpy
-Fix build errors in some configs, caught by buildbot
-Fix 3 sparse warnings
-Some changes from upstream VirtualBox svn:
 -Use 0x786f4256 /* 'VBox' little endian */ as super-magic matching upstream
 -Implement AT_STATX_SYNC_TYPE support
 -Properly return -EPERM when symlink creation is not supported

Changes in v8:
-Fix broken error-handling / oops when the vboxsf_map_folder() call fails
-Fix umount using umount.nfs to umount vboxsf mounts
-Prefixed the modules init and exit function names with vboxsf_
-Delay connecting to the vbox hypervisor until the first mount, this fixes
 vboxsf not working when it is builtin (in which case it may be initialized
 before the vboxguest driver has bound to the guest communication PCI device)
-Fix sf_write_end return value, return the number of bytes written or 0 on error:
 https://github.com/jwrdegoede/vboxsf/issues/2
-Use an ida id in the name passed to super_setup_bdi_name so that the same
 shared-folder can be mounted twice without causing a
 "sysfs: cannot create duplicate filename" error
 https://github.com/jwrdegoede/vboxsf/issues/3

Changes in v7:
-Do not propagate sgid / suid bits between guest-host, note hosts with
 VirtualBox version 5.2.6 or newer will filter these out regardless of what
 we do
-Better error messages when we cannot connect to the VirtualBox guest PCI
 device, which may e.g. happen when trying to use vboxsf outside a vbox vm

Changes in v6:
-Address: https://www.virtualbox.org/ticket/819 which really is multiple bugs:
 1) Fix MAP_SHARED not being supported
 2) Fix changes done through regular read/write on the guest side not being
    seen by guest apps using mmap() access
 3) Fix any changes done on the host side not being seen by guest apps using
    mmap() access

Changes in v5:
-Honor CONFIG_NLS_DEFAULT (reported-by michael.thayer@oracle.com)

Changes in v4:
-Drop "name=..." mount option, instead use the dev_name argument to the
 mount syscall, to keep compatibility with existing fstab entries
-Fix "nls=%" match_table_t entry to "nls=%s"

Changes in v3:
-Use text only mount options, instead of a custom data struct
-Stop caching full path in inode data, if parents gets renamed it will change
-Fixed negative dentries handling
-Dropped the force_reread flag for dirs, not sure what it was actually for
 but it is no good, doing a re-read on unlink of a file will lead to
 another file being skipped if the caller has already iterated over the
 entry for the unlinked file.
-Use file_inode(), file_dentry() and d_inode() helpers
-Prefix any non object-private symbols with vboxsf_ so as to not pollute
 the global namespace when builtin
-Add MAINTAINERS entry
-Misc. cleanups

Changes in v2:
-Removed various unused wrapper functions
-Don't use i_private, instead defined alloc_inode and destroy_inode
 methods and use container_of.
-Drop obsolete comment referencing people to
 http://www.atnf.csiro.au/people/rgooch/linux/vfs.txt
-move the single symlink op of from lnkops.c to file.c
-Use SPDX license headers
-Replace SHFLROOT / SHFLHANDLE defines with normal types
-Removed unnecessary S_ISREG checks
-Got rid of bounce_buffer in regops, instead add a "user" flag to
 vboxsf_read / vboxsf_write, re-using the existing __user address support
 in the vboxguest module
-Make vboxsf_wrappers return regular linux errno values
-Use i_size_write to update size on writing
-Convert doxygen style comments to kerneldoc style comments