ceph-fuse is working on FreeBSD

ceph-fuse is working on FreeBSD

[Willem Jan Withagen]

Hi,

I needed some more skills to actually get everythingin place to get it
working. But in essence I have ceph-fuse running...

wjw# df | grep fuse
/dev/fuse 9168256790 203540395 8964716395 2%    /zfs/home/wjw/mnt/zfs
/dev/fuse 8241876992  60174336 8181702656 1%    /zfs/home/wjw/mnt/cephf

wjw# ls ~/mnt/cephfs/
wjw# touch ~/mnt/cephfs//test
wjw# ~/mnt/cephfs/
test

So we are slowly getting there....

--WjW

Re: ceph-fuse is working on FreeBSD

[John Spray]

Nice!

On Wed, Mar 29, 2017 at 5:08 PM, Willem Jan Withagen <wjw@digiware.nl> wrote:
> Hi,
>
> I needed some more skills to actually get everythingin place to get it
> working. But in essence I have ceph-fuse running...
>
> wjw# df | grep fuse
> /dev/fuse 9168256790 203540395 8964716395 2%    /zfs/home/wjw/mnt/zfs
> /dev/fuse 8241876992  60174336 8181702656 1%    /zfs/home/wjw/mnt/cephf
>
> wjw# ls ~/mnt/cephfs/
> wjw# touch ~/mnt/cephfs//test
> wjw# ~/mnt/cephfs/
> test
>
> So we are slowly getting there....
>
> --WjW
>
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: ceph-fuse is working on FreeBSD

[Gregory Farnum]

Sweet! Try pjd yet? ;)

On Wed, Mar 29, 2017 at 9:08 AM, Willem Jan Withagen <wjw@digiware.nl> wrote:
> Hi,
>
> I needed some more skills to actually get everythingin place to get it
> working. But in essence I have ceph-fuse running...
>
> wjw# df | grep fuse
> /dev/fuse 9168256790 203540395 8964716395 2%    /zfs/home/wjw/mnt/zfs
> /dev/fuse 8241876992  60174336 8181702656 1%    /zfs/home/wjw/mnt/cephf
>
> wjw# ls ~/mnt/cephfs/
> wjw# touch ~/mnt/cephfs//test
> wjw# ~/mnt/cephfs/
> test
>
> So we are slowly getting there....
>
> --WjW
>
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: ceph-fuse is working on FreeBSD

[Willem Jan Withagen]

On 29-3-2017 18:12, Gregory Farnum wrote:
> Sweet! Try pjd yet? ;)

I guess you missed the "slowly" part..... 8-D

I was able to cp -r a small tree to it. Which I think is already a major
one for me.

That said, I know that the FreeBSD fuse interface is "fragile", and I
have seen users complain about loose bits and pieces.

--WjW


> On Wed, Mar 29, 2017 at 9:08 AM, Willem Jan Withagen <wjw@digiware.nl> wrote:
>> Hi,
>>
>> I needed some more skills to actually get everythingin place to get it
>> working. But in essence I have ceph-fuse running...
>>
>> wjw# df | grep fuse
>> /dev/fuse 9168256790 203540395 8964716395 2%    /zfs/home/wjw/mnt/zfs
>> /dev/fuse 8241876992  60174336 8181702656 1%    /zfs/home/wjw/mnt/cephf
>>
>> wjw# ls ~/mnt/cephfs/
>> wjw# touch ~/mnt/cephfs//test
>> wjw# ~/mnt/cephfs/
>> test
>>
>> So we are slowly getting there....
>>
>> --WjW
>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: ceph-fuse is working on FreeBSD

[Alan Somers]

Awesome news.  Keep up the good work, Willem.
-Alan

On Wed, Mar 29, 2017 at 10:18 AM, Willem Jan Withagen <wjw@digiware.nl> wrote:
> On 29-3-2017 18:12, Gregory Farnum wrote:
>> Sweet! Try pjd yet? ;)
>
> I guess you missed the "slowly" part..... 8-D
>
> I was able to cp -r a small tree to it. Which I think is already a major
> one for me.
>
> That said, I know that the FreeBSD fuse interface is "fragile", and I
> have seen users complain about loose bits and pieces.
>
> --WjW
>
>
>> On Wed, Mar 29, 2017 at 9:08 AM, Willem Jan Withagen <wjw@digiware.nl> wrote:
>>> Hi,
>>>
>>> I needed some more skills to actually get everythingin place to get it
>>> working. But in essence I have ceph-fuse running...
>>>
>>> wjw# df | grep fuse
>>> /dev/fuse 9168256790 203540395 8964716395 2%    /zfs/home/wjw/mnt/zfs
>>> /dev/fuse 8241876992  60174336 8181702656 1%    /zfs/home/wjw/mnt/cephf
>>>
>>> wjw# ls ~/mnt/cephfs/
>>> wjw# touch ~/mnt/cephfs//test
>>> wjw# ~/mnt/cephfs/
>>> test
>>>
>>> So we are slowly getting there....
>>>
>>> --WjW
>>>
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: ceph-fuse is working on FreeBSD

[Willem Jan Withagen]

On 29-3-2017 18:12, Gregory Farnum wrote:
> Sweet! Try pjd yet? ;)

I now know why pjd sounded so familiar. Pawel Jakub Dawidek
<pawel@dawidek.net> was the person that ported ZFS to FreeBSD and did an
excellent at that. I guess that this was his testbed to see if
everything was working as should.

Now my questions about this:
 - You select UFS as testing FS?
 - What coverage do you get from running the test?

Like what I just tried gave me tons of errors on chflags and device
operations etc...

The other thing is I need to remake my cephfs, it complains it is about
17x to small if I look at the pgs :(
So got to look in dimensioning cephfs.

--WjW


> On Wed, Mar 29, 2017 at 9:08 AM, Willem Jan Withagen <wjw@digiware.nl> wrote:
>> Hi,
>>
>> I needed some more skills to actually get everythingin place to get it
>> working. But in essence I have ceph-fuse running...
>>
>> wjw# df | grep fuse
>> /dev/fuse 9168256790 203540395 8964716395 2%    /zfs/home/wjw/mnt/zfs
>> /dev/fuse 8241876992  60174336 8181702656 1%    /zfs/home/wjw/mnt/cephf
>>
>> wjw# ls ~/mnt/cephfs/
>> wjw# touch ~/mnt/cephfs//test
>> wjw# ~/mnt/cephfs/
>> test
>>
>> So we are slowly getting there....
>>
>> --WjW
>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: ceph-fuse is working on FreeBSD

[Gregory Farnum]

Eek, sorry this got lost in my inbox.

On Thu, Mar 30, 2017 at 2:59 AM, Willem Jan Withagen <wjw@digiware.nl> wrote:
> On 29-3-2017 18:12, Gregory Farnum wrote:
>> Sweet! Try pjd yet? ;)
>
> I now know why pjd sounded so familiar. Pawel Jakub Dawidek
> <pawel@dawidek.net> was the person that ported ZFS to FreeBSD and did an
> excellent at that. I guess that this was his testbed to see if
> everything was working as should.
>
> Now my questions about this:
>  - You select UFS as testing FS?

I don't think we did anything explicit here; it's just whatever
pjd-on-linux does by default. I would guess UFS is the closest
equivalent on BSD, but can't be sure. :/

>  - What coverage do you get from running the test?

It invokes most of the fs-related syscalls in most of the ways they
can be tested? Not sure what you mean.

>
> Like what I just tried gave me tons of errors on chflags and device
> operations etc...

I'm not familiar with chflags, but as I look at the manpage that looks
like a BSD thing with a bunch of flags Linux doesn't support? So Ceph
definitely won't do well with that.
-Greg

>
> The other thing is I need to remake my cephfs, it complains it is about
> 17x to small if I look at the pgs :(
> So got to look in dimensioning cephfs.
>
> --WjW
>
>
>> On Wed, Mar 29, 2017 at 9:08 AM, Willem Jan Withagen <wjw@digiware.nl> wrote:
>>> Hi,
>>>
>>> I needed some more skills to actually get everythingin place to get it
>>> working. But in essence I have ceph-fuse running...
>>>
>>> wjw# df | grep fuse
>>> /dev/fuse 9168256790 203540395 8964716395 2%    /zfs/home/wjw/mnt/zfs
>>> /dev/fuse 8241876992  60174336 8181702656 1%    /zfs/home/wjw/mnt/cephf
>>>
>>> wjw# ls ~/mnt/cephfs/
>>> wjw# touch ~/mnt/cephfs//test
>>> wjw# ~/mnt/cephfs/
>>> test
>>>
>>> So we are slowly getting there....
>>>
>>> --WjW
>>>
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>