From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jens Axboe Subject: Re: [Lsf-pc] [LSF/MM TOPIC] async buffered diskio read for userspace apps Date: Fri, 23 Jan 2015 19:17:05 -0700 Message-ID: <54C300A1.7040202@kernel.dk> References: <20150115223157.GB25884@quack.suse.cz> <20150116165506.GA10856@samba2> <20150119071218.GA9747@jeremy-HP> <1421652849.2080.20.camel@HansenPartnership.com> <54BD234F.3060203@kernel.dk> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Cc: Volker Lendecke , James Bottomley , Jeremy Allison , Jan Kara , Christoph Hellwig , linux-mm , "linux-fsdevel@vger.kernel.org" , "lsf-pc@lists.linux-foundation.org" To: Steve French , Milosz Tanski Return-path: Received: from mail-pd0-f169.google.com ([209.85.192.169]:41971 "EHLO mail-pd0-f169.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750836AbbAXCRI (ORCPT ); Fri, 23 Jan 2015 21:17:08 -0500 Received: by mail-pd0-f169.google.com with SMTP id g10so1175880pdj.0 for ; Fri, 23 Jan 2015 18:17:07 -0800 (PST) In-Reply-To: Sender: linux-fsdevel-owner@vger.kernel.org List-ID: On 01/23/2015 04:15 PM, Steve French wrote: > On Mon, Jan 19, 2015 at 10:20 AM, Milosz Tanski wrote: >> On Mon, Jan 19, 2015 at 11:10 AM, Volker Lendecke >> wrote: >>> On Mon, Jan 19, 2015 at 08:31:27AM -0700, Jens Axboe wrote: >>>> I didn't look at your code yet, but I'm assuming it's a self >>>> contained IO engine. So we should be able to make that work, by only >>>> linking the engine itself against libsmbclient. But sheesh, what a >>>> pain in the butt, why can't we just all be friends. >>> >>> The published libsmbclient API misses the async features >>> that are needed here. Milosz needs to go lower-level. >>> >>> Volker >> >> Volker, the sync code path works; in fact I pushed some minor >> corrections to my branch this morning. And for now using FIO I can >> generate multiple clients (threads / processes). >> >> I started working on the async features (SMB2 async read/write) for >> client library the samba repo. There's a patch there for the first >> step of it it there; see the other email I sent to you and Jeremy. I >> was going to make sure it licensed under whatever it needs to get into >> the samba repo... and since this is done on my own time I personally >> don't care what license it's under provided it's not a PITA. > > Why not do the async read/write via the kernel client if the license > is an issue? It already has async SMB2/SMB3 operations > (with a synchronous send/receive-like wrapper). The license issue has been solved. Fio is cross platform, so would be preferable to have this work through libsmbclient, if at all possible. -- Jens Axboe From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pd0-f177.google.com (mail-pd0-f177.google.com [209.85.192.177]) by kanga.kvack.org (Postfix) with ESMTP id 1993E6B0032 for ; Fri, 23 Jan 2015 21:17:10 -0500 (EST) Received: by mail-pd0-f177.google.com with SMTP id y13so1130712pdi.8 for ; Fri, 23 Jan 2015 18:17:09 -0800 (PST) Received: from mail-pd0-f170.google.com (mail-pd0-f170.google.com. [209.85.192.170]) by mx.google.com with ESMTPS id ry9si3964769pbc.147.2015.01.23.18.17.07 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 23 Jan 2015 18:17:08 -0800 (PST) Received: by mail-pd0-f170.google.com with SMTP id p10so1167218pdj.1 for ; Fri, 23 Jan 2015 18:17:07 -0800 (PST) Message-ID: <54C300A1.7040202@kernel.dk> Date: Fri, 23 Jan 2015 19:17:05 -0700 From: Jens Axboe MIME-Version: 1.0 Subject: Re: [Lsf-pc] [LSF/MM TOPIC] async buffered diskio read for userspace apps References: <20150115223157.GB25884@quack.suse.cz> <20150116165506.GA10856@samba2> <20150119071218.GA9747@jeremy-HP> <1421652849.2080.20.camel@HansenPartnership.com> <54BD234F.3060203@kernel.dk> In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Sender: owner-linux-mm@kvack.org List-ID: To: Steve French , Milosz Tanski Cc: Volker Lendecke , James Bottomley , Jeremy Allison , Jan Kara , Christoph Hellwig , linux-mm , "linux-fsdevel@vger.kernel.org" , "lsf-pc@lists.linux-foundation.org" On 01/23/2015 04:15 PM, Steve French wrote: > On Mon, Jan 19, 2015 at 10:20 AM, Milosz Tanski wrote: >> On Mon, Jan 19, 2015 at 11:10 AM, Volker Lendecke >> wrote: >>> On Mon, Jan 19, 2015 at 08:31:27AM -0700, Jens Axboe wrote: >>>> I didn't look at your code yet, but I'm assuming it's a self >>>> contained IO engine. So we should be able to make that work, by only >>>> linking the engine itself against libsmbclient. But sheesh, what a >>>> pain in the butt, why can't we just all be friends. >>> >>> The published libsmbclient API misses the async features >>> that are needed here. Milosz needs to go lower-level. >>> >>> Volker >> >> Volker, the sync code path works; in fact I pushed some minor >> corrections to my branch this morning. And for now using FIO I can >> generate multiple clients (threads / processes). >> >> I started working on the async features (SMB2 async read/write) for >> client library the samba repo. There's a patch there for the first >> step of it it there; see the other email I sent to you and Jeremy. I >> was going to make sure it licensed under whatever it needs to get into >> the samba repo... and since this is done on my own time I personally >> don't care what license it's under provided it's not a PITA. > > Why not do the async read/write via the kernel client if the license > is an issue? It already has async SMB2/SMB3 operations > (with a synchronous send/receive-like wrapper). The license issue has been solved. Fio is cross platform, so would be preferable to have this work through libsmbclient, if at all possible. -- Jens Axboe -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org