From mboxrd@z Thu Jan 1 00:00:00 1970 From: Milosz Tanski Subject: Re: [Lsf-pc] [LSF/MM TOPIC] async buffered diskio read for userspace apps Date: Mon, 19 Jan 2015 11:20:50 -0500 Message-ID: References: <20150115223157.GB25884@quack.suse.cz> <20150116165506.GA10856@samba2> <20150119071218.GA9747@jeremy-HP> <1421652849.2080.20.camel@HansenPartnership.com> <54BD234F.3060203@kernel.dk> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Cc: Jens Axboe , James Bottomley , Jeremy Allison , Jan Kara , Christoph Hellwig , linux-mm@kvack.org, "linux-fsdevel@vger.kernel.org" , lsf-pc@lists.linux-foundation.org To: Volker Lendecke Return-path: Received: from mail-lb0-f180.google.com ([209.85.217.180]:54334 "EHLO mail-lb0-f180.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751143AbbASQUx (ORCPT ); Mon, 19 Jan 2015 11:20:53 -0500 Received: by mail-lb0-f180.google.com with SMTP id b6so3527674lbj.11 for ; Mon, 19 Jan 2015 08:20:50 -0800 (PST) In-Reply-To: Sender: linux-fsdevel-owner@vger.kernel.org List-ID: On Mon, Jan 19, 2015 at 11:10 AM, Volker Lendecke wrote: > On Mon, Jan 19, 2015 at 08:31:27AM -0700, Jens Axboe wrote: >> I didn't look at your code yet, but I'm assuming it's a self >> contained IO engine. So we should be able to make that work, by only >> linking the engine itself against libsmbclient. But sheesh, what a >> pain in the butt, why can't we just all be friends. > > The published libsmbclient API misses the async features > that are needed here. Milosz needs to go lower-level. > > Volker Volker, the sync code path works; in fact I pushed some minor corrections to my branch this morning. And for now using FIO I can generate multiple clients (threads / processes). I started working on the async features (SMB2 async read/write) for client library the samba repo. There's a patch there for the first step of it it there; see the other email I sent to you and Jeremy. I was going to make sure it licensed under whatever it needs to get into the samba repo... and since this is done on my own time I personally don't care what license it's under provided it's not a PITA. -- Milosz Tanski CTO 16 East 34th Street, 15th floor New York, NY 10016 p: 646-253-9055 e: milosz@adfin.com From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-lb0-f170.google.com (mail-lb0-f170.google.com [209.85.217.170]) by kanga.kvack.org (Postfix) with ESMTP id B627D6B0032 for ; Mon, 19 Jan 2015 11:26:16 -0500 (EST) Received: by mail-lb0-f170.google.com with SMTP id 10so28937520lbg.1 for ; Mon, 19 Jan 2015 08:26:16 -0800 (PST) Received: from mail-lb0-f173.google.com (mail-lb0-f173.google.com. [209.85.217.173]) by mx.google.com with ESMTPS id aa1si12422470lbc.24.2015.01.19.08.20.50 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 19 Jan 2015 08:20:50 -0800 (PST) Received: by mail-lb0-f173.google.com with SMTP id p9so5775258lbv.4 for ; Mon, 19 Jan 2015 08:20:50 -0800 (PST) MIME-Version: 1.0 In-Reply-To: References: <20150115223157.GB25884@quack.suse.cz> <20150116165506.GA10856@samba2> <20150119071218.GA9747@jeremy-HP> <1421652849.2080.20.camel@HansenPartnership.com> <54BD234F.3060203@kernel.dk> Date: Mon, 19 Jan 2015 11:20:50 -0500 Message-ID: Subject: Re: [Lsf-pc] [LSF/MM TOPIC] async buffered diskio read for userspace apps From: Milosz Tanski Content-Type: text/plain; charset=UTF-8 Sender: owner-linux-mm@kvack.org List-ID: To: Volker Lendecke Cc: Jens Axboe , James Bottomley , Jeremy Allison , Jan Kara , Christoph Hellwig , linux-mm@kvack.org, "linux-fsdevel@vger.kernel.org" , lsf-pc@lists.linux-foundation.org On Mon, Jan 19, 2015 at 11:10 AM, Volker Lendecke wrote: > On Mon, Jan 19, 2015 at 08:31:27AM -0700, Jens Axboe wrote: >> I didn't look at your code yet, but I'm assuming it's a self >> contained IO engine. So we should be able to make that work, by only >> linking the engine itself against libsmbclient. But sheesh, what a >> pain in the butt, why can't we just all be friends. > > The published libsmbclient API misses the async features > that are needed here. Milosz needs to go lower-level. > > Volker Volker, the sync code path works; in fact I pushed some minor corrections to my branch this morning. And for now using FIO I can generate multiple clients (threads / processes). I started working on the async features (SMB2 async read/write) for client library the samba repo. There's a patch there for the first step of it it there; see the other email I sent to you and Jeremy. I was going to make sure it licensed under whatever it needs to get into the samba repo... and since this is done on my own time I personally don't care what license it's under provided it's not a PITA. -- Milosz Tanski CTO 16 East 34th Street, 15th floor New York, NY 10016 p: 646-253-9055 e: milosz@adfin.com -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org