From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Return-Path: Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Playing with BFQ From: Paolo Valente In-Reply-To: Date: Tue, 16 May 2017 10:45:00 +0200 Cc: Markus Trippelsdorf , Jens Axboe , Ulf Hansson , linux-block@vger.kernel.org, Goldwyn Rodrigues , Mark Brown Message-Id: <46E25DBE-D153-4517-B6F7-5C32424E1332@linaro.org> References: <20170502080044.GA292@x4> <20170502121605.GA294@x4> To: sedat.dilek@gmail.com List-ID: > Il giorno 13 mag 2017, alle ore 09:50, Sedat Dilek = ha scritto: >=20 > On Wed, May 3, 2017 at 11:21 AM, Paolo Valente = wrote: >>=20 >>> Il giorno 03 mag 2017, alle ore 10:00, Sedat Dilek = ha scritto: >>>=20 >>> On Tue, May 2, 2017 at 2:16 PM, Markus Trippelsdorf >>> wrote: >>>> On 2017.05.02 at 14:07 +0200, Sedat Dilek wrote: >>>>> On Tue, May 2, 2017 at 10:00 AM, Markus Trippelsdorf >>>>> wrote: >>>>>> On 2017.05.02 at 09:54 +0200, Sedat Dilek wrote: >>>>>>> Hi, >>>>>>>=20 >>>>>>> I want to play with BFQ. >>>>>>>=20 >>>>>>> My base is block-next as of 28-Apr-2017. >>>>> [...] >>>>>>> Not sure if the attached patches make sense (right now). >>>>>>=20 >>>>>> No, it doesn't make sense at all. >>>>>=20 >>>>> Hmm, I looked at 4.11.0-v8r11 and 0001 has exactly what my 2 = patches do :-). >>>>=20 >>>> BFQ started as a conventional scheduler. But because mq is the way = of >>>> the future it was ported before it was accepted into mainline. >>>>=20 >>>=20 >>> I am still playing and want to do my own experiences with BFQ. >>>=20 >>> Not sure if FIO is a good testcase-tool here. >>>=20 >>=20 >> If you want to perform a thorough benchmarking of also responsiveness >> and latency for time-sensitive applications (such as video playing) >> then you may want to use S [1]. It's rather rustic, do ask if you >> encounter any difficulty. >>=20 >> [1] https://github.com/Algodev-github/S >>=20 >=20 > Sorry for the delay. Don't worry, I'm replying late too ... > Currently, I am swittching from Ubuntu/precise 12.04 LTS (EOL) back to > the Debian world. >=20 > The responsiveness is really bad when my mlocate cron-job, a git pull > on linux.git and firefox runs parallel. Thanks for reporting this issue. I have a few considerations and requests for information on it. 1) Two of the three sources of I/O you mention, namely mlocate update and git pull, are doing writes. As I already pointed in a few occasions and places, intense write workloads trigger problems that an I/O scheduler cannot solve. In contrast, these problems *can* be solved using BFQ. In particular, I already have a prototype solution, but I have't found support yet to turn it into a possible production-level solution; till a few days, ago, when I talked about this with Goldwyn Rodrigues (in CC). He seems interested in having a look at this solution, and possibly collaborating on it. 2) A web browser like Firefox can generate extremely varying workloads; so, if you mentioned Firefox as one of the sources of I/O in your unlucky situation, then it would be important to know what Firefox was doing. 3) Even if BFQ cannot counteract problems occurring above its head, it usually improves responsiveness even in heavy-write scenarios. It would then be interesting if you could compare responsiveness with the other I/O schedulers (mq-deadline, Kyber) and with none too (make sure that the I/O is really the same in all cases). > This is with Linux v4.11.1-rc1 and BFQ patchset v4.11.0-v8r11. >=20 > My linux-config is attached. >=20 >>> So if MQ is the way why isn't the Kconfig called = CONFIG_MQ_IOSCHED_BFQ >>> according to CONFIG_MQ_IOSCHED_DEADLINE? >>>=20 >>> As we are talking about "*Storage* I/O schedulers" which of the MQ >>> Kconfig make sense when using MQ_DEADLINE and (MQ_)BFQ? >>>=20 >>> # egrep -i 'bfq|deadline|_mq|mq_|_mq_' = /boot/config-4.11.0-1-bfq-amd64 >>> CONFIG_POSIX_MQUEUE=3Dy >>> CONFIG_POSIX_MQUEUE_SYSCTL=3Dy >>> CONFIG_BLK_WBT_MQ=3Dy >>> CONFIG_BLK_MQ_PCI=3Dy >>> CONFIG_BLK_MQ_VIRTIO=3Dy >>> CONFIG_IOSCHED_DEADLINE=3Dy >>> CONFIG_IOSCHED_BFQ=3Dy >>> CONFIG_BFQ_GROUP_IOSCHED=3Dy >>> # CONFIG_DEFAULT_DEADLINE is not set >>> CONFIG_DEFAULT_BFQ=3Dy >>> CONFIG_DEFAULT_IOSCHED=3D"bfq" >>> CONFIG_MQ_IOSCHED_DEADLINE=3Dy >>> # CONFIG_NET_SCH_MQPRIO is not set >>> CONFIG_SCSI_MQ_DEFAULT=3Dy >>> # CONFIG_DM_MQ_DEFAULT is not set >>>=20 >>=20 >> The config for BFQ seems correct. For the others, it depends on what >> scheduler you want. If useful for you, the other two MQ- schedulers >> are mq-deadline and cyber. >>=20 >=20 > What about those two (Kconfig) patches which is in your current > bfq-4.11.y patchset. >=20 I'm not sure I fully understand the purpose of the two patches you propose (in your following emails). The first patch seems to move BFQ config options to a different position in Kconfig.iosched, but the position of those items should be irrelevant. Am I missing something? The second patch seems to have to do with configuration bits of bfq for blk, yet such a bfq version is not available in mainline. In any case, for possible new submissions, you should inline your patches. For complete instructions on submitting patches, have a look at Documentation/process/submitting-patches Thanks, Paolo > Thanks Sedat. >