From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-dm3nam03on0059.outbound.protection.outlook.com ([104.47.41.59]:25496 "EHLO NAM03-DM3-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751640AbdCBWJW (ORCPT ); Thu, 2 Mar 2017 17:09:22 -0500 From: Chris Taylor Subject: RE: FIO log averaging issue with --write_bw_log and --write_iops_log using > 1000 log_avg_msec values Date: Thu, 2 Mar 2017 21:52:29 +0000 Message-ID: References: In-Reply-To: Content-Language: en-US Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 Sender: fio-owner@vger.kernel.org List-Id: fio@vger.kernel.org To: Sitsofe Wheeler Cc: "fio@vger.kernel.org" SGksDQpJIGFtIGxlc3MgY29uY2VybmVkIGFib3V0IGFueSBwb3NzaWJsZSB0aW1pbmcgaXNzdWVz IGFzIHRoZXkgYXJlIHByb2JhYmx5IG1pbmlzY3VsZSBhbmQgSSBjYW4ndCB0aGluayBvZiB0aGUg c2NlbmFyaW8gd2hlcmUgaXQgd291bGQgYmUgYSBwcm9ibGVtIGFuZCBjYXVzZSBsZXNzIGFjY3Vy YXRlIHJlc3VsdHMgdG8gcmVhbGx5IGJlIGNvbmNlcm5lZCBhYm91dC4gIA0KVGVzdHMgcHJldHR5 IG11Y2ggcHJvdmUgd2UgYXJlIGdldHRpbmcgY2xvc2UgdG8gd2hhdCB3ZSBleHBlY3Q6IA0KZmlv IC0tZXRhPW5ldmVyIC0taW9lbmdpbmU9bGliYWlvIC0tcmVhZHdyaXRlPXdyaXRlIC0tdGltZV9i YXNlZD0xIC0tcnVudGltZT02MCAtLWZpbGVuYW1lPS90bXAvZmlvIC0tc2l6ZT0xTSAtLWRpcmVj dD0xIC0tbmFtZT10ZXN0IC0td3JpdGVfaW9wc19sb2c9L3RtcC90ZXN0IC0tbG9nX2F2Z19tc2Vj PTU1MDAgLS1sb2dfdW5peF9lcG9jaD0xDQoxNDg4NDg5MTM3NjMyLCA2NDEzLCAxLCAwDQoxNDg4 NDg5MTQzMTMxLCA1NTAzLCAxLCAwDQoxNDg4NDg5MTQ4NjMxLCA1NTg1LCAxLCAwDQoxNDg4NDg5 MTU0MTMxLCA1ODgzLCAxLCAwDQoxNDg4NDg5MTU5NjMxLCA1NzI2LCAxLCAwDQoxNDg4NDg5MTY1 MTMxLCA1MzMxLCAxLCAwDQoxNDg4NDg5MTcwNjMxLCA1NzcyLCAxLCAwDQoxNDg4NDg5MTc2MTMx LCA1NjYxLCAxLCAwDQoxNDg4NDg5MTgxNjMxLCA1OTcwLCAxLCAwDQoxNDg4NDg5MTg3MTMxLCA1 Nzc2LCAxLCAwDQpbNTQ5OSwgNTUwMCwgNTUwMCwgNTUwMCwgNTUwMCwgNTUwMCwgNTUwMCwgNTUw MCwgNTUwMF0NCg0KSG93ZXZlciwgdGhlIHByb2JsZW0gc3RpbGwgZXhpc3RzIHdoZXJlIGluIHRp bWV2YWxfYWRkX21zZWMgZ2V0cyBhIHZhbHVlIGdyZWF0ZXIgdGhhbiAxMDAwIG1zZWNzIHRoZSB0 di0+dHZfdXNlYyBpdCB3aWxsIGdyb3cgYmV5b25kIHVzZWNzICgxMDAwMDAwKSBhbmQgY2F1c2Vz IHVuZXhwZWN0ZWQgYmVoYXZpb3IuICBQb3NzaWJseSB0aGlzIGlzIHRoZSBiZXR0ZXIgZml4IHRv IGF2b2lkIG90aGVyIGNhbGxlcnMgaGF2aW5nIHRvIGFkanVzdCBmb3IgIHRoZSBvdmVyZmxvdyBp biB0aW1ldmFsX2FkZF9tc2Vjcz9cDQpkaWZmIC0tZ2l0IGEvdGltZS5jIGIvdGltZS5jDQppbmRl eCBmNWRjMDQ5Li5hMzE4YWQ1IDEwMDY0NA0KLS0tIGEvdGltZS5jDQorKysgYi90aW1lLmMNCkBA IC05LDEwICs5LDkgQEAgc3RhdGljIHVuc2lnbmVkIGxvbmcgbnNfZ3JhbnVsYXJpdHk7DQogdm9p ZCB0aW1ldmFsX2FkZF9tc2VjKHN0cnVjdCB0aW1ldmFsICp0diwgdW5zaWduZWQgaW50IG1zZWMp DQogew0KICAgICAgICB0di0+dHZfdXNlYyArPSAxMDAwICogbXNlYzsNCi0gICAgICAgaWYgKHR2 LT50dl91c2VjID49IDEwMDAwMDApIHsNCi0gICAgICAgICAgICAgICB0di0+dHZfdXNlYyAtPSAx MDAwMDAwOw0KLSAgICAgICAgICAgICAgIHR2LT50dl9zZWMrKzsNCi0gICAgICAgfQ0KKyAgICB0 di0+dHZfc2VjICs9IHR2LT50dl91c2VjIC8gMTAwMDAwMDsNCisgICAgdHYtPnR2X3VzZWMgJT0g MTAwMDAwMDsNCisNCiB9DQogDQogLyoNClJ1bm5pbmcgdGhlIHNhbWUgam9iIGFzIGFib3ZlIHdp dGggdGhlIGNoYW5nZToNCjE0ODg0ODk3NjMwOTksIDU3NzMsIDEsIDANCjE0ODg0ODk3Njg1OTks IDU4NTIsIDEsIDANCjE0ODg0ODk3NzQwOTksIDU2NTQsIDEsIDANCjE0ODg0ODk3Nzk1OTksIDU0 ODIsIDEsIDANCjE0ODg0ODk3ODUwOTksIDU2NTAsIDEsIDANCjE0ODg0ODk3OTA1OTksIDU3NTIs IDEsIDANCjE0ODg0ODk3OTYwOTksIDUzOTAsIDEsIDANCjE0ODg0ODk4MDE1OTksIDU3NDYsIDEs IDANCjE0ODg0ODk4MDcwOTksIDU2MTAsIDEsIDANCjE0ODg0ODk4MTI1OTksIDUzNjEsIDEsIDAN Cls1NTAwLCA1NTAwLCA1NTAwLCA1NTAwLCA1NTAwLCA1NTAwLCA1NTAwLCA1NTAwLCA1NTAwXQ0K DQpUaGFua3MsDQpDaHJpcw0KDQotLS0tLU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KRnJvbTogU2l0 c29mZSBXaGVlbGVyIFttYWlsdG86c2l0c29mZUBnbWFpbC5jb21dIA0KU2VudDogVHVlc2RheSwg RmVicnVhcnkgMjgsIDIwMTcgMTE6NTAgQU0NClRvOiBDaHJpcyBUYXlsb3IgPGN0YXlsb3JAcGl2 b3QzLmNvbT4NCkNjOiBmaW9Admdlci5rZXJuZWwub3JnDQpTdWJqZWN0OiBSZTogRklPIGxvZyBh dmVyYWdpbmcgaXNzdWUgd2l0aCAtLXdyaXRlX2J3X2xvZyBhbmQgLS13cml0ZV9pb3BzX2xvZyB1 c2luZyA+IDEwMDAgbG9nX2F2Z19tc2VjIHZhbHVlcw0KDQpIaSwNCg0KUmUgdGltaW5nIGlzc3Vl czogZG8geW91IG1lYW4gYmVjYXVzZSBvZiB1c2VjIC89IDEwMDA7IG9uIGxpbmUgNDI4PyBBcyBt dGltZV9zaW5jZSgpIHJldHVybnMgbWlsbGlzZWNvbmRzIGl0IHdvdWxkIG1lYW4gYWxsIGZyYWN0 aW9uYWwgbWlsbGlzZWNvbmQgYW1vdW50cyB3b3VsZCBiZSBwdXNoZWQgZG93bndhcmQgc28gcG90 ZW50aWFsbHkgdGhpbmdzIGNvdWxkIGJlIGJlIHVuZGVyIGJ5IGEgbWlsbGlzZWNvbmQuIElmIHRo YXQncyB3aGF0IHlvdSdyZSB0aGlua2luZyBvZiBJIGd1ZXNzIGhvdyBiYWQgdGhhdCBpcyBkZXBl bmRzIG9uIGhvdyBtdWNoIGFjY3VyYWN5IHlvdSBuZWVkIGFuZCBob3cgbXVjaCBqaXR0ZXIgdGhl cmUgaXMgd2l0aGluIHRoZSBzeXN0ZW0gYWxyZWFkeS4gUGVyaGFwcyB5b3UgY2FuIGRlbW9uc3Ry YXRlIGEgcHJvYmxlbSBzY2VuYXJpbyBzbyBmb2xrcyBudW1lcmF0ZSB0aGFuIEkgd2lsbCBzZWUg dGhlIHByb2JsZW0gdG9vLi4uDQoNClJlIHJvdW5kaW5nIHByb2JsZW0gLSBmYWlyIGVub3VnaC4N Cg0KT24gMjggRmVicnVhcnkgMjAxNyBhdCAwMDo0NywgQ2hyaXMgVGF5bG9yIDxjdGF5bG9yQHBp dm90My5jb20+IHdyb3RlOg0KPiBIaSBTaXRzb2ZlLA0KPiBMb29rcyBsaWtlIHRoaXMgaXMgaGFu ZGxlZCBpbiBjb21taXQgYmU2YmIyYjcyNjA4ZDdlZmJlYzEzZDA2YzY3NDQ2ZTIyOTEzNmFmYS4N Cj4gSSBhbSBubyBsb25nZXIgYWJsZSB0byByZXByb2R1Y2UgdGhlIGlzc3VlIHdpdGggbGF0ZXN0 IHZlcnNpb24gb2YgRklPIDIuMTcsIHdpdGggdGhhdCBjaGFuZ2UgYXMgdXNlY3Mgd2lsbCBub3cg YmUgMC4gIENvdWxkIHRoaXMgcG90ZW50aWFsbHkgY2F1c2Ugc29tZSB0aW1pbmcgaXNzdWVzPw0K Pg0KPiBQcmlvciB0byB0aGF0IGNvbW1pdC4uLg0KPiBUaGUgam9iIGJlbG93IHdvdWxkIHJlc3Vs dCBpbiBid19sb2dzIGFuZCBpb3BzX2xvZyB0aGF0IGhhdmUgc2tld2VkIA0KPiByZXN1bHRzIGJv dGggdGhlIGFkZF9pb3BzX3NhbXBsZXMgYW5kIGFkZF9id19zYW1wbGVzIG1ha2VzIGEgY2FsbCB0 byANCj4gbXRpbWVfc2luY2Ugd2l0aCBzdGFydCB0aW1lIGFzIHRoZSBfc2FtcGxlX3RpbWUNCj4g Li9zdGF0LmM6MjQzNTogIHNwZW50ID0gbXRpbWVfc2luY2UoJnRkLT5id19zYW1wbGVfdGltZSwg dCkNCj4gLi9zdGF0LmM6MjUxMDogIHNwZW50ID0gbXRpbWVfc2luY2UoJnRkLT5pb3BzX3NhbXBs ZV90aW1lLCB0KTsNCj4NCj4gLi9zdGF0LmM6MjQ3MzogIHRpbWV2YWxfYWRkX21zZWMoJnRkLT5i d19zYW1wbGVfdGltZSwgDQo+IHRkLT5vLmJ3X2F2Z190aW1lKTsNCj4gLi9zdGF0LmM6MjU0ODog IHRpbWV2YWxfYWRkX21zZWMoJnRkLT5pb3BzX3NhbXBsZV90aW1lLCANCj4gdGQtPm8uaW9wc19h dmdfdGltZSk7DQo+DQo+IHN0YXQuYzoyNDgwOjI3OiBydW50aW1lIGVycm9yOiB1bnNpZ25lZCBp bnRlZ2VyIG92ZXJmbG93OiAyMDAwIC0gMTg0NDY3NDQwNzM3MDg0NDkgY2Fubm90IGJlIHJlcHJl c2VudGVkIGluIHR5cGUgJ3Vuc2lnbmVkIGxvbmcnDQo+IHN0YXQuYzoyNTU1OjI5OiBydW50aW1l IGVycm9yOiB1bnNpZ25lZCBpbnRlZ2VyIG92ZXJmbG93OiAyMDAwIC0gMTg0NDY3NDQwNzM3MDg0 NDkgY2Fubm90IGJlIHJlcHJlc2VudGVkIGluIHR5cGUgJ3Vuc2lnbmVkIGxvbmcnDQo+DQo+IFRo ZSBvdmVyZmxvdyBhdCBzdGF0LmM6MjI2NSBpcyBhIGRpZmZlcmVudCBpc3N1ZSBwb3NzaWJseSBh IHJvdW5kaW5nIHByb2JsZW0gd2l0aCBtc2VjIGFuZCB1c2Vjcy4NCg0KLS0NClNpdHNvZmUgfCBo dHRwOi8vc3Vjcy5vcmcvfnNpdHMvDQoNCk9uIDI4IEZlYnJ1YXJ5IDIwMTcgYXQgMDA6NDcsIENo cmlzIFRheWxvciA8Y3RheWxvckBwaXZvdDMuY29tPiB3cm90ZToNCj4gSGkgU2l0c29mZSwNCj4g TG9va3MgbGlrZSB0aGlzIGlzIGhhbmRsZWQgaW4gY29tbWl0IGJlNmJiMmI3MjYwOGQ3ZWZiZWMx M2QwNmM2NzQ0NmUyMjkxMzZhZmEuDQo+IEkgYW0gbm8gbG9uZ2VyIGFibGUgdG8gcmVwcm9kdWNl IHRoZSBpc3N1ZSB3aXRoIGxhdGVzdCB2ZXJzaW9uIG9mIEZJTyAyLjE3LCB3aXRoIHRoYXQgY2hh bmdlIGFzIHVzZWNzIHdpbGwgbm93IGJlIDAuICBDb3VsZCB0aGlzIHBvdGVudGlhbGx5IGNhdXNl IHNvbWUgdGltaW5nIGlzc3Vlcz8NCj4NCj4gUHJpb3IgdG8gdGhhdCBjb21taXQuLi4NCj4gVGhl IGpvYiBiZWxvdyB3b3VsZCByZXN1bHQgaW4gYndfbG9ncyBhbmQgaW9wc19sb2cgdGhhdCBoYXZl IHNrZXdlZCANCj4gcmVzdWx0cyBib3RoIHRoZSBhZGRfaW9wc19zYW1wbGVzIGFuZCBhZGRfYndf c2FtcGxlcyBtYWtlcyBhIGNhbGwgdG8gDQo+IG10aW1lX3NpbmNlIHdpdGggc3RhcnQgdGltZSBh cyB0aGUgX3NhbXBsZV90aW1lDQo+IC4vc3RhdC5jOjI0MzU6ICBzcGVudCA9IG10aW1lX3NpbmNl KCZ0ZC0+Yndfc2FtcGxlX3RpbWUsIHQpDQo+IC4vc3RhdC5jOjI1MTA6ICBzcGVudCA9IG10aW1l X3NpbmNlKCZ0ZC0+aW9wc19zYW1wbGVfdGltZSwgdCk7DQo+DQo+IC4vc3RhdC5jOjI0NzM6ICB0 aW1ldmFsX2FkZF9tc2VjKCZ0ZC0+Yndfc2FtcGxlX3RpbWUsIA0KPiB0ZC0+by5id19hdmdfdGlt ZSk7DQo+IC4vc3RhdC5jOjI1NDg6ICB0aW1ldmFsX2FkZF9tc2VjKCZ0ZC0+aW9wc19zYW1wbGVf dGltZSwgDQo+IHRkLT5vLmlvcHNfYXZnX3RpbWUpOw0KPg0KPiBzdGF0LmM6MjQ4MDoyNzogcnVu dGltZSBlcnJvcjogdW5zaWduZWQgaW50ZWdlciBvdmVyZmxvdzogMjAwMCAtIDE4NDQ2NzQ0MDcz NzA4NDQ5IGNhbm5vdCBiZSByZXByZXNlbnRlZCBpbiB0eXBlICd1bnNpZ25lZCBsb25nJw0KPiBz dGF0LmM6MjU1NToyOTogcnVudGltZSBlcnJvcjogdW5zaWduZWQgaW50ZWdlciBvdmVyZmxvdzog MjAwMCAtIDE4NDQ2NzQ0MDczNzA4NDQ5IGNhbm5vdCBiZSByZXByZXNlbnRlZCBpbiB0eXBlICd1 bnNpZ25lZCBsb25nJw0KPg0KPiBUaGUgb3ZlcmZsb3cgYXQgc3RhdC5jOjIyNjUgaXMgYSBkaWZm ZXJlbnQgaXNzdWUgcG9zc2libHkgYSByb3VuZGluZyBwcm9ibGVtIHdpdGggbXNlYyBhbmQgdXNl Y3MuDQo+DQo+DQo+IFRoYW5rcywNCj4gQ2hyaXMNCj4NCj4gT24gMjMgRmVicnVhcnkgMjAxNyBh dCAyMDo1NSwgQ2hyaXMgVGF5bG9yIDxjdGF5bG9yQHBpdm90My5jb20+IHdyb3RlOg0KPj4gVGhl cmUgaXMgYW4gaXNzdWUgaW4gRklPIHdoZW4gdXNpbmcgdGhlIGRldGFpbGVkIGJhbmR3aWR0aCBh bmQgaW9wcyBsb2dnaW5nIHdpdGggYXZlcmFnaW5nIG92ZXIgYSBwZXJpb2Qgb2YgdGltZSA+IDEg c2Vjb25kLg0KPj4gSXQgc2VlbXMgdGhhdCB1c2VjcyBvdmVyZmxvd3Mgd2hpY2ggbGF0ZXIgY2F1 c2VzIG5lZ2F0aXZlIHRpbWUgZGlmZiB2YWx1ZXMgcmVzdWx0aW5nIGluIHNrZXdlZCB0b3dhcmQg MCByZXN1bHRzLg0KPj4gSSBoYXZlIGF0dGFjaGVkIGEgcG90ZW50aWFsIGZpeCB0aGF0IHNob3Vs ZCBwcmV2ZW50IHVzZWNzIGZyb20gZ29pbmcgYmV5b25kIDEwMDAwMDAuDQo+DQo+IElzIHRoaXMg cHJvYmxlbSBzaG93biBieSB0aGUgZm9sbG93aW5nIGpvYjoNCj4NCj4gLi9maW8gLS1pb2VuZ2lu ZT1udWxsIC0td3JpdGVfYndfbG9nPS9kZXYvbnVsbCAtLWxvZ19hdmdfbXNlYz0yMDAwIA0KPiAt LXNpemU9MTAwTSAtLXJ1bnRpbWU9MTBzIC0tdGltZV9iYXNlZCAtLW5hbWU9b3ZlcmZsb3cNCj4N Cj4gQW1vbmcgQ2xhbmcncyB1bmRlZmluZWQgYmVoYXZpb3VyIHNhbml0aXplciBvdXRwdXQgd2Fz IHRoaXMgZm9yIHRoZSBhYm92ZToNCj4gc3RhdC5jOjIyNjU6NDM6IHJ1bnRpbWUgZXJyb3I6IHVu c2lnbmVkIGludGVnZXIgb3ZlcmZsb3c6IDE5OTkgLSAyMDAwIGNhbm5vdCBiZSByZXByZXNlbnRl ZCBpbiB0eXBlICd1bnNpZ25lZCBsb25nJw0KPiBzdGF0LmM6MjI2NToyODogcnVudGltZSBlcnJv cjogdW5zaWduZWQgaW50ZWdlciBvdmVyZmxvdzogMzk5OSAtDQo+IDQyOTQ5NjcyOTUgY2Fubm90 IGJlIHJlcHJlc2VudGVkIGluIHR5cGUgJ3Vuc2lnbmVkIGxvbmcnDQo+DQo+PiBkaWZmIC0tZ2l0 IGEvdGltZS5jIGIvdGltZS5jDQo+PiBpbmRleCBmNWRjMDQ5Li5jNzQ4YmVlIDEwMDY0NA0KPj4g LS0tIGEvdGltZS5jDQo+PiArKysgYi90aW1lLmMNCj4+IEBAIC04LDExICs4LDE4IEBAIHN0YXRp YyB1bnNpZ25lZCBsb25nIG5zX2dyYW51bGFyaXR5Ow0KPj4NCj4+IHZvaWQgdGltZXZhbF9hZGRf bXNlYyhzdHJ1Y3QgdGltZXZhbCAqdHYsIHVuc2lnbmVkIGludCBtc2VjKSB7DQo+PiAtICAgICAg IHR2LT50dl91c2VjICs9IDEwMDAgKiBtc2VjOw0KPj4gLSAgICAgICBpZiAodHYtPnR2X3VzZWMg Pj0gMTAwMDAwMCkgew0KPj4gLSAgICAgICAgICAgICAgIHR2LT50dl91c2VjIC09IDEwMDAwMDA7 DQo+PiAtICAgICAgICAgICAgICAgdHYtPnR2X3NlYysrOw0KPj4gLSAgICAgICB9DQo+PiArICAg ICAgIGludCBhZGpfdXNlYyA9IDEwMDAgKiBtc2VjOw0KPj4gKyAgICAgICBpbnQgYWRqX3NlYyA9 IDA7DQo+PiArICAgICAgIHR2LT50dl91c2VjICs9ICBhZGpfdXNlYzsNCj4+ICsgICAgICAgaWYg KGFkal91c2VjID49IDEwMDAwMDApIHsNCj4+ICsgICAgICAgICAgICAgICBhZGpfc2VjID0gYWRq X3VzZWMgLyAxMDAwMDAwOw0KPj4gKyAgICAgICAgICAgICAgIHR2LT50dl91c2VjIC09ICBhZGpf c2VjICogMTAwMDAwMDsNCj4+ICsgICAgICAgICAgICAgICB0di0+dHZfc2VjICs9IGFkal9zZWM7 DQo+PiArICAgIH0NCj4+ICsgICAgaWYgKHR2LT50dl91c2VjID49IDEwMDAwMDApew0KPj4gKyAg ICAgICAgICAgIHR2LT50dl91c2VjIC09IDEwMDAwMDA7DQo+PiArICAgICAgICAgICAgdHYtPnR2 X3NlYysrOw0KPj4gKyAgICB9DQo+PiB9DQo+DQo+IElzIGl0IHN0aWxsIHNhZmUgdG8gdXNlIGlu dCBpZiB5b3UncmUgdGFyZ2V0aW5nIGEgMzIgYml0IHBsYXRmb3JtPw0KPiAtLQ0KPiBTaXRzb2Zl IHwgaHR0cDovL3N1Y3Mub3JnL35zaXRzLw0KDQoNCg0KLS0NClNpdHNvZmUgfCBodHRwOi8vc3Vj cy5vcmcvfnNpdHMvDQo=