From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.9 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 97FC3C83007 for ; Wed, 29 Apr 2020 10:11:12 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 5A5512074A for ; Wed, 29 Apr 2020 10:11:12 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=amazon.com header.i=@amazon.com header.b="BhN/GWG2" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5A5512074A Authentication-Results: mail.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=amazon.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id E8EEC8E0005; Wed, 29 Apr 2020 06:11:11 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E17388E0001; Wed, 29 Apr 2020 06:11:11 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id CE13B8E0005; Wed, 29 Apr 2020 06:11:11 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0183.hostedemail.com [216.40.44.183]) by kanga.kvack.org (Postfix) with ESMTP id B0EDA8E0001 for ; Wed, 29 Apr 2020 06:11:11 -0400 (EDT) Received: from smtpin20.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id 70CAB180AD804 for ; Wed, 29 Apr 2020 10:11:11 +0000 (UTC) X-FDA: 76760474742.20.sink02_a50fc4cbae47 X-HE-Tag: sink02_a50fc4cbae47 X-Filterd-Recvd-Size: 5260 Received: from smtp-fw-33001.amazon.com (smtp-fw-33001.amazon.com [207.171.190.10]) by imf42.hostedemail.com (Postfix) with ESMTP for ; Wed, 29 Apr 2020 10:11:10 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1588155072; x=1619691072; h=from:to:cc:subject:date:message-id:in-reply-to: mime-version; bh=9CQS42kGK5ZNYWUV4gu/AjvQxaOsf0urRIP1lzCXhDQ=; b=BhN/GWG2dGQVwBMEcwj7OGVRxzhU2ZXADlxbCHioJcQ88RZxp0CTbZzb tDNDBdMu9m0tu49kWbq+Zo16/H4NEH/iq8CzUJUr5b+8jJ5LVK3ng1blx tYX+b0NqG8JWCwbAu65sz1jFfaplAtF5c67ZayKlegf2ov208uzLFCOY5 Q=; IronPort-SDR: K8AboDQXsW8YZoXYONZzkIizxiyiNkRHbVOEogmdF86aRc06DTu2amOAD3i/LB4jfRbhjfsz1z 5Mv3iajYFj2Q== X-IronPort-AV: E=Sophos;i="5.73,331,1583193600"; d="scan'208";a="41592898" Received: from sea32-co-svc-lb4-vlan3.sea.corp.amazon.com (HELO email-inbound-relay-1a-715bee71.us-east-1.amazon.com) ([10.47.23.38]) by smtp-border-fw-out-33001.sea14.amazon.com with ESMTP; 29 Apr 2020 10:11:07 +0000 Received: from EX13MTAUEA002.ant.amazon.com (iad55-ws-svc-p15-lb9-vlan2.iad.amazon.com [10.40.159.162]) by email-inbound-relay-1a-715bee71.us-east-1.amazon.com (Postfix) with ESMTPS id 6A24FA1E7F; Wed, 29 Apr 2020 10:10:55 +0000 (UTC) Received: from EX13D31EUA001.ant.amazon.com (10.43.165.15) by EX13MTAUEA002.ant.amazon.com (10.43.61.77) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 29 Apr 2020 10:10:54 +0000 Received: from u886c93fd17d25d.ant.amazon.com (10.43.160.65) by EX13D31EUA001.ant.amazon.com (10.43.165.15) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 29 Apr 2020 10:10:38 +0000 From: SeongJae Park To: Jonathan Cameron CC: SeongJae Park , , "SeongJae Park" , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Subject: Re: Re: [PATCH v9 00/15] Introduce Data Access MONitor (DAMON) Date: Wed, 29 Apr 2020 12:10:19 +0200 Message-ID: <20200429101019.26299-1-sjpark@amazon.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200429101806.000002f4@Huawei.com> (raw) MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [10.43.160.65] X-ClientProxiedBy: EX13D28UWC001.ant.amazon.com (10.43.162.166) To EX13D31EUA001.ant.amazon.com (10.43.165.15) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed, 29 Apr 2020 10:18:06 +0100 Jonathan Cameron wrote: > On Wed, 29 Apr 2020 09:49:54 +0200 > SeongJae Park wrote: > > > On Tue, 28 Apr 2020 17:17:13 +0100 Jonathan Cameron wrote: > > > > > On Tue, 28 Apr 2020 15:23:42 +0200 > > > SeongJae Park wrote: > > > > > > > On Tue, 28 Apr 2020 13:27:04 +0100 Jonathan Cameron wrote: > > > > > > > > > On Mon, 27 Apr 2020 14:04:27 +0200 > > > > > SeongJae Park wrote: > > > > > > > > > > > From: SeongJae Park > > > > > > > > > > > > Introduction > > > > > > ============ > > > > > > [...] > > > > Appreciate your explanations and suggestions. > > You are welcome. > > Out of interest, do you have any comparative data on how 'accurate' the resulting > estimates are vs a more precise heatmap from a memory trace? No, I don't have such data. I'm only comparing the big trends of heatmap, working set sizes analyzed from the recorded access pattern and the DAMOS performance results for each version using my human eye, to check regression. > > I'm looking at gathering such data but much happier to leverage your work if > you've already done it! That would be great. If I get such data later, I will let you know. I will be also very happy if you could get it first and share with me. Maybe we could make and use another variant of DAMON, which uses page-size regions only and disable the adaptive regions adjustment. It will be also useful for overhead comparison. Actually, I heard that my previous colleague made this variant for the comparison based on a prototype of DAMON. I will also consider extending DAMON to support such variant. Also, if you need the heatmaps, analyzed working set size distribution, and/or the record file itself for each version of the patchsets, please let me know. Thanks, SeongJae Park