From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.8 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D6342C2D0E4 for ; Tue, 17 Nov 2020 08:06:24 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 1ABC720E65 for ; Tue, 17 Nov 2020 08:06:23 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=amazon.com header.i=@amazon.com header.b="r7irN8HX" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 1ABC720E65 Authentication-Results: mail.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=amazon.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id DED946B0036; Tue, 17 Nov 2020 03:06:22 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id D7A456B005D; Tue, 17 Nov 2020 03:06:22 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BF03C6B0068; Tue, 17 Nov 2020 03:06:22 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0004.hostedemail.com [216.40.44.4]) by kanga.kvack.org (Postfix) with ESMTP id 915A76B0036 for ; Tue, 17 Nov 2020 03:06:22 -0500 (EST) Received: from smtpin01.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 3FDD1362A for ; Tue, 17 Nov 2020 08:06:22 +0000 (UTC) X-FDA: 77493177804.01.bait22_3506bc027330 Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin01.hostedemail.com (Postfix) with ESMTP id 22EEF10049333 for ; Tue, 17 Nov 2020 08:06:22 +0000 (UTC) X-HE-Tag: bait22_3506bc027330 X-Filterd-Recvd-Size: 6485 Received: from smtp-fw-2101.amazon.com (smtp-fw-2101.amazon.com [72.21.196.25]) by imf28.hostedemail.com (Postfix) with ESMTP for ; Tue, 17 Nov 2020 08:06:21 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1605600382; x=1637136382; h=from:to:cc:subject:date:message-id:in-reply-to: mime-version; bh=K8f6ETiEAQNHhAiPwTTzrZ8ML7xCbvOY3ECTsRFRiDw=; b=r7irN8HXOePiw8itlFDd5gb3hL3YeETeaXsJdAlDeBaUBYy5VDpSPiuf 83yNJprTAvNCM69IGU+Df3ESvfYa49xuSXBGpHwULXNPhbsfQZLMlYwGA H7PapC9yjTN3OLBrhQoaq6cB6sSf4b+qmWh5T4wXCo3vvRoR4N3fverR+ Y=; X-IronPort-AV: E=Sophos;i="5.77,484,1596499200"; d="scan'208";a="64147388" Received: from iad12-co-svc-p1-lb1-vlan3.amazon.com (HELO email-inbound-relay-2b-c7131dcf.us-west-2.amazon.com) ([10.43.8.6]) by smtp-border-fw-out-2101.iad2.amazon.com with ESMTP; 17 Nov 2020 08:06:13 +0000 Received: from EX13D31EUA001.ant.amazon.com (pdx1-ws-svc-p6-lb9-vlan2.pdx.amazon.com [10.236.137.194]) by email-inbound-relay-2b-c7131dcf.us-west-2.amazon.com (Postfix) with ESMTPS id C43A8A1C14; Tue, 17 Nov 2020 08:06:09 +0000 (UTC) Received: from u3f2cd687b01c55.ant.amazon.com (10.43.162.144) by EX13D31EUA001.ant.amazon.com (10.43.165.15) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 17 Nov 2020 08:05:53 +0000 From: SeongJae Park To: SeongJae Park CC: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Subject: Re: [PATCH v22 00/18] Introduce Data Access MONitor (DAMON) Date: Tue, 17 Nov 2020 09:05:39 +0100 Message-ID: <20201117080539.31334-1-sjpark@amazon.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201111164113.23245-1-sjpark@amazon.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [10.43.162.144] X-ClientProxiedBy: EX13D46UWB001.ant.amazon.com (10.43.161.16) To EX13D31EUA001.ant.amazon.com (10.43.165.15) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Another week, another ping. I'm waiting for _any_ comments. Thanks, SeongJae Park On Wed, 11 Nov 2020 17:41:13 +0100 SeongJae Park wrote: > Hi, I'd like to remind you that I'm still waiting more reviews. Any comments > are welcome. > > > Thanks, > SeongJae Park > > On Tue, 20 Oct 2020 10:59:22 +0200 SeongJae Park wrote: > > > From: SeongJae Park > > > > Changes from Previous Version (v21) > > =================================== > > > > This version contains below minor changes. > > > > - Fix build warnings and errors (kernel test robot) > > - Fix a memory leak (kmemleak) > > - Respect KUNIT_ALL_TESTS > > - Rebase on v5.9 > > - Update the evaluation results > > > > Introduction > > ============ > > > > DAMON is a data access monitoring framework for the Linux kernel. The core > > mechanisms of DAMON called 'region based sampling' and 'adaptive regions > > adjustment' (refer to 'mechanisms.rst' in the 11th patch of this patchset for > > the detail) make it > > > > - accurate (The monitored information is useful for DRAM level memory > > management. It might not appropriate for Cache-level accuracy, though.), > > - light-weight (The monitoring overhead is low enough to be applied online > > while making no impact on the performance of the target workloads.), and > > - scalable (the upper-bound of the instrumentation overhead is controllable > > regardless of the size of target workloads.). > > > > Using this framework, therefore, several memory management mechanisms such as > > reclamation and THP can be optimized to aware real data access patterns. > > Experimental access pattern aware memory management optimization works that > > incurring high instrumentation overhead will be able to have another try. > > > > Though DAMON is for kernel subsystems, it can be easily exposed to the user > > space by writing a DAMON-wrapper kernel subsystem. Then, user space users who > > have some special workloads will be able to write personalized tools or > > applications for deeper understanding and specialized optimizations of their > > systems. > > > > Evaluations > > =========== > > > > We evaluated DAMON's overhead, monitoring quality and usefulness using 24 > > realistic workloads on my QEMU/KVM based virtual machine running a kernel that > > v22 DAMON patchset is applied. > > > > DAMON is lightweight. It increases system memory usage by 0.25% and slows > > target workloads down by 0.89%. > > > > DAMON is accurate and useful for memory management optimizations. An > > experimental DAMON-based operation scheme for THP, 'ethp', removes 81.73% of > > THP memory overheads while preserving 95.29% of THP speedup. Another > > experimental DAMON-based 'proactive reclamation' implementation, 'prcl', > > reduces 91.30% of residential sets and 23.45% of system memory footprint while > > incurring only 2.08% runtime overhead in the best case (parsec3/freqmine). > > > > NOTE that the experimentail THP optimization and proactive reclamation are not > > for production but only for proof of concepts. > > > > Please refer to the official document[1] or "Documentation/admin-guide/mm: Add > > a document for DAMON" patch in this patchset for detailed evaluation setup and > > results. > > > > [1] https://damonitor.github.io/doc/html/latest-damon/admin-guide/mm/damon/eval.html > >