From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S965051AbcHaPpE (ORCPT ); Wed, 31 Aug 2016 11:45:04 -0400 Received: from mga14.intel.com ([192.55.52.115]:12626 "EHLO mga14.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S964800AbcHaPpC (ORCPT ); Wed, 31 Aug 2016 11:45:02 -0400 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.30,262,1470726000"; d="scan'208";a="3191793" From: "Huang\, Ying" To: Mel Gorman Cc: "Huang\, Ying" , Andrew Morton , , , , , , , Hugh Dickins , Shaohua Li , Minchan Kim , Rik van Riel , Tejun Heo , Wu Fengguang Subject: Re: [PATCH -v2] mm: Don't use radix tree writeback tags for pages in swap cache References: <1472578089-5560-1-git-send-email-ying.huang@intel.com> <20160831091459.GY8119@techsingularity.net> <87oa49m0hn.fsf@yhuang-mobile.sh.intel.com> <20160831153908.GA8119@techsingularity.net> Date: Wed, 31 Aug 2016 08:44:39 -0700 In-Reply-To: <20160831153908.GA8119@techsingularity.net> (Mel Gorman's message of "Wed, 31 Aug 2016 16:39:08 +0100") Message-ID: <87r395kkns.fsf@yhuang-mobile.sh.intel.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Mel Gorman writes: > On Wed, Aug 31, 2016 at 08:17:24AM -0700, Huang, Ying wrote: >> Mel Gorman writes: >> >> > On Tue, Aug 30, 2016 at 10:28:09AM -0700, Huang, Ying wrote: >> >> From: Huang Ying >> >> >> >> File pages use a set of radix tree tags (DIRTY, TOWRITE, WRITEBACK, >> >> etc.) to accelerate finding the pages with a specific tag in the radix >> >> tree during inode writeback. But for anonymous pages in the swap >> >> cache, there is no inode writeback. So there is no need to find the >> >> pages with some writeback tags in the radix tree. It is not necessary >> >> to touch radix tree writeback tags for pages in the swap cache. >> >> >> >> Per Rik van Riel's suggestion, a new flag AS_NO_WRITEBACK_TAGS is >> >> introduced for address spaces which don't need to update the writeback >> >> tags. The flag is set for swap caches. It may be used for DAX file >> >> systems, etc. >> >> >> >> With this patch, the swap out bandwidth improved 22.3% (from ~1.2GB/s to >> >> ~ 1.48GBps) in the vm-scalability swap-w-seq test case with 8 processes. >> >> The test is done on a Xeon E5 v3 system. The swap device used is a RAM >> >> simulated PMEM (persistent memory) device. The improvement comes from >> >> the reduced contention on the swap cache radix tree lock. To test >> >> sequential swapping out, the test case uses 8 processes, which >> >> sequentially allocate and write to the anonymous pages until RAM and >> >> part of the swap device is used up. >> >> >> >> Details of comparison is as follow, >> >> >> >> base base+patch >> >> ---------------- -------------------------- >> >> %stddev %change %stddev >> >> \ | \ >> >> 2506952 ± 2% +28.1% 3212076 ± 7% vm-scalability.throughput >> >> 1207402 ± 7% +22.3% 1476578 ± 6% vmstat.swap.so >> >> 10.86 ± 12% -23.4% 8.31 ± 16% perf-profile.cycles-pp._raw_spin_lock_irq.__add_to_swap_cache.add_to_swap_cache.add_to_swap.shrink_page_list >> >> 10.82 ± 13% -33.1% 7.24 ± 14% perf-profile.cycles-pp._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_zone_memcg >> >> 10.36 ± 11% -100.0% 0.00 ± -1% perf-profile.cycles-pp._raw_spin_lock_irqsave.__test_set_page_writeback.bdev_write_page.__swap_writepage.swap_writepage >> >> 10.52 ± 12% -100.0% 0.00 ± -1% perf-profile.cycles-pp._raw_spin_lock_irqsave.test_clear_page_writeback.end_page_writeback.page_endio.pmem_rw_page >> >> >> > >> > I didn't see anything wrong with the patch but it's worth highlighting >> > that this hunk means we are now out of GFP bits. >> >> Sorry, I don't know whether I understand your words. It is something >> about, >> >> __GFP_BITS_SHIFT == 26 >> >> So remainning bits in mapping_flags is 6. And now the latest bit is >> used for the flag introduced in the patch? >> > > __GFP_BITS_SHIFT + 5 (AS_NO_WRITEBACK_TAGS) = 31 > > mapping->flags is a combination of AS and GFP flags so increasing > __GFP_BITS_SHIFT overflows mapping->flags on 32-bit as gfp_t is an > unsigned int. Got it! Thanks a lot! Best Regards, Huang, Ying