From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.0 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 807A5C4320A for ; Wed, 1 Sep 2021 03:07:56 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 5B0ED6101B for ; Wed, 1 Sep 2021 03:07:56 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S241758AbhIADIu (ORCPT ); Tue, 31 Aug 2021 23:08:50 -0400 Received: from mail-bn8nam11on2129.outbound.protection.outlook.com ([40.107.236.129]:57344 "EHLO NAM11-BN8-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S240843AbhIADIt (ORCPT ); Tue, 31 Aug 2021 23:08:49 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oVIT82nN5jQYZb5z+BRfFr1gIm0UQ4+oBfLnMiIi60zfL8Muym1PONXSTgVf1KNGCxKm4O/Tk/KagtXELGA2XdwME9DVaOZLGmjQO8cg3FBld5m1AtBFutPwYq3cyQCuxD3ZA2+tDUPKMKZa/XKP/Qc/Z6w+DbVQ7PBe5OkHCAOlakMqzPMjy3Xof36s8SPVagaDvoDbhzPMzFW4WH5x6RkeY7/x1BLRjkIPCF05K9sfLFLMawJo234oxPORm0vD/GsTZqIDcQ9epr8a+MtPQzuDx6DZrA4y5hMCO7jwkb8RPlCC5AEr/MCOBZ6uu9Rv2526dHAVO0uUR5qUnV8tvA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vf7Goqqt+zoHwhfJBFspaJ3whsb8WqOYIs4e6d6Qj8I=; b=Zv7TOCxQjemP1LT+giQnrKbSTx+laUETJ9Isv8tZ03kLZ6sQFI3DSx3Qg6wu8y2/8Y629MNveVeRisr6D3krXNksrMED4/lMLFE/ZA+WWm0AANVfgt5CqpRa5fxDrAi2koeiW7HAAnk5O6VgPBT3QKc3l36n6MQOBNRpIRPl/b4UE9h78KxqYI3jUF9qKTdedjGkB470n6YT4RgzEn1mo/gQ/CaXwE9CrNZNaHziH4GInYBX6zt1/F7Op5LpYDlw/l0L+1a7XjaRe07qLly6kI9nmAVsOJLFJyZtawPCYTZeZPCZ/bsTpYhnBA1PPEwDsDn3m91fAZXtorn1c+TFTA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=os.amperecomputing.com; dmarc=pass action=none header.from=amperemail.onmicrosoft.com; dkim=pass header.d=amperemail.onmicrosoft.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amperemail.onmicrosoft.com; s=selector1-amperemail-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vf7Goqqt+zoHwhfJBFspaJ3whsb8WqOYIs4e6d6Qj8I=; b=zdgXUKpoeJOAdFpTKBgBr+e0SZhnHqwwucc4iHei71IfMk1qpBYotliZrQa1It4hA1GQZeASjVQiOG2V2+MC2imm/8ktt6TidxAymzQtWOxNQt3xNsyXn85/nQ4nsbVrnvx0tFcsS4/TPONKbjFzx4IpD9DLV4Dz/kaGXeCRl6c= Authentication-Results: amperecomputing.com; dkim=none (message not signed) header.d=none;amperecomputing.com; dmarc=none action=none header.from=amperemail.onmicrosoft.com; Received: from MWHPR0101MB3165.prod.exchangelabs.com (2603:10b6:301:2f::19) by MW4PR01MB6132.prod.exchangelabs.com (2603:10b6:303:7f::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4457.23; Wed, 1 Sep 2021 03:07:50 +0000 Received: from MWHPR0101MB3165.prod.exchangelabs.com ([fe80::ed89:1b21:10f4:ed56]) by MWHPR0101MB3165.prod.exchangelabs.com ([fe80::ed89:1b21:10f4:ed56%3]) with mapi id 15.20.4457.025; Wed, 1 Sep 2021 03:07:50 +0000 From: Shijie Huang Subject: Is it possible to implement the per-node page cache for programs/libraries? To: torvalds@linux-foundation.org, viro@zeniv.linux.org.uk, akpm@linux-foundation.org, linux-mm@kvack.org, song.bao.hua@hisilicon.com Cc: linux-kernel@vger.kernel.org, Frank Wang Message-ID: Date: Wed, 1 Sep 2021 11:07:41 +0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-ClientProxiedBy: HK2PR02CA0170.apcprd02.prod.outlook.com (2603:1096:201:1f::30) To MWHPR0101MB3165.prod.exchangelabs.com (2603:10b6:301:2f::19) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [10.30.33.15] (180.167.209.74) by HK2PR02CA0170.apcprd02.prod.outlook.com (2603:1096:201:1f::30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4478.19 via Frontend Transport; Wed, 1 Sep 2021 03:07:48 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: df315fab-8baf-4746-f198-08d96cf5ae7c X-MS-TrafficTypeDiagnostic: MW4PR01MB6132: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8273; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: JyXwQvM9/bpr5eHQm+f0aMBd53ug3uH5NF4kBxJYwqhdTNJB2OR2rzx7vKajN2dpliT3hqu03LFCZLFH8yWumQxAv9F/fI1pKqd8qEQ8a72GAe6HSu/yT86q/uTOJyBfh6JB1U4mAWJZI5hlSGEy4IkUfgEU5HryXyyWfd6s6oWx70id7awWZHioG2eyBxBmyP5oL9oAjJ67lb5DtUqeVxYVBIDvOQ/L055JrtQubYbgLRZdsIay1E7pz48Ja4ax/gSv4zaitT0kAqMspbw5Z3PrBaz23REaItgcU4INp6gNVkhTKQmNeawr25yOUS1UD8GLRFEpPDAcYAvYMID+OZyvMffBoOB4YRsGJKbKG41mHxWqENGm57F+McQypmjAKU400ji27L0g6ajfjjn4Y6ESwG+ybqfC7MYlvn75nA4cMSQUNvM5gppKUe1sS6vPF3rg1v/4MaeaUNSuP/VuxuJmVdOqANg5Yf+JZFNf6G+pARHT5TqKOvMk0XmPLBZ8MwFJgxoq7YbK4siwKFs8w8Rx/p+RGjquDktorwFpG/Fkr59ygJgkxlbb1EIUYEjMLIUpuiytx0xHsWNVAnQdIo9cmSMYyZ5hwctTUk7tx0N9WTNuw9aG/FXCTbW47GGWGesj2Ij4nrQSuwOWLSiBsQF6odaPsmBnbOYJphVBten6iwuF/dzcAk+jkxgAXzpSW5gbNo9eEYmathPIQeZD6JlJ0FKVuSV0ilDXQKg6ViESXI1cqgSKpMwugBYOb4n8jztuOBFuNbuefOjnmQR4oQ== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MWHPR0101MB3165.prod.exchangelabs.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(31696002)(6486002)(26005)(42882007)(83380400001)(5660300002)(83170400001)(186003)(66946007)(4744005)(316002)(16576012)(38350700002)(508600001)(38100700002)(66556008)(66476007)(8676002)(956004)(6666004)(2906002)(31686004)(107886003)(52116002)(2616005)(8936002)(4326008)(45980500001)(43740500002);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?dXNqcTc1ci84YmRIYjh1SVZSbUlQYWNDQ3ppZTNuN0lMNEJmQzE4NVh6V3dZ?= =?utf-8?B?dXRSSHJ4SndiLytwdlh3cm80TWxycHcxZW5lRUhjWGNHVXVsTVFEMnVkYzhu?= =?utf-8?B?WW5OYzBiK2kxNmFWYjZuNEYxZXRDbnJsMCtVV3ZYTXNLQmFsMnp1U2wzM2RT?= =?utf-8?B?NFJFV2xQSkVuL1A0VlNmdFF1V0hSNkJ4ZVJ6d20wci91T3FQak9iNzhDK2Ix?= =?utf-8?B?Z3lDUjlBdU5BSGowNG9TeGhMZGtLMC9BS0hWaXFJcXh0MUFNQXp1ZjlQaFZP?= =?utf-8?B?czR1L1Ayek9PNEg2N3dvTk0yT1drdFFRUlMwV3liUHdQSHU2d05sUzlGN2xw?= =?utf-8?B?TXZuTS9rdEtKQ2dJbkRFTXZwM0tMTDFjVGdEUjJ4VUJXa24rVjVjN0hHLzcv?= =?utf-8?B?SXlpU3c3SEZHR3RoMlRsZCtTV0Q0TGtPSmM0eXkya0pnejViV1RoODYxRGQ0?= =?utf-8?B?c21Wb0N2VkJVcmpKdmFLR0JMZ3Q3cGtVZHhUVlNISWV6YnFMdXlCdWpoSUs3?= =?utf-8?B?N29WRkVHbnJJMmV3cEFPOWlMZCs3VVlleWt6UHM3dEkzT0FZcWdmck9SOXBQ?= =?utf-8?B?clo3VE9qTHd5SUN2Nm5iOERDTXlMWWs0YlozdDNJNGNCUXh2d2hoalRhS0s5?= =?utf-8?B?SllyNG5ING1yeXNDc1o1OWxLQ2dOVVRUaERyTGh5clJRUjZGaU1RSEpDekk2?= =?utf-8?B?SGZVU3FjT1FpZXdQaHpjK2tLdXdGZjZFV1QvZEFPdVJUdGNEdzhrRzYvbUZZ?= =?utf-8?B?aHVaczVQbDdKYitiLzNwVFNuak5XR21wUENpTjhiWnFrVEgzdHdZbEZRMllx?= =?utf-8?B?OXJhM0YyeWU3VzdVU0h4MHdQZThVbTlWVmFmVDF0WG9DSVpMbEVaeG1CNitW?= =?utf-8?B?cTFpMjFkOEFWVEJGZm1uUWtyZndiV3FSc2NNamtqdzAwQWJybzV6b0laQWdW?= =?utf-8?B?eDNwZko1YW9maCtFdzJPYTh6NjdJOGZaZWpSWStMT3RpTlhISHo2UFh3cE10?= =?utf-8?B?aFdkQm44RWpOQnRHbTRScFNSUXdNRmRKZmpseVpLZ2MyakZTZy9mNzR3V0g4?= =?utf-8?B?ZVdYam5zVUUvZGFLWWlBc2RWZnJTNDBXcEZ1cUpKNWhEdkFZMklFWDJGNzRm?= =?utf-8?B?dEhaa05pSlVpUnpXQmx6K0Vkb3ZUZ1hZank0NWdqV0RMN0ZXY1VPMGIvVVF6?= =?utf-8?B?dVNZeTlDa1VjMUtib29UNnRjdkJQcHk2bEFuaFo0MHJxRHAwZGFmWlNTQUR6?= =?utf-8?B?QjI2d25VeERUZzk0TFJOc0xSR3NHQkNBU3pUc0Y5bGkwWU1Yc2ZjdW5vL1Zq?= =?utf-8?B?Q215NjM5b0Y1OEtwV3VWcHlpcFJFeEp6NllJT04xMzQyZGoyNnREZFdKYkF0?= =?utf-8?B?c3BzSWRZdlNQSjN1SW45Qk1uTEdDTnV6SkFONzhGNVJFN09TZXlKUExWb3Ja?= =?utf-8?B?aUl2ZS83eTllMVVrM0hJUnc1ZnNsWklPNklrQTNpWmVHMy8vUG9SZVdzWnI0?= =?utf-8?B?WjlVNTlMdldjQWFmUitOUFNwRXg0QUdtVUVEZm5icm5tNGlCN1RyWkFHSk8w?= =?utf-8?B?c2prejFKU3lxOW9oTDRXNCtQalVhVVB6SzB5RHZnbHZVMk5aMWxvMnN1UDk0?= =?utf-8?B?NkkxVXFXWjE0TU4wM0hxSjkvWFR6MkhhZVVJWHpCOVJSZTVSV21CMDhWMWRB?= =?utf-8?B?VmR5dk1TcVFEL3c3UUVwbzgzN0I3NmkrWU4xMEdkTXJyR2pQQzVYbkRRalk4?= =?utf-8?Q?bdoQrc2WKft8NQSCpsDkGa84wEqFQUuPMjfWamq?= X-OriginatorOrg: amperemail.onmicrosoft.com X-MS-Exchange-CrossTenant-Network-Message-Id: df315fab-8baf-4746-f198-08d96cf5ae7c X-MS-Exchange-CrossTenant-AuthSource: MWHPR0101MB3165.prod.exchangelabs.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Sep 2021 03:07:50.2945 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: sSnx1+1k7QJh+EK0FMGJo/1Oml5F0qMuBrFG9NxiTQBVTMoQVI1mNToIg56IX5jUG5kYI3SLYoYuLK0B/oSrDraW/oOwlFJzD4s4x7q1IJVX88FC2pgq3SJCQUPd3nZI X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR01MB6132 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Everyone,     In the NUMA, we only have one page cache for each file. For the program/shared libraries, the remote-access delays longer then the  local-access. So, is it possible to implement the per-node page cache for programs/libraries?    We can do it like this:         1.) Add a new system call to control specific files to NUMA-aware, such as:                    set_numa_aware("/usr/lib/libc.so", enable);             After the system call, the page cache of libc.so has the flags "NUMA_ENABLED"         2.) When A new process tries to setup the MMU page table for libc.so, it will check              if NUMA_ENABLED is set. If it set, the kernel will give a page which is bind to the process's NUMA node.              By this way, we can eliminate the remote-access for programs/shared library. Is this proposal ok?  Or do you have a better idea? Thanks Huang Shijie From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.0 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 12B30C432BE for ; Wed, 1 Sep 2021 03:07:56 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 717E460F9E for ; Wed, 1 Sep 2021 03:07:55 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 717E460F9E Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=amperemail.onmicrosoft.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvack.org Received: by kanga.kvack.org (Postfix) id C9C618D0001; Tue, 31 Aug 2021 23:07:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id C4C5D6B0071; Tue, 31 Aug 2021 23:07:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id AC53C8D0001; Tue, 31 Aug 2021 23:07:54 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0194.hostedemail.com [216.40.44.194]) by kanga.kvack.org (Postfix) with ESMTP id 9C7D76B006C for ; Tue, 31 Aug 2021 23:07:54 -0400 (EDT) Received: from smtpin12.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 4418D274DC for ; Wed, 1 Sep 2021 03:07:54 +0000 (UTC) X-FDA: 78537520068.12.73CAE4E Received: from NAM11-BN8-obe.outbound.protection.outlook.com (mail-bn8nam11on2124.outbound.protection.outlook.com [40.107.236.124]) by imf29.hostedemail.com (Postfix) with ESMTP id CE3299000247 for ; Wed, 1 Sep 2021 03:07:53 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=g+U6tvFpQelvSMNirbNnVFH90G5FCR/+dpGcx3izauWn+pDrLxCK5Ej8Dg++gXQQ5S4c/dDAEMxcko4hgYJip5Qhc0APf95SMmu+TLQaOmgFM2hqosKzgK/GyMu0++lnVVbYRuO5G0Pl2ju6m1OMFKUusuOZn3cS4PWZ0fg8tH7hWQX03I2JSAeUjOBYlenXxokxwVLVa8ifestJzLLPOMasG8RlHD3pMR2IH5Y2CzGRoM/Rhu+ArP3OCc+Q6KaZKo6KFmr0vhJP44+nQf+XrDhJTealO6ky3Y79sn5raWfc3qQoc+VE9Q1flWjtB1RT2ODlQYDSyklAj7VfgJbI8Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hiqgA1CtM/LYpBxz9qQVmXtP2iYf/EUzzURNb9iYblA=; b=LUjyX4PZJfsElwc690RY+zgezevcgMyTrxAh/jDMfIO97HgAPDZreD1TF+dLdOhIu6S+LvXtW6bZRBxVA64w1l2O0MQxqj7jCUFI6YyjeywwJ+RdmzrOibEL1xMVt0EVT26Sa47Ug5J5DqOF79xnTsPOOWNbByLSZI0NSCH9DZIdgAhHOd9i8CqLRvPjRdfEwlDC9j+Npw9sWo9R3SEZov2bnzxwUvbEqEv30myYoLR/BXrlUezlS+ABy6UHnQ72e3HpW0UiDsJZiF1CCZCe/VLUlg1K3h7CvoG48TQEOhmS4bqmSMPepqvWY+KecKHgVK6DLCVCTJhfhXy5hcvUuw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=os.amperecomputing.com; dmarc=pass action=none header.from=amperemail.onmicrosoft.com; dkim=pass header.d=amperemail.onmicrosoft.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amperemail.onmicrosoft.com; s=selector1-amperemail-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hiqgA1CtM/LYpBxz9qQVmXtP2iYf/EUzzURNb9iYblA=; b=TCkEmqebF4HYDLcImGtk7Yf71L6wW4/Auhdp2wkIjSx8Cdx55DtG3naEDrpmd4zdIVaN16wMeaEHW7o80h9F0RF/a+nMltuj6HTo7KhJL7jls9oa3+YA9r9cw+B979r8y3slImxuLjJfiL2KJZ8dApWgH/q98Dz8q8aG4U3FsgY= Received: from MWHPR0101MB3165.prod.exchangelabs.com (2603:10b6:301:2f::19) by MW4PR01MB6132.prod.exchangelabs.com (2603:10b6:303:7f::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4457.23; Wed, 1 Sep 2021 03:07:50 +0000 Received: from MWHPR0101MB3165.prod.exchangelabs.com ([fe80::ed89:1b21:10f4:ed56]) by MWHPR0101MB3165.prod.exchangelabs.com ([fe80::ed89:1b21:10f4:ed56%3]) with mapi id 15.20.4457.025; Wed, 1 Sep 2021 03:07:50 +0000 From: Shijie Huang Subject: Is it possible to implement the per-node page cache for programs/libraries? To: torvalds@linux-foundation.org, viro@zeniv.linux.org.uk, akpm@linux-foundation.org, linux-mm@kvack.org, song.bao.hua@hisilicon.com Cc: linux-kernel@vger.kernel.org, Frank Wang Message-ID: Date: Wed, 1 Sep 2021 11:07:41 +0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: HK2PR02CA0170.apcprd02.prod.outlook.com (2603:1096:201:1f::30) To MWHPR0101MB3165.prod.exchangelabs.com (2603:10b6:301:2f::19) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [10.30.33.15] (180.167.209.74) by HK2PR02CA0170.apcprd02.prod.outlook.com (2603:1096:201:1f::30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4478.19 via Frontend Transport; Wed, 1 Sep 2021 03:07:48 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: df315fab-8baf-4746-f198-08d96cf5ae7c X-MS-TrafficTypeDiagnostic: MW4PR01MB6132: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8273; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: Fl7tHaFQfA5ogAKA4yadsbfRZCJhL1gsK0lOpKLjLRjNzXhecuebhr+zHOhr7vC9GiVH6/NuEIB/63O/Ok5wlTo2G5+qRXiJOIHHExh9DQyQOnTtE+2jHkhlzef+JuxoglhxJrAmzHjYmnYZ4ClexmMftzDR6uA+DKsB8XXh8Fvw2dzYyaYQAHSqQZZXiPSApIJ8JVOCp/T58Lq67WIXrb8F+dJQun4S0KuKOaSyEPRlXU60ZnZcGe/opGjlsuVxTbCBBNQTnQsMqJy3PEopJnNGcC6tm65rmPulC/8CaM8Vh7bySGE7FTzOkQ8xIMtEGiPdaU59Ocv8KzWzTMYUXjbjMIoNch0MWOek+rtCO9bqaa/gDoOLZYXLsS06yANkym8Zqxp8g85Wk1JXW//cNtMg6KDc/Z01k7gX5UQxvd+UC3Kx9xG6g4vvC1PCdPvssX+Q7bAp53JhB3ZMygKN/xz4EGv7FVgboizwHrbY6QB+9WJOdHay6coWWzJxfOABRDf6X6SS/bCdH6dBGpiNKJ/H23MZ6xu/hTAGUy6TOQKf86tOj2e7dj+lQEBMUeEmvioFrR+4eRnOyrJ7vbKp3mkvkSqAP6rX2hOYk8JDR3CQbYNwnHyKW/Rfs8YESEvl8JS2+9VNhQJUQEP48stZkiQnECDkBeyPJ8QWKuzkdsaNC/GwUTjyfNN0tqhRSp5+eX09MplGf40auueDbnv65BGI5JIW/qmJ6RwNV9+3i1V4/bhyISKFSZuTtMmrj3+2f4+HFiO3ZUgs5z7Nf3n4ww== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MWHPR0101MB3165.prod.exchangelabs.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(31696002)(6486002)(26005)(42882007)(83380400001)(5660300002)(83170400001)(186003)(66946007)(316002)(16576012)(38350700002)(508600001)(38100700002)(66556008)(66476007)(8676002)(956004)(6666004)(2906002)(31686004)(107886003)(52116002)(2616005)(8936002)(4326008)(45980500001)(43740500002);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?Q3V5TEl3T3FpUjZKTUsrbWlPTWRPaW9VZXh5S0J3ODhodWRHT1pxYkFDeC9v?= =?utf-8?B?RnJKRWlSeis2eU5aOXFxaWNPaXpWUFVKcmZGLzFWaDJtYU5CaTJaZ0RNQXdw?= =?utf-8?B?NXNIdTlTL1czZ04zb2hwR2pSVmVoaDliWHZMWUNWcy9TSHZldExmU1EzZ1NS?= =?utf-8?B?eit0LzFpMGhpdkxWN3RNRlBVb1hLNmNiU3BteTBDSHhiT3BjYThnYTNjUEhL?= =?utf-8?B?VDZrSHJCSDk4bEIyVWpWN21MTWNRK01pSVV3Tnl4cVdLK3hrWkpIUW04elVE?= =?utf-8?B?U0gvTzdpWldkYUh2MEg5akJzTFVXcFlPWDJMMVdIbmRMTzJjUVExS3Vqa3o4?= =?utf-8?B?Zjk0bzNQcWt0REFOSk1lZE9Fb1oxb3FVdHhIT2ZWcG5FU3RhbnJmUmowbGNh?= =?utf-8?B?VjRsd2lMMmtPcVlpdGI2aFRoNDUzb1ByZ0thdERFSHlETWMvRG1ETW1hWlpN?= =?utf-8?B?dzgwenhiT3l2TXNacktpcGdBV3pkTWtRdWtZd0dqVm43MmNNRlFCWTBLYUxM?= =?utf-8?B?TS92STNob0NUemdzL2lmZ3RPenBlY0NCU0ZFZXBDOXgrNDZzSHpyaksraW14?= =?utf-8?B?cUkyUmErVXRxMDFpT1hqYzgxS3Z5TllwQ21sck5iT3hBWW1MMVRCalQrMXRR?= =?utf-8?B?RzU5WUdUWm16OTZCSStrdjlCVzZvR09jdW1WZlNyOHlQcVBSTHBRaHRUaUt5?= =?utf-8?B?aldPTjhkdkswc0JJazliZVFIQXBpamJRZ0ZZRmVnYnUzcW1aRXdJc1l0MzRP?= =?utf-8?B?cHNMczVpekxpeHVyOTFHVWh5YXhQOS83eWg1Yi9sRXd6eXcxMnlEaVlHWlc2?= =?utf-8?B?OE5DU1ZIM2xqVnFqeTgxZmIvZ0JNZ1ZpWmdaNWtpd05WbWtjU0VqTGJUM21v?= =?utf-8?B?b20xbFFrK1ZjZXZWWnFGaFozODNRZ3NDeEp4MXBJU3RvdlZPN2tldm5oUEY0?= =?utf-8?B?N2l3MHRuMitOanNuRVdISFR1bkJ5cXg4R29MTUxuZzRuYmNUci9MdFk1SHVP?= =?utf-8?B?dnlaNDNYa3gyTVVnUVhQTkVxblFjNDUvd1UxWDlNNlVJTE45NzZLTElQcStx?= =?utf-8?B?REtPZUxnL0tKbEo2SnU1MWY2bVlreitPb3hyM0lOUVFVa2IrR3RtZlFFSkpE?= =?utf-8?B?OVRraDRVSmlRenhpSHljdWcyVFI2OHM5WjdnenBRU3FoZ0tiL3lQSS9ZMjJZ?= =?utf-8?B?RWpZaVlIYTNtMjMyT2Z6c2V6UHoyTllsYVRTcmluZVQ2QnlPeS93cGM1RlYx?= =?utf-8?B?c3QyK2JSTW0wdUpmbFZuMzJFdjVLWGltSDJ1VGNGTUY2c3RnQ1ZhbUNJc2Ez?= =?utf-8?B?NXhoN2I4NXA1Nk5KYUM0RFhSWkRMb1RydTZLNVo2OWpZSm1EV1ZLcUJyTThG?= =?utf-8?B?SVh0bWI2VXo2OXkyYkF2ZkgxU01MTGVLa3ZoaGtPTGhWaWVkUDcxVU9iNWRH?= =?utf-8?B?YkN5N1RjWHMwK2dhaUVnM0JpM054L3FhVWRGaHB5TlIyeHVJMTl6SDY3dGxV?= =?utf-8?B?UHBMM2w1KzR0amlROWlyckEvMk0zRlNRa0JGUmVRK3V3aFB3bkFGb2RVR2hO?= =?utf-8?B?bkI3cFRsODFRWWF0Qk9DamFTVEUrUEpiZUx4YmlldkZQMTFqNXA2SHc4eFU1?= =?utf-8?B?QU16TVZrSG9OTXI0YXBrRzUyMCthTDgrUTRxUHU0MXcvVUU1Ym9RcFNhYmts?= =?utf-8?B?R0xKbzI2YTkyK2VjNVlGdmp1VWhTQUo2eVJJNGhEZk5FMUZ3U3V4Zm5zdnN3?= =?utf-8?Q?TfDPomwAtb26XOSFYcp7DH7OfBJBmRkcQOrqBk5?= X-OriginatorOrg: amperemail.onmicrosoft.com X-MS-Exchange-CrossTenant-Network-Message-Id: df315fab-8baf-4746-f198-08d96cf5ae7c X-MS-Exchange-CrossTenant-AuthSource: MWHPR0101MB3165.prod.exchangelabs.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Sep 2021 03:07:50.2945 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: sSnx1+1k7QJh+EK0FMGJo/1Oml5F0qMuBrFG9NxiTQBVTMoQVI1mNToIg56IX5jUG5kYI3SLYoYuLK0B/oSrDraW/oOwlFJzD4s4x7q1IJVX88FC2pgq3SJCQUPd3nZI X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR01MB6132 Authentication-Results: imf29.hostedemail.com; dkim=none ("invalid DKIM record") header.d=amperemail.onmicrosoft.com header.s=selector1-amperemail-onmicrosoft-com header.b=TCkEmqeb; spf=pass (imf29.hostedemail.com: domain of Shijie@os.amperecomputing.com designates 40.107.236.124 as permitted sender) smtp.mailfrom=Shijie@os.amperecomputing.com; dmarc=none X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: CE3299000247 X-Stat-Signature: pa8x5ty7ez1tb7h31ojuz19ibxdgs4pb X-HE-Tag: 1630465673-363442 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000021, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi Everyone, In the NUMA, we only have one page cache for each file. For the program/shared libraries, the remote-access delays longer then the local-access. So, is it possible to implement the per-node page cache for programs/libraries? We can do it like this: 1.) Add a new system call to control specific files to NUMA-aware, such as: set_numa_aware("/usr/lib/libc.so", enable); After the system call, the page cache of libc.so has the flags "NUMA_ENABLED" 2.) When A new process tries to setup the MMU page table for libc.so, it will check if NUMA_ENABLED is set. If it set, the kernel will give a page which is bind to the process's NUMA node. By this way, we can eliminate the remote-access for programs/shared library. Is this proposal ok? Or do you have a better idea? Thanks Huang Shijie CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is = for the sole use of the intended recipient(s) and contains information that= is confidential and proprietary to Ampere Computing or its subsidiaries. I= t is to be used solely for the purpose of furthering the parties' business = relationship. Any unauthorized review, copying, or distribution of this ema= il (or any attachments thereto) is strictly prohibited. If you are not the = intended recipient, please contact the sender immediately and permanently d= elete the original and any copies of this email and any attachments thereto= .