From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.5 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, MSGID_FROM_MTA_HEADER,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 06ED0C433E0 for ; Fri, 22 Jan 2021 21:52:51 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 7F75E23B00 for ; Fri, 22 Jan 2021 21:52:50 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 7F75E23B00 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=oracle.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id E655E6B0007; Fri, 22 Jan 2021 16:52:49 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id DEDE16B000A; Fri, 22 Jan 2021 16:52:49 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C66666B000D; Fri, 22 Jan 2021 16:52:49 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0236.hostedemail.com [216.40.44.236]) by kanga.kvack.org (Postfix) with ESMTP id ACC286B0007 for ; Fri, 22 Jan 2021 16:52:49 -0500 (EST) Received: from smtpin13.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 73430B9F1 for ; Fri, 22 Jan 2021 21:52:49 +0000 (UTC) X-FDA: 77734761258.13.pig40_0604eb32756f Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin13.hostedemail.com (Postfix) with ESMTP id 4F251182009F3 for ; Fri, 22 Jan 2021 21:52:49 +0000 (UTC) X-HE-Tag: pig40_0604eb32756f X-Filterd-Recvd-Size: 12221 Received: from aserp2120.oracle.com (aserp2120.oracle.com [141.146.126.78]) by imf17.hostedemail.com (Postfix) with ESMTP for ; Fri, 22 Jan 2021 21:52:48 +0000 (UTC) Received: from pps.filterd (aserp2120.oracle.com [127.0.0.1]) by aserp2120.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 10MLfomF086643; Fri, 22 Jan 2021 21:52:46 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : in-reply-to : content-type : content-transfer-encoding : mime-version; s=corp-2020-01-29; bh=UXSUnZTY07JfDHqMSp6eopvHMk2eLDAwcykZE6mB0FY=; b=SyYoLEKLurk+fnfjmzGYKjSGT+gGnMmJD0UNdQGHLvhvV6o0bzqOdMx/P0V69rNA6a/b f9OcGQfNJg2RnhTVtpbURUzpEL0LEiumRqsPXUMYP+I30+TAXAYIJr0h9tXeIM9WSxVK sMnt0d8XIZYjDmlK3KUc4+8TlrN7Az9H8gwbDF7XVsLNTOUQw7uhejgfA5GD+yOPX8nr GenYX8+bo2TleXO4inJsa8f41Djq+QciFuV/MGO25FrnA2xpWsU8yHK5FcDlwtVzdwuI cAWvlirumwtz+4ANKj0Dv4FlZWXEIoCQAE4LJSKT3X5l2v0Dn32JQIBV2OHETkOpsUcj 0A== Received: from aserp3020.oracle.com (aserp3020.oracle.com [141.146.126.70]) by aserp2120.oracle.com with ESMTP id 3668qn6a00-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 22 Jan 2021 21:52:46 +0000 Received: from pps.filterd (aserp3020.oracle.com [127.0.0.1]) by aserp3020.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 10MLa9Zb085413; Fri, 22 Jan 2021 21:50:45 GMT Received: from nam12-dm6-obe.outbound.protection.outlook.com (mail-dm6nam12lp2170.outbound.protection.outlook.com [104.47.59.170]) by aserp3020.oracle.com with ESMTP id 3668rj62gh-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 22 Jan 2021 21:50:45 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=MTl1ExmpXmSv3ur8QhO9WcWwHA1wvw/We54xiP37akSrX9ehU+znhaUbw9yZpd/fahhx3s1PVz5wLq4FTPGuRl1zBdBZFS4zoPrBZ7m1tsBVHeZvmMifxpV/V0/Up/8SktO6E4MC7+1qUcYPZ2TBSul/0j/txnTKO3bR34O7Sk0t2Nve0yWtXQaslurfNmyobJq+iFY1nGOkl+SOupueT+dstmBlfCrJK5iGgNdRcHulw1gtOyZgtrjI9DEv+76EUt7aFoIHfxJVgLxIqrThnlYi1ESfO331xYGsrca3etkQBpznRMkSpcmAyqs0+Y6K6n76DrRVZFF/QQZEfwZs0w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=UXSUnZTY07JfDHqMSp6eopvHMk2eLDAwcykZE6mB0FY=; b=bTUl1c2eQGCkwQrfJn+cgMli18dJVZLInMv5x4zs2dwiOQVfkc778TOqvJ6BglQJcoec7Bwd568YpBB9cemu78TOkp29pC6zPQPw8Wcl0Bw4+C7zCe1clk5MxpEEGOGawk56BwpPGdygNjC90m+2NOChwc9N+QCbtLjgZRz3B22vud6H2WZy7z6yhqnEqOna8GEOjUtNVcQzPakN7YjMdh8PL1rOa8go0a33jGCYl9kfERMREoooHzy/mxxT0Mcr+t3hkOPdnpXIIYn6WjwDAF8JbCx9xB9VSv432uYVVdvN958FJch4Vdj2KStwZXJT2FG+lDMbrmxN3gUOrorkCg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=UXSUnZTY07JfDHqMSp6eopvHMk2eLDAwcykZE6mB0FY=; b=cGjdrjw2jRBDRcdOZCzPz9eJHU4HmofWh79wELRPwOtzKrkYedVPWSBVofHYCQb+wqFKnQBKznOnZ5OCSo86rQt1BCcBNBHzJb+FxEZl+mmHfaWPm7Rez6zKCFSMzZGdP0mVxAwLIp4XNu+bLRBRFyBmRvnlEanuMqV0K0zeazg= Authentication-Results: kvack.org; dkim=none (message not signed) header.d=none;kvack.org; dmarc=none action=none header.from=oracle.com; Received: from MWHPR10MB1389.namprd10.prod.outlook.com (2603:10b6:300:21::22) by CO1PR10MB4451.namprd10.prod.outlook.com (2603:10b6:303:96::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3784.11; Fri, 22 Jan 2021 21:50:43 +0000 Received: from MWHPR10MB1389.namprd10.prod.outlook.com ([fe80::897d:a360:92db:3074]) by MWHPR10MB1389.namprd10.prod.outlook.com ([fe80::897d:a360:92db:3074%5]) with mapi id 15.20.3784.015; Fri, 22 Jan 2021 21:50:43 +0000 Subject: Re: [Bug 211287] New: Softdirty bit does not work with hugetlb To: shu wang Cc: Linux Memory Management List References: <999775bf-4204-2bec-7c3d-72d81b4fce30@oracle.com> From: Mike Kravetz Message-ID: <6aa94855-c204-83a6-98e5-2841f1b00b16@oracle.com> Date: Fri, 22 Jan 2021 13:50:42 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.1.1 In-Reply-To: Content-Type: text/plain; charset=iso-2022-jp Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [50.38.35.18] X-ClientProxiedBy: MWHPR08CA0044.namprd08.prod.outlook.com (2603:10b6:300:c0::18) To MWHPR10MB1389.namprd10.prod.outlook.com (2603:10b6:300:21::22) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [192.168.2.112] (50.38.35.18) by MWHPR08CA0044.namprd08.prod.outlook.com (2603:10b6:300:c0::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3784.12 via Frontend Transport; Fri, 22 Jan 2021 21:50:43 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: bc226ddb-6007-4fbc-e952-08d8bf1fc47d X-MS-TrafficTypeDiagnostic: CO1PR10MB4451: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:6430; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: WPXwm4JptZnctxjJxTX/9GSkBjdDZj/tRkwJcPDgDBZZMzcxfrDNWPWkorBFnc1pt15xASYGbMALV9N5Ho2WQz04rZmsPBEPzvJOfHlUa2JA6SeLfqAFs5KwsXztc7dxbnjufscxwOXcqKx4qlVlgLIzKjypTnnzLotcglHWmSXaY/tvyGe6lqS0/4h8RZmHYKIjrLbA6krCaKg62FBSEGiyc8IAYvGGBf3Pap4+4UjT+3ig1WsWXJQM1WIMmp/fV/l78War09a0s9farJh3hIDORLX6hwjGGrESGo2YyXOa/wZ9W6EVFppcSw67JksrNxpvCPm0a0T1g8p7EHmy1/QF3vy2HkPQFhicoEHRO5ixCAx+suplw5lryBS994f+ca6dz/XqKU3XGKEFcvM0cVMfDRruukuhCB3omVXtwIZc8nOk7dd0BSX4PV2ZFRjSGeZ9/OwxcEuuWExej0WRt3rdFEztNhnSdID0jZ9KPo57UCVjbro9pL0kuWzqSo9gNIxHKG7KalUiCs8+aF4+3CmHI7NFf1wfSoH2/DtMKPTfNs81/DlA4au3EF18IRB+ X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MWHPR10MB1389.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(136003)(39860400002)(366004)(376002)(346002)(396003)(6916009)(316002)(66556008)(66476007)(53546011)(26005)(66946007)(16576012)(86362001)(8676002)(31696002)(2906002)(36756003)(8936002)(6486002)(5660300002)(186003)(31686004)(83380400001)(52116002)(4326008)(16526019)(45080400002)(956004)(966005)(2616005)(44832011)(478600001)(43740500002)(45980500001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData: =?iso-2022-jp?B?bE51TzIvVmEwMy94a0xUZ2FrRnYvSG53bWZyUTNzYUpSVFhuQnBjaGJi?= =?iso-2022-jp?B?MUtwUnZRSjBOcVFreEtPcnBheVk0bHJDVG4rcnF4cXQxa2o0N0QxOFFv?= =?iso-2022-jp?B?ZkxIQy9PSlJtQ29TNE9Xc2hTdzdmcFY3ckh2dlRtUEtzc1R5OFBzYmJ3?= =?iso-2022-jp?B?eDhQUGEvRmRjcGNZcW9pZTUvbFVYZGRQNVdia3ZRRkNkQk9kMG0zcHU1?= =?iso-2022-jp?B?Ujh0WmIvd0tHNFpYdTdZL0VCc2pqUUZLaW9mUlc3NmFVRXRqam85ZXhC?= =?iso-2022-jp?B?YjVpdndlRmJqRlRaTXZCZEVCRjk0b1RjSjZPQytjVFlRdTlwbTBpZHRK?= =?iso-2022-jp?B?S09ZbktNZFBzME9jZFYwdnJRUStUVGFYbWZ6R3RnaXBhVmhjSUxQZUFs?= =?iso-2022-jp?B?T2RkRjRJdTRPMG4xdkYvNFRYeVdKVlQwOStzSjJmMGVYeUtyN1BxNjVB?= =?iso-2022-jp?B?OGo4c1h4ZzNQN284bUY4SG5oVlN5ZzUvTWI1VU5Tc2wzYmR4STNHYzlJ?= =?iso-2022-jp?B?WDhCb0o4MnFiTE5hdU03WkhjWCtib1BPNTNrLzFvbVQ5RGJMemRqN0FH?= =?iso-2022-jp?B?ME1TWDErNk8vVXJMbnpIaWRvaWVLeE9ZTGRaK3B1RkcvYmhMR3pGOGJR?= =?iso-2022-jp?B?SldmbDJKcDZ4bVRSNVEvRlVMQkxVbXJlV0NlQUx2U09ncXVFT3pnMnFy?= =?iso-2022-jp?B?QnVKWU9VZ1NsMldhSkhmaFAxRTF3MmJmK0pRdFhLTWY2ZEl1T1BJcTNn?= =?iso-2022-jp?B?YlA5MkRHZFNoaDdMSkxkd3FrblpyRTdoRHRyTXl0ZjlteVQ5QUhQWThJ?= =?iso-2022-jp?B?VEVHYlUrOFIvZS9rTE1uWE1ZeGVyN0RYYWphYkhPeUFFckhjSmRiMCtt?= =?iso-2022-jp?B?NERDT3JYWisrOWdmMHhRNlg1R0N6a0llcU9jcGpBY1A3b3ZqRHR6Z05v?= =?iso-2022-jp?B?b3I1MkhNTW1wWVE4Y2JjaU5lTEdPdWZJRkNHTWNabE0wYmdZVEYzb1Vh?= =?iso-2022-jp?B?TjhpT2liSDFva1J3UlZhamR1cXNhRWZWcjZZRlRTY08yUUMvdlZONkFt?= =?iso-2022-jp?B?SjFqUVJmczBJcmRqRzA2azIyVUNJcmJxcUgwN2tzaUF2UURTOGphK1Zh?= =?iso-2022-jp?B?SjlyazNoSTBqTWVKNnMyOEdHMXdNc3lIQWVVMnYxUElLd2NyTzhNS2x2?= =?iso-2022-jp?B?QXd0cmZ3dkhNVVNUS0UyZytlbWVLUjdKZHNYWm5VcFpTeWkxeXBWZ1Jw?= =?iso-2022-jp?B?VlhYbWFGenRtZm9qNEdzZjV6eGw1eHRlS3FQVHdFMGprQ2lmVCsyRTZl?= =?iso-2022-jp?B?b0tKZWNBQTN2aGhVemhLZXE2Vmc2dEtGUk43TFFEeDJPZklpeEVLYTRs?= =?iso-2022-jp?B?R1lRbkFNWW1xUWxYbHVvbVc3dGplYjBodTFxb1BEQ1VkbUZDNkIvUDYy?= =?iso-2022-jp?B?MzZaQjd2dHMwajN5L2ZYbnhtVUlkM2Z4QWdhYnJzZmExaG0xcVR5WkdH?= =?iso-2022-jp?B?SVRqdjdSeEo5MzRZRnZUemh0V054Wno4WStrL0E2bnZkMVExNE4=?= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: bc226ddb-6007-4fbc-e952-08d8bf1fc47d X-MS-Exchange-CrossTenant-AuthSource: MWHPR10MB1389.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Jan 2021 21:50:43.6231 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: fzmqCLE8UW7HvlQJHaI5NzYzKpsCgAcoTaIRy5VZjtETA31CyjTvl9CrEUplqyRobxxW5vC2xmJuE6bfxFGNsg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR10MB4451 X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=9872 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxscore=0 spamscore=0 suspectscore=0 adultscore=0 mlxlogscore=840 bulkscore=0 malwarescore=0 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2101220112 X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=9872 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 priorityscore=1501 adultscore=0 impostorscore=0 mlxlogscore=962 spamscore=0 suspectscore=0 phishscore=0 clxscore=1015 bulkscore=0 mlxscore=0 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2101220112 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 1/22/21 10:42 AM, shu wang wrote: > Our use case is: > We maps both PMEM and hugetlb DRAM to process’s address space to provide large amount of memory to the application. Periodically, we clear the soft dirty bit by writing ‘4’ to the clear_refs. Then, we check the page’s soft dirty bit from pagemap and use this information to track write activity to memory. We migrate the data between DRAM and PMEM based the write activity for better performance. > Thank you for the information! If someone does not beat me to it, I should be able to look at this next week. -- Mike Kravetz > Sent from Mail for Windows 10 > > From: Mike Kravetz > Sent: 2021年1月21日 16:58 > To: malate_wangshu@hotmail.com > Cc: Linux Memory Management List > Subject: [Bug 211287] New: Softdirty bit does not work with hugetlb > >>> Start Bug Report << > Bug ID: 211287 > https://bugzilla.kernel.org/show_bug.cgi?id=211287 > Summary: Softdirty bit does not work with hugetlb > > When a memory region is mapped with huge pages, the softdirty bit is set only > right after the huge pages is mapped. After the memory mapping, if the > softdirty bit is cleared and the memory is written again, the softdirty bit is > not set when reading from the process's pagemap. >>> End Bug Report << > > I am not surprised with this reported bug. The page fault code diverges > pretty quickly for hugetlb pages. I have not looked closely at the details > of soft dirty, and do not immediately see where in the fault path for normal > pages it gets reset. But, I only took a quick glance. > > I can work on adding support for hugetlb. > > Can you provide some details about your use case? > -- > Mike Kravetz