From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id B508CC433EF for ; Fri, 17 Sep 2021 18:03:31 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 9B2D561216 for ; Fri, 17 Sep 2021 18:03:31 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S245080AbhIQSEw (ORCPT ); Fri, 17 Sep 2021 14:04:52 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:57996 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230115AbhIQSEv (ORCPT ); Fri, 17 Sep 2021 14:04:51 -0400 Received: from mail-pj1-x102d.google.com (mail-pj1-x102d.google.com [IPv6:2607:f8b0:4864:20::102d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 4EA22C061574 for ; Fri, 17 Sep 2021 11:03:29 -0700 (PDT) Received: by mail-pj1-x102d.google.com with SMTP id mv7-20020a17090b198700b0019c843e7233so4220849pjb.4 for ; Fri, 17 Sep 2021 11:03:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=posk.io; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=36UC4VgoNG+xUtS3CUnA5OGNelTv5dcazwBLXCUgHnY=; b=P1pGgZux5VMQly7sgAybNbszwaVyT5rwESyq+rTJiAKIJbuLc2+x+ycZbQbZ4JI14H Db8JqrT1DkjnkiYttNeODKJnmZ7udMy35kEIeBCVa9/8TBOwuPhDuR6RCyhztWnlsAjy t2NSz6HnBcD47HCQNO71jicTOg/3MYm0g7dRyYjjU6VkXIyAiPXGu3LrWHkp1rdHSx01 CoDtapPx38Gh4KeDoc2p1nKKnLELg5mIKL6UuwlocI+sFLnVgp5RhTWMnVqGSyU1dSjz dLFdlUyOrY8II6Zi74OoLAYiQgKiO7VT1J+tsrQfTo2TqA/FI8D4Xk/YnBeTSfH2XyaQ Zsyw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=36UC4VgoNG+xUtS3CUnA5OGNelTv5dcazwBLXCUgHnY=; b=VLAkeU/kvoyqcPX+eWHDr1Bymhw8Zjz5+X1/LliuQPQrJFlDMVPrCw00wx4NHrFEyK ZEYKRTxmQNjQRUox0jy0N894xiAqPBAFZNuuTvTOgm8p/t+yYg1L5x7cRjnAI6iLFckb 5ggu85d9BlzPq/RveFC+67aLtEGGMxQawPuuHS1bJzS4jfW9hW33aL29psnj5bwL/64Q WQveaIqrIn523VcRkFukrkD2wXE9UDzQ8aZmreb80B/wtwqbMv3Wgckz6+W9rH6cz04X eyh0GLFS+mR6UdTwzoeaDOfU1AG5sedRamhTAAHGXZjYL38azyk1H/qxPHVQhs4sVSbs HCKA== X-Gm-Message-State: AOAM5301uvPscE2krlheSiH3JvoeQSc8EAEcvwfWg5F5isUMAqYYggcs kuUyYlXJsvQAgysY7neu3goBKQ== X-Google-Smtp-Source: ABdhPJxeNM00Cp6rlI/AYcwyGrkNzny06sDpAiN8TOJ491ocsLeW14aAgGv/7dHroVBI6eDgT//ZIg== X-Received: by 2002:a17:902:c94f:b0:13b:8359:9506 with SMTP id i15-20020a170902c94f00b0013b83599506mr10707262pla.33.1631901808773; Fri, 17 Sep 2021 11:03:28 -0700 (PDT) Received: from posk-g1.lan (23-118-52-46.lightspeed.sntcca.sbcglobal.net. [23.118.52.46]) by smtp.gmail.com with ESMTPSA id b24sm5781773pfi.205.2021.09.17.11.03.27 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 17 Sep 2021 11:03:28 -0700 (PDT) From: Peter Oskolkov X-Google-Original-From: Peter Oskolkov To: Peter Zijlstra , Ingo Molnar , Thomas Gleixner , linux-kernel@vger.kernel.org, linux-api@vger.kernel.org Cc: Paul Turner , Ben Segall , Peter Oskolkov , Peter Oskolkov , Andrei Vagin , Jann Horn , Thierry Delisle Subject: [PATCH 0/5 v0.6] sched/umcg: RFC UMCG patchset Date: Fri, 17 Sep 2021 11:03:18 -0700 Message-Id: <20210917180323.278250-1-posk@google.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Many thanks to Jann Horn for a detailed review of v0.5: https://lore.kernel.org/lkml/20210908184905.163787-1-posk@google.com/ The main change in this patchet vs v0.5 is pinning of pages containing struct umcg_task of RUNNING workers and their servers. This allows uaccess operations from sched_submit_work (preempt-disabled). The pages are pinned only for RUNNING workers, i.e. at most NR_CPUS pages are pinned by UMCG at any one time, across the whole machine. A smaller change is the move of worker wakeup processing from sched_update_worker() to exit_to_user_mode_loop(), to ensure that no kernel locks are held if the worker is descheduled there. Commit messages in patches 2 and 3 list more changes. Peter Oskolkov (5): sched/umcg: add WF_CURRENT_CPU and externise ttwu sched/umcg: RFC: add userspace atomic helpers sched/umcg: RFC: implement UMCG syscalls sched/umcg: add Documentation/userspace-api/umcg.rst sched/umcg: add Documentation/userspace-api/umcg.txt Documentation/userspace-api/umcg.rst | 550 ++++++++++++++++++ Documentation/userspace-api/umcg.txt | 537 ++++++++++++++++++ arch/x86/entry/syscalls/syscall_64.tbl | 2 + fs/exec.c | 1 + include/linux/sched.h | 56 ++ include/linux/syscalls.h | 4 + include/uapi/asm-generic/unistd.h | 8 +- include/uapi/linux/umcg.h | 117 ++++ init/Kconfig | 10 + kernel/entry/common.c | 1 + kernel/exit.c | 2 + kernel/sched/Makefile | 1 + kernel/sched/core.c | 18 +- kernel/sched/fair.c | 4 + kernel/sched/sched.h | 15 +- kernel/sched/umcg.c | 745 +++++++++++++++++++++++++ kernel/sched/umcg_uaccess.h | 344 ++++++++++++ kernel/sys_ni.c | 4 + 18 files changed, 2408 insertions(+), 11 deletions(-) create mode 100644 Documentation/userspace-api/umcg.rst create mode 100644 Documentation/userspace-api/umcg.txt create mode 100644 include/uapi/linux/umcg.h create mode 100644 kernel/sched/umcg.c create mode 100644 kernel/sched/umcg_uaccess.h -- 2.25.1