From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.1 required=3.0 tests=DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_PASS,T_DKIM_INVALID, USER_AGENT_MUTT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id DE846C433F4 for ; Fri, 21 Sep 2018 09:13:34 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 8D6A52086E for ; Fri, 21 Sep 2018 09:13:34 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="qI3TBC3P" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 8D6A52086E Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=infradead.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2389493AbeIUPBW (ORCPT ); Fri, 21 Sep 2018 11:01:22 -0400 Received: from merlin.infradead.org ([205.233.59.134]:51538 "EHLO merlin.infradead.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2389010AbeIUPBW (ORCPT ); Fri, 21 Sep 2018 11:01:22 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=merlin.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=6yPxsOtlw9W2+AXmLKs3L65FIJEhqMk64IGNPH0mW5k=; b=qI3TBC3PnDYwLYcEUD8hfPACK UTZ/3pr/DedyWWrTp9O+WbGYg+BcnGWPbDf/2maZAB5KD2pNDyd2B+88XkcLFLqx2aGScEGa6lpOc 1FMkq/t/ohYIhUPTG/hL7pXDZkFmgrojLG02iiYX1AAU/Pw0V9N3DNfJ00m1iTJ0YKQKgyvF4yzXt b4TBvtk4qHv1tPRo+7K1NHVzkOIY/JPIQB+Ak2Ahrds2Jqw47mQy0qsKfo7Ee2vpJT+Py0BYuPFSt pObyKdzBz6x7NLcgOHrCR41dsMJpFWZeK7FrYjfaDcH1rRkJjNTDLrYSqydODt657vs+UEtzpGB3S zE1+uhhJQ==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=hirez.programming.kicks-ass.net) by merlin.infradead.org with esmtpsa (Exim 4.90_1 #2 (Red Hat Linux)) id 1g3HUt-0002nm-1c; Fri, 21 Sep 2018 09:13:12 +0000 Received: by hirez.programming.kicks-ass.net (Postfix, from userid 1000) id 42C43200C0A5B; Fri, 21 Sep 2018 11:13:08 +0200 (CEST) Date: Fri, 21 Sep 2018 11:13:08 +0200 From: Peter Zijlstra To: Patrick Bellasi Cc: Juri Lelli , linux-kernel@vger.kernel.org, linux-pm@vger.kernel.org, Ingo Molnar , Tejun Heo , "Rafael J . Wysocki" , Viresh Kumar , Vincent Guittot , Paul Turner , Quentin Perret , Dietmar Eggemann , Morten Rasmussen , Todd Kjos , Joel Fernandes , Steve Muckle , Suren Baghdasaryan Subject: Re: [PATCH v4 14/16] sched/core: uclamp: request CAP_SYS_ADMIN by default Message-ID: <20180921091308.GD24082@hirez.programming.kicks-ass.net> References: <20180828135324.21976-1-patrick.bellasi@arm.com> <20180828135324.21976-15-patrick.bellasi@arm.com> <20180904134748.GA4974@localhost.localdomain> <20180906144053.GD25636@e110439-lin> <20180914111003.GC24082@hirez.programming.kicks-ass.net> <20180914140732.GR1413@e110439-lin> <20180914142813.GM24124@hirez.programming.kicks-ass.net> <20180917122723.GS1413@e110439-lin> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180917122723.GS1413@e110439-lin> User-Agent: Mutt/1.10.0 (2018-05-17) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Sep 17, 2018 at 01:27:23PM +0100, Patrick Bellasi wrote: > On 14-Sep 16:28, Peter Zijlstra wrote: > > The thing is, the values you'd want to use are for example the capacity > > of the little CPUs. or the capacity of the most energy efficient OPP > > (the knee). > > I don't think so. > > On the knee topic, we had some thinking and on most platforms it seems > to be a rather arbitrary decision. > > On sane platforms, the Energy Efficiency (EE) is monotonically > decreasing with frequency increase. Maybe we can define a threshold > for a "EE derivative ratio", but it will still be quite arbitrary. > Moreover, it could be that in certain use-cases we want to push for > higher energy efficiency (i.e. lower derivatives) then others. I remember IBM-power folks asking for knee related features a number of years ago (Dusseldorf IIRC) because after some point their chips start to _really_ suck power. Sure, the curve is monotonic, but the perf/watt takes a nose dive. And given that: P = CfV^2, that seems like a fairly generic observation. However, maybe, due to the very limited thermal capacity of these mobile things, the issue doesn't really arrise in them. Laptops with active cooling however... > > Similarly for boosting, how are we 'easily' going to find the values > > that correspond to the various available OPPs. > > In our experience with SchedTune on Android, we found that we > generally focus on a small set of representative use-cases and then > run an exploration, by tuning the percentage of boost, to identify the > optimal trade-off between Performance and Energy. So you basically do an automated optimization for a benchmark? > The value you get could be something which do not match exactly an OPP > but still, since we (will) bias not only OPP selection but also tasks > placement, it's the one which makes most sense. *groan*, so how exactly does that work? By limiting the task capacity, we allow some stacking on the CPUs before we switch to regular load-balancing? > Thus, the capacity of little CPUs, or the exact capacity of an OPP, is > something we don't care to specify exactly, since: > > - schedutil will top the util request to the next frequency anyway > > - capacity by itself is a loosely defined metric, since it's usually > measured considering a specific kind of instructions mix, which > can be very different from the actual instruction mix (e.g. integer > vs floating point) Sure, things like pure SIMD workloads can skew things pretty bad, but on average it should not drastically change the overall shape of the curve and the knee point should not move around a lot. > - certain platforms don't even expose OPPs, but just "performance > levels"... which ultimately are a "percentage" Well, the whole capacity thing is a 'percentage', it's just that 1024 is much nicer to work with (for computers) than 100 is (also it provides a wee bit more resolution). But even the platforms with hidden OPPs (can) have knee points, and if you measure their power to capacity curve you can place a workload around the knee by capping capacity. But yes, this gets trick real fast :/ > - there are so many rounding errors around on utilization tracking > and it aggregation that being exact on an OPP if of "relative" > importance I'm not sure I understand that argument; sure the measurement is subject to 'issues', but if we hard clip the result, that will exactly match the fixed points for OPP selection. Any issues on the measurement are lost after clipping. > Do you see specific use-cases where an exact OPP capacity is much > better then a percentage value ? If I don't have algorithmic optimization available, hand selecting an OPP is the 'obvious' thing to do. > Of course there can be scenarios in which wa want to clamp to a > specific OPP. But still, why should it be difficult for a platform > integrator to express it as a close enough percentage value ? But why put him through the trouble of finding the capacity value in the EAS exposed data, converting that to a percentage that will work and then feeding it back in. I don't see the point or benefit of percentages, there's nothing magical about 1/100, _any_ other fraction works exactly the same. So why bother changing it around? > > The EAS thing might have these around; but I forgot if/how they're > > exposed to userspace (I'll have to soon look at the latest posting). > > The new "Energy Model Management" framework can certainly be use to > get the list of OPPs for each frequency domain. IMO this could be > used to identify the maximum number of clamp groups we can have. > In this case, the discretization patch can translate a generic > percentage clamp into the closest OPP capacity... > > ... but to me that's an internal detail which I'm not convinced we > don't need to expose to user-space. > > IMHO we should instead focus just on defining a usable and generic > userspace interface. Then, platform specific tuning is something > user-space can do, either offline or on-line. The thing I worry about is how do we determine the value to put in in the first place. How are expecting people to determine what to put into the interface? Knee points, little capacity, those things make 'obvious' sense. > > But changing the clamp metric to something different than these values > > is going to be pain. > > Maybe I don't completely get what you mean here... are you saying that > not using exact capacity values to defined clamps is difficult ? > If that's the case why? Can you elaborate with an example ? I meant changing the unit around, 1/1024 is what we use throughout and is what EAS is also exposing IIRC, so why make things complicated again and use 1/100 (which is a shit fraction for computers).