From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from phobos.denx.de (phobos.denx.de [85.214.62.61]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 79D4FC636CC for ; Mon, 20 Feb 2023 11:15:32 +0000 (UTC) Received: from h2850616.stratoserver.net (localhost [IPv6:::1]) by phobos.denx.de (Postfix) with ESMTP id 7E0C685805; Mon, 20 Feb 2023 12:15:29 +0100 (CET) Authentication-Results: phobos.denx.de; dmarc=pass (p=quarantine dis=none) header.from=theobroma-systems.com Authentication-Results: phobos.denx.de; spf=pass smtp.mailfrom=u-boot-bounces@lists.denx.de Authentication-Results: phobos.denx.de; dkim=pass (2048-bit key; unprotected) header.d=theobroma-systems.com header.i=@theobroma-systems.com header.b="ReS2Ewg3"; dkim-atps=neutral Received: by phobos.denx.de (Postfix, from userid 109) id 348858580F; Mon, 20 Feb 2023 12:15:27 +0100 (CET) Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-he1eur04on0631.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe0d::631]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by phobos.denx.de (Postfix) with ESMTPS id DDEF1857E9 for ; Mon, 20 Feb 2023 12:15:23 +0100 (CET) Authentication-Results: phobos.denx.de; dmarc=pass (p=quarantine dis=none) header.from=theobroma-systems.com Authentication-Results: phobos.denx.de; spf=pass smtp.mailfrom=quentin.schulz@theobroma-systems.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=AA6ang1gN2fcGEDM/w+ja9rHaOeyWEYr+jiSURFibZ0yobYemWkGDFTcCzzchePflvovPb6bzho/G7KjK1SxUPfkZEKdAeiP6S93ab+DTfjyZKTLdr8/ctY9/rVkBORrQ9N6s4QL5zCsRvZ5Cv9tHH4Z/kFvkOIF/82CyueRxQNxyqCa/R+S/zarhNRETZ7ziZZPBNnaCR42UPPrC6D2iBQ+2IPqXuDTMYPkIwvACBzfTBsizGhZWZ+x4DS5wBjKvDzr03YDi9Phd1igbxa7C5oBzD+5zyE7pwpdmwAd+45ir5XmATDOL0sj6/JigidqFnijOZH/2eF+7OiBo1N9tQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=QF21ovitsY5kd0o4t8ZB8tJSnS97414xdhv56yt1TtQ=; b=jq99aMccBzJsv77O1QnwD+Qa2r63bGw7f9TJb2NCC/BdO5jKSJCo+DryJAhDo9a7/4XOyiu0trw8R1hfvKG6ndu1gMqpUSNaKi8nUao1myEr6MVSjHnZgUKmdHNOuV89Y51gjNa5pRIkC+fPD3Cmc0w5hTjrvyfw0VqQcZXNuwQO1XkjVlXFIkrdpLdSnLNw8DcG4OxuFjzFgy6C6Q29lCul44HWoW7VRzNL4KBBR7cwT4Du3txRVALR0Z6EuO9NWsA3UXvrgDm7JlubY3KCz4PECd3UxpEBd3d/r2YDA/tNQxfZ5xO6exLmFyeNZUz/K3t6C4QM4UKNWX/GLjWLbQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=theobroma-systems.com; dmarc=pass action=none header.from=theobroma-systems.com; dkim=pass header.d=theobroma-systems.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=theobroma-systems.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=QF21ovitsY5kd0o4t8ZB8tJSnS97414xdhv56yt1TtQ=; b=ReS2Ewg3U1IcKGqGX1JlFFArapICc1OftadBhTQvpl0Tf9RcLCe+3uq2XQsHzqRrbf5iq9X/ES91AJkaaQogn0bflK4LiN23g7JTqwmglGP0Gm79L/60iSNThf3HsDK9P3/0RdM8CrvFGKf+jrP/bUk1r241/xn8+3CRw1Uw2mRHkRyuyL39PEVib5PuSwHh+KobsINVRbX5eAU4KcQ9SXO5vrhbCPo0CzToQiyeOUTPkaLxdCXGDVulT4fptgoNWHVB7vpXjSHajbNdXvkESlLWrPeCGS8ADERO43Y4btmRvZf+f9LqveeNYM1e1W0JvGVQKUk5JPlLnseCyMltkA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=theobroma-systems.com; Received: from DU2PR04MB8536.eurprd04.prod.outlook.com (2603:10a6:10:2d7::10) by AM7PR04MB6775.eurprd04.prod.outlook.com (2603:10a6:20b:102::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6111.20; Mon, 20 Feb 2023 11:15:21 +0000 Received: from DU2PR04MB8536.eurprd04.prod.outlook.com ([fe80::24d3:14a5:eeda:6cdd]) by DU2PR04MB8536.eurprd04.prod.outlook.com ([fe80::24d3:14a5:eeda:6cdd%7]) with mapi id 15.20.6111.020; Mon, 20 Feb 2023 11:15:21 +0000 Message-ID: <46bd706b-05e9-75e0-7ccd-1c869c7ff764@theobroma-systems.com> Date: Mon, 20 Feb 2023 12:15:15 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.7.1 Subject: Re: [PATCH] binman: Avoid requiring a home directory on startup Content-Language: en-US To: Simon Glass Cc: Tom Rini , Mike Frysinger , Mark Kettenis , u-boot@lists.denx.de, alpernebiyasak@gmail.com, n-francis@ti.com, stefan.herbrechtsmeier@weidmueller.com, philippe.reynes@softathome.com, peng.fan@nxp.com References: <20230210135941.1.I81a5b410c8645752b44ba7afa2c4406f7c80f3d2@changeid> <87ttztuse7.fsf@bloch.sibelius.xs4all.nl> <604373d6-e085-2ebd-2822-1d11cf3392dc@theobroma-systems.com> From: Quentin Schulz In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: FR2P281CA0126.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:9d::20) To DU2PR04MB8536.eurprd04.prod.outlook.com (2603:10a6:10:2d7::10) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DU2PR04MB8536:EE_|AM7PR04MB6775:EE_ X-MS-Office365-Filtering-Correlation-Id: 5982baae-d4fe-449f-76f0-08db1333c132 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: Cdjh1iN6HdJhz5wwbyPvfOOo9KKlkAGfhk6JWB5MBivC6/B8kRSf2f9+IZj06SVEKl8qee+j4bJvYTuvsZ0LcncSte40oGAV4YOjCSlAa0wr/frtVdmeSM4c9zjnENyQZ9ey3LE42fZeZJgrASOCrzHO3sHLf5uZbWsAEQTocwezqz2EdhXpQ0oJStOucSeNFEASeE3F2RChcs3V2yotzzvmjyBIGmK1CI8VN8MGVh/elNcykFsbBhjbeFHZY3F29+R+2Apa06mFwI+BVp0RVh1dbKs8uLKyb3w1lMoJuAY1RahyxtJ1rKzytZDYa8mGzEX3GN/+fosHxKVvtHVRs20r5SNJapl4lhvQmdJpGwgizFSQxDBeipHaM4GMCB96cNDA2WTfg+edG3AGRs/c6qPjPwnNZflX7J7t7Jy/hD8SdWrrYTdfuwfRZ1eCnXJ6jWir0gZdhQM/S5madGxs+KeKCRhC26gA+xd4pRMbJNLVzgTu1YlTy9r5zrwbRUqeCWA+lF07hPp/VOx7InbLvVdj7UyV/lIegipV6bOMvt5pTRmwRFxLTwvHxo2nErjBpX3xEqEJkYm8f/hffnM88DWV/lBHpeBM259X//2+ozFvulmAKbh+B68my7KVZAjjrkI/n5etfVKU6x7KklMsd3bVip8454U/0bTb6aVqr/bjilaEtGgxBtChzAOUhba4wgXw9hq6LWvj7pBbcSx29BqSV0bQxb7mduc80ljy7E8= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DU2PR04MB8536.eurprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(4636009)(39840400004)(376002)(366004)(136003)(396003)(346002)(451199018)(83380400001)(8936002)(5660300002)(7416002)(66574015)(41300700001)(86362001)(44832011)(2906002)(4326008)(6486002)(6666004)(6512007)(186003)(26005)(6506007)(316002)(6916009)(8676002)(66946007)(66556008)(66476007)(53546011)(2616005)(54906003)(31696002)(478600001)(38100700002)(36756003)(31686004)(45980500001)(43740500002); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?N25JWU1ySnQ1R2xGbk5vSUZKam4yNGVRYVlyakN6YlBZaUZDRFkzTFhkdEEw?= =?utf-8?B?Rk4vbWFNbTFtbDJHVG9iVVZsU0Z5anhnRUdQSXV4TlNjSkVjdGhvZXVXaEhp?= =?utf-8?B?OHNUNDFYenM0ekNJZ1pSTlZMd1Vob1d3UUEwMHZVbU5lRHdhR3ZLYkEwNGpj?= =?utf-8?B?RlNZYURyTjhFSmZ3WjBudFF5ckxWd0VYeFlHRC93ck9LYmZrRTIyUG1VR1M0?= =?utf-8?B?U2QxakRMUE95SFVnbTVCR0hKUVNJc1o5eFNid3U4SE9iMGp0ZFlwc0xxS2F2?= =?utf-8?B?aHp3VjhPbTZyUi9HZjNoOHVTMVlOTWEvZHdrSEI3cjVOblg0OCt6dG1kYmth?= =?utf-8?B?aE9WdWlMdmllVVV6bHMrN0ttdVQ5SktSNW1yUGpuNjg2YjQ4TGdHdnVHekR6?= =?utf-8?B?VU82cHdPYU9BNEZJelVwYXI1amNtYlorRC9HQk4zMkNYVnIrSnBpMTJYZ25H?= =?utf-8?B?WGFFR01aaVprdFhCa0JZMWt1NG4zWnhaWFdlVzhCVlY1WjRNeWNvT2JHLzND?= =?utf-8?B?aytKNlVPcEtweXdTNVZTMk5zaXJZVVJocTJFbVBSOEIyMkpsZ0pyZHVkclR1?= =?utf-8?B?K3pJd2NudHBIY2svMkRlcEt3azAxL1B5M3ZPOERDYUhMLzFLdHRBUTdwTUdx?= =?utf-8?B?eTBFR2pkazhMUzlzWGNzU2ZsYmIxNDFwTU9tOXZxU0ZrVkNJMWFuWjhLY00y?= =?utf-8?B?NnM5SlJLZGl2Tm5pUnpvVGVjRithOEFqSU8rcXN0L1B2VVNhNWwzbDBtZzRr?= =?utf-8?B?QzNqZVBkZUYzaFNNQzdHL0U0Z2VIK2tXaTNkdWRHUjc5c0ptNDZJd1ZkTkYr?= =?utf-8?B?ZDYydEt1TTZIbFZlN1hGWVMvWkdlMkRVdkdLc1BjNExlSkpaMVA2MDV1LzBL?= =?utf-8?B?QytiZjBLTHFkMWQzdmtLVEhRb2RNTXl2VTJYc3hzNXV4STZ3OWp0K0xNY0M0?= =?utf-8?B?RVgwKzRvSHA1YXdDT3g2Z2s1RzhVejV6Y25mellPSzZXRitOK3hGUzBIMDBz?= =?utf-8?B?Q2gydEpLbmFaaTIzblIvbHpFLzZzaGhLdG1nZThYYnBRazZsS3JEVTA4YlM2?= =?utf-8?B?UG9NUm94L09IdHFTNzd6Z1lBSU12Q0ZqaEl6akF5MFJ0YVY5Q2dibFVJSXZT?= =?utf-8?B?M3VjMlA0TWlWZ3RsclM4d2tkY2twaGJyM1NkRnViaEpRTEg1OEIyTFNYZndw?= =?utf-8?B?cE8zc1VSem9COXQyd2N4c2k1VzhncENrNU1ML3BjZDJ3M1pwWTJtMzVycjJk?= =?utf-8?B?am9xTGd2cy9SSGJndGticlhQRHBIaGxvNU9IaWIvNk4yR1pKdmZjMFY5UEJV?= =?utf-8?B?MURobVlJbGNPTHhZUnd6b3c3SkRBaFFneXRQbUs3TUpFOHRPdUt0NEhQV3Ji?= =?utf-8?B?WHN5ZjRteHlObmVoanpXaEdjcndpbTVWS2pLQVdsM0pDYitPRUVaeHNJQkJs?= =?utf-8?B?OENseDBMeWNBMHZHSU1tYVBzcW9iQityQ01heU8xRzMzR21heFk5eGYrZnBI?= =?utf-8?B?NGYzK2dPQzFxZFJNVWMyZ1l6Z0k2NURURk1UOEFwYWZ4eEVVV3kvU2JxYngr?= =?utf-8?B?QUhPN01aQzFjbDNzbmt4NTMxLzF5cytZSGR4c3E5YkFITFpMTDlKR0JWVHpi?= =?utf-8?B?UjA1L3g0Y2x4d1FmRER2UFZJdlI5YjB5ZHNFbE93T3p6eS9IUm9pTDVmMXVm?= =?utf-8?B?VEtWb1BuR2xZejRiaVRsVjdkSFp4ME5xWVoxaHhWaDkzY1dCakxaZHlidFY2?= =?utf-8?B?cDV6R3p6YVU1dEpZVHZreWRlRnprZmhKdjZRSDV0VVhmWDJWRzlDKzN1Tlc2?= =?utf-8?B?NjlqR1QxcUZ1alMxUHJqaEE3Y3dWZm9ZcWJsWmF4cExsUDFQUWZIbGVKSk9T?= =?utf-8?B?M2w0R2FMcm5ubURMRTJPWmtHdllZNFNubDNHN2FWUXFoYTVnVTBJVEV6dUJE?= =?utf-8?B?emU0TFJoaDZLcEhzaUpjOVlxdEgwZTBtazE4UDRTSzVraW9LL0pMMFI4dlhC?= =?utf-8?B?cHZWVk94WHpsR0dhODBZUGR2SHhFUkhMSGlJQmFrLzdYVkpxeDVBNVo4ZUlL?= =?utf-8?B?Y0pyUDFHRkJwSTk0eUxaUTI2SnBtajZ6WE42Y0IzYjQ5SVV5S3FCYlhPVk5x?= =?utf-8?B?U1JnVjdLcElCZFhCUndIbzJIaTM1Nnk5U2VKYVhzU3h0ZVRvYStqWlFSUHYr?= =?utf-8?Q?iWecYR7UR8DvsAnrd6V7vx0=3D?= X-OriginatorOrg: theobroma-systems.com X-MS-Exchange-CrossTenant-Network-Message-Id: 5982baae-d4fe-449f-76f0-08db1333c132 X-MS-Exchange-CrossTenant-AuthSource: DU2PR04MB8536.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Feb 2023 11:15:21.1595 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 5e0e1b52-21b5-4e7b-83bb-514ec460677e X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: c82k1UMTkoArG9mLZl3sKgtas2G1Amfh2KaSE5+P6nzUMGbRnIyzVYf1JJdzpBIX4aAlpFVuYH66UfdV4cz8xGOjh7hiFH7XQtTr5F7sNda+MxfNdE8HnZyTDF7cRArc X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM7PR04MB6775 X-BeenThere: u-boot@lists.denx.de X-Mailman-Version: 2.1.39 Precedence: list List-Id: U-Boot discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: u-boot-bounces@lists.denx.de Sender: "U-Boot" X-Virus-Scanned: clamav-milter 0.103.6 at phobos.denx.de X-Virus-Status: Clean Hi Simon, On 2/18/23 00:49, Simon Glass wrote: > Hi Quentin, > > On Fri, 17 Feb 2023 at 05:21, Quentin Schulz > wrote: >> >> Hi all, >> >> On 2/17/23 03:55, Simon Glass wrote: >>> Hi Tom, >>> >>> On Thu, 16 Feb 2023 at 17:19, Tom Rini wrote: >>>> >>>> On Thu, Feb 16, 2023 at 05:12:33PM -0700, Simon Glass wrote: >>>>> Hi Tom, >>>>> >>>>> On Tue, 14 Feb 2023 at 13:27, Tom Rini wrote: >>>>>> >>>>>> On Tue, Feb 14, 2023 at 03:12:46PM -0500, Mike Frysinger wrote: >>>>>>> On Tue, Feb 14, 2023 at 3:08 PM Tom Rini wrote: >>>>>>>> Downloading things from the internet and putting them in to the default >>>>>>>> PATH always and forever is also kinda not great? >>>>>>> >>>>>>> you just described a standard distribution. this is like literally >>>>>>> how all of them work. not to mention every other language-specific >>>>>>> distro tool out there (e.g. Python pip, Perl cpan, Go, etc...). >>>>>>> >>>>>>> maybe you'd like more guarantees on top (e.g. signature verification) >>>>>>> which is reasonable. >>>>>>> >>>>>>> but to be clear, this script is already merged & in the tree, so your >>>>>>> feedback doesn't block this patch. >>>>>> >>>>>> Yes, exactly. This is a fix on top of what we do today, so it should go >>>>>> in. But modern distributions only install signed packages, and >>>>>> language-specific tools tend to be a hive of bad examples. Looking over >>>>>> binman right now, I see that we're either using apt (and oh, there's >>>>>> "aot" typo in one spot) or downloading from a known Google drive, for >>>>>> only a few less common tools. >>>>>> >>>>>> So yes, I would like to see some ideas on how to improve things in the >>>>>> future so we aren't putting the binaries somewhere that's not a default >>>>>> (or frequently common) PATH location. >>>>> >>>>> Are you thinking they should go in ~/.binman-tools or something like >>>>> that? Then we would need to tell people to add it to their path. But >>>>> we could make binman look there automatically. >>>> >>>> We should document that it's where we're putting stuff, not so much >>>> "tell" them, unless you mean as a note when downloading. But yes, >>>> ~/.binman-tools sounds reasonable. Maybe a flag to point elsewhere? >>> >>> OK I will take a look. >>> >> >> I think this should be directly put into the output/build directory used >> by U-Boot, because what happens when you have two U-Boot git repos with >> different version requirements for those host tools? Then you need to >> make sure you're not building both at the same time, that you update >> them properly before each build, etc. > > My advice: *Don't do that* > > So far as binman is concerned, a tool is a tool. Tools should be > backwards compatible so updating to the new one should fix all the > problems. > That's a very bold claim :) > The problem with using the output dir is we then have to download them > for each build, or cache them somewhere. To my mind, the 'binman tool' > feature is a convenience to reduce the pain involved in obtaining > tools needed to build. It is a not a panacea for strange situations. > Have the default in the build directory and allow the user to define an out-of-tree directory if they want to cache them somewhere? Similar to Yocto with SSTATE_DIR/DL_DIR, Buildroot with BR2_DL_DIR for example. Cheers, Quentin