From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9DFADC433EF for ; Thu, 12 May 2022 02:25:04 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232646AbiELCZD (ORCPT ); Wed, 11 May 2022 22:25:03 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50240 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229823AbiELCZB (ORCPT ); Wed, 11 May 2022 22:25:01 -0400 Received: from outgoing.mit.edu (outgoing-auth-1.mit.edu [18.9.28.11]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A9DA4C2E; Wed, 11 May 2022 19:25:00 -0700 (PDT) Received: from cwcc.thunk.org (pool-108-7-220-252.bstnma.fios.verizon.net [108.7.220.252]) (authenticated bits=0) (User authenticated as tytso@ATHENA.MIT.EDU) by outgoing.mit.edu (8.14.7/8.12.4) with ESMTP id 24C2ObEp028012 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 11 May 2022 22:24:38 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mit.edu; s=outgoing; t=1652322280; bh=VS1Wz6MTDeDEe7mFjiXRuQFi0ffsrqAX4JhdhobUr+g=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=nNm5XGIRxTLkjZ9+UM/FNhm3f18Kz/55+4qIb2adh81DsdLJNfttLakxIdBFcKBz/ v6RcM3QlUFnreCqfGI9u0aM29E2Hajngw3eNDNzNaBwVfexhXlodmpISiMjDfCneba zKOe5AGr/mkJmrvK5CQdgcbL1k5Lz3M7eFbWYe4rUMHh1E6vRf9Q4fEwhUYDFlbK5y LWqOCX6pa+RkWVEdidnv1a0BZYzD3du3sS6sdLzZ/0AvpZequqUjv+mz6lB5zYAUT4 38DKNY31Qk0LCta6rxrZKK02UcwVWoo5XwR/bdEuCvaFs9XHUxOtFf4hqy3pynrbXw 6uy4GZTTcYUrA== Received: by cwcc.thunk.org (Postfix, from userid 15806) id 67CE015C3F2A; Wed, 11 May 2022 22:24:37 -0400 (EDT) Date: Wed, 11 May 2022 22:24:37 -0400 From: "Theodore Ts'o" To: Rob Clark Cc: Greg Kroah-Hartman , Michel =?iso-8859-1?Q?D=E4nzer?= , Tomeu Vizoso , Jonathan Corbet , freedreno , "open list:DOCUMENTATION" , Abhinav Kumar , dri-devel , LKML , Linus Torvalds , Thomas Zimmermann , linux-arm-msm , Dave Airlie , Sean Paul Subject: Re: [Freedreno] Adding CI results to the kernel tree was Re: [RFC v2] drm/msm: Add initial ci/ subdirectory Message-ID: References: <20220510070140.45407-1-tomeu.vizoso@collabora.com> <20220510141329.54414-1-tomeu.vizoso@collabora.com> <1255a66a-121d-988a-19a7-316f703cb37d@mailbox.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: linux-arm-msm@vger.kernel.org On Wed, May 11, 2022 at 06:33:32AM -0700, Rob Clark wrote: > > And ofc we want the expectations to be in the kernel tree because > there could be, for example, differences between -fixes and -next > branches. (Or even stable kernel branches if/when we get to the point > of running CI on those.) There are tradeoffs both ways, whether the patches are kept separate, opr in the kernel tree. In the file system world, when we discover a bug, very often a test case is found to test the fix, and to protect us against regressions. It has one other benefit; since the tests (xfstests) are kept separate from the kernel, it's a useful way to identify when some patch didn't get automatically backported to a LTS or distro kernel. (For example, because the patch didn't cherry-pick cleanly and the manual backport process fell through the cracks.) It does make things annoying when we have bugs that can not be safely backported (which results in tests that fail on the LTS kernel without kernel-version exclude files), and/or when the expectations change between versions. (Although to be honest, for us, the more common annoyance is when some userspace package --- e.g., bash or coreutils or util-linux --- changes their output, and we have to add filter functions to accomodate expected output differences.) - Ted