From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.1 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A9202C3F68F for ; Mon, 3 Feb 2020 17:53:28 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 7D42020721 for ; Mon, 3 Feb 2020 17:53:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1580752408; bh=+F911pBIa8UlZE0vunHO6BITHlbAp/snKVv81Rwfgu4=; h=Date:From:To:Cc:Subject:In-Reply-To:References:List-ID:From; b=v++LEGNqB3xRvDDv2lzxn7LYnsjHf7yZcAkLCli+AZfjtbGspLRF7K+aou8bE8el8 2x1/FWpNfseFPrb3oHud3cGYGrnB4nX0PxNcf9FPaYbNjHiwgT5aiDuedoJmyXZJ/E erlmit1H/Igr1v7TVJ87b7W74jyeKF8fuF2mZGOw= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729133AbgBCRx2 (ORCPT ); Mon, 3 Feb 2020 12:53:28 -0500 Received: from mail.kernel.org ([198.145.29.99]:54926 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727311AbgBCRx1 (ORCPT ); Mon, 3 Feb 2020 12:53:27 -0500 Received: from cakuba.hsd1.ca.comcast.net (unknown [199.201.64.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 4530B2087E; Mon, 3 Feb 2020 17:53:26 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1580752406; bh=+F911pBIa8UlZE0vunHO6BITHlbAp/snKVv81Rwfgu4=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=yZNSUeOU9BuVDZG2NfZ2Cjbin6LdM35W5BRwsUTgG2fMGQpmbEIRG55wlqFO2Q1vb KZ03OAq6Q/zN85eIgsgOpx1N/Aw2Rg4CgvUUg7goyX16hRidDcTC32/9skI+kg/PKA XdgO+q/Pevl+hIOGqxPWBzNuO70YsRXXDwtYhRI8= Date: Mon, 3 Feb 2020 09:53:25 -0800 From: Jakub Kicinski To: Christian Zigotzky Cc: Christophe Leroy , Michael Ellerman , DTML , Darren Stevens , Linux Kernel Mailing List , linuxppc-dev@ozlabs.org, "contact@a-eon.com" , "R.T.Dickinson" , Christoph Hellwig , mad skateman , "netdev@vger.kernel.org" Subject: Re: Latest Git kernel: avahi-daemon[2410]: ioctl(): Inappropriate ioctl for device Message-ID: <20200203095325.24c3ab1c@cakuba.hsd1.ca.comcast.net> In-Reply-To: <9624aebf-edb9-a3b0-1a29-b61df6b7ba2f@xenosoft.de> References: <20200126115247.13402-1-mpe@ellerman.id.au> <58a6d45c-0712-18df-1b14-2f04cf12a1cb@xenosoft.de> <75aab3c9-1cb6-33bf-5de1-e05bbd98b6fb@c-s.fr> <9624aebf-edb9-a3b0-1a29-b61df6b7ba2f@xenosoft.de> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Sun, 2 Feb 2020 16:02:18 +0100, Christian Zigotzky wrote: > On 02 February 2020 at 09:19 am, Christophe Leroy wrote: > > Hello, > > > > Le 02/02/2020 =C3=A0 01:08, Christian Zigotzky a =C3=A9crit=C2=A0: =20 > >> Hello, > >> > >> We regularly compile and test Linux kernels every day during the=20 > >> merge window. Since Thuesday we have very high CPU loads because of=20 > >> the avahi daemon on our desktop Linux systems (Ubuntu, Debian etc). > >> > >> Error message: avahi-daemon[2410]: ioctl(): Inappropriate ioctl for=20 > >> device =20 > > > > Do you know which ioctl, on which device ? > > Can you take a trace of running avahi-daemon with 'strace' ? > > > > Can you bisect ? > > > > Christophe =20 > Hi Christophe, > Hi All, >=20 > I figured out that the avahi-daemon has a problem with the IPv6 address=20 > of a network interface since the Git kernel from Thursday. (Log attached) > This generates high CPU usage because the avahi-daemon tries to access=20 > the IPv6 address again and again and thereby it produces a lot of log=20 > messages. >=20 > We figured out that the networking updates aren't responsible for this=20 > issue because we created a test kernel on Wednesday. The issue is=20 > somewhere in the commits from Wednesday night to Thursday (CET). FWIW Thursday is when the latest networking pull came in, so could well be networking related.. > Please compile the latest Git kernel and test it with a desktop linux=20 > distribution for example Ubuntu. In my point of view there are many=20 > desktop machines affected. Many server systems don't use the avahi=20 > daemon so they aren't affected. >=20 > It's possible to deactivate the access to the IPv6 address with the=20 > following line in the file "/etc/avahi/avahi-daemon.conf": >=20 > use-ipv6=3Dno >=20 > After a reboot the CPU usage is normal again. This is only a temporary=20 > solution. >=20 > Unfortunately I don't have the time for bisecting next week. I have a=20 > lot of other work to do. In my point of view it is very important that=20 > you also compile the latest Git kernels. Then you will see the issue and= =20 > then you have a better possibility to fix the issue. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A060FC35247 for ; Mon, 3 Feb 2020 20:29:05 +0000 (UTC) Received: from lists.ozlabs.org (lists.ozlabs.org [203.11.71.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 52A582087E for ; Mon, 3 Feb 2020 20:29:05 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=kernel.org header.i=@kernel.org header.b="yZNSUeOU" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 52A582087E Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=linuxppc-dev-bounces+linuxppc-dev=archiver.kernel.org@lists.ozlabs.org Received: from lists.ozlabs.org (lists.ozlabs.org [IPv6:2401:3900:2:1::3]) by lists.ozlabs.org (Postfix) with ESMTP id 48BKDH0fJhzDqP8 for ; Tue, 4 Feb 2020 07:29:03 +1100 (AEDT) Received: from ozlabs.org (bilbo.ozlabs.org [203.11.71.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.ozlabs.org (Postfix) with ESMTPS id 48BFmn5Y3GzDqC0 for ; Tue, 4 Feb 2020 04:53:29 +1100 (AEDT) Authentication-Results: lists.ozlabs.org; dmarc=pass (p=none dis=none) header.from=kernel.org Authentication-Results: lists.ozlabs.org; dkim=pass (1024-bit key; unprotected) header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=default header.b=yZNSUeOU; dkim-atps=neutral Received: from ozlabs.org (bilbo.ozlabs.org [IPv6:2401:3900:2:1::2]) by bilbo.ozlabs.org (Postfix) with ESMTP id 48BFmn463Fz8t3y for ; Tue, 4 Feb 2020 04:53:29 +1100 (AEDT) Received: by ozlabs.org (Postfix) id 48BFmn3Zzlz9sRY; Tue, 4 Feb 2020 04:53:29 +1100 (AEDT) Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=kernel.org (client-ip=198.145.29.99; helo=mail.kernel.org; envelope-from=kuba@kernel.org; receiver=) Authentication-Results: ozlabs.org; dmarc=pass (p=none dis=none) header.from=kernel.org Authentication-Results: ozlabs.org; dkim=pass (1024-bit key; unprotected) header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=default header.b=yZNSUeOU; dkim-atps=neutral Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 48BFmn0xpmz9sRR for ; Tue, 4 Feb 2020 04:53:28 +1100 (AEDT) Received: from cakuba.hsd1.ca.comcast.net (unknown [199.201.64.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 4530B2087E; Mon, 3 Feb 2020 17:53:26 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1580752406; bh=+F911pBIa8UlZE0vunHO6BITHlbAp/snKVv81Rwfgu4=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=yZNSUeOU9BuVDZG2NfZ2Cjbin6LdM35W5BRwsUTgG2fMGQpmbEIRG55wlqFO2Q1vb KZ03OAq6Q/zN85eIgsgOpx1N/Aw2Rg4CgvUUg7goyX16hRidDcTC32/9skI+kg/PKA XdgO+q/Pevl+hIOGqxPWBzNuO70YsRXXDwtYhRI8= Date: Mon, 3 Feb 2020 09:53:25 -0800 From: Jakub Kicinski To: Christian Zigotzky Subject: Re: Latest Git kernel: avahi-daemon[2410]: ioctl(): Inappropriate ioctl for device Message-ID: <20200203095325.24c3ab1c@cakuba.hsd1.ca.comcast.net> In-Reply-To: <9624aebf-edb9-a3b0-1a29-b61df6b7ba2f@xenosoft.de> References: <20200126115247.13402-1-mpe@ellerman.id.au> <58a6d45c-0712-18df-1b14-2f04cf12a1cb@xenosoft.de> <75aab3c9-1cb6-33bf-5de1-e05bbd98b6fb@c-s.fr> <9624aebf-edb9-a3b0-1a29-b61df6b7ba2f@xenosoft.de> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Mailman-Approved-At: Tue, 04 Feb 2020 07:27:33 +1100 X-BeenThere: linuxppc-dev@lists.ozlabs.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux on PowerPC Developers Mail List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: DTML , Darren Stevens , mad skateman , Linux Kernel Mailing List , linuxppc-dev@ozlabs.org, "contact@a-eon.com" , "R.T.Dickinson" , "netdev@vger.kernel.org" , Christoph Hellwig Errors-To: linuxppc-dev-bounces+linuxppc-dev=archiver.kernel.org@lists.ozlabs.org Sender: "Linuxppc-dev" On Sun, 2 Feb 2020 16:02:18 +0100, Christian Zigotzky wrote: > On 02 February 2020 at 09:19 am, Christophe Leroy wrote: > > Hello, > > > > Le 02/02/2020 =C3=A0 01:08, Christian Zigotzky a =C3=A9crit=C2=A0: =20 > >> Hello, > >> > >> We regularly compile and test Linux kernels every day during the=20 > >> merge window. Since Thuesday we have very high CPU loads because of=20 > >> the avahi daemon on our desktop Linux systems (Ubuntu, Debian etc). > >> > >> Error message: avahi-daemon[2410]: ioctl(): Inappropriate ioctl for=20 > >> device =20 > > > > Do you know which ioctl, on which device ? > > Can you take a trace of running avahi-daemon with 'strace' ? > > > > Can you bisect ? > > > > Christophe =20 > Hi Christophe, > Hi All, >=20 > I figured out that the avahi-daemon has a problem with the IPv6 address=20 > of a network interface since the Git kernel from Thursday. (Log attached) > This generates high CPU usage because the avahi-daemon tries to access=20 > the IPv6 address again and again and thereby it produces a lot of log=20 > messages. >=20 > We figured out that the networking updates aren't responsible for this=20 > issue because we created a test kernel on Wednesday. The issue is=20 > somewhere in the commits from Wednesday night to Thursday (CET). FWIW Thursday is when the latest networking pull came in, so could well be networking related.. > Please compile the latest Git kernel and test it with a desktop linux=20 > distribution for example Ubuntu. In my point of view there are many=20 > desktop machines affected. Many server systems don't use the avahi=20 > daemon so they aren't affected. >=20 > It's possible to deactivate the access to the IPv6 address with the=20 > following line in the file "/etc/avahi/avahi-daemon.conf": >=20 > use-ipv6=3Dno >=20 > After a reboot the CPU usage is normal again. This is only a temporary=20 > solution. >=20 > Unfortunately I don't have the time for bisecting next week. I have a=20 > lot of other work to do. In my point of view it is very important that=20 > you also compile the latest Git kernels. Then you will see the issue and= =20 > then you have a better possibility to fix the issue.