From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_PASS,URIBL_BLOCKED,USER_AGENT_MUTT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6AE4EC43444 for ; Thu, 17 Jan 2019 10:36:11 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 3937E2054F for ; Thu, 17 Jan 2019 10:36:11 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728410AbfAQKgJ (ORCPT ); Thu, 17 Jan 2019 05:36:09 -0500 Received: from mx1.redhat.com ([209.132.183.28]:40856 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727709AbfAQKgJ (ORCPT ); Thu, 17 Jan 2019 05:36:09 -0500 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 8106874F0C; Thu, 17 Jan 2019 10:36:08 +0000 (UTC) Received: from ming.t460p (ovpn-8-27.pek2.redhat.com [10.72.8.27]) by smtp.corp.redhat.com (Postfix) with ESMTPS id A509D5DD6D; Thu, 17 Jan 2019 10:35:59 +0000 (UTC) Date: Thu, 17 Jan 2019 18:35:55 +0800 From: Ming Lei To: Guenter Roeck Cc: Stephen Rothwell , Linux Next Mailing List , Linux Kernel Mailing List , Christoph Hellwig , Omar Sandoval , Jens Axboe Subject: Re: linux-next: Tree for Jan 16 Message-ID: <20190117103553.GB23565@ming.t460p> References: <20190116173838.042db659@canb.auug.org.au> <20190116203547.GA788@roeck-us.net> <20190117084902.GA20220@ming.t460p> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190117084902.GA20220@ming.t460p> User-Agent: Mutt/1.9.1 (2017-09-22) X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.39]); Thu, 17 Jan 2019 10:36:08 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jan 17, 2019 at 04:49:03PM +0800, Ming Lei wrote: > On Wed, Jan 16, 2019 at 12:35:47PM -0800, Guenter Roeck wrote: > > On Wed, Jan 16, 2019 at 05:38:38PM +1100, Stephen Rothwell wrote: > > > Hi all, > > > > > > Changes since 20190115: > > > > > > The vfs tree still had its build failure for which I applied a patch. > > > > > > The drm-misc tree gained conflicts against the drm-intel tree. > > > > > > The mali-dp tree still had its failure for which I applied a merge > > > fix patch. > > > > > > The block tree gained a conflict against the fscrypt tree and build > > > failures for which I applied 2 merge fix patches and a fix patch. > > > > > > Non-merge commits (relative to Linus' tree): 1975 > > > 2069 files changed, 67760 insertions(+), 30784 deletions(-) > > > > > > > Time for a damage report. > > > > Build results: > > total: 159 pass: 148 fail: 11 > > Failed builds: > > alpha:allmodconfig > > ia64:defconfig > > ia64:allnoconfig > > ia64:tinyconfig > > powerpc:ppc6xx_defconfig > > sh:defconfig > > sh:allnoconfig > > sh:tinyconfig > > sh:dreamcast_defconfig > > sh:microdev_defconfig > > sh:shx3_defconfig > > Qemu test results: > > total: 343 pass: 230 fail: 113 > > [details dropped] > > > > I won't address the build failures; I assume the culprits know through > > 0day. See https://kerneltests.org/builders/ for details and logs. > > > > The main culprit of the qemu test failures is a block subsystem commit. > > bisect log and bisected backtrace below. It may well be that there are > > other failures in that subsystem - backtraces are not always the same. > > Affected architectures are arm, mips, ppc, parisc, sparc, and x86. > > sh4 may be affected as well, but all sh4 images fail to build and can > > not be tested at this time. > > > > Also, I suspect that the observed crashes may hide other failures - > > I had seen some boot stalls in next-20190115 (not bisected). > > > > Guenter > > > > --- > > # bad: [cbeb3db684f72d744e74c567542faac796d9cbd8] Add linux-next specific files for 20190116 > > # good: [1c7fc5cbc33980acd13d668f1c8f0313d6ae9fd8] Linux 5.0-rc2 > > git bisect start 'HEAD' 'v5.0-rc2' > > # good: [11822c837bf744c38fab8370899338884d30f30b] Merge remote-tracking branch 'nfc-next/master' > > git bisect good 11822c837bf744c38fab8370899338884d30f30b > > # bad: [8c4aa656d7befa3ca3c5c2856eeabc30317d9775] Merge remote-tracking branch 'apparmor/apparmor-next' > > git bisect bad 8c4aa656d7befa3ca3c5c2856eeabc30317d9775 > > # good: [2465c219c523ed47f2adae88805d3bb68fbc51c0] Merge remote-tracking branch 'drm-misc/for-linux-next' > > git bisect good 2465c219c523ed47f2adae88805d3bb68fbc51c0 > > # good: [afa8e20f9d4d5aacf9158b7be36ec81ec499aa5c] Merge remote-tracking branch 'sound-asoc/for-next' > > git bisect good afa8e20f9d4d5aacf9158b7be36ec81ec499aa5c > > # bad: [ae563d4fc73ad2cfd1408e72fd3aa67c4f5c9c8d] Merge remote-tracking branch 'kgdb/kgdb-next' > > git bisect bad ae563d4fc73ad2cfd1408e72fd3aa67c4f5c9c8d > > # bad: [6cb6b5a89b70120f840f37e94ee10f9b8ffdabd9] Merge remote-tracking branch 'block/for-next' > > git bisect bad 6cb6b5a89b70120f840f37e94ee10f9b8ffdabd9 > > # bad: [93670fad03e97d5526b23fe67a3fe2be52e21732] block: kill QUEUE_FLAG_NO_SG_MERGE > > git bisect bad 93670fad03e97d5526b23fe67a3fe2be52e21732 > > # bad: [beab05e0114623255b4d5cd3776df6da26be42b0] block: introduce bvec_last_segment() > > git bisect bad beab05e0114623255b4d5cd3776df6da26be42b0 > > # good: [f3effe4c1240a36a487ba1ff134478236a69b32d] block: rename bvec helpers > > git bisect good f3effe4c1240a36a487ba1ff134478236a69b32d > > # good: [cad1e6bb0ecfebbb3168ebc46dcf5e39f7bf2268] block: introduce bio_for_each_bvec() and rq_for_each_bvec() > > git bisect good cad1e6bb0ecfebbb3168ebc46dcf5e39f7bf2268 > > # bad: [73f4209ccda9cf3d403692517bc90d5431c1ef2d] block: use bio_for_each_bvec() to map sg > > git bisect bad 73f4209ccda9cf3d403692517bc90d5431c1ef2d > > # bad: [258cfdfaf7bd729e759a0a91fd00ac9794796ad3] block: use bio_for_each_bvec() to compute multi-page bvec count > > git bisect bad 258cfdfaf7bd729e759a0a91fd00ac9794796ad3 > > # first bad commit: [258cfdfaf7bd729e759a0a91fd00ac9794796ad3] block: use bio_for_each_bvec() to compute multi-page bvec count > > > > -- > > Bisected backtrace: > > > > [ 24.745267] BUG: unable to handle kernel paging request at 0959bd38 > > [ 24.745267] #PF error: [normal kernel read fault] > > [ 24.745267] *pde = 00000000 > > [ 24.745267] Oops: 0000 [#1] SMP > > [ 24.745267] CPU: 0 PID: 7 Comm: kworker/u2:0 Not tainted 5.0.0-rc2-next-20190116 #1 > > [ 24.745267] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.12.0-0-ga698c8995f-prebuilt.qemu.org 04/01/2014 > > [ 24.745267] Workqueue: events_unbound async_run_entry_fn > > [ 24.745267] EIP: blk_rq_map_sg+0x1cd/0x510 > > [ 24.745267] Code: e8 a8 f2 01 00 8b 5d d0 8b 75 e8 89 f9 03 75 cc 89 f2 f7 d2 > > 23 93 54 03 00 00 83 c2 01 39 bb 6c 03 00 00 0f 46 8b 6c 03 00 00 <8b> 18 39 ca > > 0f 47 d1 89 f1 c1 ee 0c 83 e3 03 81 e1 ff 0f 00 00 89 > > [ 24.745267] EAX: 0959bd38 EBX: cfbfb500 ECX: 000000ff EDX: 00000000 > > [ 24.745267] ESI: 00000000 EDI: 000000ff EBP: cf8b3bd8 ESP: cf8b3b94 > > [ 24.745267] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00200212 > > [ 24.745267] CR0: 80050033 CR2: 0959bd38 CR3: 09e72000 CR4: 003406d0 > > [ 24.745267] Call Trace: > > [ 24.745267] scsi_init_sgtable+0x30/0x70 > > [ 24.745267] scsi_init_io+0x2a/0x80 > > [ 24.745267] scsi_queue_rq+0x64e/0xa50 > > [ 24.745267] blk_mq_dispatch_rq_list+0x318/0x4c0 > > [ 24.745267] blk_mq_do_dispatch_sched+0x6d/0xf0 > > [ 24.745267] blk_mq_sched_dispatch_requests+0xee/0x150 > > [ 24.745267] __blk_mq_run_hw_queue+0x59/0xd0 > > [ 24.745267] __blk_mq_delay_run_hw_queue+0x177/0x1a0 > > [ 24.745267] blk_mq_run_hw_queue+0x72/0xc0 > > [ 24.745267] ? dd_merged_requests+0xb0/0xb0 > > [ 24.745267] blk_mq_sched_insert_request+0x103/0x190 > > [ 24.745267] blk_execute_rq_nowait+0x3c/0x50 > > [ 24.745267] blk_execute_rq+0x52/0x80 > > [ 24.745267] ? blk_execute_rq_nowait+0x50/0x50 > > [ 24.745267] __scsi_execute+0xd9/0x1d0 > > [ 24.745267] scsi_vpd_inquiry+0x62/0xb0 > > [ 24.745267] ? regcache_read+0x12f/0x160 > > [ 24.745267] scsi_get_vpd_buf+0x2f/0x90 > > [ 24.745267] scsi_attach_vpd+0x32/0xc0 > > [ 24.745267] scsi_probe_and_add_lun+0xa6e/0xb70 > > [ 24.745267] ? __pm_runtime_resume+0x4f/0x90 > > [ 24.745267] __scsi_add_device+0x103/0x120 > > [ 24.745267] ata_scsi_scan_host+0x8e/0x1b0 > > [ 24.745267] async_port_probe+0x3b/0x4b > > [ 24.745267] ? ata_port_probe+0x30/0x30 > > [ 24.745267] async_run_entry_fn+0x35/0xf0 > > [ 24.745267] process_one_work+0x1e4/0x530 > > [ 24.745267] worker_thread+0x39/0x3d0 > > [ 24.745267] kthread+0xf2/0x110 > > [ 24.745267] ? drain_workqueue+0x170/0x170 > > [ 24.745267] ? kthread_park+0x90/0x90 > > [ 24.745267] ret_from_fork+0x2e/0x38 > > [ 24.745267] Modules linked in: > > [ 24.745267] CR2: 000000000959bd38 > > [ 24.745267] ---[ end trace 3e516846ce7ccae9 ]--- > > [ 24.745267] EIP: blk_rq_map_sg+0x1cd/0x510 > > [ 24.745267] Code: e8 a8 f2 01 00 8b 5d d0 8b 75 e8 89 f9 03 75 cc 89 f2 f7 d2 > > 23 93 54 03 00 00 83 c2 01 39 bb 6c 03 00 00 0f 46 8b 6c 03 00 00 <8b> 18 39 ca > > 0f 47 d1 89 f1 c1 ee 0c 83 e3 03 81 e1 ff 0f 00 00 89 > > [ 24.745267] EAX: 0959bd38 EBX: cfbfb500 ECX: 000000ff EDX: 00000000 > > [ 24.745267] ESI: 00000000 EDI: 000000ff EBP: cf8b3bd8 ESP: c9e7649c > > [ 24.745267] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00200212 > > [ 24.745267] CR0: 80050033 CR2: 0959bd38 CR3: 09e72000 CR4: 003406d0 > > [ 24.745267] BUG: sleeping function called from invalid context at include/linux/percpu-rwsem.h:34 > > [ 24.745267] in_atomic(): 1, irqs_disabled(): 1, pid: 7, name: kworker/u2:0 > > [ 24.745267] INFO: lockdep is turned off. > > [ 24.745267] irq event stamp: 49332 > > [ 24.745267] hardirqs last enabled at (49331): [] trace_hardirqs_on_thunk+0xc/0x10 > > [ 24.745267] hardirqs last disabled at (49332): [] trace_hardirqs_off_thunk+0xc/0x12 > > [ 24.745267] softirqs last enabled at (49330): [] __do_softirq+0x2c2/0x3d7 > > [ 24.745267] softirqs last disabled at (49323): [] call_on_stack+0x40/0x50 > > [ 24.745267] CPU: 0 PID: 7 Comm: kworker/u2:0 Tainted: G D 5.0.0-rc2-next-20190116 #1 > > [ 24.745267] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS > > rel-1.12.0-0-ga698c8995f-prebuilt.qemu.org 04/01/2014 > > [ 24.745267] Workqueue: events_unbound async_run_entry_fn > > [ 24.745267] Call Trace: > > [ 24.745267] dump_stack+0x66/0x8e > > [ 24.745267] ___might_sleep.cold.85+0x8e/0x9f > > [ 24.745267] __might_sleep+0x2e/0x80 > > [ 24.745267] exit_signals+0x25/0x220 > > [ 24.745267] do_exit+0x89/0xb80 > > [ 24.745267] ? kthread+0xf2/0x110 > > [ 24.745267] ? drain_workqueue+0x170/0x170 > > [ 24.745267] rewind_stack_do_exit+0x11/0x13 > > > > Hi Guenter, > > Could you share me the .config? >From your dmesg log, looks the test is run on i386, so please feel free to try the following patch: https://marc.info/?l=linux-kernel&m=154772088110800&w=2 Thanks, Ming