From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754910AbXKXRzP (ORCPT ); Sat, 24 Nov 2007 12:55:15 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1752590AbXKXRy6 (ORCPT ); Sat, 24 Nov 2007 12:54:58 -0500 Received: from nf-out-0910.google.com ([64.233.182.186]:60912 "EHLO nf-out-0910.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752491AbXKXRy4 (ORCPT ); Sat, 24 Nov 2007 12:54:56 -0500 DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=received:message-id:date:from:user-agent:mime-version:to:cc:subject:references:in-reply-to:content-type:content-transfer-encoding; b=PbCv4UZsWn3AFYIQ+SXBYiyUAU+t1MYYMvmFXtggUluixMABnKCGdW8yjzTMvsWSCmtkBZms1rDKNWx8nCE6gPdE4k0OFIQgjMDmiwxlcX1l/wUQBijp9arB+oXsn6sjiLXYpwtQiCZmBem0qfDZMOCQ6oOMHdxvls5SCxc57Gc= Message-ID: <47486569.1040406@googlemail.com> Date: Sat, 24 Nov 2007 18:54:49 +0100 From: Gabriel C User-Agent: Thunderbird 2.0.0.6 (X11/20071004) MIME-Version: 1.0 To: James Bottomley CC: Laurent Riffard , Hannes Reinecke , Andrew Morton , linux-kernel@vger.kernel.org, linux-ide@vger.kernel.org, linux-scsi@vger.kernel.org Subject: Re: 2.6.24-rc3-mm1: I/O error, system hangs References: <20071120204525.ff27ac98.akpm@linux-foundation.org> <4744A6F2.4030302@free.fr> <20071121144116.c932727b.akpm@linux-foundation.org> <4746814F.80502@free.fr> <4746866B.5070207@suse.de> <4746BB9D.2030508@suse.de> <4747135C.60205@free.fr> <1195886569.3195.2.camel@localhost.localdomain> <47481FA6.9050506@free.fr> <1195910809.3195.5.camel@localhost.localdomain> In-Reply-To: <1195910809.3195.5.camel@localhost.localdomain> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org James Bottomley wrote: > On Sat, 2007-11-24 at 13:57 +0100, Laurent Riffard wrote: >> Le 24.11.2007 07:42, James Bottomley a écrit : >>> On Fri, 2007-11-23 at 18:52 +0100, Laurent Riffard wrote: >>>> Le 23.11.2007 12:38, Hannes Reinecke a écrit : >>>>> Hannes Reinecke wrote: >>>>>> Laurent Riffard wrote: >>>>>>> Le 21.11.2007 23:41, Andrew Morton a écrit : >>>>>>>> On Wed, 21 Nov 2007 22:45:22 +0100 >>>>>>>> Laurent Riffard wrote: >>>>>>>> >>>>>>>>> Le 21.11.2007 05:45, Andrew Morton a écrit : >>>>>>>>>> ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/patches/2.6/2.6.24-rc3/2.6.24-rc3-mm1/ >>>>>>>>> Hello, >>>>>>>>> >>>>>>>>> My system hangs shortly after I logged in Gnome desktop. SysRq-W shows >>>>>>>>> that a bunch of task are blocked in "D" state, they seem to wait for >>>>>>>>> some I/O completion. I can try to hand-copy some data if requested. >>>>>>>>> >>>>>>>>> I found these messages in dmesg: >>>>>>>>> >>>>>>>>> ~$ grep -C2 end_request dmesg-2.6.24-rc3-mm1 >>>>>>>>> EXT3-fs: mounted filesystem with ordered data mode. >>>>>>>>> sd 0:0:0:0: [sda] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK,SUGGEST_OK >>>>>>>>> end_request: I/O error, dev sda, sector 16460 >>>>>>>>> ReiserFS: sda7: found reiserfs format "3.6" with standard journal >>>>>>>>> ReiserFS: sda7: using ordered data mode >>>>>>>>> -- >>>>>>>>> ReiserFS: sda7: Using r5 hash to sort names >>>>>>>>> sd 0:0:1:0: [sdb] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK,SUGGEST_OK >>>>>>>>> end_request: I/O error, dev sdb, sector 19632 >>>>>>>>> sd 0:0:1:0: [sdb] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK,SUGGEST_OK >>>>>>>>> end_request: I/O error, dev sdb, sector 40037363 >>>>>>>>> Adding 1048568k swap on /dev/mapper/vglinux1-lvswap. Priority:-1 extents:1 across:1048568k >>>>>>>>> lp0: using parport0 (interrupt-driven). >>>>>>>>> >>>>>>>>> These errors occur *only* with 2.6.24-rc3-mm1, they are 100% reproducible. >>>>>>>>> 2.6.24-rc3 and 2.6.24-rc2-mm1 are fine. >>>>>>>>> >>>>>>>>> Maybe something is broken in pata_via driver ? >>>>>>>>> >>>>>>>> Could be - libata-reimplement-ata_acpi_cbl_80wire-using-ata_acpi_gtm_xfermask.patch >>>>>>>> and pata_amd-pata_via-de-couple-programming-of-pio-mwdma-and-udma-timings.patch >>>>>>>> touch pata_via.c. >>>>>>> None of the above... >>>>>>> >>>>>>> I did a bisection, it spotted git-scsi-misc.patch. >>>>>>> I just run 2.6.24-rc3-mm1 + revert-git-scsi-misc.patch, and it works fine. >>>>>>> >>>>>>> I guess commit 8655a546c83fc43f0a73416bbd126d02de7ad6c0 "[SCSI] Do not >>>>>>> requeue requests if REQ_FAILFAST is set" is the real culprit. The other >>>>>>> commits are touching documentation or drivers I don't use. I'll try >>>>>>> to revert only this one this evening. >>>> I can confirm : reverting commit 8655a546c83fc43f0a73416bbd126d02de7ad6c0 >>>> does fix the problem. >>>> >>>>>> Hmm. Weird. I'll have a look into it. Apparently I'll be returning an error where >>>>>> I shouldn't. Checking ... >>>>>> >>>>> Ok, found it. We are blocking even special commands (ie requests with PREEMPT not set) >>>>> when FAILFAST is set. Which is clearly wrong. The attached patch fixes this. >>>> Sorry, it's not enough. 2.6.24-rc3-mm1 + your patch still hangs with I/O errors. >>> I think the problem is the way we treat BLOCKED and QUIESCED (the latter >>> is the state that the domain validation uses and which we cannot kill >>> fastfail on). It's definitely wrong to kill fastfail requests when the >>> state is QUIESCE. >>> >>> This patch (which is applied on top of Hannes original) separates the >>> BLOCK and QUIESCE states correctly ... does this fix the problem? >> >> No, it doesn't help... (2.6.24-rc3-mm1 + your patch still has problems) > > OK, could you post dmesgs again, please. I actually tested this with an > aic79xx card, and for me it does cause Domain Validation to succeed > again. > Are the patches indeed to fix that problem as well ? http://lkml.org/lkml/2007/11/23/5 > James Gabriel