reiser4: mount -o remount,ro / causes error on reboot

reiser4: mount -o remount,ro / causes error on reboot

[Peter]

Using: gentoo
kernel 2.6.17.11 with beyond patchset
reiser patch 2.6.17-3
reiser4progs 1.0.5

At the end of the gentoo shutdown script is a short function which
remounts / as ro.

sync; sync
sleep 1
.....
# ${x} = /
mount -n -o remount,ro "${x}" &>/dev/null

On reboot or after a poweroff, root does not mount properly, and after
some modules are loaded, there are segfaults when running init scripts.

The init scripts prompts for the root password for maintenance. Simply
typing exit forces an unmount of / and a reboot.

After this, everything is normal. On a normal shutdown, this error cycle
begins anew. Something has changed in the gentoo shutdown sequence as this
error is new to my system. However, gentoo does not support reiser4 as it
is experimental. I wanted to report this.

Remount is required since with the halt script running, the root cannot be
unmounted. After halt.sh, reboot -idpk is called or shutdown.

My hds are IDE

/dev/hda:

 Model=Maxtor 6Y200P0, FwRev=YAR41BW0, SerialNo=Y65WFMPE
 Config={ Fixed }
 RawCHS=16383/16/63, TrkSize=0, SectSize=0, ECCbytes=57
 BuffType=DualPortCache, BuffSize=7936kB, MaxMultSect=16, MultSect=16
 CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=268435455
 IORDY=on/off, tPIO={min:120,w/IORDY:120}, tDMA={min:120,rec:120}
 PIO modes:  pio0 pio1 pio2 pio3 pio4 
 DMA modes:  mdma0 mdma1 mdma2 
 UDMA modes: udma0 udma1 udma2 udma3 udma4 udma5 *udma6 
 AdvancedPM=yes: disabled (255) WriteCache=enabled
 Drive conforms to: (null):  ATA/ATAPI-1 ATA/ATAPI-2 ATA/ATAPI-3 ATA/ATAPI-4 ATA/ATAPI-5 ATA/ATAPI-6 ATA/ATAPI-7

 * signifies the current active mode

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[David Masover]

Peter wrote:
> Using: gentoo
> kernel 2.6.17.11 with beyond patchset
> reiser patch 2.6.17-3
> reiser4progs 1.0.5
> 
> At the end of the gentoo shutdown script is a short function which
> remounts / as ro.

There's also one in the Gentoo startup script, which attempts to remount 
/ ro, then remount it rw.  I commented that out, because it was causing 
similar problems.  I figure if it runs sync when it shuts down, that's 
good enough.

Still, it's an annoying problem, I think it's a kernel oops.  Namesys, 
what kind of information would be helpful?

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Sun, 10 Sep 2006 15:12:00 -0500, David Masover wrote:

> Peter wrote:
>> Using: gentoo
>> kernel 2.6.17.11 with beyond patchset
>> reiser patch 2.6.17-3
>> reiser4progs 1.0.5
>> 
>> At the end of the gentoo shutdown script is a short function which
>> remounts / as ro.
> 
> There's also one in the Gentoo startup script, which attempts to remount 
> / ro, then remount it rw.  I commented that out, because it was causing 
> similar problems.  I figure if it runs sync when it shuts down, that's 
> good enough.

The errors I note only occur on shutdown (halt.sh) not startup. Do you
think it could be an IDE timing thing similar to what was described on
another thread on this ml? What's interesting is that this problem is
recent and I am trying to look back and see what system-level packages
were updated recently (I just converted to the 2006.1 profile before this
occured and that caused a lot of programs to recompile. A week earlier,
it was gcc-4.1.1. I know base layout was updated recently). Maybe something
in mount changed? The shutdown scripts look the same. Something is left
unhinged somewhere. Glad I was not hallucinating! Thanks for confirming
for me.

> 
> Still, it's an annoying problem, I think it's a kernel oops.  Namesys,
> what kind of information would be helpful?

Yes, it's annoying and disconcerting at the same time. If it was a kernel
oop then, wouldn't it have shown itself earlier? I

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Vladimir V. Saveliev]

Hello

On Monday 11 September 2006 01:26, Peter wrote:
> On Sun, 10 Sep 2006 15:12:00 -0500, David Masover wrote:
> > Peter wrote:
> >> Using: gentoo
> >> kernel 2.6.17.11 with beyond patchset
> >> reiser patch 2.6.17-3
> >> reiser4progs 1.0.5
> >>
> >> At the end of the gentoo shutdown script is a short function which
> >> remounts / as ro.
> >
> > There's also one in the Gentoo startup script, which attempts to remount
> > / ro, then remount it rw.  I commented that out, because it was causing
> > similar problems.  I figure if it runs sync when it shuts down, that's
> > good enough.
>
> The errors I note only occur on shutdown (halt.sh) not startup. 

Sorry, I am confused. In the first mail you said:
"On reboot or after a poweroff, root does not mount properly, and after
some modules are loaded, there are segfaults when running init scripts."

This looks like  you have problems on startup. Would you, please, describe the 
sequence of operations which leads to the problem with more details.


> Do you 
> think it could be an IDE timing thing similar to what was described on
> another thread on this ml? What's interesting is that this problem is
> recent and I am trying to look back and see what system-level packages
> were updated recently (I just converted to the 2006.1 profile before this
> occured and that caused a lot of programs to recompile. A week earlier,
> it was gcc-4.1.1. I know base layout was updated recently). Maybe something
> in mount changed? The shutdown scripts look the same. Something is left
> unhinged somewhere. Glad I was not hallucinating! Thanks for confirming
> for me.
>
> > Still, it's an annoying problem, I think it's a kernel oops.  Namesys,
> > what kind of information would be helpful?
>
> Yes, it's annoying and disconcerting at the same time. If it was a kernel
> oop then, wouldn't it have shown itself earlier? I

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Mon, 11 Sep 2006 11:30:39 +0400, Vladimir V. Saveliev wrote:

> Hello
> 
> On Monday 11 September 2006 01:26, Peter wrote:
>> On Sun, 10 Sep 2006 15:12:00 -0500, David Masover wrote:
>> > Peter wrote:
>> >> Using: gentoo
>> >> kernel 2.6.17.11 with beyond patchset
>> >> reiser patch 2.6.17-3
>> >> reiser4progs 1.0.5
>> >>
>> >> At the end of the gentoo shutdown script is a short function which
>> >> remounts / as ro.
>> >
>> > There's also one in the Gentoo startup script, which attempts to remount
>> > / ro, then remount it rw.  I commented that out, because it was causing
>> > similar problems.  I figure if it runs sync when it shuts down, that's
>> > good enough.
>>
>> The errors I note only occur on shutdown (halt.sh) not startup. 
> 
> Sorry, I am confused. In the first mail you said:
> "On reboot or after a poweroff, root does not mount properly, and after
> some modules are loaded, there are segfaults when running init scripts."
> 
> This looks like  you have problems on startup. Would you, please, describe the 
> sequence of operations which leads to the problem with more details.
> 
Yes, it is confusing. I may be incorrect. It is my BELIEF that the error
is caused by an improper shutdown, not an improper startup. This is
because after the error, typing CTRL-D to continue merely unmounts the /
volume and reboots again. Next time the system runs fine. If it was a
startup problem, wouldn't it occur every time then? If you recall, when I
wrote about this with teh Sabayon Linux CD issue, it was not unmounting
volumes or syncing them properly which led to a similar problem on
startup. That's why I thought the mount -o remount,ro / command was the
culprit. I think the only way to nail this down will be to create a
separate partition, identical in all ways, except with reiserfs or ext3
instead. See what happens then.

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Sander Sweers]

On 11/09/06, Peter <sw98234@hotmail.com> wrote:
[....]
> >> >> At the end of the gentoo shutdown script is a short function which
> >> >> remounts / as ro.
> >> >
> >> > There's also one in the Gentoo startup script, which attempts to remount
> >> > / ro, then remount it rw.  I commented that out, because it was causing
> >> > similar problems.  I figure if it runs sync when it shuts down, that's
> >> > good enough.
> >>
> >> The errors I note only occur on shutdown (halt.sh) not startup.

There was a bug in baselayout which caused partition (except /) not to
remount ro properly. The bug number is 131001 [1], is this your
problem?

Greets
Sander

1: http://bugs.gentoo.org/show_bug.cgi?id=131001

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Mon, 11 Sep 2006 13:10:54 +0200, Sander Sweers wrote:

snip...

> There was a bug in baselayout which caused partition (except /) not to
> remount ro properly. The bug number is 131001 [1], is this your problem?
> 
> Greets
> Sander
> 
> 1: http://bugs.gentoo.org/show_bug.cgi?id=131001

Thank you, I read that. My version of baselayout has that fix, but that
does not appear to be the problem. I think it has more specifically to do
with the way the remount option is affecting the reiser4 fs. And, only /
is left when the remount,ro part comes anyway. Everything else is
unmounted by that time.

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Mon, 11 Sep 2006 11:30:39 +0400, Vladimir V. Saveliev wrote:

snip...
> Sorry, I am confused. In the first mail you said:
> "On reboot or after a poweroff, root does not mount properly, and after
> some modules are loaded, there are segfaults when running init scripts."
> 
> This looks like  you have problems on startup. Would you, please, describe the 
> sequence of operations which leads to the problem with more details.
> 
I should have written that it occurs always after a normal shutdown or
reboot. On initial startup, the error occurs. Then, after CTRL-D, the
system reboots and all is fine. Then, after the day, normal shutdown, then
abnormal startup.

Some more information, I looked at the output from the final mount -v -n -o
remont,ro / command, it appears perfectly normal. However, I am not sure
it is working normally!

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:

> Using: gentoo
> kernel 2.6.17.11 with beyond patchset
> reiser patch 2.6.17-3
> reiser4progs 1.0.5
> 
update...
Transferring / to a reiser3 partition removes this problem. Shutdown and
startup proceed normally. I am using util-linux-2.12r with gentoo patches
-r4. This was updated on 9/4/06. I am thinking I will downgrade to -r3 and
see if that removes the problem.

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:
all snip...

To Vladimir and David:

This appears to be a nasty gentoo issue. After perusing the forums and
bugzilla, it appears that we are not alone in having difficulties with the
baselayout. Nonetheless, as the reporter did, I downgraded baselayout from
1.12.4-r7-r7 to 1.11.15-r3 and the reboot problem I noted went away. It is
interesting to note that it may be a C program startstop-daemon.c that may
be the culprit. I don't expect much help from the gentoo devs since they
won't support reiser4, but thought I would throw this out.

Sorry to report this as an r4 bug, although it's interesting to note that
the 1.12.4 baselayout did NOT cause this problem in reiserfs3.6

HTH

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Tue, 12 Sep 2006 21:10:08 +0000, Peter wrote:

> On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:
> all snip...
> 
> To Vladimir and David:
> 
> This appears to be a nasty gentoo issue. After perusing the forums and
> bugzilla, it appears that we are not alone in having difficulties with the
> baselayout. Nonetheless, as the reporter did, I downgraded baselayout from
> 1.12.4-r7-r7 to 1.11.15-r3 and the reboot problem I noted went away. It is
> interesting to note that it may be a C program startstop-daemon.c that may
> be the culprit. I don't expect much help from the gentoo devs since they
> won't support reiser4, but thought I would throw this out.
> 
> Sorry to report this as an r4 bug, although it's interesting to note that
> the 1.12.4 baselayout did NOT cause this problem in reiserfs3.6
> 
> HTH
>

http://bugs.gentoo.org/show_bug.cgi?id=147274

I have learned that the new baselayout caches some services during
startup. While this does not explain why all works fine on a reboot and
not on the first boot, perhaps there is something not being cached
properly?

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[David Masover]

Peter wrote:
> On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:
> all snip...
more snip...

> Sorry to report this as an r4 bug, although it's interesting to note that
> the 1.12.4 baselayout did NOT cause this problem in reiserfs3.6

Mine was doubtlessly a Reiser4 bug, as it resulted in either an oops or 
a panic, I'm not sure which.  I think it was an oops, and after that 
oops, the disk is inaccessible.  Since it's a root FS, this is a 
problem!  The init scripts should not be able to cause this, no matter 
how buggy they are.

If you would like more information, I can try to reproduce this (it's 
been awhile, I don't even remember the versions) and grab what logs I 
can (log to network, maybe)...

I haven't done this already, because everything works now, and no one's 
asked me to yet.

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Tue, 12 Sep 2006 21:48:16 -0500, David Masover wrote:

snip...
>> Sorry to report this as an r4 bug, although it's interesting to note that
>> the 1.12.4 baselayout did NOT cause this problem in reiserfs3.6
> 
> Mine was doubtlessly a Reiser4 bug, as it resulted in either an oops or 
> a panic, I'm not sure which.  I think it was an oops, and after that 
> oops, the disk is inaccessible.  Since it's a root FS, this is a 
> problem!  The init scripts should not be able to cause this, no matter 
> how buggy they are.
> 

That's good to know...I guess :)
> 
> I haven't done this already, because everything works now, and no one's 
> asked me to yet.

I find this curious, don't you?

I'm wondering if kernel preemption settings and anticipatory read ahead
settings could play a role? Mine are CONFIG_PREEMPT=y and
CONFIG_DEFAULT_IOSCHED=CFQ. One other thing of note is that my kernel has
Jens Axboe's iosched-rollup-2.6.17.4-2 patch. My reiser4 patch is
2.6.17-3. The iosched patch removed a lot of dma messages in the kernel
log (not disk errors).

Anyway, whatever changed in my downgraded baselayout, at least it's not
causing reiser4 to hiccup. Curious problem in that it only occurs
immediately after a shutdown, not after the error and a reboot from a
maintenance prompt.

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Vladimir V. Saveliev]

Hello

On Wednesday 13 September 2006 01:10, Peter wrote:
> On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:
> all snip...
>
> To Vladimir and David:
>
> This appears to be a nasty gentoo issue. After perusing the forums and
> bugzilla, it appears that we are not alone in having difficulties with the
> baselayout. Nonetheless, as the reporter did, I downgraded baselayout from
> 1.12.4-r7-r7 to 1.11.15-r3 and the reboot problem I noted went away. It is
> interesting to note that it may be a C program startstop-daemon.c that may
> be the culprit. I don't expect much help from the gentoo devs since they
> won't support reiser4, but thought I would throw this out.
>
> Sorry to report this as an r4 bug, although it's interesting to note that
> the 1.12.4 baselayout did NOT cause this problem in reiserfs3.6
>

I still think that the problem is in reiser4. When the system fails on boot it 
usually outputs something which may help to understand the problem. Do you 
see anything like that on faulty startups? You can use either serial or 
network console to catch kernel output.

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Wed, 13 Sep 2006 14:49:05 +0400, Vladimir V. Saveliev wrote:

snip...
> 
> I still think that the problem is in reiser4. When the system fails on boot it 
> usually outputs something which may help to understand the problem. Do you 
> see anything like that on faulty startups? You can use either serial or 
> network console to catch kernel output.

Well, the output is from the gentoo rc script and from the imported
functions.sh script. It showed two segfaults. It occured afaikt when the
dmcrypt addon is called. It uses the start-stop-daemon program. I tried
taking a photo of it, but it was blurry and the flash obscured it.

I backtracked all the way from the errant baselayout and until 1.11.15-r3
none of the 1.12 series of baselayouts worked. Too bad I can't get gpm to
run otherwise I could capture the output. However, the only output are
lines from the script with uninitialized variables -- basically the source
of the scripts. No dumps, stack traces, or panics.

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Wed, 13 Sep 2006 14:49:05 +0400, Vladimir V. Saveliev wrote:

all snip.

Here is a screen shot I posted along with the bug report on this:

http://bugs.gentoo.org/attachment.cgi?id=96874&action=view . I am sorry
the pic is a little blurred, but I had battery trouble.

There are two segfaults that occur, 2399 and 2524 and the text that is
printed is from line 390 of rc and line 181 of functions.sh.

As you can see, there are no panics or dumps and it appears that for
whatever reason, the init scripts just cannot continue. However, the
reboot (ctrl-d), the scripts execute fine.

As I noted previously, the error occurs in all unmasked 1.12 base layout
files. 1.11.15-r3 works fine.

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:

this bug was also reported on gentoo wrt the newer baselayout. Indications
are it may be a r4 issue, although no one seems to know why!

http://bugs.gentoo.org/show_bug.cgi?id=144093

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Jussi Suutari-Jääskö]

Peter wrote:
> On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:
>
> this bug was also reported on gentoo wrt the newer baselayout. Indications
> are it may be a r4 issue, although no one seems to know why!
>
> http://bugs.gentoo.org/show_bug.cgi?id=144093
>
>   
I have the same problem, segfault on boot if the system was shutdown 
properly.
For me the trouble appeared after upgrading to glibc-2.4, there's no 
problem at
all with glibc-2.3.6. On my system (amd64 platform with 64-bit gentoo 
installation)
it doesn't have anything to do with baselayout, just the glibc.

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Sun, 17 Sep 2006 21:45:29 +0300, Jussi Suutari-Jääskö wrote:

> Peter wrote:
>> On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:
>>
>> this bug was also reported on gentoo wrt the newer baselayout. Indications
>> are it may be a r4 issue, although no one seems to know why!
>>
>> http://bugs.gentoo.org/show_bug.cgi?id=144093
>>
>>   
> I have the same problem, segfault on boot if the system was shutdown 
> properly.
> For me the trouble appeared after upgrading to glibc-2.4, there's no 
> problem at
> all with glibc-2.3.6. On my system (amd64 platform with 64-bit gentoo 
> installation)
> it doesn't have anything to do with baselayout, just the glibc.

That does not explain why reverting to baselayout 1.11.15 allows the
system to work! Also, for me, at least, this only occurs with reiser4 as
root, not reiser3. You may be correct about glibc-2.4 but the timing is
inconsistent. I upgraded to 2.4 on 9/1, but did not see the problem until
the baselayout incremented. Did you actually try downgrading your glibc
and if so, did the problem go away?

Would you please add your observation to the bug report? Thx for the input.

-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357

Re: reiser4: mount -o remount,ro / causes error on reboot

[Peter]

On Sun, 17 Sep 2006 21:45:29 +0300, Jussi Suutari-Jääskö wrote:

> Peter wrote:
>> On Sun, 10 Sep 2006 17:01:18 +0000, Peter wrote:
>>
>> this bug was also reported on gentoo wrt the newer baselayout. Indications
>> are it may be a r4 issue, although no one seems to know why!
>>
>> http://bugs.gentoo.org/show_bug.cgi?id=144093
>>
>>   
> I have the same problem, segfault on boot if the system was shutdown 
> properly.
> For me the trouble appeared after upgrading to glibc-2.4, there's no 
> problem at
> all with glibc-2.3.6. On my system (amd64 platform with 64-bit gentoo 
> installation)
> it doesn't have anything to do with baselayout, just the glibc.

The fellow who originally posted the bug does not use r4 nor does he use
glibc 2.4.

http://bugs.gentoo.org/show_bug.cgi?id=147622

Yet, he has the problem we all are enduring. :(


-- 
Peter
+++++
Do not reply to this email, it is a spam trap and not monitored.
I can be reached via this list, or via 
jabber: pete4abw at jabber.org
ICQ: 73676357