User mode address error problems on 7763

User mode address error problems on 7763

[Dale Larson]

I've been porting linux (2.6.30.2) to our 7763 based platform and the
kernel seems to be running fine but when user mode programs run I
randomly get errors like this:

[    8.419557] VFS: Mounted root (nfs filesystem) on device 0:9.
[    8.431863] Freeing unused kernel memory: 80k freed
init started: BusyBox v1.14.3 (2009-09-04 15:19:48 CDT)
[    8.682286] Fixing up unaligned userspace access in "mount" pid\x152
pc=0x295583d0 ins=0x60b2
[    8.699336] Sending SIGBUS to "mount" due to unaligned access (PC
a0042955 PR 295583da)
Populating /dev using udev: done

Another example:

Starting dropbear sshd: OK
[  484.428550] Fixing up unaligned userspace access in "touch" pid\x188
pc=0x295583d0 ins=0x60b2
[  492.438796] Sending SIGBUS to "touch" due to unaligned access (PC
a0042955 PR 295583da)

The SIGBUS kills the process. I've tried various versions of linux
form kernel.org: 2.6.28, 2.6.29, 2.6.30 and all have the same
behaviour.

Using JTAG I see that I'm having both data alignment and PC alignment
problems. If I turn off the I&D caching this problem doesn't happen.

It almost seems like some loader code is loading programs on bad addresses.

I'm building the system using BuildRoot and the cross compiler I'm
using is version 4.3.4 of the GNU compiler and 2.19.1 of binutils.

Can anyone give a clue as to what rabbit holes I need to look down?

Dale Larson
Johnson Controls, Inc

Re: User mode address error problems on 7763

[Matt Fleming]

On Fri, Sep 11, 2009 at 01:06:31PM -0500, Dale Larson wrote:
> I've been porting linux (2.6.30.2) to our 7763 based platform and the
> kernel seems to be running fine but when user mode programs run I
> randomly get errors like this:
> 
> [    8.419557] VFS: Mounted root (nfs filesystem) on device 0:9.
> [    8.431863] Freeing unused kernel memory: 80k freed
> init started: BusyBox v1.14.3 (2009-09-04 15:19:48 CDT)
> [    8.682286] Fixing up unaligned userspace access in "mount" pid\x152
> pc=0x295583d0 ins=0x60b2
> [    8.699336] Sending SIGBUS to "mount" due to unaligned access (PC
> a0042955 PR 295583da)
> Populating /dev using udev: done
> 
> Another example:
> 
> Starting dropbear sshd: OK
> [  484.428550] Fixing up unaligned userspace access in "touch" pid\x188
> pc=0x295583d0 ins=0x60b2
> [  492.438796] Sending SIGBUS to "touch" due to unaligned access (PC
> a0042955 PR 295583da)
> 
> The SIGBUS kills the process. I've tried various versions of linux
> form kernel.org: 2.6.28, 2.6.29, 2.6.30 and all have the same
> behaviour.
> 
> Using JTAG I see that I'm having both data alignment and PC alignment
> problems. If I turn off the I&D caching this problem doesn't happen.
> 

This is most likely to be the cache aliasing bug I'm hunting. What are
the dimensions of your cache? Can you tried building a kernel from the
sh/cachetlb branch at,

git://git.kernel.org/pub/scm/linux/kernel/git/lethal/sh-2.6.git

and see if the issue persists? Paul has made some changes recently that
might work around this problem.

Re: User mode address error problems on 7763

[Dale Larson]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="windows-1254", Size: 2909 bytes --]

Hi Matt,

> This is most likely to be the cache aliasing bug I'm hunting. What are
> the dimensions of your cache?

Here's the kernel messages up to the cache initialization:

[    0.000000] Linux version 2.6.30.2 (dlarson@UbuntuDale) (gcc
version 4.3.4 (GCC) ) #2 Fri Sep 11 08:13:33 CDT 2009
[    0.000000] Boot params:
[    0.000000] ... MOUNT_ROOT_RDONLY - 00000001
[    0.000000] ... RAMDISK_FLAGS     - 00000000
[    0.000000] ... ORIG_ROOT_DEV     - 00000200
[    0.000000] ... LOADER_TYPE       - 00000001
[    0.000000] ... INITRD_START      - 00000000
[    0.000000] ... INITRD_SIZE       - 00000000
[    0.000000] Early serial console at MMIO 0x18000008 (options '115200n8')
[    0.000000] console [uart0] enabled
[    0.000000] Booting machvec: jci7763
[    0.000000] Node 0: start_pfn = 0x8000, low = 0x10000
[    0.000000] Zone PFN ranges:
[    0.000000]   Normal   0x00008000 -> 0x00010000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[1] active PFN ranges
[    0.000000]     0: 0x00008000 -> 0x00010000
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.
Total pages: 32512
[    0.000000] Kernel command line:
earlycon=uart,mmio,0x18000008,115200n8 console=ttyS0,115200n8
root=/dev/nfs rw rootfstype=nfs nfsroot\x159.222.11.56:/n40root ip=dhcp
[    0.000000] NR_IRQS:256
[    0.000000] PID hash table entries: 512 (order: 9, 2048 bytes)
[    0.000000] Using tmu for system timer
[    0.009785] Dentry cache hash table entries: 16384 (order: 4, 65536 bytes)
[    0.027415] Inode-cache hash table entries: 8192 (order: 3, 32768 bytes)
[    0.066315] Memory: 127232k/131072k available (1341k kernel code,
424k data, 80k init)
[    0.085260] PVR\x10200a00 CVRs440010 PRR\0000a10
[    0.096690] I-cache : n_ways=4 n_sets%6 way_incr92
[    0.109171] I-cache : entry_mask=0x00001fe0 alias_mask=0x00001000 n_aliases=2
[    0.126200] D-cache : n_ways=4 n_sets%6 way_incr92
[    0.138681] D-cache : entry_mask=0x00001fe0 alias_mask=0x00001000 n_aliases=2
[    0.156627] Calibrating delay loop (skipped)... 266.66 BogoMIPS
PRESET (lpjS3333)
[    0.175518] Mount-cache hash table entries: 512
[    0.187776] CPU: SH7763
[    0.198888] net_namespace: 296 bytes
[    0.208654] NET: Registered protocol family 16
[    0.247770] bio: create slab <bio-0> at 0
[    0.264336] SCSI subsystem initialized
[    0.288467] NET: Registered protocol family 2


>Can you tried building a kernel from the
> sh/cachetlb branch at,
>
> git://git.kernel.org/pub/scm/linux/kernel/git/lethal/sh-2.6.git
>
> and see if the issue persists? Paul has made some changes recently that
> might work around this problem.

I'll give this a shot on Monday. I do have a clone of that repository.
--
To unsubscribe from this list: send the line "unsubscribe linux-sh" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: User mode address error problems on 7763

[Dale Larson]

Matt,

I've built and run the latest code in the 'sh/cachetlb' branch od
'git://git.kernel.org/pub/scm/linux/kernel/git/lethal/sh-2.6.git' and
I get many more fixup messages starting with 'swapper':

[    0.296000] NET: Registered protocol family 17
[    0.300000] RPC: Registered udp transport module.
[    0.304000] RPC: Registered tcp transport module.
[    0.820000] net eth0: attached phy 1 to driver Generic PHY
[    1.828000] Sending DHCP requests ..
[    6.136000] Unaligned kernel access on behalf of "swapper" pid=0
pc=0x881d409a ins=0x8810
[    6.136000] Fixing up unaligned kernel access in "swapper" pid=0
pc=0x881d409a ins=0x6732
[    6.144000] Unaligned kernel access on behalf of "swapper" pid=0
pc=0x881d40e2 ins=0x881a
[    6.144000] Fixing up unaligned kernel access in "swapper" pid=0
pc=0x881d40e2 ins=0x6126
[    6.152000] Unaligned kernel access on behalf of "swapper" pid=0
pc=0x881d40e4 ins=0x881a
[    6.152000] Fixing up unaligned kernel access in "swapper" pid=0
pc=0x881d40e4 ins=0x6726
[    6.160000] Unaligned kernel access on behalf of "swapper" pid=0
pc=0x881d40ee ins=0x881a
[    6.160000] Fixing up unaligned kernel access in "swapper" pid=0
pc=0x881d40ee ins=0x6726
[    6.164000] Unaligned kernel access on behalf of "swapper" pid=0
pc=0x881d40ee ins=0x881a
[    6.164000] Fixing up unaligned kernel access in "swapper" pid=0
pc=0x881d40ee ins=0x6726
[    6.168000] Unaligned kernel access on behalf of "swapper" pid=0
pc=0x881d40ee ins=0x881a

Dale Larson
Johnson Controls, Inc

Re: User mode address error problems on 7763

[Paul Mundt]

On Mon, Sep 14, 2009 at 08:02:16AM -0500, Dale Larson wrote:
> I've built and run the latest code in the 'sh/cachetlb' branch od
> 'git://git.kernel.org/pub/scm/linux/kernel/git/lethal/sh-2.6.git' and
> I get many more fixup messages starting with 'swapper':
> 
These are fine, they are kernel accesses that are being fixed up.
Unfortunately some of the networking paths generate lots of unaligned
kernel traps, so we will probably have to go back to having a default of
not warning on them at all.  In any event, this behaviour is tunable.
Just open up arch/sh/kernel/traps_32.c and change se_kernmode_warn to 0.

Re: User mode address error problems on 7763

[Matt Fleming]

On Mon, Sep 14, 2009 at 08:02:16AM -0500, Dale Larson wrote:
> Matt,
> 
> I've built and run the latest code in the 'sh/cachetlb' branch od
> 'git://git.kernel.org/pub/scm/linux/kernel/git/lethal/sh-2.6.git' and
> I get many more fixup messages starting with 'swapper':
> 
> [    0.296000] NET: Registered protocol family 17
> [    0.300000] RPC: Registered udp transport module.
> [    0.304000] RPC: Registered tcp transport module.
> [    0.820000] net eth0: attached phy 1 to driver Generic PHY
> [    1.828000] Sending DHCP requests ..
> [    6.136000] Unaligned kernel access on behalf of "swapper" pid=0
> pc=0x881d409a ins=0x8810
> [    6.136000] Fixing up unaligned kernel access in "swapper" pid=0
> pc=0x881d409a ins=0x6732
> [    6.144000] Unaligned kernel access on behalf of "swapper" pid=0
> pc=0x881d40e2 ins=0x881a
> [    6.144000] Fixing up unaligned kernel access in "swapper" pid=0
> pc=0x881d40e2 ins=0x6126
> [    6.152000] Unaligned kernel access on behalf of "swapper" pid=0
> pc=0x881d40e4 ins=0x881a
> [    6.152000] Fixing up unaligned kernel access in "swapper" pid=0
> pc=0x881d40e4 ins=0x6726
> [    6.160000] Unaligned kernel access on behalf of "swapper" pid=0
> pc=0x881d40ee ins=0x881a
> [    6.160000] Fixing up unaligned kernel access in "swapper" pid=0
> pc=0x881d40ee ins=0x6726
> [    6.164000] Unaligned kernel access on behalf of "swapper" pid=0
> pc=0x881d40ee ins=0x881a
> [    6.164000] Fixing up unaligned kernel access in "swapper" pid=0
> pc=0x881d40ee ins=0x6726
> [    6.168000] Unaligned kernel access on behalf of "swapper" pid=0
> pc=0x881d40ee ins=0x881a
> 

Hmm... confusing. Can you send your .config too, please? Is your copy of
the sh/cachetlb branch up to date? There was an issue a few weeks ago
where we were unneccessarily reporting unaligned fix ups. It was fixed
by this commit,


commit 4aa5ac4ef44dd8c986241c54298abd7910b78b3f
Author: Matt Fleming <matt@console-pimps.org>
Date:   Fri Aug 28 21:37:20 2009 +0000

    sh: Only shout about fixing up unexpected unaligned accesses

    Some unaligned accesses are completely expected. For example, the
    trapped_io code uses the unaligned access fixup code path so there's no
    need to warn about having to fixup the unaligned access.

    Signed-off-by: Matt Fleming <matt@console-pimps.org>
    Signed-off-by: Paul Mundt <lethal@linux-sh.org>


Is this commit in your tree?

Re: User mode address error problems on 7763

[Dale Larson]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="windows-1254", Size: 34069 bytes --]

On Mon, Sep 14, 2009 at 8:14 AM, Matt Fleming <matt@console-pimps.org> wrote:
> Hmm... confusing.
> Can you send your .config too, please?

Certainly. Attached below. I've also attached the result of running
this kernel with the kernel mode fixup messages "removed".

>Is your copy of the sh/cachetlb branch up to date?

Yep, Pulled last Friday.

>There was an issue a few weeks ago
> where we were unneccessarily reporting unaligned fix ups. It was fixed
> by this commit,

I think later changes may have changed that. There are now a couple
global variables used to control kernel and user messages having to do
with address fixups in traps_32.c.:

/* bitfield: 1: warn 2: fixup 4: signal -> combinations 2|4 && 1|2|4
are not valid! */
static int se_usermode = 3;
/* 0: no warning 1: print a warning message */
static int se_kernmode_warn = 0;  /* WAS 1 - DLL20090914 */

> commit 4aa5ac4ef44dd8c986241c54298abd7910b78b3f
> Is this commit in your tree?

Yes:

$ git show 4aa5ac4ef44dd
commit 4aa5ac4ef44dd8c986241c54298abd7910b78b3f
Author: Matt Fleming <matt@console-pimps.org>
Date:   Fri Aug 28 21:37:20 2009 +0000

    sh: Only shout about fixing up unexpected unaligned accesses

    Some unaligned accesses are completely expected. For example, the
    trapped_io code uses the unaligned access fixup code path so there's no
    need to warn about having to fixup the unaligned access.

    Signed-off-by: Matt Fleming <matt@console-pimps.org>
    Signed-off-by: Paul Mundt <lethal@linux-sh.org>
===================================

Log of kernel run:

[    0.000000] Linux version 2.6.31-rc9 (dlarson@UbuntuDale) (gcc
version 4.3.4 (GCC) ) #5 Mon Sep 14 08:37:25 CDT 2009
[    0.000000] Boot params:
[    0.000000] ... MOUNT_ROOT_RDONLY - 00000001
[    0.000000] ... RAMDISK_FLAGS     - 00000000
[    0.000000] ... ORIG_ROOT_DEV     - 00000200
[    0.000000] ... LOADER_TYPE       - 00000001
[    0.000000] ... INITRD_START      - 00000000
[    0.000000] ... INITRD_SIZE       - 00000000
[    0.000000] Early serial console at MMIO 0x18000008 (options '115200n8')
[    0.000000] console [uart0] enabled
[    0.000000] Booting machvec: jci7763
[    0.000000] Node 0: start_pfn = 0x8000, low = 0x10000
[    0.000000] Zone PFN ranges:
[    0.000000]   Normal   0x00008000 -> 0x00010000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[1] active PFN ranges
[    0.000000]     0: 0x00008000 -> 0x00010000
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.
Total pages: 32512
[    0.000000] Kernel command line:
earlycon=uart,mmio,0x18000008,115200n8 console=ttyS0,115200n8
root=/dev/nfs rw rootfstype=nfs nfsroot\x159.222.11.56:/n40root ip=dhcp
[    0.000000] PID hash table entries: 512 (order: 9, 2048 bytes)
[    0.000000] Dentry cache hash table entries: 16384 (order: 4, 65536 bytes)
[    0.000000] Inode-cache hash table entries: 8192 (order: 3, 32768 bytes)
[    0.000000] PVR\x10200a00 CVRs440010 PRR\0000a10
[    0.000000] I-cache : n_ways=4 n_sets%6 way_incr92
[    0.000000] I-cache : entry_mask=0x00001fe0 alias_mask=0x00001000 n_aliases=2
[    0.000000] D-cache : n_ways=4 n_sets%6 way_incr92
[    0.000000] D-cache : entry_mask=0x00001fe0 alias_mask=0x00001000 n_aliases=2
[    0.000000] Memory: 127700k/131072k available (1365k kernel code,
446k data, 84k init)
[    0.000000] NR_IRQS:256
[    0.000000] sh_tmu: TMU0 used for clock events
[    0.000000] sh_tmu: TMU0 used for periodic clock events
[    0.000000] sh_tmu: TMU1 used as clock source
[    0.004000] Calibrating delay loop (skipped)... 266.66 BogoMIPS
PRESET (lpjS3333)
[    0.008000] Mount-cache hash table entries: 512
[    0.012000] CPU: SH7763
[    0.024000] NET: Registered protocol family 16
[    0.064000] bio: create slab <bio-0> at 0
[    0.072000] SCSI subsystem initialized
[    0.092000] NET: Registered protocol family 2
[    0.096000] IP route cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.104000] TCP established hash table entries: 4096 (order: 3, 32768 bytes)
[    0.108000] TCP bind hash table entries: 4096 (order: 2, 16384 bytes)
[    0.112000] TCP: Hash tables configured (established 4096 bind 4096)
[    0.116000] TCP reno registered
[    0.120000] NET: Registered protocol family 1
[    0.136000] msgmni has been set to 249
[    0.140000] io scheduler noop registered
[    0.144000] io scheduler anticipatory registered (default)
[    0.148000] io scheduler deadline registered
[    0.152000] io scheduler cfq registered
[    0.188000] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
[    0.196000] serial8250.0: ttyS0 at MMIO 0x18000008 (irq = 4) is a 16550A
[    0.200000] console handover: boot [uart0] -> real [ttyS0]
[    0.224000] loop: module loaded
[    0.268000] sh_mii: probed
[    0.272000] Base address at 0xfee00800, 00:10:8D:01:C1:9A, IRQ 57.
[    0.284000] sh_tmu: TMU0 kept as earlytimer
[    0.288000] sh_tmu: TMU1 kept as earlytimer
[    0.292000] TCP cubic registered
[    0.300000] NET: Registered protocol family 17
[    0.304000] RPC: Registered udp transport module.
[    0.308000] RPC: Registered tcp transport module.
[    0.824000] net eth0: attached phy 1 to driver Generic PHY
[    1.832000] Sending DHCP requests ..
[    4.824000] PHY: 0:01 - Link is Up - 100/Full
[    7.840000] .., OK
[   14.540000] IP-Config: Got DHCP answer from 0.0.0.0, my address is
159.222.10.209
[   14.548000] IP-Config: Complete:
[   14.552000]      device=eth0, addr\x159.222.10.209,
mask%5.255.252.0, gw\x159.222.8.2,
[   14.568000]      host\x159.222.10.209, domain=cg.na.jci.com,
nis-domain=(none),
[   14.572000]      bootserver=0.0.0.0, rootserver\x159.222.11.56, rootpath[   14.584000] Looking up port of RPC 100003/2 on 159.222.11.56
[   14.592000] Looking up port of RPC 100005/1 on 159.222.11.56
[   14.660000] VFS: Mounted root (nfs filesystem) on device 0:9.
[   14.664000] Freeing unused kernel memory: 84k freed
init started: BusyBox v1.14.3 (2009-09-04 15:19:48 CDT)
Populating /dev using udev: done
Initializing random number generator... done.
Starting network...
ip: RTNETLINK answers: File exists
[   17.040000] Unaligned userspace access in "sh" pid\x189
pc=0x295583d0 ins=0x60b2
[   17.044000] Fixing up unaligned userspace access in "sh" pid\x189
pc=0x295583d0 ins=0x60b2
[   17.048000] Sending SIGBUS to "sh" due to unaligned access (PC
a0042955 PR 295583da)
Starting dropbear sshd: generating rsa key... generating dsa key... OK
[   45.608000] Unaligned userspace access in "syslogd" pid\x199
pc=0x295583d0 ins=0x60b2
[   45.612000] Fixing up unaligned userspace access in "syslogd"
pid\x199 pc=0x295583d0 ins=0x60b2
[   45.624000] Sending SIGBUS to "syslogd" due to unaligned access (PC
a0042955 PR 295583da)

Welcome to MongooseLinux
MongooseLinux login: root

BusyBox v1.14.3 (2009-09-04 15:19:48 CDT) built-in shell (ash)
Enter 'help' for a list of built-in commands.

# alias ll='ls -al'
# ll
drwxr-xr-x    2 root     root         1024 Sep  4  2009 .
drwxr-xr-x   17 root     root         1024 Sep 14  2009 ..
-rw-r--r--    1 root     root            0 Aug  6  2009 .bash_history
-rw-r--r--    1 root     root          175 Aug  6  2009 .bash_logout
-rw-r--r--    1 root     root          161 Aug  6  2009 .bash_profile
-rw-r--r--    1 root     root         1711 Aug  6  2009 .bashrc
# cd ..
# ll
[  108.736000] ------------[ cut here ]------------
[  108.736000] Kernel BUG at 8804492e [verbose debug info unavailable]
[  108.736000] Kernel BUG: 003e [#1]
[  108.736000]
[  108.736000] Pid : 198, Comm:                 sh
[  108.736000] CPU : 0                  Not tainted  (2.6.31-rc9 #5)
[  108.736000]
[  108.736000] PC is at cache_alloc_refill+0xc2/0x39c
[  108.736000] PR is at kmem_cache_alloc+0x52/0xb0
[  108.736000] PC  : 8804492e SP  : 8f903e94 SR  : 400080f1 TEA : 00485a14
[  108.736000] R0  : 00000023 R1  : 0000002e R2  : 0000002e R3  : 8f8e2e48
[  108.736000] R4  : 00000010 R5  : 8f8029a0 R6  : 8f8e2000 R7  : 0000002f
[  108.736000] R8  : 8f8029a8 R9  : 8f809400 R10 : 8f8029b0 R11 : 8f800a20
[  108.736000] R12 : 0000000f R13 : 00000001 R14 : 8f903e94
[  108.736000] MACH: 00000000 MACL: 00000d74 GBR : 00000000 PR  : 88044d2a
[  108.736000]
[  108.736000] Call trace:
[  108.736000]  [<88044d2a>] kmem_cache_alloc+0x52/0xb0
[  108.736000]  [<88011790>] dup_mm+0x150/0x2cc
[  108.736000]  [<88011e64>] copy_process+0x518/0xa9c
[  108.736000]  [<880bc614>] memcpy+0x0/0x28c
[  108.736000]  [<880124d6>] do_fork+0xee/0x250
[  108.736000]  [<88003bac>] sys_fork+0x0/0x28
[  108.736000]  [<88003bc8>] sys_fork+0x1c/0x28
[  108.736000]  [<88003bac>] sys_fork+0x0/0x28
[  108.736000]  [<88007226>] syscall_call+0xc/0x10
[  108.736000]
[  108.736000] Code:
[  108.736000]   88044928:  mov.l     @(28,r11), r1
[  108.736000]   8804492a:  cmp/hs    r1, r2
[  108.736000]   8804492c:  bf        8804495a
[  108.736000] ->8804492e:  trapa     #62
[  108.736000]   88044930:  bra       8804495c
[  108.736000]   88044932:  mov       r12, r4
[  108.736000]   88044934:  mov.l     @(16,r11), r3
[  108.736000]   88044936:  mov.l     @(20,r6), r1
[  108.736000]   88044938:  mov.l     @r9, r2
[  108.736000]
[  108.736000] Process: sh (pid: 198, stack limit = 8f902001)
[  108.736000] Stack: (0x8f903e94 to 0x8f904000)
[  108.736000] 3e80:
000000d0 000000d0 00000000
[  108.736000] 3ea0: 88044d2a 8f903ec0 8f95248c 8f8d5ba0 8f800a20
000000d0 00000001 00000000
[  108.736000] 3ec0: 88011790 8f903ed8 8f8fff44 8f8d5380 00000001
8f952470 8f952488 8f95247c
[  108.736000] 3ee0: 8f8d53b4 8f8d5bd4 88011e64 8f903f08 8f865900
8f867840 8f86793c 880bc614
[  108.736000] 3f00: fffffff4 00000000 8f865940 00000000 8f903fa4
7bdf09d8 00000011 8f867954
[  108.736000] 3f20: 00000000 8f44ec38 00000000 880124d6 8f903f58
00000000 00000000 00000011
[  108.736000] 3f40: 00000071 00000000 88003bac 00000000 00000000
00000000 00000000 8f903fa4
[  108.736000] 3f60: 7bdf09d8 00000000 00456fd0 10000000 00481e4c
88003bc8 8f903f9c ffffffff
[  108.736000] 3f80: 295da3b8 00000000 00000071 00000100 88003bac
00000000 00000000 88007226
[  108.736000] 3fa0: 7bdf09d8 00000002 00403c70 08000000 00000002
00485a00 00483234 00000000
[  108.736000] 3fc0: 00000004 00483234 00485a00 00000000 004847fd
295da3b8 ffffffff 7bdf09d8
[  108.736000] 3fe0: 7bdf09d8 29591782 0042403c 00000000 00000000
0000003e 000000c8 00000040
[  108.740000] ---[ end trace 0313ffa0cd7d6a7f ]---

======================================

My .config:

#
# Automatically generated make config: don't edit
# Linux kernel version: 2.6.31-rc9
# Mon Sep 14 08:37:12 2009
#
CONFIG_SUPERH=y
CONFIG_SUPERH32=y
# CONFIG_SUPERH64 is not set
CONFIG_ARCH_DEFCONFIG="arch/sh/configs/shx3_defconfig"
CONFIG_RWSEM_GENERIC_SPINLOCK=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_FIND_NEXT_BIT=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_HARDIRQS_NO__DO_IRQ=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_IRQ_PER_CPU=y
# CONFIG_GENERIC_GPIO is not set
CONFIG_GENERIC_TIME=y
CONFIG_GENERIC_CLOCKEVENTS=y
# CONFIG_ARCH_SUSPEND_POSSIBLE is not set
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_SYS_SUPPORTS_TMU=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_HAVE_LATENCYTOP_SUPPORT=y
# CONFIG_ARCH_HAS_ILOG2_U32 is not set
# CONFIG_ARCH_HAS_ILOG2_U64 is not set
CONFIG_ARCH_NO_VIRT_TO_BUS=y
CONFIG_ARCH_HAS_DEFAULT_IDLE=y
CONFIG_ARCH_HAS_CPU_IDLE_WAIT=y
CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
CONFIG_CONSTRUCTORS=y

#
# General setup
#
CONFIG_EXPERIMENTAL=y
CONFIG_BROKEN_ON_SMP=y
CONFIG_INIT_ENV_ARG_LIMIT2
CONFIG_LOCALVERSION=""
CONFIG_LOCALVERSION_AUTO=y
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
# CONFIG_SWAP is not set
CONFIG_SYSVIPC=y
CONFIG_SYSVIPC_SYSCTL=y
# CONFIG_POSIX_MQUEUE is not set
# CONFIG_BSD_PROCESS_ACCT is not set
# CONFIG_TASKSTATS is not set
# CONFIG_AUDIT is not set

#
# RCU Subsystem
#
CONFIG_CLASSIC_RCU=y
# CONFIG_TREE_RCU is not set
# CONFIG_PREEMPT_RCU is not set
# CONFIG_TREE_RCU_TRACE is not set
# CONFIG_PREEMPT_RCU_TRACE is not set
# CONFIG_IKCONFIG is not set
CONFIG_LOG_BUF_SHIFT\x17
# CONFIG_GROUP_SCHED is not set
# CONFIG_CGROUPS is not set
# CONFIG_SYSFS_DEPRECATED_V2 is not set
# CONFIG_RELAY is not set
# CONFIG_NAMESPACES is not set
# CONFIG_BLK_DEV_INITRD is not set
CONFIG_CC_OPTIMIZE_FOR_SIZE=y
CONFIG_SYSCTL=y
CONFIG_EMBEDDED=y
# CONFIG_UID16 is not set
# CONFIG_SYSCTL_SYSCALL is not set
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
# CONFIG_KALLSYMS_EXTRA_PASS is not set
CONFIG_HOTPLUG=y
CONFIG_PRINTK=y
CONFIG_BUG=y
# CONFIG_ELF_CORE is not set
CONFIG_BASE_FULL=y
# CONFIG_FUTEX is not set
# CONFIG_EPOLL is not set
# CONFIG_SIGNALFD is not set
# CONFIG_TIMERFD is not set
# CONFIG_EVENTFD is not set
# CONFIG_SHMEM is not set
# CONFIG_AIO is not set
CONFIG_HAVE_PERF_COUNTERS=y

#
# Performance Counters
#
# CONFIG_PERF_COUNTERS is not set
# CONFIG_VM_EVENT_COUNTERS is not set
# CONFIG_STRIP_ASM_SYMS is not set
CONFIG_COMPAT_BRK=y
CONFIG_SLAB=y
# CONFIG_SLUB is not set
# CONFIG_SLOB is not set
# CONFIG_PROFILING is not set
# CONFIG_MARKERS is not set
CONFIG_HAVE_OPROFILE=y
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_HAVE_KPROBES=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_CLK=y
CONFIG_HAVE_DMA_API_DEBUG=y

#
# GCOV-based kernel profiling
#
# CONFIG_SLOW_WORK is not set
CONFIG_HAVE_GENERIC_DMA_COHERENT=y
CONFIG_SLABINFO=y
CONFIG_BASE_SMALL=0
# CONFIG_MODULES is not set
CONFIG_BLOCK=y
CONFIG_LBDAF=y
# CONFIG_BLK_DEV_BSG is not set
# CONFIG_BLK_DEV_INTEGRITY is not set

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
CONFIG_DEFAULT_AS=y
# CONFIG_DEFAULT_DEADLINE is not set
# CONFIG_DEFAULT_CFQ is not set
# CONFIG_DEFAULT_NOOP is not set
CONFIG_DEFAULT_IOSCHED="anticipatory"
# CONFIG_FREEZER is not set

#
# System type
#
CONFIG_CPU_SH4=y
CONFIG_CPU_SH4A=y
# CONFIG_CPU_SUBTYPE_SH7619 is not set
# CONFIG_CPU_SUBTYPE_SH7201 is not set
# CONFIG_CPU_SUBTYPE_SH7203 is not set
# CONFIG_CPU_SUBTYPE_SH7206 is not set
# CONFIG_CPU_SUBTYPE_SH7263 is not set
# CONFIG_CPU_SUBTYPE_MXG is not set
# CONFIG_CPU_SUBTYPE_SH7705 is not set
# CONFIG_CPU_SUBTYPE_SH7706 is not set
# CONFIG_CPU_SUBTYPE_SH7707 is not set
# CONFIG_CPU_SUBTYPE_SH7708 is not set
# CONFIG_CPU_SUBTYPE_SH7709 is not set
# CONFIG_CPU_SUBTYPE_SH7710 is not set
# CONFIG_CPU_SUBTYPE_SH7712 is not set
# CONFIG_CPU_SUBTYPE_SH7720 is not set
# CONFIG_CPU_SUBTYPE_SH7721 is not set
# CONFIG_CPU_SUBTYPE_SH7750 is not set
# CONFIG_CPU_SUBTYPE_SH7091 is not set
# CONFIG_CPU_SUBTYPE_SH7750R is not set
# CONFIG_CPU_SUBTYPE_SH7750S is not set
# CONFIG_CPU_SUBTYPE_SH7751 is not set
# CONFIG_CPU_SUBTYPE_SH7751R is not set
# CONFIG_CPU_SUBTYPE_SH7760 is not set
# CONFIG_CPU_SUBTYPE_SH4_202 is not set
# CONFIG_CPU_SUBTYPE_SH7723 is not set
# CONFIG_CPU_SUBTYPE_SH7724 is not set
# CONFIG_CPU_SUBTYPE_SH7757 is not set
CONFIG_CPU_SUBTYPE_SH7763=y
# CONFIG_CPU_SUBTYPE_SH7770 is not set
# CONFIG_CPU_SUBTYPE_SH7780 is not set
# CONFIG_CPU_SUBTYPE_SH7785 is not set
# CONFIG_CPU_SUBTYPE_SH7786 is not set
# CONFIG_CPU_SUBTYPE_SHX3 is not set
# CONFIG_CPU_SUBTYPE_SH7343 is not set
# CONFIG_CPU_SUBTYPE_SH7722 is not set
# CONFIG_CPU_SUBTYPE_SH7366 is not set

#
# Memory management options
#
CONFIG_QUICKLIST=y
CONFIG_MMU=y
CONFIG_PAGE_OFFSET=0x80000000
CONFIG_FORCE_MAX_ZONEORDER\x11
CONFIG_MEMORY_START=0x08000000
CONFIG_MEMORY_SIZE=0x08000000
CONFIG_29BIT=y
# CONFIG_VSYSCALL is not set
CONFIG_ARCH_FLATMEM_ENABLE=y
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SPARSEMEM_DEFAULT=y
CONFIG_MAX_ACTIVE_REGIONS=1
CONFIG_ARCH_POPULATES_NODE_MAP=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_PAGE_SIZE_4KB=y
# CONFIG_PAGE_SIZE_8KB is not set
# CONFIG_PAGE_SIZE_16KB is not set
# CONFIG_PAGE_SIZE_64KB is not set
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_FLATMEM_MANUAL=y
# CONFIG_DISCONTIGMEM_MANUAL is not set
# CONFIG_SPARSEMEM_MANUAL is not set
CONFIG_FLATMEM=y
CONFIG_FLAT_NODE_MEM_MAP=y
CONFIG_SPARSEMEM_STATIC=y
CONFIG_PAGEFLAGS_EXTENDED=y
CONFIG_SPLIT_PTLOCK_CPUS=4
# CONFIG_PHYS_ADDR_T_64BIT is not set
CONFIG_ZONE_DMA_FLAG=0
CONFIG_NR_QUICK=2
CONFIG_HAVE_MLOCK=y
CONFIG_HAVE_MLOCKED_PAGE_BIT=y
CONFIG_DEFAULT_MMAP_MIN_ADDR@96

#
# Cache configuration
#
CONFIG_CACHE_WRITEBACK=y
# CONFIG_CACHE_WRITETHROUGH is not set
# CONFIG_CACHE_OFF is not set

#
# Processor features
#
CONFIG_CPU_LITTLE_ENDIAN=y
# CONFIG_CPU_BIG_ENDIAN is not set
CONFIG_SH_FPU=y
# CONFIG_SH_STORE_QUEUES is not set
CONFIG_CPU_HAS_INTEVT=y
CONFIG_CPU_HAS_SR_RB=y
CONFIG_CPU_HAS_FPU=y

#
# Board support
#
# CONFIG_SH_SH7763RDP is not set
CONFIG_SH_JCI7763=y
# CONFIG_SH_ESPT is not set

#
# Timer and clock configuration
#
CONFIG_SH_TIMER_TMU=y
CONFIG_SH_PCLK_FREQ3333333
CONFIG_SH_CLK_CPG=y
CONFIG_SH_CLK_CPG_LEGACY=y
# CONFIG_NO_HZ is not set
# CONFIG_HIGH_RES_TIMERS is not set
CONFIG_GENERIC_CLOCKEVENTS_BUILD=y

#
# CPU Frequency scaling
#
# CONFIG_CPU_FREQ is not set

#
# DMA support
#
# CONFIG_SH_DMA is not set

#
# Companion Chips
#

#
# Additional SuperH Device Drivers
#
# CONFIG_HEARTBEAT is not set
# CONFIG_PUSH_SWITCH is not set

#
# Kernel features
#
# CONFIG_HZ_100 is not set
CONFIG_HZ_250=y
# CONFIG_HZ_300 is not set
# CONFIG_HZ_1000 is not set
CONFIG_HZ%0
# CONFIG_SCHED_HRTICK is not set
# CONFIG_KEXEC is not set
# CONFIG_CRASH_DUMP is not set
# CONFIG_SECCOMP is not set
# CONFIG_PREEMPT_NONE is not set
CONFIG_PREEMPT_VOLUNTARY=y
# CONFIG_PREEMPT is not set
CONFIG_GUSA=y
# CONFIG_SPARSE_IRQ is not set

#
# Boot options
#
CONFIG_ZERO_PAGE_OFFSET=0x00001000
CONFIG_BOOT_LINK_OFFSET=0x00800000
CONFIG_ENTRY_OFFSET=0x00001000
CONFIG_CMDLINE_OVERWRITE=y
# CONFIG_CMDLINE_EXTEND is not set
CONFIG_CMDLINE="earlycon=uart,mmio,0x18000008,115200n8
console=ttyS0,115200n8 root=/dev/nfs rw rootfstype=nfs
nfsroot\x159.222.11.56:/n40root ip=dhcp"

#
# Bus options
#
# CONFIG_ARCH_SUPPORTS_MSI is not set
# CONFIG_PCCARD is not set

#
# Executable file formats
#
CONFIG_BINFMT_ELF=y
# CONFIG_HAVE_AOUT is not set
# CONFIG_BINFMT_MISC is not set

#
# Power management options (EXPERIMENTAL)
#
# CONFIG_PM is not set
# CONFIG_CPU_IDLE is not set
CONFIG_NET=y

#
# Networking options
#
CONFIG_PACKET=y
# CONFIG_PACKET_MMAP is not set
CONFIG_UNIX=y
# CONFIG_NET_KEY is not set
CONFIG_INET=y
# CONFIG_IP_MULTICAST is not set
# CONFIG_IP_ADVANCED_ROUTER is not set
CONFIG_IP_FIB_HASH=y
CONFIG_IP_PNP=y
CONFIG_IP_PNP_DHCP=y
CONFIG_IP_PNP_BOOTP=y
# CONFIG_IP_PNP_RARP is not set
# CONFIG_NET_IPIP is not set
# CONFIG_NET_IPGRE is not set
# CONFIG_ARPD is not set
# CONFIG_SYN_COOKIES is not set
# CONFIG_INET_AH is not set
# CONFIG_INET_ESP is not set
# CONFIG_INET_IPCOMP is not set
# CONFIG_INET_XFRM_TUNNEL is not set
# CONFIG_INET_TUNNEL is not set
# CONFIG_INET_XFRM_MODE_TRANSPORT is not set
# CONFIG_INET_XFRM_MODE_TUNNEL is not set
# CONFIG_INET_XFRM_MODE_BEET is not set
# CONFIG_INET_LRO is not set
# CONFIG_INET_DIAG is not set
# CONFIG_TCP_CONG_ADVANCED is not set
CONFIG_TCP_CONG_CUBIC=y
CONFIG_DEFAULT_TCP_CONG="cubic"
# CONFIG_TCP_MD5SIG is not set
# CONFIG_IPV6 is not set
# CONFIG_NETWORK_SECMARK is not set
# CONFIG_NETFILTER is not set
# CONFIG_IP_DCCP is not set
# CONFIG_IP_SCTP is not set
# CONFIG_TIPC is not set
# CONFIG_ATM is not set
# CONFIG_BRIDGE is not set
# CONFIG_NET_DSA is not set
# CONFIG_VLAN_8021Q is not set
# CONFIG_DECNET is not set
# CONFIG_LLC2 is not set
# CONFIG_IPX is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_ECONET is not set
# CONFIG_WAN_ROUTER is not set
# CONFIG_PHONET is not set
# CONFIG_IEEE802154 is not set
# CONFIG_NET_SCHED is not set
# CONFIG_DCB is not set

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
# CONFIG_HAMRADIO is not set
# CONFIG_CAN is not set
# CONFIG_IRDA is not set
# CONFIG_BT is not set
# CONFIG_AF_RXRPC is not set
# CONFIG_WIRELESS is not set
# CONFIG_WIMAX is not set
# CONFIG_RFKILL is not set
# CONFIG_NET_9P is not set

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug"
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=y
CONFIG_FIRMWARE_IN_KERNEL=y
CONFIG_EXTRA_FIRMWARE=""
# CONFIG_DEBUG_DRIVER is not set
# CONFIG_DEBUG_DEVRES is not set
# CONFIG_SYS_HYPERVISOR is not set
# CONFIG_CONNECTOR is not set
# CONFIG_MTD is not set
# CONFIG_PARPORT is not set
CONFIG_BLK_DEV=y
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=y
# CONFIG_BLK_DEV_CRYPTOLOOP is not set
# CONFIG_BLK_DEV_NBD is not set
# CONFIG_BLK_DEV_RAM is not set
# CONFIG_CDROM_PKTCDVD is not set
# CONFIG_ATA_OVER_ETH is not set
# CONFIG_BLK_DEV_HD is not set
# CONFIG_MISC_DEVICES is not set
CONFIG_HAVE_IDE=y
# CONFIG_IDE is not set

#
# SCSI device support
#
# CONFIG_RAID_ATTRS is not set
CONFIG_SCSI=y
CONFIG_SCSI_DMA=y
# CONFIG_SCSI_TGT is not set
# CONFIG_SCSI_NETLINK is not set
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=y
# CONFIG_CHR_DEV_ST is not set
# CONFIG_CHR_DEV_OSST is not set
# CONFIG_BLK_DEV_SR is not set
# CONFIG_CHR_DEV_SG is not set
# CONFIG_CHR_DEV_SCH is not set
# CONFIG_SCSI_MULTI_LUN is not set
# CONFIG_SCSI_CONSTANTS is not set
# CONFIG_SCSI_LOGGING is not set
# CONFIG_SCSI_SCAN_ASYNC is not set

#
# SCSI Transports
#
# CONFIG_SCSI_SPI_ATTRS is not set
# CONFIG_SCSI_FC_ATTRS is not set
# CONFIG_SCSI_ISCSI_ATTRS is not set
# CONFIG_SCSI_SAS_LIBSAS is not set
# CONFIG_SCSI_SRP_ATTRS is not set
CONFIG_SCSI_LOWLEVEL=y
# CONFIG_ISCSI_TCP is not set
# CONFIG_LIBFC is not set
# CONFIG_LIBFCOE is not set
# CONFIG_SCSI_DEBUG is not set
# CONFIG_SCSI_DH is not set
# CONFIG_SCSI_OSD_INITIATOR is not set
# CONFIG_ATA is not set
# CONFIG_MD is not set
CONFIG_NETDEVICES=y
# CONFIG_DUMMY is not set
# CONFIG_BONDING is not set
# CONFIG_MACVLAN is not set
# CONFIG_EQUALIZER is not set
# CONFIG_TUN is not set
# CONFIG_VETH is not set
CONFIG_PHYLIB=y

#
# MII PHY device drivers
#
# CONFIG_MARVELL_PHY is not set
# CONFIG_DAVICOM_PHY is not set
# CONFIG_QSEMI_PHY is not set
# CONFIG_LXT_PHY is not set
# CONFIG_CICADA_PHY is not set
# CONFIG_VITESSE_PHY is not set
# CONFIG_SMSC_PHY is not set
# CONFIG_BROADCOM_PHY is not set
# CONFIG_ICPLUS_PHY is not set
# CONFIG_REALTEK_PHY is not set
# CONFIG_NATIONAL_PHY is not set
# CONFIG_STE10XP is not set
# CONFIG_LSI_ET1011C_PHY is not set
# CONFIG_FIXED_PHY is not set
CONFIG_MDIO_BITBANG=y
CONFIG_NET_ETHERNET=y
CONFIG_MII=y
# CONFIG_AX88796 is not set
# CONFIG_STNIC is not set
CONFIG_SH_ETH=y
# CONFIG_SMC91X is not set
# CONFIG_ETHOC is not set
# CONFIG_SMC911X is not set
# CONFIG_SMSC911X is not set
# CONFIG_DNET is not set
# CONFIG_IBM_NEW_EMAC_ZMII is not set
# CONFIG_IBM_NEW_EMAC_RGMII is not set
# CONFIG_IBM_NEW_EMAC_TAH is not set
# CONFIG_IBM_NEW_EMAC_EMAC4 is not set
# CONFIG_IBM_NEW_EMAC_NO_FLOW_CTRL is not set
# CONFIG_IBM_NEW_EMAC_MAL_CLR_ICINTSTAT is not set
# CONFIG_IBM_NEW_EMAC_MAL_COMMON_ERR is not set
# CONFIG_B44 is not set
# CONFIG_KS8842 is not set
# CONFIG_NETDEV_1000 is not set
# CONFIG_NETDEV_10000 is not set

#
# Wireless LAN
#
# CONFIG_WLAN_PRE80211 is not set
# CONFIG_WLAN_80211 is not set

#
# Enable WiMAX (Networking options) to see the WiMAX drivers
#
# CONFIG_WAN is not set
# CONFIG_PPP is not set
# CONFIG_SLIP is not set
# CONFIG_NETCONSOLE is not set
# CONFIG_NETPOLL is not set
# CONFIG_NET_POLL_CONTROLLER is not set
# CONFIG_ISDN is not set
# CONFIG_PHONE is not set

#
# Input device support
#
CONFIG_INPUT=y
# CONFIG_INPUT_FF_MEMLESS is not set
# CONFIG_INPUT_POLLDEV is not set

#
# Userland interfaces
#
# CONFIG_INPUT_MOUSEDEV is not set
# CONFIG_INPUT_JOYDEV is not set
# CONFIG_INPUT_EVDEV is not set
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
# CONFIG_INPUT_KEYBOARD is not set
# CONFIG_INPUT_MOUSE is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TABLET is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
# CONFIG_INPUT_MISC is not set

#
# Hardware I/O ports
#
# CONFIG_SERIO is not set
# CONFIG_GAMEPORT is not set

#
# Character devices
#
# CONFIG_VT is not set
CONFIG_DEVKMEM=y
# CONFIG_SERIAL_NONSTANDARD is not set

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_SERIAL_8250_NR_UARTS=1
CONFIG_SERIAL_8250_RUNTIME_UARTS=1
# CONFIG_SERIAL_8250_EXTENDED is not set

#
# Non-8250 serial port support
#
# CONFIG_SERIAL_SH_SCI is not set
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_UNIX98_PTYS=y
# CONFIG_DEVPTS_MULTIPLE_INSTANCES is not set
CONFIG_LEGACY_PTYS=y
CONFIG_LEGACY_PTY_COUNT\x16
# CONFIG_IPMI_HANDLER is not set
# CONFIG_HW_RANDOM is not set
# CONFIG_R3964 is not set
# CONFIG_RAW_DRIVER is not set
# CONFIG_TCG_TPM is not set
# CONFIG_I2C is not set
# CONFIG_SPI is not set

#
# PPS support
#
# CONFIG_PPS is not set
# CONFIG_W1 is not set
# CONFIG_POWER_SUPPLY is not set
# CONFIG_HWMON is not set
# CONFIG_THERMAL is not set
# CONFIG_THERMAL_HWMON is not set
# CONFIG_WATCHDOG is not set
CONFIG_SSB_POSSIBLE=y

#
# Sonics Silicon Backplane
#
# CONFIG_SSB is not set

#
# Multifunction device drivers
#
# CONFIG_MFD_CORE is not set
# CONFIG_MFD_SM501 is not set
# CONFIG_HTC_PASIC3 is not set
# CONFIG_MFD_TMIO is not set
# CONFIG_REGULATOR is not set
# CONFIG_MEDIA_SUPPORT is not set

#
# Graphics support
#
# CONFIG_VGASTATE is not set
# CONFIG_VIDEO_OUTPUT_CONTROL is not set
# CONFIG_FB is not set
# CONFIG_BACKLIGHT_LCD_SUPPORT is not set

#
# Display device support
#
# CONFIG_DISPLAY_SUPPORT is not set
# CONFIG_SOUND is not set
# CONFIG_HID_SUPPORT is not set
# CONFIG_USB_SUPPORT is not set
# CONFIG_MMC is not set
# CONFIG_MEMSTICK is not set
# CONFIG_NEW_LEDS is not set
# CONFIG_ACCESSIBILITY is not set
CONFIG_RTC_LIB=y
# CONFIG_RTC_CLASS is not set
# CONFIG_DMADEVICES is not set
# CONFIG_AUXDISPLAY is not set
# CONFIG_UIO is not set

#
# TI VLYNQ
#
# CONFIG_STAGING is not set

#
# File systems
#
CONFIG_EXT2_FS=y
# CONFIG_EXT2_FS_XATTR is not set
# CONFIG_EXT2_FS_XIP is not set
# CONFIG_EXT3_FS is not set
# CONFIG_EXT4_FS is not set
# CONFIG_REISERFS_FS is not set
# CONFIG_JFS_FS is not set
CONFIG_FS_POSIX_ACL=y
# CONFIG_XFS_FS is not set
# CONFIG_GFS2_FS is not set
# CONFIG_OCFS2_FS is not set
# CONFIG_BTRFS_FS is not set
CONFIG_FILE_LOCKING=y
# CONFIG_FSNOTIFY is not set
# CONFIG_DNOTIFY is not set
CONFIG_INOTIFY=y
# CONFIG_INOTIFY_USER is not set
# CONFIG_QUOTA is not set
CONFIG_AUTOFS_FS=y
CONFIG_AUTOFS4_FS=y
# CONFIG_FUSE_FS is not set
CONFIG_GENERIC_ACL=y

#
# Caches
#
# CONFIG_FSCACHE is not set

#
# CD-ROM/DVD Filesystems
#
# CONFIG_ISO9660_FS is not set
# CONFIG_UDF_FS is not set

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=y
CONFIG_MSDOS_FS=y
CONFIG_VFAT_FS=y
CONFIG_FAT_DEFAULT_CODEPAGEC7
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
# CONFIG_NTFS_FS is not set

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_PROC_SYSCTL=y
CONFIG_PROC_PAGE_MONITOR=y
CONFIG_SYSFS=y
CONFIG_TMPFS=y
CONFIG_TMPFS_POSIX_ACL=y
# CONFIG_HUGETLBFS is not set
# CONFIG_HUGETLB_PAGE is not set
# CONFIG_CONFIGFS_FS is not set
# CONFIG_MISC_FILESYSTEMS is not set
CONFIG_NETWORK_FILESYSTEMS=y
CONFIG_NFS_FS=y
CONFIG_NFS_V3=y
# CONFIG_NFS_V3_ACL is not set
# CONFIG_NFS_V4 is not set
CONFIG_ROOT_NFS=y
# CONFIG_NFSD is not set
CONFIG_LOCKD=y
CONFIG_LOCKD_V4=y
CONFIG_NFS_COMMON=y
CONFIG_SUNRPC=y
# CONFIG_RPCSEC_GSS_KRB5 is not set
# CONFIG_RPCSEC_GSS_SPKM3 is not set
# CONFIG_SMB_FS is not set
# CONFIG_CIFS is not set
# CONFIG_NCP_FS is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not set

#
# Partition Types
#
# CONFIG_PARTITION_ADVANCED is not set
CONFIG_MSDOS_PARTITION=y
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-1"
# CONFIG_NLS_CODEPAGE_437 is not set
# CONFIG_NLS_CODEPAGE_737 is not set
# CONFIG_NLS_CODEPAGE_775 is not set
# CONFIG_NLS_CODEPAGE_850 is not set
# CONFIG_NLS_CODEPAGE_852 is not set
# CONFIG_NLS_CODEPAGE_855 is not set
# CONFIG_NLS_CODEPAGE_857 is not set
# CONFIG_NLS_CODEPAGE_860 is not set
# CONFIG_NLS_CODEPAGE_861 is not set
# CONFIG_NLS_CODEPAGE_862 is not set
# CONFIG_NLS_CODEPAGE_863 is not set
# CONFIG_NLS_CODEPAGE_864 is not set
# CONFIG_NLS_CODEPAGE_865 is not set
# CONFIG_NLS_CODEPAGE_866 is not set
# CONFIG_NLS_CODEPAGE_869 is not set
# CONFIG_NLS_CODEPAGE_936 is not set
# CONFIG_NLS_CODEPAGE_950 is not set
# CONFIG_NLS_CODEPAGE_932 is not set
# CONFIG_NLS_CODEPAGE_949 is not set
# CONFIG_NLS_CODEPAGE_874 is not set
# CONFIG_NLS_ISO8859_8 is not set
# CONFIG_NLS_CODEPAGE_1250 is not set
# CONFIG_NLS_CODEPAGE_1251 is not set
CONFIG_NLS_ASCII=y
# CONFIG_NLS_ISO8859_1 is not set
# CONFIG_NLS_ISO8859_2 is not set
# CONFIG_NLS_ISO8859_3 is not set
# CONFIG_NLS_ISO8859_4 is not set
# CONFIG_NLS_ISO8859_5 is not set
# CONFIG_NLS_ISO8859_6 is not set
# CONFIG_NLS_ISO8859_7 is not set
# CONFIG_NLS_ISO8859_9 is not set
# CONFIG_NLS_ISO8859_13 is not set
# CONFIG_NLS_ISO8859_14 is not set
# CONFIG_NLS_ISO8859_15 is not set
# CONFIG_NLS_KOI8_R is not set
# CONFIG_NLS_KOI8_U is not set
CONFIG_NLS_UTF8=y
# CONFIG_DLM is not set

#
# Kernel hacking
#
CONFIG_TRACE_IRQFLAGS_SUPPORT=y
CONFIG_PRINTK_TIME=y
# CONFIG_ENABLE_WARN_DEPRECATED is not set
# CONFIG_ENABLE_MUST_CHECK is not set
CONFIG_FRAME_WARN\x1024
# CONFIG_MAGIC_SYSRQ is not set
# CONFIG_UNUSED_SYMBOLS is not set
# CONFIG_DEBUG_FS is not set
# CONFIG_HEADERS_CHECK is not set
CONFIG_DEBUG_KERNEL=y
CONFIG_DEBUG_SHIRQ=y
# CONFIG_DETECT_SOFTLOCKUP is not set
# CONFIG_DETECT_HUNG_TASK is not set
# CONFIG_SCHED_DEBUG is not set
# CONFIG_SCHEDSTATS is not set
# CONFIG_TIMER_STATS is not set
# CONFIG_DEBUG_OBJECTS is not set
# CONFIG_DEBUG_SLAB is not set
# CONFIG_DEBUG_SPINLOCK is not set
# CONFIG_DEBUG_MUTEXES is not set
# CONFIG_DEBUG_LOCK_ALLOC is not set
# CONFIG_PROVE_LOCKING is not set
# CONFIG_LOCK_STAT is not set
# CONFIG_DEBUG_SPINLOCK_SLEEP is not set
# CONFIG_DEBUG_LOCKING_API_SELFTESTS is not set
# CONFIG_DEBUG_KOBJECT is not set
# CONFIG_DEBUG_BUGVERBOSE is not set
CONFIG_DEBUG_INFO=y
# CONFIG_DEBUG_VM is not set
# CONFIG_DEBUG_WRITECOUNT is not set
# CONFIG_DEBUG_MEMORY_INIT is not set
# CONFIG_DEBUG_LIST is not set
# CONFIG_DEBUG_SG is not set
# CONFIG_DEBUG_NOTIFIERS is not set
CONFIG_FRAME_POINTER=y
# CONFIG_RCU_TORTURE_TEST is not set
# CONFIG_RCU_CPU_STALL_DETECTOR is not set
# CONFIG_BACKTRACE_SELF_TEST is not set
# CONFIG_DEBUG_BLOCK_EXT_DEVT is not set
# CONFIG_FAULT_INJECTION is not set
# CONFIG_LATENCYTOP is not set
# CONFIG_PAGE_POISONING is not set
CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_HAVE_FTRACE_SYSCALLS=y
CONFIG_TRACING_SUPPORT=y
CONFIG_FTRACE=y
# CONFIG_FUNCTION_TRACER is not set
# CONFIG_IRQSOFF_TRACER is not set
# CONFIG_SCHED_TRACER is not set
# CONFIG_ENABLE_DEFAULT_TRACERS is not set
# CONFIG_FTRACE_SYSCALLS is not set
# CONFIG_BOOT_TRACER is not set
CONFIG_BRANCH_PROFILE_NONE=y
# CONFIG_PROFILE_ANNOTATED_BRANCHES is not set
# CONFIG_PROFILE_ALL_BRANCHES is not set
# CONFIG_STACK_TRACER is not set
# CONFIG_KMEMTRACE is not set
# CONFIG_WORKQUEUE_TRACER is not set
# CONFIG_BLK_DEV_IO_TRACE is not set
# CONFIG_DMA_API_DEBUG is not set
# CONFIG_SAMPLES is not set
CONFIG_HAVE_ARCH_KGDB=y
# CONFIG_KGDB is not set
# CONFIG_SH_STANDARD_BIOS is not set
# CONFIG_EARLY_SCIF_CONSOLE is not set
# CONFIG_STACK_DEBUG is not set
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_4KSTACKS is not set
CONFIG_DUMP_CODE=y
# CONFIG_DWARF_UNWINDER is not set
# CONFIG_SH_NO_BSS_INIT is not set

#
# Security options
#
# CONFIG_KEYS is not set
# CONFIG_SECURITY is not set
# CONFIG_SECURITYFS is not set
# CONFIG_SECURITY_FILE_CAPABILITIES is not set
CONFIG_CRYPTO=y

#
# Crypto core or helper
#
# CONFIG_CRYPTO_FIPS is not set
# CONFIG_CRYPTO_MANAGER is not set
# CONFIG_CRYPTO_MANAGER2 is not set
# CONFIG_CRYPTO_GF128MUL is not set
# CONFIG_CRYPTO_NULL is not set
# CONFIG_CRYPTO_CRYPTD is not set
# CONFIG_CRYPTO_AUTHENC is not set

#
# Authenticated Encryption with Associated Data
#
# CONFIG_CRYPTO_CCM is not set
# CONFIG_CRYPTO_GCM is not set
# CONFIG_CRYPTO_SEQIV is not set

#
# Block modes
#
# CONFIG_CRYPTO_CBC is not set
# CONFIG_CRYPTO_CTR is not set
# CONFIG_CRYPTO_CTS is not set
# CONFIG_CRYPTO_ECB is not set
# CONFIG_CRYPTO_LRW is not set
# CONFIG_CRYPTO_PCBC is not set
# CONFIG_CRYPTO_XTS is not set

#
# Hash modes
#
# CONFIG_CRYPTO_HMAC is not set
# CONFIG_CRYPTO_XCBC is not set

#
# Digest
#
# CONFIG_CRYPTO_CRC32C is not set
# CONFIG_CRYPTO_MD4 is not set
# CONFIG_CRYPTO_MD5 is not set
# CONFIG_CRYPTO_MICHAEL_MIC is not set
# CONFIG_CRYPTO_RMD128 is not set
# CONFIG_CRYPTO_RMD160 is not set
# CONFIG_CRYPTO_RMD256 is not set
# CONFIG_CRYPTO_RMD320 is not set
# CONFIG_CRYPTO_SHA1 is not set
# CONFIG_CRYPTO_SHA256 is not set
# CONFIG_CRYPTO_SHA512 is not set
# CONFIG_CRYPTO_TGR192 is not set
# CONFIG_CRYPTO_WP512 is not set

#
# Ciphers
#
# CONFIG_CRYPTO_AES is not set
# CONFIG_CRYPTO_ANUBIS is not set
# CONFIG_CRYPTO_ARC4 is not set
# CONFIG_CRYPTO_BLOWFISH is not set
# CONFIG_CRYPTO_CAMELLIA is not set
# CONFIG_CRYPTO_CAST5 is not set
# CONFIG_CRYPTO_CAST6 is not set
# CONFIG_CRYPTO_DES is not set
# CONFIG_CRYPTO_FCRYPT is not set
# CONFIG_CRYPTO_KHAZAD is not set
# CONFIG_CRYPTO_SALSA20 is not set
# CONFIG_CRYPTO_SEED is not set
# CONFIG_CRYPTO_SERPENT is not set
# CONFIG_CRYPTO_TEA is not set
# CONFIG_CRYPTO_TWOFISH is not set

#
# Compression
#
# CONFIG_CRYPTO_DEFLATE is not set
# CONFIG_CRYPTO_ZLIB is not set
# CONFIG_CRYPTO_LZO is not set

#
# Random Number Generation
#
# CONFIG_CRYPTO_ANSI_CPRNG is not set
CONFIG_CRYPTO_HW=y
# CONFIG_BINARY_PRINTF is not set

#
# Library routines
#
CONFIG_BITREVERSE=y
CONFIG_GENERIC_FIND_LAST_BIT=y
# CONFIG_CRC_CCITT is not set
# CONFIG_CRC16 is not set
CONFIG_CRC_T10DIF=y
# CONFIG_CRC_ITU_T is not set
CONFIG_CRC32=y
# CONFIG_CRC7 is not set
# CONFIG_LIBCRC32C is not set
CONFIG_HAS_IOMEM=y
CONFIG_HAS_IOPORT=y
CONFIG_HAS_DMA=y
CONFIG_HAVE_LMB=y
CONFIG_NLATTR=y
CONFIG_GENERIC_ATOMIC64=y
--
To unsubscribe from this list: send the line "unsubscribe linux-sh" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: User mode address error problems on 7763

[Matt Fleming]

On Mon, Sep 14, 2009 at 08:54:31AM -0500, Dale Larson wrote:
> On Mon, Sep 14, 2009 at 8:14 AM, Matt Fleming <matt@console-pimps.org> wrote:
>
> >There was an issue a few weeks ago
> > where we were unneccessarily reporting unaligned fix ups. It was fixed
> > by this commit,
> 
> I think later changes may have changed that. There are now a couple
> global variables used to control kernel and user messages having to do
> with address fixups in traps_32.c.:
> 
> /* bitfield: 1: warn 2: fixup 4: signal -> combinations 2|4 && 1|2|4
> are not valid! */
> static int se_usermode = 3;
> /* 0: no warning 1: print a warning message */
> static int se_kernmode_warn = 0;  /* WAS 1 - DLL20090914 */
> 

Ah, OK, I missed that change.

> 
> Log of kernel run:
> 

[...]

> Starting network...
> ip: RTNETLINK answers: File exists
> [   17.040000] Unaligned userspace access in "sh" pid\x189
> pc=0x295583d0 ins=0x60b2
> [   17.044000] Fixing up unaligned userspace access in "sh" pid\x189
> pc=0x295583d0 ins=0x60b2
> [   17.048000] Sending SIGBUS to "sh" due to unaligned access (PC
> a0042955 PR 295583da)
> Starting dropbear sshd: generating rsa key... generating dsa key... OK
> [   45.608000] Unaligned userspace access in "syslogd" pid\x199
> pc=0x295583d0 ins=0x60b2
> [   45.612000] Fixing up unaligned userspace access in "syslogd"
> pid\x199 pc=0x295583d0 ins=0x60b2
> [   45.624000] Sending SIGBUS to "syslogd" due to unaligned access (PC
> a0042955 PR 295583da)
> 

OK, these are unexpected fixups and similar to the issues I've been
seeing. The current train of thought is that these unaligned accesses
are a symptom of having aliases in the D-cache. I've been trawling
through the cache/tlb code for SH4 and so far haven't found the bug.

As a little experiment, could you try bumping the page size from 4K to
8K and see if the unaligned accesses go away? If they are caused by
D-cache aliasing, in theory, they should disappear with 8K pages.

The option in menuconfig is under,

    System type --->
    	   Memory management options --->
	   	  Kernel page size --->

> [  108.736000] ------------[ cut here ]------------
> [  108.736000] Kernel BUG at 8804492e [verbose debug info unavailable]
> [  108.736000] Kernel BUG: 003e [#1]
> [  108.736000]
> [  108.736000] Pid : 198, Comm:                 sh
> [  108.736000] CPU : 0                  Not tainted  (2.6.31-rc9 #5)
> [  108.736000]
> [  108.736000] PC is at cache_alloc_refill+0xc2/0x39c
> [  108.736000] PR is at kmem_cache_alloc+0x52/0xb0
> [  108.736000] PC  : 8804492e SP  : 8f903e94 SR  : 400080f1 TEA : 00485a14
> [  108.736000] R0  : 00000023 R1  : 0000002e R2  : 0000002e R3  : 8f8e2e48
> [  108.736000] R4  : 00000010 R5  : 8f8029a0 R6  : 8f8e2000 R7  : 0000002f
> [  108.736000] R8  : 8f8029a8 R9  : 8f809400 R10 : 8f8029b0 R11 : 8f800a20
> [  108.736000] R12 : 0000000f R13 : 00000001 R14 : 8f903e94
> [  108.736000] MACH: 00000000 MACL: 00000d74 GBR : 00000000 PR  : 88044d2a
> [  108.736000]
> [  108.736000] Call trace:
> [  108.736000]  [<88044d2a>] kmem_cache_alloc+0x52/0xb0
> [  108.736000]  [<88011790>] dup_mm+0x150/0x2cc
> [  108.736000]  [<88011e64>] copy_process+0x518/0xa9c
> [  108.736000]  [<880bc614>] memcpy+0x0/0x28c
> [  108.736000]  [<880124d6>] do_fork+0xee/0x250
> [  108.736000]  [<88003bac>] sys_fork+0x0/0x28
> [  108.736000]  [<88003bc8>] sys_fork+0x1c/0x28
> [  108.736000]  [<88003bac>] sys_fork+0x0/0x28
> [  108.736000]  [<88007226>] syscall_call+0xc/0x10
> [  108.736000]
> [  108.736000] Code:
> [  108.736000]   88044928:  mov.l     @(28,r11), r1
> [  108.736000]   8804492a:  cmp/hs    r1, r2
> [  108.736000]   8804492c:  bf        8804495a
> [  108.736000] ->8804492e:  trapa     #62
> [  108.736000]   88044930:  bra       8804495c
> [  108.736000]   88044932:  mov       r12, r4
> [  108.736000]   88044934:  mov.l     @(16,r11), r3
> [  108.736000]   88044936:  mov.l     @(20,r6), r1
> [  108.736000]   88044938:  mov.l     @r9, r2
> [  108.736000]
> [  108.736000] Process: sh (pid: 198, stack limit = 8f902001)
> [  108.736000] Stack: (0x8f903e94 to 0x8f904000)
> [  108.736000] 3e80:
> 000000d0 000000d0 00000000
> [  108.736000] 3ea0: 88044d2a 8f903ec0 8f95248c 8f8d5ba0 8f800a20
> 000000d0 00000001 00000000
> [  108.736000] 3ec0: 88011790 8f903ed8 8f8fff44 8f8d5380 00000001
> 8f952470 8f952488 8f95247c
> [  108.736000] 3ee0: 8f8d53b4 8f8d5bd4 88011e64 8f903f08 8f865900
> 8f867840 8f86793c 880bc614
> [  108.736000] 3f00: fffffff4 00000000 8f865940 00000000 8f903fa4
> 7bdf09d8 00000011 8f867954
> [  108.736000] 3f20: 00000000 8f44ec38 00000000 880124d6 8f903f58
> 00000000 00000000 00000011
> [  108.736000] 3f40: 00000071 00000000 88003bac 00000000 00000000
> 00000000 00000000 8f903fa4
> [  108.736000] 3f60: 7bdf09d8 00000000 00456fd0 10000000 00481e4c
> 88003bc8 8f903f9c ffffffff
> [  108.736000] 3f80: 295da3b8 00000000 00000071 00000100 88003bac
> 00000000 00000000 88007226
> [  108.736000] 3fa0: 7bdf09d8 00000002 00403c70 08000000 00000002
> 00485a00 00483234 00000000
> [  108.736000] 3fc0: 00000004 00483234 00485a00 00000000 004847fd
> 295da3b8 ffffffff 7bdf09d8
> [  108.736000] 3fe0: 7bdf09d8 29591782 0042403c 00000000 00000000
> 0000003e 000000c8 00000040
> [  108.740000] ---[ end trace 0313ffa0cd7d6a7f ]---
> 

Can you reliably reproduce this? A little tip when doing development is
to turn on Verbose BUG() reporting, which is located in the Kernel
Hacking menu. That'll give you a line and number in the source file.

Re: User mode address error problems on 7763

[Dale Larson]

On Tue, Sep 15, 2009 at 3:39 AM, Matt Fleming <matt@console-pimps.org> wrote:
> OK, these are unexpected fixups and similar to the issues I've been
> seeing. The current train of thought is that these unaligned accesses
> are a symptom of having aliases in the D-cache. I've been trawling
> through the cache/tlb code for SH4 and so far haven't found the bug.
>
> As a little experiment, could you try bumping the page size from 4K to
> 8K and see if the unaligned accesses go away? If they are caused by
> D-cache aliasing, in theory, they should disappear with 8K pages.

The 7763 only supports 1K, 4K, 64K and 1M pages. Would a 64K page
yield any useful info?

> Can you reliably reproduce this? A little tip when doing development is
> to turn on Verbose BUG() reporting, which is located in the Kernel
> Hacking menu. That'll give you a line and number in the source file.

I can certainly try. I see I forget to turn on BUG(). I'll post
results. Anything I can do to assist in finding this I'm open to.
Clearly I don't want to run my system without I/D Cache. :)

Thanks,
Dale Larson
Johnson Controls, Inc

Re: User mode address error problems on 7763

[Paul Mundt]

On Tue, Sep 15, 2009 at 06:54:35AM -0500, Dale Larson wrote:
> On Tue, Sep 15, 2009 at 3:39 AM, Matt Fleming <matt@console-pimps.org> wrote:
> > OK, these are unexpected fixups and similar to the issues I've been
> > seeing. The current train of thought is that these unaligned accesses
> > are a symptom of having aliases in the D-cache. I've been trawling
> > through the cache/tlb code for SH4 and so far haven't found the bug.
> >
> > As a little experiment, could you try bumping the page size from 4K to
> > 8K and see if the unaligned accesses go away? If they are caused by
> > D-cache aliasing, in theory, they should disappear with 8K pages.
> 
> The 7763 only supports 1K, 4K, 64K and 1M pages. Would a 64K page
> yield any useful info?
> 
You can get 8kB pages by enabling extended mode TLB. But yes, 64k pages
are fine too, if using the compat mode TLB.

Re: User mode address error problems on 7763

[Dale Larson]

Hi Paul,

>> The 7763 only supports 1K, 4K, 64K and 1M pages. Would a 64K page
>> yield any useful info?
> You can get 8kB pages by enabling extended mode TLB. But yes, 64k pages
> are fine too, if using the compat mode TLB.

I can? I don't see it in the 7763 hardware manual. I only see this in
the MMU section:

"This LSI has four instruction TLB (ITLB) entries and 64 unified TLB
(UTLB) entries. UTLB
copies are stored in the ITLB by hardware. A paging system is used for
address translation, with
four page sizes (1, 4, and 64 Kbytes, and 1 Mbyte) supported. It is
possible to set the virtual
address space access right and implement memory protection
independently for privileged mode
and user mode."

If 64K would work with "compat mode TLB" how do I turn it on?

Re: User mode address error problems on 7763

[Paul Mundt]

On Tue, Sep 15, 2009 at 07:20:27AM -0500, Dale Larson wrote:
> >> The 7763 only supports 1K, 4K, 64K and 1M pages. Would a 64K page
> >> yield any useful info?
> > You can get 8kB pages by enabling extended mode TLB. But yes, 64k pages
> > are fine too, if using the compat mode TLB.
> 
> I can? I don't see it in the 7763 hardware manual. I only see this in
> the MMU section:
> 
> "This LSI has four instruction TLB (ITLB) entries and 64 unified TLB
> (UTLB) entries. UTLB
> copies are stored in the ITLB by hardware. A paging system is used for
> address translation, with
> four page sizes (1, 4, and 64 Kbytes, and 1 Mbyte) supported. It is
> possible to set the virtual
> address space access right and implement memory protection
> independently for privileged mode
> and user mode."
> 
I assumed SH7763 was an SH-X2 based core, but it turns out it is a
first-generation SH-4A, in which case it does not implement the extended
mode TLB. So the next available page size above 4k is 64k. I wasn't aware
there was anyone still running first generation SH-4A, I'll have to dust
some of mine off to see if I can reproduce your issues.

> If 64K would work with "compat mode TLB" how do I turn it on?

From the top menu, System Type -> Memory management options -> Kernel
page size. That will bring up a menu where you can cycle through the
available page sizes. I don't recommend 1MB for a system page size, as it
tends to interact badly with some of the slab allocators. 64k will give
you an idea of whether there are indeed any aliasing bugs lurking about.

Re: User mode address error problems on 7763

[Dale Larson]

> I assumed SH7763 was an SH-X2 based core, but it turns out it is a
> first-generation SH-4A, in which case it does not implement the extended
> mode TLB. So the next available page size above 4k is 64k. I wasn't aware
> there was anyone still running first generation SH-4A, I'll have to dust
> some of mine off to see if I can reproduce your issues.

We're finally replacing our 7760 (yep, you heard right) based product
with the 7763.
While you're dusting your's off we'll just be putting polish on it. ;-)

> page size. That will bring up a menu where you can cycle through the
> available page sizes. I don't recommend 1MB for a system page size, as it
> tends to interact badly with some of the slab allocators. 64k will give
> you an idea of whether there are indeed any aliasing bugs lurking about.

I'll try that.

Thanks!

Re: User mode address error problems on 7763

[Paul Mundt]

On Tue, Sep 15, 2009 at 07:55:14AM -0500, Dale Larson wrote:
> > I assumed SH7763 was an SH-X2 based core, but it turns out it is a
> > first-generation SH-4A, in which case it does not implement the extended
> > mode TLB. So the next available page size above 4k is 64k. I wasn't aware
> > there was anyone still running first generation SH-4A, I'll have to dust
> > some of mine off to see if I can reproduce your issues.
> 
> We're finally replacing our 7760 (yep, you heard right) based product
> with the 7763.
> While you're dusting your's off we'll just be putting polish on it. ;-)
> 
That's actually good to know, it means we'll have to do more aggressive
regression testing on first-generation SH-X parts (we tend to scale back
regression testing efforts on older parts when there are no visible users
of them on the current kernel). In any event, I'll give both the SH7780
and SH7770 highlanders a go tomorrow and see how things go.. and if that
doesn't work, I'm sure there's a 7763 lying around the office somwehere.
;-)

> > page size. That will bring up a menu where you can cycle through the
> > available page sizes. I don't recommend 1MB for a system page size, as it
> > tends to interact badly with some of the slab allocators. 64k will give
> > you an idea of whether there are indeed any aliasing bugs lurking about.
> 
> I'll try that.
> 
> Thanks!

One other thing I forgot to mention is that you might also want to try a
4k page size with write-through caching enabled. This you can configure
via System type -> Cache configuration.

Re: User mode address error problems on 7763

[Dale Larson]

On Tue, Sep 15, 2009 at 8:07 AM, Paul Mundt <lethal@linux-sh.org> wrote:
> On Tue, Sep 15, 2009 at 07:55:14AM -0500, Dale Larson wrote:
>> > I assumed SH7763 was an SH-X2 based core, but it turns out it is a
>> > first-generation SH-4A, in which case it does not implement the extended
>> > mode TLB. So the next available page size above 4k is 64k. I wasn't aware
>> > there was anyone still running first generation SH-4A, I'll have to dust
>> > some of mine off to see if I can reproduce your issues.
>>
>> We're finally replacing our 7760 (yep, you heard right) based product
>> with the 7763.
>> While you're dusting your's off we'll just be putting polish on it. ;-)
>>
> That's actually good to know, it means we'll have to do more aggressive
> regression testing on first-generation SH-X parts (we tend to scale back
> regression testing efforts on older parts when there are no visible users
> of them on the current kernel). In any event, I'll give both the SH7780
> and SH7770 highlanders a go tomorrow and see how things go.. and if that
> doesn't work, I'm sure there's a 7763 lying around the office somwehere.
> ;-)
>
>> > page size. That will bring up a menu where you can cycle through the
>> > available page sizes. I don't recommend 1MB for a system page size, as it
>> > tends to interact badly with some of the slab allocators. 64k will give
>> > you an idea of whether there are indeed any aliasing bugs lurking about.
>>
>> I'll try that.
>>
>> Thanks!
>
> One other thing I forgot to mention is that you might also want to try a
> 4k page size with write-through caching enabled. This you can configure
> via System type -> Cache configuration.

At one point I did give that a try but the system refused to run. I didn't take
any time to investigate why that happened.

I'll try it again with this newer code.

Thanks!

Re: User mode address error problems on 7763

[Dale Larson]

> Can you reliably reproduce this? A little tip when doing development is
> to turn on Verbose BUG() reporting, which is located in the Kernel
> Hacking menu. That'll give you a line and number in the source file.

Here's a dump with BUG() on. I just booted the system and let it sit.
After a while the following crash occurs:

[ 2484.956000] ------------[ cut here ]------------
[ 2484.956000] kernel BUG at mm/slab.c:2974!
[ 2484.956000] Kernel BUG: 003e [#1]
[ 2484.956000]
[ 2484.956000] Pid : 0, Comm:           swapper
[ 2484.956000] CPU : 0                  Not tainted  (2.6.31-rc9 #6)
[ 2484.956000]
[ 2484.956000] PC is at cache_alloc_refill+0xc2/0x39c
[ 2484.956000] PR is at kmem_cache_alloc+0x52/0xb0
[ 2484.956000] PC  : 8804492e SP  : 881afdb0 SR  : 400080f1 TEA : 8f8a605a
[ 2484.956000] R0  : 00000006 R1  : 0000000f R2  : 0000000f R3  : 8f9501a0
[ 2484.956000] R4  : 00000008 R5  : 8f847d60 R6  : 8f950040 R7  : 00000010
[ 2484.956000] R8  : 8f847d68 R9  : 8f84a800 R10 : 8f847d70 R11 : 8f8105c0
[ 2484.956000] R12 : 00000007 R13 : 00000001 R14 : 881afdb0
[ 2484.956000] MACH: 00000242 MACL: 00000100 GBR : 00000000 PR  : 88044d2a
[ 2484.956000]
[ 2484.956000] Call trace:
[ 2484.956000]  [<88044d2a>] kmem_cache_alloc+0x52/0xb0
[ 2484.956000]  [<88103f2e>] dst_alloc+0x2a/0x78
[ 2484.956000]  [<881126f6>] ip_route_input+0x952/0xb70
[ 2484.956000]  [<88113896>] ip_rcv+0x1e2/0x414
[ 2484.956000]  [<880ff75a>] netif_receive_skb+0x216/0x23c
[ 2484.956000]  [<880ff7de>] process_backlog+0x5e/0xb4
[ 2484.956000]  [<880ffd40>] net_rx_action+0x40/0x118
[ 2484.956000]  [<88016dd6>] __do_softirq+0x62/0xf8
[ 2484.956000]  [<88016e9a>] do_softirq+0x2e/0x60
[ 2484.956000]  [<88153c60>] printk+0x0/0x30
[ 2484.956000]  [<880bcb00>] strlen+0x0/0x58
[ 2484.956000]  [<88016fe2>] irq_exit+0x2a/0x44
[ 2484.956000]  [<88003718>] do_IRQ+0x38/0x60
[ 2484.956000]  [<880070fc>] ret_from_exception+0x0/0xc
[ 2484.956000]  [<88153e8c>] schedule+0x0/0x358
[ 2484.956000]  [<880036e0>] do_IRQ+0x0/0x60
[ 2484.956000]  [<880031b8>] default_idle+0x0/0x78
[ 2484.956000]  [<88045698>] quicklist_trim+0x0/0xe0
[ 2484.956000]  [<88153e8c>] schedule+0x0/0x358
[ 2484.956000]  [<880bcb00>] strlen+0x0/0x58
[ 2484.956000]  [<88153c60>] printk+0x0/0x30
[ 2484.956000]  [<880031e4>] default_idle+0x2c/0x78
[ 2484.956000]  [<88003276>] cpu_idle+0x32/0x6c
[ 2484.956000]  [<88152f0c>] rest_init+0x44/0x7c
[ 2484.956000]  [<88003da0>] kernel_thread+0x0/0x70
[ 2484.956000]  [<881c88e2>] start_kernel+0x3c2/0x3fc
[ 2484.956000]  [<8800202c>] _stext+0x2c/0x38
[ 2484.956000]
[ 2484.956000] Code:
[ 2484.956000]   88044928:  mov.l     @(28,r11), r1
[ 2484.956000]   8804492a:  cmp/hs    r1, r2
[ 2484.956000]   8804492c:  bf        8804495a
[ 2484.956000] ->8804492e:  trapa     #62
[ 2484.956000]   88044930:  bra       8804495c
[ 2484.956000]   88044932:  mov       r12, r4
[ 2484.956000]   88044934:  mov.l     @(16,r11), r3
[ 2484.956000]   88044936:  mov.l     @(20,r6), r1
[ 2484.956000]   88044938:  mov.l     @r9, r2
[ 2484.956000]
[ 2484.956000] Process: swapper (pid: 0, stack limit = 881ae001)
[ 2484.956000] Stack: (0x881afdb0 to 0x881b0000)
[ 2484.956000] fda0:                                     00000020
00000020 00000000 88044d2a
[ 2484.956000] fdc0: 881afddc 8f84e000 a10bde9f 8f8105c0 00008020
ffffff97 00000000 88103f2e
[ 2484.956000] fde0: 881afdf4 00000001 00000001 ffffff97 881c4194
881126f6 881afe00 0000009f
[ 2484.956000] fe00: 00000000 00000000 ff0bde9f 8f836300 8f84f7a0
14000000 00000000 00000002
[ 2484.956000] fe20: 00000000 ff0bde9f a10bde9f 00000000 00000000
00000000 00000000 00000000
[ 2484.956000] fe40: 00000000 00000000 00000000 00000000 00000000
fd030020 8f89c2c0 8f83639c
[ 2484.956000] fe60: 8f84e000 8f84f7a0 d40ade9f 00000000 88113896
881afe94 00000008 00000000
[ 2484.956000] fe80: 8f84e000 8f83639c 8f8a604e 8f836300 8f84e000
8f8a3d20 880ff75a 881afeac
[ 2484.956000] fea0: 8f83639c 8f836300 881b0300 881b0320 880ff7de
881afed0 881c39b0 00000040
[ 2484.956000] fec0: 000855bf 881c39cc 881c39b4 00000001 880ffd40
881afef0 881c39b0 000855c1
[ 2484.956000] fee0: 0000012c 00000000 00000040 881c39cc 88016dd6
881aff10 0000000a 0000000c
[ 2484.956000] ff00: 00000001 881fed18 00000100 00000003 88016e9a
881aff30 88153c60 880bcb00
[ 2484.956000] ff20: 881dd290 00000000 881c1e94 000000f0 88016fe2
881aff3c 0000003a 88003718
[ 2484.956000] ff40: 881aff44 880070fc 881affb4 88153e8c 880036e0
400080f1 00000000 881ae000
[ 2484.956000] ff60: ffffff0f 50008001 00000001 00000000 00000019
00000010 880031b8 88045698
[ 2484.956000] ff80: 88153e8c 881dd290 880bcb00 88153c60 881affb4
881affb4 880031e4 88003276
[ 2484.956000] ffa0: 50008001 00000000 00000242 8b875800 ffffffff
881affb8 88152f0c 881affd0
[ 2484.956000] ffc0: 881d8b45 881d8860 881b15f8 88003da0 881c88e2
881affdc 8820080c 881d8ac0
[ 2484.956000] ffe0: 8800202c 00000000 00000062 00000fa0 ffe7ffff
00000000 000026a2 000026a2
[ 2484.960000] Kernel panic - not syncing: Fatal exception in interrupt
[ 2484.964000] Stack: (0x881afcd4 to 0x881b0000)
[ 2484.968000] fcc0:
88153b4e 881afce4 881afd54
[ 2484.984000] fce0: 8818c2b4 88153ba4 881afcec 881afd10 88006312
881afd1c 00000001 00000007
[ 2485.000000] fd00: 0000003e 8818c164 881afd54 88153c60 00000002
881afcf8 ffffffff 88005e82
[ 2485.020000] fd20: 881afd34 8f8105c0 881afdac 881afd54 8804492e
88005eec 881afd44 881afd54
[ 2485.036000] fd40: 881afd94 880071c6 881afdb0 0000007f 88005e9c
00000006 0000000f 0000000f
[ 2485.052000] fd60: 8f9501a0 00000008 8f847d60 8f950040 00000010
8f847d68 8f84a800 8f847d70
[ 2485.068000] fd80: 8f8105c0 00000007 00000001 881afdb0 881afdb0
8804492e 88044d2a 400080f1
[ 2485.088000] fda0: 00000000 00000242 00000100 000000f8 00000020
00000020 00000000 88044d2a
[ 2485.104000] fdc0: 881afddc 8f84e000 a10bde9f 8f8105c0 00008020
ffffff97 00000000 88103f2e
[ 2485.120000] fde0: 881afdf4 00000001 00000001 ffffff97 881c4194
881126f6 881afe00 0000009f
[ 2485.136000] fe00: 00000000 00000000 ff0bde9f 8f836300 8f84f7a0
14000000 00000000 00000002
[ 2485.156000] fe20: 00000000 ff0bde9f a10bde9f 00000000 00000000
00000000 00000000 00000000
[ 2485.172000] fe40: 00000000 00000000 00000000 00000000 00000000
fd030020 8f89c2c0 8f83639c
[ 2485.188000] fe60: 8f84e000 8f84f7a0 d40ade9f 00000000 88113896
881afe94 00000008 00000000
[ 2485.204000] fe80: 8f84e000 8f83639c 8f8a604e 8f836300 8f84e000
8f8a3d20 880ff75a 881afeac
[ 2485.224000] fea0: 8f83639c 8f836300 881b0300 881b0320 880ff7de
881afed0 881c39b0 00000040
[ 2485.240000] fec0: 000855bf 881c39cc 881c39b4 00000001 880ffd40
881afef0 881c39b0 000855c1
[ 2485.256000] fee0: 0000012c 00000000 00000040 881c39cc 88016dd6
881aff10 0000000a 0000000c
[ 2485.276000] ff00: 00000001 881fed18 00000100 00000003 88016e9a
881aff30 88153c60 880bcb00
[ 2485.292000] ff20: 881dd290 00000000 881c1e94 000000f0 88016fe2
881aff3c 0000003a 88003718
[ 2485.308000] ff40: 881aff44 880070fc 881affb4 88153e8c 880036e0
400080f1 00000000 881ae000
[ 2485.324000] ff60: ffffff0f 50008001 00000001 00000000 00000019
00000010 880031b8 88045698
[ 2485.344000] ff80: 88153e8c 881dd290 880bcb00 88153c60 881affb4
881affb4 880031e4 88003276
[ 2485.360000] ffa0: 50008001 00000000 00000242 8b875800 ffffffff
881affb8 88152f0c 881affd0
[ 2485.376000] ffc0: 881d8b45 881d8860 881b15f8 88003da0 881c88e2
881affdc 8820080c 881d8ac0
[ 2485.392000] ffe0: 8800202c 00000000 00000062 00000fa0 ffe7ffff
00000000 000026a2 000026a2
[ 2485.412000]
[ 2485.412000] Call trace:
[ 2485.416000]  [<88153b4e>] dump_stack+0xe/0x1c
[ 2485.420000]  [<88153ba4>] panic+0x48/0x104
[ 2485.424000]  [<88006312>] die+0xda/0x140
[ 2485.428000]  [<88153c60>] printk+0x0/0x30
[ 2485.432000]  [<88005e82>] handle_BUG+0x5e/0x78
[ 2485.436000]  [<8804492e>] cache_alloc_refill+0xc2/0x39c
[ 2485.440000]  [<88005eec>] bug_trap_handler+0x50/0x84
[ 2485.444000]  [<880071c6>] debug_trap+0xe/0x18
[ 2485.448000]  [<88005e9c>] bug_trap_handler+0x0/0x84
[ 2485.452000]  [<8804492e>] cache_alloc_refill+0xc2/0x39c
[ 2485.456000]  [<88044d2a>] kmem_cache_alloc+0x52/0xb0
[ 2485.460000]  [<88044d2a>] kmem_cache_alloc+0x52/0xb0
[ 2485.464000]  [<88103f2e>] dst_alloc+0x2a/0x78
[ 2485.468000]  [<881126f6>] ip_route_input+0x952/0xb70
[ 2485.472000]  [<88113896>] ip_rcv+0x1e2/0x414
[ 2485.476000]  [<880ff75a>] netif_receive_skb+0x216/0x23c
[ 2485.480000]  [<880ff7de>] process_backlog+0x5e/0xb4
[ 2485.484000]  [<880ffd40>] net_rx_action+0x40/0x118
[ 2485.488000]  [<88016dd6>] __do_softirq+0x62/0xf8
[ 2485.492000]  [<88016e9a>] do_softirq+0x2e/0x60
[ 2485.496000]  [<88153c60>] printk+0x0/0x30
[ 2485.500000]  [<880bcb00>] strlen+0x0/0x58
[ 2485.504000]  [<88016fe2>] irq_exit+0x2a/0x44
[ 2485.508000]  [<88003718>] do_IRQ+0x38/0x60
[ 2485.512000]  [<880070fc>] ret_from_exception+0x0/0xc
[ 2485.516000]  [<88153e8c>] schedule+0x0/0x358
[ 2485.520000]  [<880036e0>] do_IRQ+0x0/0x60
[ 2485.524000]  [<880031b8>] default_idle+0x0/0x78
[ 2485.528000]  [<88045698>] quicklist_trim+0x0/0xe0
[ 2485.532000]  [<88153e8c>] schedule+0x0/0x358
[ 2485.536000]  [<880bcb00>] strlen+0x0/0x58
[ 2485.540000]  [<88153c60>] printk+0x0/0x30
[ 2485.544000]  [<880031e4>] default_idle+0x2c/0x78
[ 2485.548000]  [<88003276>] cpu_idle+0x32/0x6c
[ 2485.552000]  [<88152f0c>] rest_init+0x44/0x7c
[ 2485.556000]  [<88003da0>] kernel_thread+0x0/0x70
[ 2485.560000]  [<881c88e2>] start_kernel+0x3c2/0x3fc
[ 2485.564000]  [<8800202c>] _stext+0x2c/0x38
[ 2485.568000]

Re: User mode address error problems on 7763

[Dale Larson]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="windows-1254", Size: 6242 bytes --]

>> > page size. That will bring up a menu where you can cycle through the
>> > available page sizes. I don't recommend 1MB for a system page size, as it
>> > tends to interact badly with some of the slab allocators. 64k will give
>> > you an idea of whether there are indeed any aliasing bugs lurking about.

When I turned on 64K pages I got the following panic:

[    0.000000] Linux version 2.6.31-rc9 (dlarson@UbuntuDale) (gcc
version 4.3.4 (GCC) ) #7 Tue Sep 15 08:05:36 CDT 2009
[    0.000000] Boot params:
[    0.000000] ... MOUNT_ROOT_RDONLY - 00000001
[    0.000000] ... RAMDISK_FLAGS     - 00000000
[    0.000000] ... ORIG_ROOT_DEV     - 00000200
[    0.000000] ... LOADER_TYPE       - 00000001
[    0.000000] ... INITRD_START      - 00000000
[    0.000000] ... INITRD_SIZE       - 00000000
[    0.000000] Early serial console at MMIO 0x18000008 (options '115200n8')
[    0.000000] console [uart0] enabled
[    0.000000] Booting machvec: jci7763
[    0.000000] Node 0: start_pfn = 0x800, low = 0x1000
[    0.000000] Zone PFN ranges:
[    0.000000]   Normal   0x00000800 -> 0x00001000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[1] active PFN ranges
[    0.000000]     0: 0x00000800 -> 0x00001000
[    0.000000] Built 1 zonelists in Zone order, mobility grouping off.
 Total pages: 2047
[    0.000000] Kernel command line:
earlycon=uart,mmio,0x18000008,115200n8 console=ttyS0,115200n8
root=/dev/nfs rw rootfstype=nfs nfsroot\x159.222.11.56:/n40root ip=dhcp
[    0.000000] PID hash table entries: 512 (order: 9, 2048 bytes)
[    0.000000] Dentry cache hash table entries: 16384 (order: 0, 65536 bytes)
[    0.000000] Inode-cache hash table entries: 16384 (order: 0, 65536 bytes)
[    0.000000] PVR\x10200a00 CVRs440010 PRR\0000a10
[    0.000000] I-cache : n_ways=4 n_sets%6 way_incr92
[    0.000000] I-cache : entry_mask=0x00001fe0 alias_mask=0x00000000 n_aliases=0
[    0.000000] D-cache : n_ways=4 n_sets%6 way_incr92
[    0.000000] D-cache : entry_mask=0x00001fe0 alias_mask=0x00000000 n_aliases=0
[    0.000000] Memory: 128064k/131072k available (1424k kernel code,
623k data, 192k init)
[    0.000000] NR_IRQS:256
[    0.000000] sh_tmu: TMU0 used for clock events
[    0.000000] sh_tmu: TMU0 used for periodic clock events
[    0.000000] sh_tmu: TMU1 used as clock source
[    0.004000] Calibrating delay loop (skipped)... 266.66 BogoMIPS
PRESET (lpjS3333)
[    0.008000] Mount-cache hash table entries: 8192
[    0.016000] CPU: SH7763
[    0.032000] NET: Registered protocol family 16
[    0.072000] bio: create slab <bio-0> at 0
[    0.080000] SCSI subsystem initialized
[    0.100000] NET: Registered protocol family 2
[    0.104000] IP route cache hash table entries: 16384 (order: 0, 65536 bytes)
[    0.108000] TCP established hash table entries: 8192 (order: 0, 65536 bytes)
[    0.112000] TCP bind hash table entries: 8192 (order: -1, 32768 bytes)
[    0.116000] TCP: Hash tables configured (established 8192 bind 8192)
[    0.120000] TCP reno registered
[    0.124000] NET: Registered protocol family 1
[    0.140000] msgmni has been set to 248
[    0.144000] io scheduler noop registered
[    0.148000] io scheduler anticipatory registered (default)
[    0.156000] io scheduler deadline registered
[    0.160000] io scheduler cfq registered
[    0.200000] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
[    0.204000] serial8250.0: ttyS0 at MMIO 0x18000008 (irq = 4) is a 16550A
[    0.208000] console handover: boot [uart0] -> real [ttyS0]
[    0.232000] loop: module loaded
[    0.276000] sh_mii: probed
[    0.280000] Base address at 0xfee00800, 00:10:8D:01:C1:9A, IRQ 57.
[    0.292000] sh_tmu: TMU0 kept as earlytimer
[    0.296000] sh_tmu: TMU1 kept as earlytimer
[    0.300000] TCP cubic registered
[    0.304000] NET: Registered protocol family 17
[    0.308000] RPC: Registered udp transport module.
[    0.312000] RPC: Registered tcp transport module.
[    0.832000] net eth0: attached phy 1 to driver Generic PHY
[    1.844000] Sending DHCP requests ..
[    4.832000] PHY: 0:01 - Link is Up - 100/Full
[    9.668000] .., OK
[   18.396000] IP-Config: Got DHCP answer from 0.0.0.0, my address is
159.222.10.212
[   18.408000] IP-Config: Complete:
[   18.412000]      device=eth0, addr\x159.222.10.212,
mask%5.255.252.0, gw\x159.222.8.2,
[   18.424000]      host\x159.222.10.212, domain=cg.na.jci.com,
nis-domain=(none),
[   18.428000]      bootserver=0.0.0.0, rootserver\x159.222.11.56, rootpath[   18.440000] Looking up port of RPC 100003/2 on 159.222.11.56
[   18.448000] Looking up port of RPC 100005/1 on 159.222.11.56
[   18.588000] VFS: Mounted root (nfs filesystem) on device 0:9.
[   18.596000] Freeing unused kernel memory: 192k freed
/sbin/init:572: can't map '/lib/libm.so.0'
/sbin/init:572: can't map '/lib/libm.so.0'
/sbin/init: can't load library 'libm.so.0'
[   18.828000] Kernel panic - not syncing: Attempted to kill init!
[   18.832000] Stack: (0x8c12ff1c to 0x8c130000)
[   18.836000] ff00:
             8817176a
[   18.852000] ff20: 8c12ff2c 8c113400 881b5570 881717c0 8c12ff34
8c12ff58 88033390 8c12ff64
[   18.868000] ff40: 29563718 29574008 8c113400 00001000 8c113400
000000bc 8c1133f8 fffffefd
[   18.888000] ff60: 8c12ff3c 8804319a 00000001 7be6fb84 29574008
8c12ff74 8c12ff74 880338d0
[   18.904000] ff80: 8c12ff9c 29563718 29574008 00000000 00000071
00000100 880338c0 88025226
[   18.920000] ffa0: 7be6fbb4 00000001 ffffff82 2959001a 00000001
00000010 00010000 00000002
[   18.936000] ffc0: 29590019 00000000 00402109 29580028 0048149c
29574008 29563718 7be6fbb4
[   18.956000] ffe0: 7be6fbb4 29562c66 29562c5e 00008100 00000000
00000004 00000001 00000044
[   18.972000]
[   18.972000] Call trace:
[   18.976000]  [<8817176a>] dump_stack+0xe/0x1c
[   18.980000]  [<881717c0>] panic+0x48/0x104
[   18.984000]  [<88033390>] do_exit+0x40/0x4bc
[   18.988000]  [<8804319a>] up_write+0xa/0x18
[   18.992000]  [<880338d0>] sys_exit+0x10/0x18
[   18.996000]  [<880338c0>] sys_exit+0x0/0x18
[   19.000000]  [<88025226>] syscall_call+0xc/0x10
[   19.004000]

Dale Larson
--
To unsubscribe from this list: send the line "unsubscribe linux-sh" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: User mode address error problems on 7763

[Paul Mundt]

On Tue, Sep 15, 2009 at 08:29:21AM -0500, Dale Larson wrote:
> >> > page size. That will bring up a menu where you can cycle through the
> >> > available page sizes. I don't recommend 1MB for a system page size, as it
> >> > tends to interact badly with some of the slab allocators. 64k will give
> >> > you an idea of whether there are indeed any aliasing bugs lurking about.
> 
> When I turned on 64K pages I got the following panic:
> 
> [   18.596000] Freeing unused kernel memory: 192k freed
> /sbin/init:572: can't map '/lib/libm.so.0'
> /sbin/init:572: can't map '/lib/libm.so.0'
> /sbin/init: can't load library 'libm.so.0'
> [   18.828000] Kernel panic - not syncing: Attempted to kill init!
> [   18.832000] Stack: (0x8c12ff1c to 0x8c130000)
> [   18.836000] ff00:
>              8817176a
> [   18.852000] ff20: 8c12ff2c 8c113400 881b5570 881717c0 8c12ff34
> 8c12ff58 88033390 8c12ff64
> [   18.868000] ff40: 29563718 29574008 8c113400 00001000 8c113400
> 000000bc 8c1133f8 fffffefd
> [   18.888000] ff60: 8c12ff3c 8804319a 00000001 7be6fb84 29574008
> 8c12ff74 8c12ff74 880338d0
> [   18.904000] ff80: 8c12ff9c 29563718 29574008 00000000 00000071
> 00000100 880338c0 88025226
> [   18.920000] ffa0: 7be6fbb4 00000001 ffffff82 2959001a 00000001
> 00000010 00010000 00000002
> [   18.936000] ffc0: 29590019 00000000 00402109 29580028 0048149c
> 29574008 29563718 7be6fbb4
> [   18.956000] ffe0: 7be6fbb4 29562c66 29562c5e 00008100 00000000
> 00000004 00000001 00000044
> [   18.972000]
> [   18.972000] Call trace:
> [   18.976000]  [<8817176a>] dump_stack+0xe/0x1c
> [   18.980000]  [<881717c0>] panic+0x48/0x104
> [   18.984000]  [<88033390>] do_exit+0x40/0x4bc
> [   18.988000]  [<8804319a>] up_write+0xa/0x18
> [   18.992000]  [<880338d0>] sys_exit+0x10/0x18
> [   18.996000]  [<880338c0>] sys_exit+0x0/0x18
> [   19.000000]  [<88025226>] syscall_call+0xc/0x10
> [   19.004000]
> 
Great, your libc doesn't handle variable page sizes. You're either going
to have to update and rebuild your libc, or go back to the write-through
caching on 4k pages thing. The latter should be fine in the current tree,
as I've tested it on a number of boards. If you run in to issues with
that, please post a full boot log for that also.

Re: User mode address error problems on 7763

[Valentin R Sitsikov]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="windows-1254", Size: 6983 bytes --]

Hello Dale!
Hello Paul!

Due to cache alias problem we used 8k page size on Sh7785.
But it also required corresponding uclibc/glibc.
At least right now I am using uclibc with page size = 8k as it is 
configured in kernel.

May be it helps.

Best regards,
Valentin

Dale Larson wrote:
>>>> page size. That will bring up a menu where you can cycle through the
>>>> available page sizes. I don't recommend 1MB for a system page size, as it
>>>> tends to interact badly with some of the slab allocators. 64k will give
>>>> you an idea of whether there are indeed any aliasing bugs lurking about.
>>>>         
>
> When I turned on 64K pages I got the following panic:
>
> [    0.000000] Linux version 2.6.31-rc9 (dlarson@UbuntuDale) (gcc
> version 4.3.4 (GCC) ) #7 Tue Sep 15 08:05:36 CDT 2009
> [    0.000000] Boot params:
> [    0.000000] ... MOUNT_ROOT_RDONLY - 00000001
> [    0.000000] ... RAMDISK_FLAGS     - 00000000
> [    0.000000] ... ORIG_ROOT_DEV     - 00000200
> [    0.000000] ... LOADER_TYPE       - 00000001
> [    0.000000] ... INITRD_START      - 00000000
> [    0.000000] ... INITRD_SIZE       - 00000000
> [    0.000000] Early serial console at MMIO 0x18000008 (options '115200n8')
> [    0.000000] console [uart0] enabled
> [    0.000000] Booting machvec: jci7763
> [    0.000000] Node 0: start_pfn = 0x800, low = 0x1000
> [    0.000000] Zone PFN ranges:
> [    0.000000]   Normal   0x00000800 -> 0x00001000
> [    0.000000] Movable zone start PFN for each node
> [    0.000000] early_node_map[1] active PFN ranges
> [    0.000000]     0: 0x00000800 -> 0x00001000
> [    0.000000] Built 1 zonelists in Zone order, mobility grouping off.
>  Total pages: 2047
> [    0.000000] Kernel command line:
> earlycon=uart,mmio,0x18000008,115200n8 console=ttyS0,115200n8
> root=/dev/nfs rw rootfstype=nfs nfsroot\x159.222.11.56:/n40root ip=dhcp
> [    0.000000] PID hash table entries: 512 (order: 9, 2048 bytes)
> [    0.000000] Dentry cache hash table entries: 16384 (order: 0, 65536 bytes)
> [    0.000000] Inode-cache hash table entries: 16384 (order: 0, 65536 bytes)
> [    0.000000] PVR\x10200a00 CVRs440010 PRR\0000a10
> [    0.000000] I-cache : n_ways=4 n_sets%6 way_incr92
> [    0.000000] I-cache : entry_mask=0x00001fe0 alias_mask=0x00000000 n_aliases=0
> [    0.000000] D-cache : n_ways=4 n_sets%6 way_incr92
> [    0.000000] D-cache : entry_mask=0x00001fe0 alias_mask=0x00000000 n_aliases=0
> [    0.000000] Memory: 128064k/131072k available (1424k kernel code,
> 623k data, 192k init)
> [    0.000000] NR_IRQS:256
> [    0.000000] sh_tmu: TMU0 used for clock events
> [    0.000000] sh_tmu: TMU0 used for periodic clock events
> [    0.000000] sh_tmu: TMU1 used as clock source
> [    0.004000] Calibrating delay loop (skipped)... 266.66 BogoMIPS
> PRESET (lpjS3333)
> [    0.008000] Mount-cache hash table entries: 8192
> [    0.016000] CPU: SH7763
> [    0.032000] NET: Registered protocol family 16
> [    0.072000] bio: create slab <bio-0> at 0
> [    0.080000] SCSI subsystem initialized
> [    0.100000] NET: Registered protocol family 2
> [    0.104000] IP route cache hash table entries: 16384 (order: 0, 65536 bytes)
> [    0.108000] TCP established hash table entries: 8192 (order: 0, 65536 bytes)
> [    0.112000] TCP bind hash table entries: 8192 (order: -1, 32768 bytes)
> [    0.116000] TCP: Hash tables configured (established 8192 bind 8192)
> [    0.120000] TCP reno registered
> [    0.124000] NET: Registered protocol family 1
> [    0.140000] msgmni has been set to 248
> [    0.144000] io scheduler noop registered
> [    0.148000] io scheduler anticipatory registered (default)
> [    0.156000] io scheduler deadline registered
> [    0.160000] io scheduler cfq registered
> [    0.200000] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
> [    0.204000] serial8250.0: ttyS0 at MMIO 0x18000008 (irq = 4) is a 16550A
> [    0.208000] console handover: boot [uart0] -> real [ttyS0]
> [    0.232000] loop: module loaded
> [    0.276000] sh_mii: probed
> [    0.280000] Base address at 0xfee00800, 00:10:8D:01:C1:9A, IRQ 57.
> [    0.292000] sh_tmu: TMU0 kept as earlytimer
> [    0.296000] sh_tmu: TMU1 kept as earlytimer
> [    0.300000] TCP cubic registered
> [    0.304000] NET: Registered protocol family 17
> [    0.308000] RPC: Registered udp transport module.
> [    0.312000] RPC: Registered tcp transport module.
> [    0.832000] net eth0: attached phy 1 to driver Generic PHY
> [    1.844000] Sending DHCP requests ..
> [    4.832000] PHY: 0:01 - Link is Up - 100/Full
> [    9.668000] .., OK
> [   18.396000] IP-Config: Got DHCP answer from 0.0.0.0, my address is
> 159.222.10.212
> [   18.408000] IP-Config: Complete:
> [   18.412000]      device=eth0, addr\x159.222.10.212,
> mask%5.255.252.0, gw\x159.222.8.2,
> [   18.424000]      host\x159.222.10.212, domain=cg.na.jci.com,
> nis-domain=(none),
> [   18.428000]      bootserver=0.0.0.0, rootserver\x159.222.11.56, rootpath> [   18.440000] Looking up port of RPC 100003/2 on 159.222.11.56
> [   18.448000] Looking up port of RPC 100005/1 on 159.222.11.56
> [   18.588000] VFS: Mounted root (nfs filesystem) on device 0:9.
> [   18.596000] Freeing unused kernel memory: 192k freed
> /sbin/init:572: can't map '/lib/libm.so.0'
> /sbin/init:572: can't map '/lib/libm.so.0'
> /sbin/init: can't load library 'libm.so.0'
> [   18.828000] Kernel panic - not syncing: Attempted to kill init!
> [   18.832000] Stack: (0x8c12ff1c to 0x8c130000)
> [   18.836000] ff00:
>              8817176a
> [   18.852000] ff20: 8c12ff2c 8c113400 881b5570 881717c0 8c12ff34
> 8c12ff58 88033390 8c12ff64
> [   18.868000] ff40: 29563718 29574008 8c113400 00001000 8c113400
> 000000bc 8c1133f8 fffffefd
> [   18.888000] ff60: 8c12ff3c 8804319a 00000001 7be6fb84 29574008
> 8c12ff74 8c12ff74 880338d0
> [   18.904000] ff80: 8c12ff9c 29563718 29574008 00000000 00000071
> 00000100 880338c0 88025226
> [   18.920000] ffa0: 7be6fbb4 00000001 ffffff82 2959001a 00000001
> 00000010 00010000 00000002
> [   18.936000] ffc0: 29590019 00000000 00402109 29580028 0048149c
> 29574008 29563718 7be6fbb4
> [   18.956000] ffe0: 7be6fbb4 29562c66 29562c5e 00008100 00000000
> 00000004 00000001 00000044
> [   18.972000]
> [   18.972000] Call trace:
> [   18.976000]  [<8817176a>] dump_stack+0xe/0x1c
> [   18.980000]  [<881717c0>] panic+0x48/0x104
> [   18.984000]  [<88033390>] do_exit+0x40/0x4bc
> [   18.988000]  [<8804319a>] up_write+0xa/0x18
> [   18.992000]  [<880338d0>] sys_exit+0x10/0x18
> [   18.996000]  [<880338c0>] sys_exit+0x0/0x18
> [   19.000000]  [<88025226>] syscall_call+0xc/0x10
> [   19.004000]
>
> Dale Larson
> --
> To unsubscribe from this list: send the line "unsubscribe linux-sh" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>   

--
To unsubscribe from this list: send the line "unsubscribe linux-sh" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: User mode address error problems on 7763

[Dale Larson]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="windows-1254", Size: 74569 bytes --]

> Great, your libc doesn't handle variable page sizes. You're either going
> to have to update and rebuild your libc, or go back to the write-through
> caching on 4k pages thing. The latter should be fine in the current tree,
> as I've tested it on a number of boards. If you run in to issues with
> that, please post a full boot log for that also.

I changed to write-through cache and it runs much better. I ran two
ssh session with "du /" and "find /" looping on those sessions and
"top" running on the console. Eventially the 'top' session crashed and
the ssh sessions stopped generating output. Here's the dump (craddle
to grave) with many 'top''s removed:

Mongoose startup...

Enter 'bnm' to start factory diagnostics.
Otherwise, EBOOT will be started.

You have 4 seconds to choose...
[    0.000000] Linux version 2.6.31-rc9 (dlarson@UbuntuDale) (gcc
version 4.3.4 (GCC) ) #9 Tue Sep 15 09:20:34 CDT 2009
[    0.000000] Boot params:
[    0.000000] ... MOUNT_ROOT_RDONLY - 00000001
[    0.000000] ... RAMDISK_FLAGS     - 00000000
[    0.000000] ... ORIG_ROOT_DEV     - 00000200
[    0.000000] ... LOADER_TYPE       - 00000001
[    0.000000] ... INITRD_START      - 00000000
[    0.000000] ... INITRD_SIZE       - 00000000
[    0.000000] Early serial console at MMIO 0x18000008 (options '115200n8')
[    0.000000] console [uart0] enabled
[    0.000000] Booting machvec: jci7763
[    0.000000] Node 0: start_pfn = 0x8000, low = 0x10000
[    0.000000] Zone PFN ranges:
[    0.000000]   Normal   0x00008000 -> 0x00010000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[1] active PFN ranges
[    0.000000]     0: 0x00008000 -> 0x00010000
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.
Total pages: 32512
[    0.000000] Kernel command line:
earlycon=uart,mmio,0x18000008,115200n8 console=ttyS0,115200n8
root=/dev/nfs rw rootfstype=nfs nfsroot\x159.222.11.56:/n40root ip=dhcp
[    0.000000] PID hash table entries: 512 (order: 9, 2048 bytes)
[    0.000000] Dentry cache hash table entries: 16384 (order: 4, 65536 bytes)
[    0.000000] Inode-cache hash table entries: 8192 (order: 3, 32768 bytes)
[    0.000000] PVR\x10200a00 CVRs440010 PRR\0000a10
[    0.000000] I-cache : n_ways=4 n_sets%6 way_incr92
[    0.000000] I-cache : entry_mask=0x00001fe0 alias_mask=0x00001000 n_aliases=2
[    0.000000] D-cache : n_ways=4 n_sets%6 way_incr92
[    0.000000] D-cache : entry_mask=0x00001fe0 alias_mask=0x00001000 n_aliases=2
[    0.000000] Memory: 127700k/131072k available (1365k kernel code,
454k data, 84k init)
[    0.000000] NR_IRQS:256
[    0.000000] sh_tmu: TMU0 used for clock events
[    0.000000] sh_tmu: TMU0 used for periodic clock events
[    0.000000] sh_tmu: TMU1 used as clock source
[    0.004000] Calibrating delay loop (skipped)... 266.66 BogoMIPS
PRESET (lpjS3333)
[    0.008000] Mount-cache hash table entries: 512
[    0.012000] CPU: SH7763
[    0.028000] NET: Registered protocol family 16
[    0.076000] bio: create slab <bio-0> at 0
[    0.088000] SCSI subsystem initialized
[    0.112000] NET: Registered protocol family 2
[    0.120000] IP route cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.124000] TCP established hash table entries: 4096 (order: 3, 32768 bytes)
[    0.128000] TCP bind hash table entries: 4096 (order: 2, 16384 bytes)
[    0.132000] TCP: Hash tables configured (established 4096 bind 4096)
[    0.136000] TCP reno registered
[    0.140000] NET: Registered protocol family 1
[    0.152000] msgmni has been set to 249
[    0.160000] io scheduler noop registered
[    0.164000] io scheduler anticipatory registered (default)
[    0.168000] io scheduler deadline registered
[    0.172000] io scheduler cfq registered
[    0.216000] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
[    0.224000] serial8250.0: ttyS0 at MMIO 0x18000008 (irq = 4) is a 16550A
[    0.228000] console handover: boot [uart0] -> real [ttyS0]
[    0.256000] loop: module loaded
[    0.300000] sh_mii: probed
[    0.304000] Base address at 0xfee00800, 00:10:8D:01:C1:9A, IRQ 57.
[    0.316000] sh_tmu: TMU0 kept as earlytimer
[    0.320000] sh_tmu: TMU1 kept as earlytimer
[    0.328000] TCP cubic registered
[    0.332000] NET: Registered protocol family 17
[    0.336000] RPC: Registered udp transport module.
[    0.340000] RPC: Registered tcp transport module.
[    0.856000] net eth0: attached phy 1 to driver Generic PHY
[    1.864000] Sending DHCP requests ..
[    5.856000] PHY: 0:01 - Link is Up - 100/Full
[    8.236000] .., OK
[   15.352000] IP-Config: Got DHCP answer from 0.0.0.0, my address is
159.222.8.245
[   15.364000] IP-Config: Complete:
[   15.368000]      device=eth0, addr\x159.222.8.245,
mask%5.255.252.0, gw\x159.222.8.2,
[   15.384000]      host\x159.222.8.245, domain=cg.na.jci.com, nis-domain=(none),
[   15.388000]      bootserver=0.0.0.0, rootserver\x159.222.11.56, rootpath[   15.400000] Looking up port of RPC 100003/2 on 159.222.11.56
[   15.408000] Looking up port of RPC 100005/1 on 159.222.11.56
[   15.448000] VFS: Mounted root (nfs filesystem) on device 0:9.
[   15.452000] Freeing unused kernel memory: 84k freed
init started: BusyBox v1.14.3 (2009-09-04 15:19:48 CDT)
Populating /dev using udev: done
Initializing random number generator... done.
Starting network...
ip: RTNETLINK answers: File exists
Starting dropbear sshd: generating rsa key... generating dsa key... OK

Welcome to MongooseLinux
MongooseLinux login: root

BusyBox v1.14.3 (2009-09-04 15:19:48 CDT) built-in shell (ash)
Enter 'help' for a list of built-in commands.

# passwd
Changing password for root
New password:
Retype password:
Password for root changed by root
# stty cols 120 rows 55
# top
Mem: 5996K used, 121936K free, 0K shrd, 0K buff, 1772K cached
CPU:  66% usr  33% sys   0% nic   0% idle   0% io   0% irq   0% sirq
Load average: 0.87 0.27 0.08 3/24 249
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  247   213 root     R     1116   1%   0  44% du /
  248   208 root     R     1112   1%   0  38% find /
  249   199 root     R     1052   1%   0  19% top
    1     0 root     S     1060   1%   0   0% init
  213   212 root     S     1060   1%   0   0% -sh
  199     1 root     S     1060   1%   0   0% -sh
  208   207 root     S     1060   1%   0   0% -sh
  201     1 root     S     1044   1%   0   0% /sbin/klogd -n
  200     1 root     S     1044   1%   0   0% /sbin/syslogd -n -m 0
  207   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root     SW<      0   0%   0   0% [kswapd0]
   84     2 root     SW<      0   0%   0   0% [nfsiod]

========================================[    0.172000] io scheduler cfqMem: 6080K used, 121852K free, 0K shrd,
0K buff, 1772K cached
CPU:  49% usr  47% sys   0% nic   0% idle   0% io   0% irq   1% sirq
Load average: 2.03 1.97 1.35 3/24 551
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  549   208 root     R     1112   1%   0  49% find /
  249   199 root     R     1052   1%   0   1% top
  213   212 root     S     1060   1%   0   0% -sh
  207   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  551   213 root     R     1116   1%   0   0% du /
  208   207 root     S     1060   1%   0   0% -sh
    1     0 root     S     1060   1%   0   0% init
  199     1 root     S     1060   1%   0   0% -sh
  201     1 root     S     1044   1%   0   0% /sbin/klogd -n
  200     1 root     S     1044   1%   0   0% /sbin/syslogd -n -m 0
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root     SW<      0   0%   0   0% [kswapd0]
   84     2 root     SW<      0   0%   0   0% [nfsiod]
Mem: 6080K used, 121852K free, 0K shrd, 0K buff, 1772K cached
CPU:  49% usr  45% sys   0% nic   0% idle   0% io   0% irq   4% sirq
Load average: 2.03 1.97 1.36 3/24 553
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  249   199 root     R     1052   1%   0   1% top
  207   197 root     S     1028   1%   0   1% /usr/sbin/dropbear
  213   212 root     S     1060   1%   0   0% -sh
  208   207 root     S     1060   1%   0   0% -sh
  553   213 root     R     1116   1%   0   0% du /
  552   208 root     R     1112   1%   0   0% find /
    1     0 root     S     1060   1%   0   0% init
  199     1 root     S     1060   1%   0   0% -sh
  201     1 root     S     1044   1%   0   0% /sbin/klogd -n
  200     1 root     S     1044   1%   0   0% /sbin/syslogd -n -m 0
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root     SW<      0   0%   0   0% [kswapd0]
[ 1480.416000] ------------[ cut here ]------------od]
[ 1480.416000] kernel BUG at mm/slab.c:2974!
[ 1480.416000] Kernel BUG: 003e [#1]
[ 1480.416000]
[ 1480.416000] Pid : 553, Comm:                 du
[ 1480.416000] CPU : 0                  Not tainted  (2.6.31-rc9 #9)
[ 1480.416000]
[ 1480.416000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1480.416000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1480.416000] PC  : 8804492a SP  : 8f9b9e70 SR  : 400080f1 TEA : 0045d110
[ 1480.416000] R0  : 0000000d R1  : 0000001e R2  : 0000001e R3  : 8f5ae6b4
[ 1480.416000] R4  : 00000027 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 0000001f
[ 1480.416000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1480.416000] R12 : 00000026 R13 : 00000001 R14 : 8f9b9e70
[ 1480.416000] MACH: 00000147 MACL: 00000600 GBR : 00000000 PR  : 88044d26
[ 1480.416000]
[ 1480.416000] Call trace:
[ 1480.416000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1480.416000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1480.416000]  [<8806fe5e>] proc_fill_cache+0x6a/0x110
[ 1480.416000]  [<88052218>] filldir+0x0/0xdc
[ 1480.416000]  [<88071114>] proc_readfd_common+0x10c/0x1a4
[ 1480.416000]  [<88052218>] filldir+0x0/0xdc
[ 1480.416000]  [<880714c8>] proc_fd_instantiate+0x0/0x104
[ 1480.416000]  [<880714c8>] proc_fd_instantiate+0x0/0x104
[ 1480.416000]  [<8804a4fc>] sys_newfstat+0x20/0x38
[ 1480.416000]  [<880711d4>] proc_readfd+0xc/0x1c
[ 1480.416000]  [<88052218>] filldir+0x0/0xdc
[ 1480.416000]  [<880523e8>] vfs_readdir+0x50/0x98
[ 1480.416000]  [<8805250c>] sys_getdents+0x44/0xa4
[ 1480.416000]  [<88007226>] syscall_call+0xc/0x10
[ 1480.416000]  [<880524c8>] sys_getdents+0x0/0xa4
[ 1480.416000]
[ 1480.416000] Code:
[ 1480.416000]   88044924:  mov.l     @(28,r11), r1
[ 1480.416000]   88044926:  cmp/hs    r1, r2
[ 1480.416000]   88044928:  bf        88044956
[ 1480.416000] ->8804492a:  trapa     #62
[ 1480.416000]   8804492c:  bra       88044958
[ 1480.416000]   8804492e:  mov       r12, r4
[ 1480.416000]   88044930:  mov.l     @(16,r11), r3
[ 1480.416000]   88044932:  mov.l     @(20,r6), r1
[ 1480.416000]   88044934:  mov.l     @r9, r2
[ 1480.416000]
[ 1480.416000] Process: du (pid: 553, stack limit = 8f9b8001)
[ 1480.416000] Stack: (0x8f9b9e70 to 0x8f9ba000)
[ 1480.416000] 9e60:                                     000000d0
000000d0 00000000 88044d26
[ 1480.416000] 9e80: 8f9b9e9c 00000001 881b0190 8f800900 000000d0
8f9b9ed8 00000000 88054f82
[ 1480.416000] 9ea0: 8f9b9eb4 8f5ae3b4 8f9b9ed8 8f9b9ed8 00000000
8806fe5e 8f9b9ed0 8f9b9f1c
[ 1480.416000] 9ec0: 8f9a0c60 8f5ae3b4 8f9b9ed8 00000000 88052218
8f9b9f78 00002331 00000001
[ 1480.416000] 9ee0: 8f9b9f1c 88071114 8f9b9f14 8f9b9f78 88052218
8f9b9ef0 8f83f140 8f8148c0
[ 1480.416000] 9f00: 8f9a0c60 00000001 880714c8 8f83f140 8f9b9f2c
880714c8 8f8148c4 271f0033
[ 1480.416000] 9f20: 00000000 00000000 8804a4fc 00000003 880711d4
8f9b9f50 88052218 8f9b9f78
[ 1480.416000] 9f40: 8f58ca38 8f58c9c8 fffffffe 8f9a0c60 880523e8
8f9b9f58 8805250c 8f9b9f78
[ 1480.416000] 9f60: 00406088 7b8d6670 000003d8 8f9a0c60 00000100
fffffff7 7b8d66c0 7b8d66b0
[ 1480.416000] 9f80: 00000388 ffffffea 88007226 7b8d6a4c 295da3b8
00000000 00000071 00000100
[ 1480.416000] 9fa0: 880524c8 0000008d 000003dc 00000000 0000008d
00000007 7b8d6670 000003d8
[ 1480.416000] 9fc0: 00000001 00489a18 0048afe0 00000400 7b8d6670
295da3b8 00406088 7b8d6a4c
[ 1480.416000] 9fe0: 7b8d6670 29591a12 2959541e 00000000 00000000
00000147 ae147c00 0000004c
[ 1480.424000] ---[ end trace e0fcf399e5a41b79 ]---
Mem: 6088K used, 121844K free, 0K shrd, 0K buff, 1776K cached
CPU:  49% usr  49% sys   0% nic   0% idle   0% io   0% irq   1% sirq
Load average: 2.02 1.97 1.36 3/24 554
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  552   208 root     R     1112   1%   0  48% find /
  201     1 root     S     1044   1%   0   2% /sbin/klogd -n
  249   199 root     R     1052   1%   0   1% top
  200     1 root     S     1044   1%   0   1% /sbin/syslogd -n -m 0
  554   213 root     R     1116   1%   0   0% du /
  213   212 root     S     1060   1%   0   0% -sh
  208   207 root     S     1060   1%   0   0% -sh
    1     0 root     S     1060   1%   0   0% init
  199     1 root     S     1060   1%   0   0% -sh
  207   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root     SW<      0   0%   0   0% [kswapd0]
[ 1484.244000] ------------[ cut here ]------------od]
[ 1484.244000] kernel BUG at mm/slab.c:2974!
[ 1484.244000] Kernel BUG: 003e [#2]
[ 1484.244000]
[ 1484.244000] Pid : 554, Comm:                 du
[ 1484.244000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1484.244000]
[ 1484.244000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1484.244000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1484.244000] PC  : 8804492a SP  : 8f9bddb0 SR  : 400080f1 TEA : 00482fcc
[ 1484.244000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1484.244000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1484.244000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1484.244000] R12 : 0000003c R13 : 00000001 R14 : 8f9bddb0
[ 1484.244000] MACH: 31639a1f MACL: 0023ee05 GBR : 00000000 PR  : 88044d26
[ 1484.244000]
[ 1484.244000] Call trace:
[ 1484.244000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1484.244000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1484.244000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1484.244000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1484.244000]  [<8804da88>] path_put+0x24/0x38
[ 1484.244000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1484.244000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1484.244000]  [<880504f4>] user_path_at+0x40/0x84
[ 1484.244000]  [<88055c40>] iput+0x40/0x58
[ 1484.244000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1484.244000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1484.244000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1484.244000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1484.244000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1484.244000]  [<88007226>] syscall_call+0xc/0x10
[ 1484.244000]  [<88007226>] syscall_call+0xc/0x10
[ 1484.244000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1484.244000]
[ 1484.244000] Code:
[ 1484.244000]   88044924:  mov.l     @(28,r11), r1
[ 1484.244000]   88044926:  cmp/hs    r1, r2
[ 1484.244000]   88044928:  bf        88044956
[ 1484.244000] ->8804492a:  trapa     #62
[ 1484.244000]   8804492c:  bra       88044958
[ 1484.244000]   8804492e:  mov       r12, r4
[ 1484.244000]   88044930:  mov.l     @(16,r11), r3
[ 1484.244000]   88044932:  mov.l     @(20,r6), r1
[ 1484.244000]   88044934:  mov.l     @r9, r2
[ 1484.244000]
[ 1484.244000] Process: du (pid: 554, stack limit = 8f9bc001)
[ 1484.244000] Stack: (0x8f9bddb0 to 0x8f9be000)
[ 1484.244000] dda0:                                     000000d0
000000d0 00000000 88044d26
[ 1484.244000] ddc0: 8f9bdddc 8f9bde40 881b0190 8f800900 000000d0
8f5855d4 00000000 88054f82
[ 1484.244000] dde0: 8f9bddf4 8f5855d4 8f9bde40 8f5855d4 fffffff4
8804dc58 8f9bde10 8f9bdeac
[ 1484.244000] de00: 8f5bcad4 8f5bca64 8f5855d4 fffffff4 8f9bde54
8f80cb20 8804f4de 8f9bde38
[ 1484.244000] de20: 8f9b1011 8f9bde1c 8f5bca64 00000000 00000001
8f9bdeac 00000000 00000000
[ 1484.244000] de40: 0023ee05 00000003 8f9b100e 8f9bde50 8804da88
8f80cb20 8f5855d4 8804fae2
[ 1484.244000] de60: 8f9bde7c 8f9bdf24 ffffff9c 00000000 8f9b1000
8f9bdeac 00000000 8f80cc20
[ 1484.244000] de80: 8f401914 8804fc16 8f9bde98 8f9b1000 8f9bdeac
00000000 880504f4 8f9bdeac
[ 1484.244000] dea0: 00000071 8f9b1000 8f9b1000 8f80cb20 8f5855d4
8f9bdebc 8f5c5988 88055c40
[ 1484.244000] dec0: 8f80cc20 8f401914 00000000 00000001 00000000
7b82c9e0 00008124 00000001
[ 1484.244000] dee0: 00000000 00000000 00000003 f00000bf 00018124
00000000 00000000 00000000
[ 1484.244000] df00: 00000400 8804a13c 8f9bdf24 00406088 295da3b8
00000000 00000071 8f9bdf48
[ 1484.244000] df20: ffffffea 00000000 8804a228 8804a1c2 8f9bdf40
00000071 00000100 7b82c9e0
[ 1484.244000] df40: 8804a21c 8f9bdf48 f00000bf 00000000 00000003
8f9b8124 00000001 00000000
[ 1484.244000] df60: 00000000 00000000 00000000 00000000 386d494d
07e5c711 8f9bdf84 fffffff7
[ 1484.244000] df80: 88051d1c 00000000 88007226 7b82c8c8 295da3b8
88007226 7b82c9e0 00000100
[ 1484.244000] dfa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7b82c9e0 00489ae8
[ 1484.244000] dfc0: 00000078 00489bb0 7b82ca34 00000000 00481f98
295da3b8 00406088 7b82c9e0
[ 1484.244000] dfe0: 7b82c9e0 29592616 0043c92e 00000000 00000000
31639a1f f0000058 00000048
[ 1484.248000] ---[ end trace e0fcf399e5a41b7a ]---
[ 1486.592000] ------------[ cut here ]------------
[ 1486.592000] kernel BUG at mm/slab.c:2974!
[ 1486.592000] Kernel BUG: 003e [#3]
[ 1486.592000]
[ 1486.592000] Pid : 555, Comm:                 du
[ 1486.592000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1486.592000]
[ 1486.592000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1486.592000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1486.592000] PC  : 8804492a SP  : 8f9afdb0 SR  : 400080f1 TEA : 00483280
[ 1486.592000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1486.592000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1486.592000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1486.592000] R12 : 0000003c R13 : 00000001 R14 : 8f9afdb0
[ 1486.592000] MACH: 31639a1f MACL: 1310326a GBR : 00000000 PR  : 88044d26
[ 1486.592000]
[ 1486.592000] Call trace:
[ 1486.592000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1486.592000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1486.592000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1486.592000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1486.592000]  [<8801f53a>] delayed_work_timer_fn+0x16/0x24
[ 1486.592000]  [<8804da88>] path_put+0x24/0x38
[ 1486.592000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1486.592000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1486.592000]  [<880504f4>] user_path_at+0x40/0x84
[ 1486.592000]  [<88055c40>] iput+0x40/0x58
[ 1486.592000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1486.592000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1486.592000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1486.592000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1486.592000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1486.592000]  [<88007226>] syscall_call+0xc/0x10
[ 1486.592000]  [<88007226>] syscall_call+0xc/0x10
[ 1486.592000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1486.592000]
[ 1486.592000] Code:
[ 1486.592000]   88044924:  mov.l     @(28,r11), r1
[ 1486.592000]   88044926:  cmp/hs    r1, r2
[ 1486.592000]   88044928:  bf        88044956
[ 1486.592000] ->8804492a:  trapa     #62
[ 1486.592000]   8804492c:  bra       88044958
[ 1486.592000]   8804492e:  mov       r12, r4
[ 1486.592000]   88044930:  mov.l     @(16,r11), r3
[ 1486.592000]   88044932:  mov.l     @(20,r6), r1
[ 1486.592000]   88044934:  mov.l     @r9, r2
[ 1486.592000]
[ 1486.592000] Process: du (pid: 555, stack limit = 8f9ae001)
[ 1486.592000] Stack: (0x8f9afdb0 to 0x8f9b0000)
[ 1486.592000] fda0:                                     000000d0
000000d0 00000000 88044d26
[ 1486.592000] fdc0: 8f9afddc 8f9afe40 881b0190 8f800900 000000d0
8f5bb814 00000000 88054f82
[ 1486.592000] fde0: 8f9afdf4 8f5bb814 8f9afe40 8f5bb814 fffffff4
8804dc58 8f9afe10 8f9afeac
[ 1486.592000] fe00: 8f5879f8 8f587988 8f5bb814 fffffff4 8f9afe54
8f80cb20 8804f4de 8f9afe38
[ 1486.592000] fe20: 8f969013 8f9afe1c 8f587988 00000000 00000001
8f9afeac 00000000 8801f53a
[ 1486.592000] fe40: 1310326a 00000005 8f96900e 8f9afe50 8804da88
8f80cb20 8f5bb814 8804fae2
[ 1486.592000] fe60: 8f9afe7c 8f9aff24 ffffff9c 00000000 8f969000
8f9afeac 00000000 8f80cc20
[ 1486.592000] fe80: 8f401914 8804fc16 8f9afe98 8f969000 8f9afeac
00000000 880504f4 8f9afeac
[ 1486.592000] fea0: 00000071 8f969000 8f969000 8f80cb20 8f5bb814
8f9afebc 8f5b6be0 88055c40
[ 1486.592000] fec0: 8f80cc20 8f401914 00000000 00000001 00000000
7be8e9e0 00008124 00000001
[ 1486.592000] fee0: 00000000 00000000 00000003 f00000c1 00018124
00000000 00000000 00000000
[ 1486.592000] ff00: 00000400 8804a13c 8f9aff24 00406088 295da3b8
00000000 00000071 8f9aff48
[ 1486.592000] ff20: ffffffea 00000000 8804a228 8804a1c2 8f9aff40
00000071 00000100 7be8e9e0
[ 1486.592000] ff40: 8804a21c 8f9aff48 f00000c1 00000000 00000003
8f9a8124 00000001 00000000
[ 1486.592000] ff60: 00000000 00000000 00000000 00000000 386d4950
0d25fd8d 8f9aff84 fffffff7
[ 1486.592000] ff80: 88051d1c 00000000 88007226 7be8e8c8 295da3b8
88007226 7be8e9e0 00000100
[ 1486.592000] ffa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7be8e9e0 00489ae8
[ 1486.592000] ffc0: 00000078 00489bb0 7be8ea34 00000000 00481f98
295da3b8 00406088 7be8e9e0
[ 1486.592000] ffe0: 7be8e9e0 29592616 0043c92e 00000000 00000000
31639a1f f0000058 00000048
[ 1486.596000] ---[ end trace e0fcf399e5a41b7b ]---
Mem: 6004K used, 121928K free, 0K shrd, 0K buff, 1788K cached
CPU:  54% usr  43% sys   0% nic   0% idle   0% io   0% irq   1% sirq
Load average: 1.94 1.95 1.36 3/24 556
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  552   208 root     Z        0   0%   0  10% [find]
  201     1 root     R     1044   1%   0   3% /sbin/klogd -n
  249   199 root     R     1052   1%   0   1% top
  200     1 root     S     1044   1%   0   1% /sbin/syslogd -n -m 0
  207   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  213   212 root     S     1060   1%   0   0% -sh
  208   207 root     S     1060   1%   0   0% -sh
    1     0 root     S     1060   1%   0   0% init
  199     1 root     S     1060   1%   0   0% -sh
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
   84     2 root     SW<      0   0%   0   0% [nfsiod]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root     SW<      0   0%   0   0% [kswapd0]
[ 1489.000000] ------------[ cut here ]------------
[ 1489.000000] kernel BUG at mm/slab.c:2974!
[ 1489.000000] Kernel BUG: 003e [#4]
[ 1489.000000]
[ 1489.000000] Pid : 556, Comm:                 du
[ 1489.000000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1489.000000]
[ 1489.000000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1489.000000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1489.000000] PC  : 8804492a SP  : 8f9c5db0 SR  : 400080f1 TEA : 004885ac
[ 1489.000000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1489.000000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1489.000000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1489.000000] R12 : 0000003c R13 : 00000001 R14 : 8f9c5db0
[ 1489.000000] MACH: 31639a1f MACL: 0023531e GBR : 00000000 PR  : 88044d26
[ 1489.000000]
[ 1489.000000] Call trace:
[ 1489.000000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1489.000000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1489.000000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1489.000000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1489.000000]  [<8804da88>] path_put+0x24/0x38
[ 1489.000000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1489.000000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1489.000000]  [<880504f4>] user_path_at+0x40/0x84
[ 1489.000000]  [<88055c40>] iput+0x40/0x58
[ 1489.000000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1489.000000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1489.000000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1489.000000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1489.000000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1489.000000]  [<88007226>] syscall_call+0xc/0x10
[ 1489.000000]  [<88007226>] syscall_call+0xc/0x10
[ 1489.000000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1489.000000]
[ 1489.000000] Code:
[ 1489.000000]   88044924:  mov.l     @(28,r11), r1
[ 1489.000000]   88044926:  cmp/hs    r1, r2
[ 1489.000000]   88044928:  bf        88044956
[ 1489.000000] ->8804492a:  trapa     #62
[ 1489.000000]   8804492c:  bra       88044958
[ 1489.000000]   8804492e:  mov       r12, r4
[ 1489.000000]   88044930:  mov.l     @(16,r11), r3
[ 1489.000000]   88044932:  mov.l     @(20,r6), r1
[ 1489.000000]   88044934:  mov.l     @r9, r2
[ 1489.000000]
[ 1489.000000] Process: du (pid: 556, stack limit = 8f9c4001)
[ 1489.000000] Stack: (0x8f9c5db0 to 0x8f9c6000)
[ 1489.000000] 5da0:                                     000000d0
000000d0 00000000 88044d26
[ 1489.000000] 5dc0: 8f9c5ddc 8f9c5e40 881b0190 8f800900 000000d0
8f5b7894 00000000 88054f82
[ 1489.000000] 5de0: 8f9c5df4 8f5b7894 8f9c5e40 8f5b7894 fffffff4
8804dc58 8f9c5e10 8f9c5eac
[ 1489.000000] 5e00: 8f587b34 8f587ac4 8f5b7894 fffffff4 8f9c5e54
8f80cb20 8804f4de 8f9c5e38
[ 1489.000000] 5e20: 8f995011 8f9c5e1c 8f587ac4 00000000 00000001
8f9c5eac 00000000 00000000
[ 1489.000000] 5e40: 0023531e 00000003 8f99500e 8f9c5e50 8804da88
8f80cb20 8f5b7894 8804fae2
[ 1489.000000] 5e60: 8f9c5e7c 8f9c5f24 ffffff9c 00000000 8f995000
8f9c5eac 00000000 8f80cc20
[ 1489.000000] 5e80: 8f401914 8804fc16 8f9c5e98 8f995000 8f9c5eac
00000000 880504f4 8f9c5eac
[ 1489.000000] 5ea0: 00000071 8f995000 8f995000 8f80cb20 8f5b7894
8f9c5ebc 8f5c5e78 88055c40
[ 1489.000000] 5ec0: 8f80cc20 8f401914 00000000 00000001 00000000
7b94c9e0 00008124 00000001
[ 1489.000000] 5ee0: 00000000 00000000 00000003 f00000c7 00018124
00000000 00000000 00000000
[ 1489.000000] 5f00: 00000400 8804a13c 8f9c5f24 00406088 295da3b8
00000000 00000071 8f9c5f48
[ 1489.000000] 5f20: ffffffea 00000000 8804a228 8804a1c2 8f9c5f40
00000071 00000100 7b94c9e0
[ 1489.000000] 5f40: 8804a21c 8f9c5f48 f00000c7 00000000 00000003
8f9c8124 00000001 00000000
[ 1489.000000] 5f60: 00000000 00000000 00000000 00000000 386d4953
16b0d666 8f9c5f84 fffffff7
[ 1489.000000] 5f80: 88051d1c 00000000 88007226 7b94c8c8 295da3b8
88007226 7b94c9e0 00000100
[ 1489.000000] 5fa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7b94c9e0 00489ae8
[ 1489.000000] 5fc0: 00000078 00489bb0 7b94ca34 00000000 00481f98
295da3b8 00406088 7b94c9e0
[ 1489.000000] 5fe0: 7b94c9e0 29592616 0043c92e 00000000 00000000
31639a1f f0000058 00000048
[ 1489.004000] ---[ end trace e0fcf399e5a41b7c ]---
Mem: 6004K used, 121928K free, 0K shrd, 0K buff, 1800K cached
CPU:  52% usr  43% sys   0% nic   0% idle   0% io   0% irq   2% sirq
Load average: 1.94 1.95 1.36 2/24 557
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  201     1 root     S     1044   1%   0   5% /sbin/klogd -n
  200     1 root     S     1044   1%   0   2% /sbin/syslogd -n -m 0
  249   199 root     R     1052   1%   0   2% top
  213   212 root     S     1060   1%   0   0% -sh
  557   213 root     S     1116   1%   0   0% du /
  208   207 root     S     1060   1%   0   0% -sh
    1     0 root     S     1060   1%   0   0% init
  199     1 root     S     1060   1%   0   0% -sh
  207   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  552   208 root     Z        0   0%   0   0% [find]
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root[ 1491.424000] ------------[ cut here ]------------
[ 1491.424000] kernel BUG at mm/slab.c:2974!
[ 1491.424000] Kernel BUG: 003e [#5]
[ 1491.424000]
[ 1491.424000] Pid : 557, Comm:                 du
[ 1491.424000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1491.424000]
[ 1491.424000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1491.424000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1491.424000] PC  : 8804492a SP  : 8f9c9db0 SR  : 400080f1 TEA : 00469c94
[ 1491.424000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1491.424000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1491.424000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1491.424000] R12 : 0000003c R13 : 00000001 R14 : 8f9c9db0
[ 1491.424000] MACH: 31639a1f MACL: 8801f4cb GBR : 00000000 PR  : 88044d26
[ 1491.424000]
[ 1491.424000] Call trace:
[ 1491.424000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1491.424000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1491.424000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1491.424000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1491.424000]  [<8801f4cb>] __queue_work+0x1b/0x74
[ 1491.424000]  [<8804da88>] path_put+0x24/0x38
[ 1491.424000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1491.424000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1491.424000]  [<880504f4>] user_path_at+0x40/0x84
[ 1491.424000]  [<88055c40>] iput+0x40/0x58
[ 1491.424000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1491.424000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1491.424000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1491.424000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1491.424000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1491.424000]  [<88007226>] syscall_call+0xc/0x10
[ 1491.424000]  [<88007226>] syscall_call+0xc/0x10
[ 1491.424000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1491.424000]
[ 1491.424000] Code:
[ 1491.424000]   88044924:  mov.l     @(28,r11), r1
[ 1491.424000]   88044926:  cmp/hs    r1, r2
[ 1491.424000]   88044928:  bf        88044956
[ 1491.424000] ->8804492a:  trapa     #62
[ 1491.424000]   8804492c:  bra       88044958
[ 1491.424000]   8804492e:  mov       r12, r4
[ 1491.424000]   88044930:  mov.l     @(16,r11), r3
[ 1491.424000]   88044932:  mov.l     @(20,r6), r1
[ 1491.424000]   88044934:  mov.l     @r9, r2
[ 1491.424000]
[ 1491.424000] Process: du (pid: 557, stack limit = 8f9c8001)
[ 1491.424000] Stack: (0x8f9c9db0 to 0x8f9ca000)
[ 1491.424000] 9da0:                                     000000d0
000000d0 00000000 88044d26
[ 1491.424000] 9dc0: 8f9c9ddc 8f9c9e40 881b0190 8f800900 000000d0
8f5ae5b4 00000000 88054f82
[ 1491.424000] 9de0: 8f9c9df4 8f5ae5b4 8f9c9e40 8f5ae5b4 fffffff4
8804dc58 8f9c9e10 8f9c9eac
[ 1491.424000] 9e00: 8f5c7f08 8f5c7e98 8f5ae5b4 fffffff4 8f9c9e54
8f80cb20 8804f4de 8f9c9e38
[ 1491.424000] 9e20: 8f9bf016 8f9c9e1c 8f5c7e98 00000000 00000001
8f9c9eac 00000000 00000001
[ 1491.424000] 9e40: 8801f4cb 00000008 8f9bf00e 8f9c9e50 8804da88
8f80cb20 8f5ae5b4 8804fae2
[ 1491.424000] 9e60: 8f9c9e7c 8f9c9f24 ffffff9c 00000000 8f9bf000
8f9c9eac 00000000 8f80cc20
[ 1491.424000] 9e80: 8f401914 8804fc16 8f9c9e98 8f9bf000 8f9c9eac
00000000 880504f4 8f9c9eac
[ 1491.424000] 9ea0: 00000071 8f9bf000 8f9bf000 8f80cb20 8f5ae5b4
8f9c9ebc 8f5c40a4 88055c40
[ 1491.424000] 9ec0: 8f80cc20 8f401914 00000000 00000001 00000000
7b93e9e0 00008124 00000001
[ 1491.424000] 9ee0: 00000000 00000000 00000003 f00000ca 00018124
00000000 00000000 00000000
[ 1491.424000] 9f00: 00000400 8804a13c 8f9c9f24 00406088 295da3b8
00000000 00000071 8f9c9f48
[ 1491.424000] 9f20: ffffffea 00000000 8804a228 8804a1c2 8f9c9f40
00000071 00000100 7b93e9e0
[ 1491.424000] 9f40: 8804a21c 8f9c9f48 f00000ca 00000000 00000003
8f9c8124 00000001 00000000
[ 1491.424000] 9f60: 00000000 00000000 00000000 00000000 386d4956
2078b58b 8f9c9f84 fffffff7
[ 1491.424000] 9f80: 88051d1c 00000000 88007226 7b93e8c8 295da3b8
88007226 7b93e9e0 00000100
[ 1491.424000] 9fa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7b93e9e0 00489ae8
[ 1491.424000] 9fc0: 00000078 00489bb0 7b93ea34 00000000 00481f98
295da3b8 00406088 7b93e9e0
[ 1491.424000] 9fe0: 7b93e9e0 29592616 0043c92e 00000000 00000000
31639a1f f0000058 00000048
     SW<      0 [ 1491.428000] ---[ end trace e0fcf399e5a41b7d ]---
  0%   0   0% [kswapd0]
[ 1493.812000] ------------[ cut here ]------------od]
[ 1493.812000] kernel BUG at mm/slab.c:2974!
[ 1493.812000] Kernel BUG: 003e [#6]
[ 1493.812000]
[ 1493.812000] Pid : 558, Comm:                 du
[ 1493.812000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1493.812000]
[ 1493.812000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1493.812000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1493.812000] PC  : 8804492a SP  : 8f9c5db0 SR  : 400080f1 TEA : 295953d4
[ 1493.812000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1493.812000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1493.812000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1493.812000] R12 : 0000003c R13 : 00000001 R14 : 8f9c5db0
[ 1493.812000] MACH: 31639a1f MACL: 00286248 GBR : 00000000 PR  : 88044d26
[ 1493.812000]
[ 1493.812000] Call trace:
[ 1493.812000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1493.812000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1493.812000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1493.812000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1493.812000]  [<8804da88>] path_put+0x24/0x38
[ 1493.812000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1493.812000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1493.812000]  [<880504f4>] user_path_at+0x40/0x84
[ 1493.812000]  [<88055c40>] iput+0x40/0x58
[ 1493.812000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1493.812000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1493.812000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1493.812000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1493.812000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1493.812000]  [<88007226>] syscall_call+0xc/0x10
[ 1493.812000]  [<88007226>] syscall_call+0xc/0x10
[ 1493.812000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1493.812000]
[ 1493.812000] Code:
[ 1493.812000]   88044924:  mov.l     @(28,r11), r1
[ 1493.812000]   88044926:  cmp/hs    r1, r2
[ 1493.812000]   88044928:  bf        88044956
[ 1493.812000] ->8804492a:  trapa     #62
[ 1493.812000]   8804492c:  bra       88044958
[ 1493.812000]   8804492e:  mov       r12, r4
[ 1493.812000]   88044930:  mov.l     @(16,r11), r3
[ 1493.812000]   88044932:  mov.l     @(20,r6), r1
[ 1493.812000]   88044934:  mov.l     @r9, r2
[ 1493.812000]
[ 1493.812000] Process: du (pid: 558, stack limit = 8f9c4001)
[ 1493.812000] Stack: (0x8f9c5db0 to 0x8f9c6000)
[ 1493.812000] 5da0:                                     000000d0
000000d0 00000000 88044d26
[ 1493.812000] 5dc0: 8f9c5ddc 8f9c5e40 881b0190 8f800900 000000d0
8f5ba8b4 00000000 88054f82
[ 1493.812000] 5de0: 8f9c5df4 8f5ba8b4 8f9c5e40 8f5ba8b4 fffffff4
8804dc58 8f9c5e10 8f9c5eac
[ 1493.812000] 5e00: 8f5c4af4 8f5c4a84 8f5ba8b4 fffffff4 8f9c5e54
8f80cb20 8804f4de 8f9c5e38
[ 1493.812000] 5e20: 8f9c6011 8f9c5e1c 8f5c4a84 00000000 00000001
8f9c5eac 00000000 8f848000
[ 1493.812000] 5e40: 00286248 00000003 8f9c600e 8f9c5e50 8804da88
8f80cb20 8f5ba8b4 8804fae2
[ 1493.812000] 5e60: 8f9c5e7c 8f9c5f24 ffffff9c 00000000 8f9c6000
8f9c5eac 00000000 8f80cc20
[ 1493.812000] 5e80: 8f401914 8804fc16 8f9c5e98 8f9c6000 8f9c5eac
00000000 880504f4 8f9c5eac
[ 1493.812000] 5ea0: 00000071 8f9c6000 8f9c6000 8f80cb20 8f5ba8b4
8f9c5ebc 8f58ae98 88055c40
[ 1493.812000] 5ec0: 8f80cc20 8f401914 00000000 00000001 00000000
7b9179e0 00008124 00000001
[ 1493.812000] 5ee0: 00000000 00000000 00000003 f00000cc 00018124
00000000 00000000 00000000
[ 1493.812000] 5f00: 00000400 8804a13c 8f9c5f24 00406088 295da3b8
00000000 00000071 8f9c5f48
[ 1493.812000] 5f20: ffffffea 00000000 8804a228 8804a1c2 8f9c5f40
00000071 00000100 7b9179e0
[ 1493.812000] 5f40: 8804a21c 8f9c5f48 f00000cc 00000000 00000003
8f9c8124 00000001 00000000
[ 1493.812000] 5f60: 00000000 00000000 00000000 00000000 386d4959
28d269e0 8f9c5f84 fffffff7
[ 1493.812000] 5f80: 88051d1c 00000000 88007226 7b9178c8 295da3b8
88007226 7b9179e0 00000100
[ 1493.812000] 5fa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7b9179e0 00489ae8
[ 1493.812000] 5fc0: 00000078 00489bb0 7b917a34 00000000 00481f98
295da3b8 00406088 7b9179e0
[ 1493.812000] 5fe0: 7b9179e0 29592616 0043c92e 00000000 00000000
31639a1f f0000058 00000048
[ 1493.816000] ---[ end trace e0fcf399e5a41b7e ]---
Mem: 6032K used, 121900K free, 0K shrd, 0K buff, 1816K cached
CPU:  52% usr  42% sys   0% nic   1% idle   0% io   1% irq   2% sirq
Load average: 1.95 1.95 1.36 2/24 559
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  201     1 root     S     1044   1%   0   6% /sbin/klogd -n
  200     1 root     S     1044   1%   0   3% /sbin/syslogd -n -m 0
  249   199 root     R     1052   1%   0   1% top
  213   212 root     S     1060   1%   0   0% -sh
  559   213 root     R     1116   1%   0   0% du /
  208   207 root     S     1060   1%   0   0% -sh
    1     0 root     S     1060   1%   0   0% init
  199     1 root     S     1060   1%   0   0% -sh
  207   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  552   208 root     Z        0   0%   0   0% [find]
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root     SW<      0   0%   0   0% [kswapd0]
[ 1496.240000] ------------[ cut here ]------------od]
[ 1496.240000] kernel BUG at mm/slab.c:2974!
[ 1496.240000] Kernel BUG: 003e [#7]
[ 1496.240000]
[ 1496.240000] Pid : 559, Comm:                 du
[ 1496.240000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1496.240000]
[ 1496.240000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1496.240000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1496.240000] PC  : 8804492a SP  : 8f9cfdb0 SR  : 400080f1 TEA : 295c65fc
[ 1496.240000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1496.240000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1496.240000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1496.240000] R12 : 0000003c R13 : 00000001 R14 : 8f9cfdb0
[ 1496.240000] MACH: 31639a1f MACL: 00296db8 GBR : 00000000 PR  : 88044d26
[ 1496.240000]
[ 1496.240000] Call trace:
[ 1496.240000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1496.240000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1496.240000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1496.240000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1496.240000]  [<8804da88>] path_put+0x24/0x38
[ 1496.240000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1496.240000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1496.240000]  [<880504f4>] user_path_at+0x40/0x84
[ 1496.240000]  [<88055c40>] iput+0x40/0x58
[ 1496.240000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1496.240000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1496.240000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1496.240000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1496.240000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1496.240000]  [<88007226>] syscall_call+0xc/0x10
[ 1496.240000]  [<88007226>] syscall_call+0xc/0x10
[ 1496.240000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1496.240000]
[ 1496.240000] Code:
[ 1496.240000]   88044924:  mov.l     @(28,r11), r1
[ 1496.240000]   88044926:  cmp/hs    r1, r2
[ 1496.240000]   88044928:  bf        88044956
[ 1496.240000] ->8804492a:  trapa     #62
[ 1496.240000]   8804492c:  bra       88044958
[ 1496.240000]   8804492e:  mov       r12, r4
[ 1496.240000]   88044930:  mov.l     @(16,r11), r3
[ 1496.240000]   88044932:  mov.l     @(20,r6), r1
[ 1496.240000]   88044934:  mov.l     @r9, r2
[ 1496.240000]
[ 1496.240000] Process: du (pid: 559, stack limit = 8f9ce001)
[ 1496.240000] Stack: (0x8f9cfdb0 to 0x8f9d0000)
[ 1496.240000] fda0:                                     000000d0
000000d0 00000000 88044d26
[ 1496.240000] fdc0: 8f9cfddc 8f9cfe40 881b0190 8f800900 000000d0
8f58dbb4 00000000 88054f82
[ 1496.240000] fde0: 8f9cfdf4 8f58dbb4 8f9cfe40 8f58dbb4 fffffff4
8804dc58 8f9cfe10 8f9cfeac
[ 1496.240000] fe00: 8f5c4114 8f5c40a4 8f58dbb4 fffffff4 8f9cfe54
8f80cb20 8804f4de 8f9cfe38
[ 1496.240000] fe20: 8f9c9011 8f9cfe1c 8f5c40a4 00000000 00000001
8f9cfeac 00000000 8f9cfe40
[ 1496.240000] fe40: 00296db8 00000003 8f9c900e 8f9cfe50 8804da88
8f80cb20 8f58dbb4 8804fae2
[ 1496.240000] fe60: 8f9cfe7c 8f9cff24 ffffff9c 00000000 8f9c9000
8f9cfeac 00000000 8f80cc20
[ 1496.240000] fe80: 8f401914 8804fc16 8f9cfe98 8f9c9000 8f9cfeac
00000000 880504f4 8f9cfeac
[ 1496.240000] fea0: 00000071 8f9c9000 8f9c9000 8f80cb20 8f58dbb4
8f9cfebc 8f58bcdc 88055c40
[ 1496.240000] fec0: 8f80cc20 8f401914 00000000 00000001 00000000
7bf7f9e0 00008124 00000001
[ 1496.240000] fee0: 00000000 00000000 00000003 f00000ce 00018124
00000000 00000000 00000000
[ 1496.240000] ff00: 00000400 8804a13c 8f9cff24 00406088 295da3b8
00000000 00000071 8f9cff48
[ 1496.240000] ff20: ffffffea 00000000 8804a228 8804a1c2 8f9cff40
00000071 00000100 7bf7f9e0
[ 1496.240000] ff40: 8804a21c 8f9cff48 f00000ce 00000000 00000003
8f9c8124 00000001 00000000
[ 1496.240000] ff60: 00000000 00000000 00000000 00000000 386d495c
32d753e6 8f9cff84 fffffff7
[ 1496.240000] ff80: 88051d1c 00000000 88007226 7bf7f8c8 295da3b8
88007226 7bf7f9e0 00000100
[ 1496.240000] ffa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7bf7f9e0 00489ae8
[ 1496.240000] ffc0: 00000078 00489bb0 7bf7fa34 00000000 00481f98
295da3b8 00406088 7bf7f9e0
[ 1496.240000] ffe0: 7bf7f9e0 29592616 0043c92e 00000000 00000000
31639a1f f0000058 00000048
[ 1496.244000] ---[ end trace e0fcf399e5a41b7f ]---
[ 1498.596000] ------------[ cut here ]------------
[ 1498.596000] kernel BUG at mm/slab.c:2974!
[ 1498.596000] Kernel BUG: 003e [#8]
[ 1498.596000]
[ 1498.596000] Pid : 560, Comm:                 du
[ 1498.596000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1498.596000]
[ 1498.596000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1498.596000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1498.596000] PC  : 8804492a SP  : 8f9c5db0 SR  : 400080f1 TEA : 0043c9f6
[ 1498.596000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1498.596000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1498.596000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1498.596000] R12 : 0000003c R13 : 00000001 R14 : 8f9c5db0
[ 1498.596000] MACH: 31639a1f MACL: c22ec994 GBR : 00000000 PR  : 88044d26
[ 1498.596000]
[ 1498.596000] Call trace:
[ 1498.596000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1498.596000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1498.596000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1498.596000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1498.596000]  [<8804da88>] path_put+0x24/0x38
[ 1498.596000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1498.596000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1498.596000]  [<880504f4>] user_path_at+0x40/0x84
[ 1498.596000]  [<88055c40>] iput+0x40/0x58
[ 1498.596000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1498.596000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1498.596000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1498.596000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1498.596000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1498.596000]  [<88007226>] syscall_call+0xc/0x10
[ 1498.596000]  [<88007226>] syscall_call+0xc/0x10
[ 1498.596000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1498.596000]
[ 1498.596000] Code:
[ 1498.596000]   88044924:  mov.l     @(28,r11), r1
[ 1498.596000]   88044926:  cmp/hs    r1, r2
[ 1498.596000]   88044928:  bf        88044956
[ 1498.596000] ->8804492a:  trapa     #62
[ 1498.596000]   8804492c:  bra       88044958
[ 1498.596000]   8804492e:  mov       r12, r4
[ 1498.596000]   88044930:  mov.l     @(16,r11), r3
[ 1498.596000]   88044932:  mov.l     @(20,r6), r1
[ 1498.596000]   88044934:  mov.l     @r9, r2
[ 1498.596000]
[ 1498.596000] Process: du (pid: 560, stack limit = 8f9c4001)
[ 1498.596000] Stack: (0x8f9c5db0 to 0x8f9c6000)
[ 1498.596000] 5da0:                                     000000d0
000000d0 00000000 88044d26
[ 1498.596000] 5dc0: 8f9c5ddc 8f9c5e40 881b0190 8f800900 000000d0
8f5b7594 00000000 88054f82
[ 1498.596000] 5de0: 8f9c5df4 8f5b7594 8f9c5e40 8f5b7594 fffffff4
8804dc58 8f9c5e10 8f9c5eac
[ 1498.596000] 5e00: 8f5b82d0 8f5b8260 8f5b7594 fffffff4 8f9c5e54
8f80cb20 8804f4de 8f9c5e38
[ 1498.596000] 5e20: 8f9c0015 8f9c5e1c 8f5b8260 00000000 00000001
8f9c5eac 00000000 8f9c5e40
[ 1498.596000] 5e40: c22ec994 00000007 8f9c000e 8f9c5e50 8804da88
8f80cb20 8f5b7594 8804fae2
[ 1498.596000] 5e60: 8f9c5e7c 8f9c5f24 ffffff9c 00000000 8f9c0000
8f9c5eac 00000000 8f80cc20
[ 1498.596000] 5e80: 8f401914 8804fc16 8f9c5e98 8f9c0000 8f9c5eac
00000000 880504f4 8f9c5eac
[ 1498.596000] 5ea0: 00000071 8f9c0000 8f9c0000 8f80cb20 8f5b7594
8f9c5ebc 8f58ae98 88055c40
[ 1498.596000] 5ec0: 8f80cc20 8f401914 00000000 00000001 00000000
7baea9e0 00008124 00000001
[ 1498.596000] 5ee0: 00000000 00000000 00000003 f00000d0 00018124
00000000 00000000 00000000
[ 1498.596000] 5f00: 00000400 8804a13c 8f9c5f24 00406088 295da3b8
00000000 00000071 8f9c5f48
[ 1498.596000] 5f20: ffffffea 00000000 8804a228 8804a1c2 8f9c5f40
00000071 00000100 7baea9e0
[ 1498.596000] 5f40: 8804a21c 8f9c5f48 f00000d0 00000000 00000003
8f9c8124 00000001 00000000
[ 1498.596000] 5f60: 00000000 00000000 00000000 00000000 386d495f
3891902b 8f9c5f84 fffffff7
[ 1498.596000] 5f80: 88051d1c 00000000 88007226 7baea8c8 295da3b8
88007226 7baea9e0 00000100
[ 1498.596000] 5fa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7baea9e0 00489ae8
[ 1498.596000] 5fc0: 00000078 00489bb0 7baeaa34 00000000 00481f98
295da3b8 00406088 7baea9e0
[ 1498.596000] 5fe0: 7baea9e0 29592616 0043c92e 00000000 00000000
31639a1f f0000058 00000048
[ 1498.600000] ---[ end trace e0fcf399e5a41b80 ]---
Mem: 6060K used, 121872K free, 0K shrd, 0K buff, 1824K cached
CPU:  54% usr  43% sys   0% nic   0% idle   0% io   0% irq   1% sirq
Load average: 1.87 1.94 1.36 3/24 560
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  201     1 root     R     1044   1%   0   3% /sbin/klogd -n
  249   199 root     R     1052   1%   0   1% top
  200     1 root     S     1044   1%   0   1% /sbin/syslogd -n -m 0
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  560   213 root     R     1116   1%   0   0% [du]
  213   212 root     S     1060   1%   0   0% -sh
  208   207 root     S     1060   1%   0   0% -sh
    1     0 root     S     1060   1%   0   0% init
  199     1 root     S     1060   1%   0   0% -sh
  207   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  552   208 root     Z        0   0%   0   0% [find]
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root     SW<      0   0%   0   0% [kswapd0]
[ 1501.028000] ------------[ cut here ]------------od]
[ 1501.028000] kernel BUG at mm/slab.c:2974!
[ 1501.028000] Kernel BUG: 003e [#9]
[ 1501.028000]
[ 1501.028000] Pid : 561, Comm:                 du
[ 1501.028000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1501.028000]
[ 1501.028000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1501.028000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1501.028000] PC  : 8804492a SP  : 8f9d5db0 SR  : 400080f1 TEA : 004688dc
[ 1501.028000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1501.028000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1501.028000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1501.028000] R12 : 0000003c R13 : 00000001 R14 : 8f9d5db0
[ 1501.028000] MACH: 31639a1f MACL: 01cb142c GBR : 00000000 PR  : 88044d26
[ 1501.028000]
[ 1501.028000] Call trace:
[ 1501.028000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1501.028000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1501.028000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1501.028000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1501.028000]  [<8804da88>] path_put+0x24/0x38
[ 1501.028000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1501.028000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1501.028000]  [<880504f4>] user_path_at+0x40/0x84
[ 1501.028000]  [<88055c40>] iput+0x40/0x58
[ 1501.028000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1501.028000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1501.028000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1501.028000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1501.028000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1501.028000]  [<88007226>] syscall_call+0xc/0x10
[ 1501.028000]  [<8800d5cc>] handle_tlbmiss+0xac/0x110
[ 1501.028000]  [<88007226>] syscall_call+0xc/0x10
[ 1501.028000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1501.028000]
[ 1501.028000] Code:
[ 1501.028000]   88044924:  mov.l     @(28,r11), r1
[ 1501.028000]   88044926:  cmp/hs    r1, r2
[ 1501.028000]   88044928:  bf        88044956
[ 1501.028000] ->8804492a:  trapa     #62
[ 1501.028000]   8804492c:  bra       88044958
[ 1501.028000]   8804492e:  mov       r12, r4
[ 1501.028000]   88044930:  mov.l     @(16,r11), r3
[ 1501.028000]   88044932:  mov.l     @(20,r6), r1
[ 1501.028000]   88044934:  mov.l     @r9, r2
[ 1501.028000]
[ 1501.028000] Process: du (pid: 561, stack limit = 8f9d4001)
[ 1501.028000] Stack: (0x8f9d5db0 to 0x8f9d6000)
[ 1501.028000] 5da0:                                     000000d0
000000d0 00000000 88044d26
[ 1501.028000] 5dc0: 8f9d5ddc 8f9d5e40 881b0190 8f800900 000000d0
8f5bbc94 00000000 88054f82
[ 1501.028000] 5de0: 8f9d5df4 8f5bbc94 8f9d5e40 8f5bbc94 fffffff4
8804dc58 8f9d5e10 8f9d5eac
[ 1501.028000] 5e00: 8f58cf28 8f58ceb8 8f5bbc94 fffffff4 8f9d5e54
8f80cb20 8804f4de 8f9d5e38
[ 1501.028000] 5e20: 8f9cc012 8f9d5e1c 8f58ceb8 00000000 00000001
8f9d5eac 00000000 8f9d5e40
[ 1501.028000] 5e40: 01cb142c 00000004 8f9cc00e 8f9d5e50 8804da88
8f80cb20 8f5bbc94 8804fae2
[ 1501.028000] 5e60: 8f9d5e7c 8f9d5f24 ffffff9c 00000000 8f9cc000
8f9d5eac 00000000 8f80cc20
[ 1501.028000] 5e80: 8f401914 8804fc16 8f9d5e98 8f9cc000 8f9d5eac
00000000 880504f4 8f9d5eac
[ 1501.028000] 5ea0: 00000071 8f9cc000 8f9cc000 8f80cb20 8f5bbc94
8f9d5ebc 8f5b888c 88055c40
[ 1501.028000] 5ec0: 8f80cc20 8f401914 00000000 00000001 00000000
7b8319e0 0000416d 00000004
[ 1501.028000] 5ee0: 00000000 00000000 00000003 f00000f0 0004416d
00000000 00000000 00000000
[ 1501.028000] 5f00: 00000400 8804a13c 8f9d5f24 00406088 295da3b8
00000000 00000071 8f9d5f48
[ 1501.028000] 5f20: ffffffea 00000000 8804a228 8804a1c2 8f9d5f40
00000071 00000100 7b8319e0
[ 1501.028000] 5f40: 8804a21c 8f9d5f48 f00000f0 00000000 00000003
0000416d 00000004 00000000
[ 1501.028000] 5f60: 00000000 00000000 00000000 00000000 386d4963
0738cbd7 8f9d5f84 fffffff7
[ 1501.028000] 5f80: 88051d1c 00000000 88007226 8800d5cc 8f9d5f94
88007226 7b8319e0 00000100
[ 1501.028000] 5fa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7b8319e0 00489ae8
[ 1501.028000] 5fc0: 00000078 00489bb0 7b831a34 00000000 00481f98
295da3b8 00406088 7b8319e0
[ 1501.028000] 5fe0: 7b8319e0 29592616 0043c92e 00000000 00000000
31639a1f f0000058 00000048
[ 1501.032000] ---[ end trace e0fcf399e5a41b81 ]---
Mem: 6088K used, 121844K free, 0K shrd, 0K buff, 1836K cached
CPU:  49% usr  47% sys   0% nic   0% idle   0% io   0% irq   1% sirq
Load average: 1.88 1.94 1.36 2/24 562
  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND
  201     1 root     S     1044   1%   0   5% /sbin/klogd -n
  200     1 root     S     1044   1%   0   2% /sbin/syslogd -n -m 0
  249   199 root     R     1052   1%   0   1% top
  213   212 root     S     1060   1%   0   0% -sh
  562   213 root     R     1116   1%   0   0% du /
  208   207 root     S     1060   1%   0   0% -sh
    1     0 root     S     1060   1%   0   0% init
  199     1 root     S     1060   1%   0   0% -sh
  207   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  212   197 root     S     1028   1%   0   0% /usr/sbin/dropbear
  197     1 root     S      972   1%   0   0% /usr/sbin/dropbear
  175     1 root     S <    628   0%   0   0% /sbin/udevd -d
  552   208 root     Z        0   0%   0   0% [find]
  152     2 root     SW<      0   0%   0   0% [rpciod/0]
    5     2 root     SW<      0   0%   0   0% [khelper]
    2     0 root     SW<      0   0%   0   0% [kthreadd]
    3     2 root     SW<      0   0%   0   0% [ksoftirqd/0]
    4     2 root     SW<      0   0%   0   0% [events/0]
    8     2 root     SW<      0   0%   0   0% [async/mgr]
   54     2 root     SW<      0   0%   0   0% [kblockd/0]
   81     2 root     SW       0   0%   0   0% [pdflush]
   82     2 root     SW       0   0%   0   0% [pdflush]
   83     2 root     SW<      0   0%   0   0% [kswapd0]
[ 1503.468000] ------------[ cut here ]------------od]
[ 1503.468000] kernel BUG at mm/slab.c:2974!
[ 1503.468000] Kernel BUG: 003e [#10]
[ 1503.468000]
[ 1503.468000] Pid : 562, Comm:                 du
[ 1503.468000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1503.468000]
[ 1503.468000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1503.468000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1503.468000] PC  : 8804492a SP  : 8f9d3db0 SR  : 400080f1 TEA : 00407374
[ 1503.468000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1503.468000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1503.468000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1503.468000] R12 : 0000003c R13 : 00000001 R14 : 8f9d3db0
[ 1503.468000] MACH: 00000147 MACL: ce7473bc GBR : 00000000 PR  : 88044d26
[ 1503.468000]
[ 1503.468000] Call trace:
[ 1503.468000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1503.468000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1503.468000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1503.468000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1503.468000]  [<8800ef54>] __wake_up_common+0x28/0x64
[ 1503.468000]  [<8804da88>] path_put+0x24/0x38
[ 1503.468000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1503.468000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1503.468000]  [<880504f4>] user_path_at+0x40/0x84
[ 1503.468000]  [<88055c40>] iput+0x40/0x58
[ 1503.468000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1503.468000]  [<8804a228>] sys_newlstat+0x20/0x38
[ 1503.468000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1503.468000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1503.468000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1503.468000]  [<88007226>] syscall_call+0xc/0x10
[ 1503.468000]  [<8800d5cc>] handle_tlbmiss+0xac/0x110
[ 1503.468000]  [<88007226>] syscall_call+0xc/0x10
[ 1503.468000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1503.468000]
[ 1503.468000] Code:
[ 1503.468000]   88044924:  mov.l     @(28,r11), r1
[ 1503.468000]   88044926:  cmp/hs    r1, r2
[ 1503.468000]   88044928:  bf        88044956
[ 1503.468000] ->8804492a:  trapa     #62
[ 1503.468000]   8804492c:  bra       88044958
[ 1503.468000]   8804492e:  mov       r12, r4
[ 1503.468000]   88044930:  mov.l     @(16,r11), r3
[ 1503.468000]   88044932:  mov.l     @(20,r6), r1
[ 1503.468000]   88044934:  mov.l     @r9, r2
[ 1503.468000]
[ 1503.468000] Process: du (pid: 562, stack limit = 8f9d2001)
[ 1503.468000] Stack: (0x8f9d3db0 to 0x8f9d4000)
[ 1503.468000] 3da0:                                     000000d0
000000d0 00000000 88044d26
[ 1503.468000] 3dc0: 8f9d3ddc 8f9d3e40 881b0190 8f800900 000000d0
8f5b7e94 00000000 88054f82
[ 1503.468000] 3de0: 8f9d3df4 8f5b7e94 8f9d3e40 8f5b7e94 fffffff4
8804dc58 8f9d3e10 8f9d3eac
[ 1503.468000] 3e00: 8f5c69b8 8f5c6948 8f5b7e94 fffffff4 8f9d3e54
8f80cb20 8804f4de 8f9d3e38
[ 1503.468000] 3e20: 8f9ce014 8f9d3e1c 8f5c6948 00000000 00000001
8f9d3eac 00000000 8800ef54
[ 1503.468000] 3e40: ce7473bc 00000006 8f9ce00e 8f9d3e50 8804da88
8f80cb20 8f5b7e94 8804fae2
[ 1503.468000] 3e60: 8f9d3e7c 8f9d3f24 ffffff9c 00000000 8f9ce000
8f9d3eac 00000000 8f80cc20
[ 1503.468000] 3e80: 8f401914 8804fc16 8f9d3e98 8f9ce000 8f9d3eac
00000000 880504f4 8f9d3eac
[ 1503.468000] 3ea0: 00000071 8f9ce000 8f9ce000 8f80cb20 8f5b7e94
8f9d3ebc 8f5c6594 88055c40
[ 1503.468000] 3ec0: 8f80cc20 8f401914 00000000 00000001 00000000
7bc459e0 00008124 00000001
[ 1503.468000] 3ee0: 00000000 00000000 00000003 f0000101 00018124
00000000 00000000 00000000
[ 1503.468000] 3f00: 00000400 8804a13c 8f9d3f24 00406088 295da3b8
00000000 00000071 8f9d3f48
[ 1503.468000] 3f20: ffffffea 00000000 8804a228 8804a1c2 8f9d3f40
00000071 00000100 7bc459e0
[ 1503.468000] 3f40: 8804a21c 8f9d3f48 f0000101 00000000 00000003
8f9d8124 00000001 00000000
[ 1503.468000] 3f60: 00000000 00000000 00000000 00000000 386d4966
126eeb3a 8f9d3f84 fffffff7
[ 1503.468000] 3f80: 88051d1c 00000000 88007226 8800d5cc 8f9d3f94
88007226 7bc459e0 00000100
[ 1503.468000] 3fa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00489bb0 7bc459e0 00489ae8
[ 1503.468000] 3fc0: 00000078 00489bb0 7bc45a34 00000000 00481f98
295da3b8 00406088 7bc459e0
[ 1503.468000] 3fe0: 7bc459e0 29592616 0043c92e 00000000 00000000
00000147 ae147c00 00000048
[ 1503.476000] ---[ end trace e0fcf399e5a41b82 ]---
[ 1505.852000] ------------[ cut here ]------------
[ 1505.852000] kernel BUG at mm/slab.c:2974!
[ 1505.852000] Kernel BUG: 003e [#11]
[ 1505.852000]
[ 1505.852000] Pid : 563, Comm:                 du
[ 1505.852000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1505.852000]
[ 1505.852000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1505.852000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1505.852000] PC  : 8804492a SP  : 8f9d5db0 SR  : 400080f1 TEA : 00407374
[ 1505.852000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : fffffff2
[ 1505.852000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 9e370001
[ 1505.852000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1505.852000] R12 : 0000003c R13 : 00000001 R14 : 8f9d5db0
[ 1505.852000] MACH: 00000147 MACL: 00281968 GBR : 00000000 PR  : 88044d26
[ 1505.852000]
[ 1505.852000] Call trace:
[ 1505.852000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1505.852000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1505.852000]  [<8804dc58>] do_lookup+0x80/0x150
[ 1505.852000]  [<8804f4de>] __link_path_walk+0x7a2/0xbb4
[ 1505.852000]  [<8804fae2>] path_walk+0x5a/0xcc
[ 1505.852000]  [<8804fc16>] do_path_lookup+0x22/0x54
[ 1505.852000]  [<880504f4>] user_path_at+0x40/0x84
[ 1505.852000]  [<880733e6>] proc_readdir_de+0xe2/0x13c
[ 1505.852000]  [<8804a13c>] vfs_fstatat+0x28/0x64
[ 1505.852000]  [<880757e6>] proc_tgid_net_readdir+0x3e/0x5c
[ 1505.852000]  [<8804a1c2>] vfs_lstat+0x12/0x20
[ 1505.852000]  [<8804a21c>] sys_newlstat+0x14/0x38
[ 1505.852000]  [<880523fa>] vfs_readdir+0x62/0x98
[ 1505.852000]  [<88052400>] vfs_readdir+0x68/0x98
[ 1505.852000]  [<8805250c>] sys_getdents+0x44/0xa4
[ 1505.852000]  [<88052544>] sys_getdents+0x7c/0xa4
[ 1505.852000]  [<88051d1c>] sys_ioctl+0x0/0x68
[ 1505.852000]  [<88007226>] syscall_call+0xc/0x10
[ 1505.852000]  [<8800d5cc>] handle_tlbmiss+0xac/0x110
[ 1505.852000]  [<88007226>] syscall_call+0xc/0x10
[ 1505.852000]  [<8804a208>] sys_newlstat+0x0/0x38
[ 1505.852000]
[ 1505.852000] Code:
[ 1505.852000]   88044924:  mov.l     @(28,r11), r1
[ 1505.852000]   88044926:  cmp/hs    r1, r2
[ 1505.852000]   88044928:  bf        88044956
[ 1505.852000] ->8804492a:  trapa     #62
[ 1505.852000]   8804492c:  bra       88044958
[ 1505.852000]   8804492e:  mov       r12, r4
[ 1505.852000]   88044930:  mov.l     @(16,r11), r3
[ 1505.852000]   88044932:  mov.l     @(20,r6), r1
[ 1505.852000]   88044934:  mov.l     @r9, r2
[ 1505.852000]
[ 1505.852000] Process: du (pid: 563, stack limit = 8f9d4001)
[ 1505.852000] Stack: (0x8f9d5db0 to 0x8f9d6000)
[ 1505.852000] 5da0:                                     000000d0
000000d0 00000000 88044d26
[ 1505.852000] 5dc0: 8f9d5ddc 8f9d5e40 881b0190 8f800900 000000d0
8f582734 00000000 88054f82
[ 1505.852000] 5de0: 8f9d5df4 8f582734 8f9d5e40 8f582734 fffffff4
8804dc58 8f9d5e10 8f9d5eac
[ 1505.852000] 5e00: 8f58a528 8f58a4b8 8f582734 fffffff4 8f9d5e54
8f80cb20 8804f4de 8f9d5e38
[ 1505.852000] 5e20: 8f9d0011 8f9d5e1c 8f58a4b8 00000000 00000001
8f9d5eac 00000000 8f9d5e40
[ 1505.852000] 5e40: 00281968 00000003 8f9d000e 8f9d5e44 8f5bddf8
8f80cb20 8f582734 8804fae2
[ 1505.852000] 5e60: 8f9d5e7c 8f9d5f24 ffffff9c 00000000 8f9d0000
8f9d5eac 00000000 8f80cc20
[ 1505.852000] 5e80: 8f401914 8804fc16 8f9d5e98 8f9d0000 8f9d5eac
00000000 880504f4 8f9d5eac
[ 1505.852000] 5ea0: 00000071 8f9d0000 8f9d0000 8f80cb20 8f582734
8f9d5ef0 00000000 8f96e7c0
[ 1505.852000] 5ec0: 8f80cc20 8f401914 00000000 00000001 00000000
7bbd89d8 0000416d 00000004
[ 1505.852000] 5ee0: 00000000 00000000 0000000c 8f9d5f78 7bbd87b4
00000018 880733e6 8f9d5f24
[ 1505.852000] 5f00: 8f9d5f78 8804a13c 8f9d5f24 00406088 295da3b8
00000000 00000071 8f9d5f48
[ 1505.852000] 5f20: ffffffea 880757e6 8f9d5f44 8804a1c2 8f9d5f40
00000071 00000100 7bbd89e0
[ 1505.852000] 5f40: 8804a21c 8f9d5f48 880523fa 8f9d5f58 88052400
8f9d5f58 8805250c 8f9d5f78
[ 1505.852000] 5f60: 00406088 7bbd8670 000003d8 8f96e7c0 88052544
8f9d5f78 8f9d5f84 fffffff7
[ 1505.852000] 5f80: 88051d1c 00000000 88007226 8800d5cc 8f9d5f94
88007226 7bbd89e0 00000100
[ 1505.852000] 5fa0: 8804a208 0000006b 00403c70 295db5d4 0000006b
00484560 7bbd89e0 00489ae8
[ 1505.852000] 5fc0: 00000078 00484560 7bbd8a34 00000000 00481f98
295da3b8 00406088 7bbd89e0
[ 1505.852000] 5fe0: 7bbd89e0 29592616 0043c92e 00000000 00000000
00000147 ae147c00 00000048
[ 1505.856000] ---[ end trace e0fcf399e5a41b83 ]---
[ 1505.864000] ------------[ cut here ]------------
[ 1505.864000] kernel BUG at mm/slab.c:2974!
[ 1505.864000] Kernel BUG: 003e [#12]
[ 1505.864000]
[ 1505.864000] Pid : 201, Comm:                 klogd
[ 1505.864000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1505.864000]
[ 1505.864000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1505.864000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1505.864000] PC  : 8804492a SP  : 8f965ebc SR  : 400080f1 TEA : 29593ec8
[ 1505.864000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : 00000001
[ 1505.864000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 8820085c
[ 1505.864000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1505.864000] R12 : 0000003c R13 : 00000001 R14 : 8f965ebc
[ 1505.864000] MACH: 00000000 MACL: 0000000a GBR : 00000000 PR  : 88044d26
[ 1505.864000]
[ 1505.864000] Call trace:
[ 1505.864000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1505.864000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1505.864000]  [<880f4606>] sock_attach_fd+0x36/0xc4
[ 1505.864000]  [<880f46c6>] sock_map_fd+0x32/0x80
[ 1505.864000]  [<880f4e42>] sys_socket+0x3a/0x6c
[ 1505.864000]  [<880f4ef8>] sys_socketcall+0x84/0x180
[ 1505.864000]  [<8800d5cc>] handle_tlbmiss+0xac/0x110
[ 1505.864000]  [<88007022>] call_handle_tlbmiss+0xe/0x1a
[ 1505.864000]  [<88007226>] syscall_call+0xc/0x10
[ 1505.864000]  [<880f4e74>] sys_socketcall+0x0/0x180
[ 1505.864000]
[ 1505.864000] Code:
[ 1505.864000]   88044924:  mov.l     @(28,r11), r1
[ 1505.864000]   88044926:  cmp/hs    r1, r2
[ 1505.864000]   88044928:  bf        88044956
[ 1505.864000] ->8804492a:  trapa     #62
[ 1505.864000]   8804492c:  bra       88044958
[ 1505.864000]   8804492e:  mov       r12, r4
[ 1505.864000]   88044930:  mov.l     @(16,r11), r3
[ 1505.864000]   88044932:  mov.l     @(20,r6), r1
[ 1505.864000]   88044934:  mov.l     @r9, r2
[ 1505.864000]
[ 1505.864000] Process: klogd (pid: 201, stack limit = 8f964001)
[ 1505.864000] Stack: (0x8f965ebc to 0x8f966000)
[ 1505.864000] 5ea0:
             000000d0
[ 1505.864000] 5ec0: 000000d0 00000000 88044d26 8f965ee8 881b02f0
881b0190 8f800900 000000d0
[ 1505.864000] 5ee0: 00000003 00000000 88054f82 8f965f00 8f401514
8f965f1c 00000003 8f965f0c
[ 1505.864000] 5f00: 880f4606 8f965f1c 8f467d00 00000000 8f9a0560
00000003 8f965f0c 00000000
[ 1505.864000] 5f20: 00000000 88191f6c 880f46c6 8f965f48 0000000b
8f467d00 00000000 00000003
[ 1505.864000] 5f40: 00000003 8f965f0c 8f9a0560 880f4e42 8f965f68
295da3b8 00000000 8f965f2c
[ 1505.864000] 5f60: 00000000 00000000 8f467d00 880f4ef8 8f965f80
00000071 00000100 00000001
[ 1505.864000] 5f80: 00000001 00000002 00000000 8800d5cc 8f965f94
88007022 88007226 7bbf2778
[ 1505.864000] 5fa0: 880f4e74 00000066 00000000 00000008 00000066
00000001 7bbf2788 00000000
[ 1505.864000] 5fc0: 00000118 295da024 fffffc84 00462b00 00000002
295da3b8 0000000b 7bbf2778
[ 1505.864000] 5fe0: 7bbf2778 29593ede 295be350 00000000 00000000
00000000 0000000a 00000048
[ 1505.868000] ---[ end trace e0fcf399e5a41b84 ]---
[ 1505.876000] ------------[ cut here ]------------
[ 1505.876000] kernel BUG at mm/slab.c:2974!
[ 1505.876000] Kernel BUG: 003e [#13]
[ 1505.876000]
[ 1505.876000] Pid : 1, Comm:           init
[ 1505.876000] CPU : 0                  Tainted: G      D     (2.6.31-rc9 #9)
[ 1505.876000]
[ 1505.876000] PC is at cache_alloc_refill+0xc2/0x39c
[ 1505.876000] PR is at kmem_cache_alloc+0x52/0xb0
[ 1505.876000] PC  : 8804492a SP  : 8f819ebc SR  : 400080f1 TEA : 29593ec8
[ 1505.876000] R0  : 88044868 R1  : 0000001e R2  : 0000001e R3  : 00000001
[ 1505.876000] R4  : 8f800900 R5  : 8f8028e0 R6  : 8f5ae020 R7  : 8820085c
[ 1505.876000] R8  : 8f8028e8 R9  : 8f809000 R10 : 8f8028f0 R11 : 8f800900
[ 1505.876000] R12 : 0000003c R13 : 00000001 R14 : 8f819ebc
[ 1505.876000] MACH: 00000001 MACL: 00000840 GBR : 00000000 PR  : 88044d26
[ 1505.876000]
[ 1505.876000] Call trace:
[ 1505.876000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1505.876000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1505.876000]  [<880f4606>] sock_attach_fd+0x36/0xc4
[ 1505.876000]  [<880f46c6>] sock_map_fd+0x32/0x80
[ 1505.876000]  [<880f4e42>] sys_socket+0x3a/0x6c
[ 1505.876000]  [<880f4ef8>] sys_socketcall+0x84/0x180
[ 1505.876000]  [<8800d5cc>] handle_tlbmiss+0xac/0x110
[ 1505.876000]  [<88007022>] call_handle_tlbmiss+0xe/0x1a
[ 1505.876000]  [<88007226>] syscall_call+0xc/0x10
[ 1505.876000]  [<880f4e74>] sys_socketcall+0x0/0x180
[ 1505.876000]
[ 1505.876000] Code:
[ 1505.876000]   88044924:  mov.l     @(28,r11), r1
[ 1505.876000]   88044926:  cmp/hs    r1, r2
[ 1505.876000]   88044928:  bf        88044956
[ 1505.876000] ->8804492a:  trapa     #62
[ 1505.876000]   8804492c:  bra       88044958
[ 1505.876000]   8804492e:  mov       r12, r4
[ 1505.876000]   88044930:  mov.l     @(16,r11), r3
[ 1505.876000]   88044932:  mov.l     @(20,r6), r1
[ 1505.876000]   88044934:  mov.l     @r9, r2
[ 1505.876000]
[ 1505.876000] Process: init (pid: 1, stack limit = 8f818001)
[ 1505.876000] Stack: (0x8f819ebc to 0x8f81a000)
[ 1505.876000] 9ea0:
             000000d0
[ 1505.876000] 9ec0: 000000d0 00000000 88044d26 8f819ee8 881b02f0
881b0190 8f800900 000000d0
[ 1505.876000] 9ee0: 00000003 00000000 88054f82 8f819f00 8f401514
8f819f1c 00000003 8f819f0c
[ 1505.876000] 9f00: 880f4606 8f819f1c 8f4678e0 00000000 8f9a0b60
00000003 8f819f0c 00000000
[ 1505.876000] 9f20: 00000000 88191f6c 880f46c6 8f819f48 00000019
8f4678e0 00000000 00000003
[ 1505.876000] 9f40: 00000003 8f819f0c 8f9a0b60 880f4e42 8f819f68
295da3b8 00000000 8f819f2c
[ 1505.876000] 9f60: 00000000 00000000 8f4678e0 880f4ef8 8f819f80
00000071 00000100 00000001
[ 1505.876000] 9f80: 00000001 00000002 00000000 8800d5cc 8f819f94
88007022 88007226 7bdab66c
[ 1505.876000] 9fa0: 880f4e74 00000066 00000000 00000008 00000066
00000001 7bdab67c 00000000
[ 1505.876000] 9fc0: 00000118 295da024 fffffc84 00469a14 00000002
295da3b8 00000019 7bdab66c
[ 1505.876000] 9fe0: 7bdab66c 29593ede 295be350 00000000 00000000
00000001 33333334 00000048
[ 1505.880000] ---[ end trace e0fcf399e5a41b85 ]---
[ 1505.892000] Kernel panic - not syncing: Attempted to kill init!
[ 1505.896000] Stack: (0x8f819da8 to 0x8f81a000)
[ 1505.900000] 9da0:                   88153b4e 8f819db8 8f817b40
8818d524 88153ba4 8f819dc0
[ 1505.916000] 9dc0: 8f819de4 88015358 8f819df0 00000001 0000003c
8f817b40 0000000b 8f817b40
[ 1505.932000] 9de0: 000000bc 8f817b38 00000001 8f819dc8 00000001
00000001 0000003e 8818c164
[ 1505.952000] 9e00: 8f819e00 8f819e00 88006312 8f819e28 00000001
0000003c 0000003e 8818c164
[ 1505.968000] 9e20: 8f819e60 88153c60 88005e82 8f819e40 8f800900
8f819eb8 8f819e60 8804492a
[ 1505.984000] 9e40: 88005eec 8f819e50 8f819e60 8f819ea0 880071c6
8f819ebc 0000007f 88005e9c
[ 1506.004000] 9e60: 88044868 0000001e 0000001e 00000001 8f800900
8f8028e0 8f5ae020 8820085c
[ 1506.020000] 9e80: 8f8028e8 8f809000 8f8028f0 8f800900 0000003c
00000001 8f819ebc 8f819ebc
[ 1506.036000] 9ea0: 8804492a 88044d26 400080f1 00000000 00000001
00000840 000000f8 000000d0
[ 1506.052000] 9ec0: 000000d0 00000000 88044d26 8f819ee8 881b02f0
881b0190 8f800900 000000d0
[ 1506.072000] 9ee0: 00000003 00000000 88054f82 8f819f00 8f401514
8f819f1c 00000003 8f819f0c
[ 1506.088000] 9f00: 880f4606 8f819f1c 8f4678e0 00000000 8f9a0b60
00000003 8f819f0c 00000000
[ 1506.104000] 9f20: 00000000 88191f6c 880f46c6 8f819f48 00000019
8f4678e0 00000000 00000003
[ 1506.124000] 9f40: 00000003 8f819f0c 8f9a0b60 880f4e42 8f819f68
295da3b8 00000000 8f819f2c
[ 1506.140000] 9f60: 00000000 00000000 8f4678e0 880f4ef8 8f819f80
00000071 00000100 00000001
[ 1506.156000] 9f80: 00000001 00000002 00000000 8800d5cc 8f819f94
88007022 88007226 7bdab66c
[ 1506.172000] 9fa0: 880f4e74 00000066 00000000 00000008 00000066
00000001 7bdab67c 00000000
[ 1506.192000] 9fc0: 00000118 295da024 fffffc84 00469a14 00000002
295da3b8 00000019 7bdab66c
[ 1506.208000] 9fe0: 7bdab66c 29593ede 295be350 00008000 00000000
00000001 33333334 00000048
[ 1506.224000]
[ 1506.224000] Call trace:
[ 1506.228000]  [<88153b4e>] dump_stack+0xe/0x1c
[ 1506.232000]  [<88153ba4>] panic+0x48/0x104
[ 1506.236000]  [<88015358>] do_exit+0x40/0x4bc
[ 1506.240000]  [<88006312>] die+0xda/0x140
[ 1506.244000]  [<88153c60>] printk+0x0/0x30
[ 1506.248000]  [<88005e82>] handle_BUG+0x5e/0x78
[ 1506.252000]  [<8804492a>] cache_alloc_refill+0xc2/0x39c
[ 1506.256000]  [<88005eec>] bug_trap_handler+0x50/0x84
[ 1506.260000]  [<880071c6>] debug_trap+0xe/0x18
[ 1506.264000]  [<88005e9c>] bug_trap_handler+0x0/0x84
[ 1506.268000]  [<88044868>] cache_alloc_refill+0x0/0x39c
[ 1506.272000]  [<8804492a>] cache_alloc_refill+0xc2/0x39c
[ 1506.276000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1506.280000]  [<88044d26>] kmem_cache_alloc+0x52/0xb0
[ 1506.284000]  [<88054f82>] d_alloc+0x1e/0x110
[ 1506.288000]  [<880f4606>] sock_attach_fd+0x36/0xc4
[ 1506.292000]  [<880f46c6>] sock_map_fd+0x32/0x80
[ 1506.296000]  [<880f4e42>] sys_socket+0x3a/0x6c
[ 1506.300000]  [<880f4ef8>] sys_socketcall+0x84/0x180
[ 1506.304000]  [<8800d5cc>] handle_tlbmiss+0xac/0x110
[ 1506.308000]  [<88007022>] call_handle_tlbmiss+0xe/0x1a
[ 1506.312000]  [<88007226>] syscall_call+0xc/0x10
[ 1506.316000]  [<880f4e74>] sys_socketcall+0x0/0x180
[ 1506.320000]
--
To unsubscribe from this list: send the line "unsubscribe linux-sh" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: User mode address error problems on 7763

[Paul Mundt]

On Tue, Sep 15, 2009 at 09:43:13AM -0500, Dale Larson wrote:
> > Great, your libc doesn't handle variable page sizes. You're either going
> > to have to update and rebuild your libc, or go back to the write-through
> > caching on 4k pages thing. The latter should be fine in the current tree,
> > as I've tested it on a number of boards. If you run in to issues with
> > that, please post a full boot log for that also.
> 
> I changed to write-through cache and it runs much better. I ran two
> ssh session with "du /" and "find /" looping on those sessions and
> "top" running on the console. Eventially the 'top' session crashed and
> the ssh sessions stopped generating output. Here's the dump (craddle
> to grave) with many 'top''s removed:
> 
So basically it looks like there are two separate bugs here, one is an
aliasing issue that we need to address separately, and this one appears
to be slab corruption. Do you know roughly which previous kernel worked
for you? If so, that at least gives us a starting point for comparison.

In any event, given that this is a slab issue, this should likely be
reported to kerneloops.org, then it's possible to see if there are others
that end up with similar issues and similar callchains.

Re: User mode address error problems on 7763

[Dale Larson]

> So basically it looks like there are two separate bugs here, one is an
> aliasing issue that we need to address separately, and this one appears
> to be slab corruption. Do you know roughly which previous kernel worked
> for you? If so, that at least gives us a starting point for comparison.

I never had Linux successfully running on the 7763. I do have Linux 2.6.28.2
running on the 7760 with no problems.

> In any event, given that this is a slab issue, this should likely be
> reported to kerneloops.org, then it's possible to see if there are others
> that end up with similar issues and similar callchains.

Ok.

Dale

Re: User mode address error problems on 7763

[Dale Larson]

My current situation is that I now have Linux running solidly on the
7763 with the cache set to "write-through" and the memory manager set
to SLOB.

This allow's my other work to continue forward while this cache issue
is investigated. If you need any assistance with testing cache patches
let me know. I'd be happy to try them out.

Dale Larson
Johnson Controls, Inc