All of lore.kernel.org
 help / color / mirror / Atom feed
* [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed
@ 2015-01-30 21:12 Nix
  2015-02-02  3:29 ` Myron Stowe
  0 siblings, 1 reply; 7+ messages in thread
From: Nix @ 2015-01-30 21:12 UTC (permalink / raw)
  To: Linux Kernel Mailing List, myron.stowe, unruh, martin, bhelgaas,
	willy, gregkh

As of 3.18.3, the watchdog timer, high-res timers, etc on my Soekris
net5501 no longer work.

dmesg says:

[    1.465681] scx200_acb: can't allocate io 0x0-0x7
[    1.473909] cs5535-smb: probe of cs5535-smb failed with error -5
[    1.479991] pc87360: Device 0x09 not activated
[    1.488237] geodewdt: No timers were available
[    1.505612] Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
[    1.511699] cs5535-clockevt: Could not allocate MFGPT timer

rather than the expected

[    1.465987] cs5535-smb cs5535-smb: SCx200 device 'CS5535 ACB0' registered
[    1.466747] pc87360: Device 0x09 not activated
[    1.484989] cs5535-mfgpt cs5535-mfgpt: registered timer 0
[    1.488096] Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
[    1.504232] cs5535-mfgpt cs5535-mfgpt: registered timer 1
[    1.506634] cs5535-clockevt: Registering MFGPT timer as a clock event, using IRQ 7

Bisected to:

commit efdb9b956aa06868a052f0d4387f5f34e2321e41
Author: Myron Stowe <myron.stowe@redhat.com>
Date:   Thu Oct 30 11:54:37 2014 -0600

    PCI: Restore detection of read-only BARs

    commit 36e8164882ca6d3c41cb91e6f09a3ed236841f80 upstream.

before which everything works OK. (Bisection confirmed by reverting this
commit, following which everything works again.)

/proc/ioports in a good boot:

0000-001f : dma1
  0000-0000 : cs5535-acpi
    0000-0000 : cs5535-pms
0020-0021 : pic1
0040-0043 : timer0
0050-0053 : timer1
0060-0060 : keyboard
0064-0064 : keyboard
0070-0071 : rtc_cmos
0080-008f : dma page reg
00a0-00a1 : pic2
00c0-00df : dma2
00f0-00ff : fpu
0170-0177 : 0000:00:14.2
01f0-01f7 : 0000:00:14.2
  01f0-01f7 : pata_cs5536
0376-0376 : 0000:00:14.2
03f6-03f6 : 0000:00:14.2
  03f6-03f6 : pata_cs5536
03f8-03ff : serial
0cf8-0cff : PCI conf1
6000-6007 : cs5535-smb
  6000-6007 : 0000:00:14.0
    6000-6007 : CS5535 ACB0
6100-61ff : cs5535-gpio
  6100-61ff : 0000:00:14.0
    6100-61ff : cs5535-gpio
6200-63ff : cs5535-mfgpt
  6200-63ff : 0000:00:14.0
    6200-63ff : cs5535-mfgpt
6620-662f : pc87360
  6620-662f : pc87360
6640-664f : pc87360
  6640-664f : pc87360
d000-dfff : PCI Bus 0000:01
  d000-d0ff : 0000:01:00.0
    d000-d0ff : via-rhine
  d100-d1ff : 0000:01:01.0
    d100-d1ff : via-rhine
  d200-d2ff : 0000:01:02.0
    d200-d2ff : via-rhine
  d300-d3ff : 0000:01:03.0
    d300-d3ff : via-rhine
e000-e00f : 0000:00:14.2
  e000-e00f : pata_cs5536
e100-e1ff : 0000:00:06.0
  e100-e1ff : via-rhine
e200-e2ff : 0000:00:07.0
  e200-e2ff : via-rhine
e300-e3ff : 0000:00:08.0
  e300-e3ff : via-rhine
e400-e4ff : 0000:00:09.0
  e400-e4ff : via-rhine

Bad boot:

0000-001f : dma1
  0000-0007 : cs5535-smb
    0000-0000 : cs5535-acpi
      0000-0000 : cs5535-pms
        0000-0000 : cs5535-mfgpt
          0000-0000 : cs5535-gpio
0020-0021 : pic1
0040-0043 : timer0
0050-0053 : timer1
0060-0060 : keyboard
0064-0064 : keyboard
0070-0071 : rtc_cmos
0080-008f : dma page reg
00a0-00a1 : pic2
00c0-00df : dma2
00f0-00ff : fpu
0170-0177 : 0000:00:14.2
01f0-01f7 : 0000:00:14.2
  01f0-01f7 : pata_cs5536
0376-0376 : 0000:00:14.2
03f6-03f6 : 0000:00:14.2
  03f6-03f6 : pata_cs5536
03f8-03ff : serial
0cf8-0cff : PCI conf1
6620-662f : pc87360
  6620-662f : pc87360
6640-664f : pc87360
  6640-664f : pc87360
d000-dfff : PCI Bus 0000:01
  d000-d0ff : 0000:01:00.0
    d000-d0ff : via-rhine
  d100-d1ff : 0000:01:01.0
    d100-d1ff : via-rhine
  d200-d2ff : 0000:01:02.0
    d200-d2ff : via-rhine
  d300-d3ff : 0000:01:03.0
    d300-d3ff : via-rhine
e000-e00f : 0000:00:14.2
  e000-e00f : pata_cs5536
e100-e1ff : 0000:00:06.0
  e100-e1ff : via-rhine
e200-e2ff : 0000:00:07.0
  e200-e2ff : via-rhine
e300-e3ff : 0000:00:08.0
  e300-e3ff : via-rhine
e400-e4ff : 0000:00:09.0
  e400-e4ff : via-rhine

A diff shows what I can only describe as an ioports traffic jam:

--- /tmp/good-ioports	2015-01-30 21:01:42.724692790 +0000
+++ /tmp/bad-ioports	2015-01-30 21:01:51.803954107 +0000
@@ -1,6 +1,9 @@
 0000-001f : dma1
-  0000-0000 : cs5535-acpi
-    0000-0000 : cs5535-pms
+  0000-0007 : cs5535-smb
+    0000-0000 : cs5535-acpi
+      0000-0000 : cs5535-pms
+        0000-0000 : cs5535-mfgpt
+          0000-0000 : cs5535-gpio
 0020-0021 : pic1
 0040-0043 : timer0
 0050-0053 : timer1
@@ -19,15 +22,6 @@
   03f6-03f6 : pata_cs5536
 03f8-03ff : serial
 0cf8-0cff : PCI conf1
-6000-6007 : cs5535-smb
-  6000-6007 : 0000:00:14.0
-    6000-6007 : CS5535 ACB0
-6100-61ff : cs5535-gpio
-  6100-61ff : 0000:00:14.0
-    6100-61ff : cs5535-gpio
-6200-63ff : cs5535-mfgpt
-  6200-63ff : 0000:00:14.0
-    6200-63ff : cs5535-mfgpt
 6620-662f : pc87360
   6620-662f : pc87360
 6640-664f : pc87360

A diff between good and bad boot output is not very edifying: all we
really see is ordering differences, address differences and things
dropping out of the log because of the absent hardware (mostly, I think,
the different time source because we're forced to fall back to the PIT
rather than using the nice fast cs5535-clockevt):

--- /tmp/good-boot	2015-01-30 20:57:36.464752599 +0000
+++ /tmp/bad-boot	2015-01-30 20:50:12.541106428 +0000
@@ -1,5 +1,5 @@
 Initializing cgroup subsys cpu
-Linux version 3.18.5+ (compiler@fold) (gcc version 4.8.4 20140605 (prerelease) (GCC) ) #9 Fri Jan 30 20:53:39 GMT 2015
+Linux version 3.18.5+ (compiler@fold) (gcc version 4.8.4 20140605 (prerelease) (GCC) ) #1 Fri Jan 30 20:08:48 GMT 2015
 e820: BIOS-provided physical RAM map:
 BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
 BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
@@ -29,7 +29,7 @@
 APIC: switched to apic NOOP
 e820: [mem 0x20000000-0xffefffff] available for PCI devices
 Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 129950
-Kernel command line: BOOT_IMAGE=Linux.testing console=ttyS0,19200 root=/dev/sda1 netconsole=24183@192.168.14.1/eth0,24183@192.168.14.15/00:e0:81:c0:91:1b
+Kernel command line: auto BOOT_IMAGE=Linux console=ttyS0,19200 root=/dev/sda1 netconsole=24183@192.168.14.1/eth0,24183@192.168.14.15/00:e0:81:c0:91:1b
 PID hash table entries: 2048 (order: 1, 8192 bytes)
 Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
 Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
@@ -40,15 +40,15 @@
     vmalloc : 0xe0800000 - 0xfffa2000   ( 503 MB)
     lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
       .init : 0xc045b000 - 0xc048f000   ( 208 kB)
-      .data : 0xc0368dd5 - 0xc0459cc0   ( 963 kB)
-      .text : 0xc0100000 - 0xc0368dd5   (2467 kB)
+      .data : 0xc0368e15 - 0xc0459cc0   ( 963 kB)
+      .text : 0xc0100000 - 0xc0368e15   (2467 kB)
 Checking if this processor honours the WP bit even in supervisor mode...Ok.
 SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
 NR_IRQS:2304 nr_irqs:24 0
 console [ttyS0] enabled
 tsc: Fast TSC calibration using PIT
-tsc: Detected 499.923 MHz processor
-Calibrating delay loop (skipped), value calculated using timer frequency.. 999.84 BogoMIPS (lpj=4999230)
+tsc: Detected 499.914 MHz processor
+Calibrating delay loop (skipped), value calculated using timer frequency.. 999.82 BogoMIPS (lpj=4999140)
 pid_max: default: 32768 minimum: 101
 Security Framework initialized
 Yama: becoming mindful.
@@ -108,9 +108,10 @@
 Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
 loop: module loaded
 zram: Created 1 device(s) ...
-cs5535-gpio cs5535-gpio: reserved resource region [io  0x6100-0x61ff]
-cs5535-mfgpt cs5535-mfgpt: reserved resource region [io  0x6200-0x63ff]
-cs5535-mfgpt cs5535-mfgpt: 8 MFGPT timers available
+cs5535-gpio cs5535-gpio: can't request region
+cs5535-gpio: probe of cs5535-gpio failed with error -5
+cs5535-mfgpt cs5535-mfgpt: can't request region
+cs5535-mfgpt: probe of cs5535-mfgpt failed with error -5
 cs5535-mfd 0000:00:14.0: 5 devices registered.
 scsi host0: pata_cs5536
 scsi host1: pata_cs5536
@@ -143,16 +144,16 @@
 ehci-pci 0000:00:15.1: USB 2.0 started, EHCI 1.00
 ata1.00: configured for MWDMA2
 scsi 0:0:0:0: Direct-Access     ATA      SanDisk SDCFH2-0 4.32 PQ: 0 ANSI: 5
+hub 1-0:1.0: USB hub found
 sd 0:0:0:0: Attached scsi generic sg0 type 0
 sd 0:0:0:0: [sda] 4001760 512-byte logical blocks: (2.04 GB/1.90 GiB)
-hub 1-0:1.0: USB hub found
 hub 1-0:1.0: 4 ports detected
-sd 0:0:0:0: [sda] Write Protect is off
 ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
 ohci-pci: OHCI PCI platform driver
 ohci-pci 0000:00:15.0: OHCI PCI host controller
 ohci-pci 0000:00:15.0: new USB bus registered, assigned bus number 2
 ohci-pci 0000:00:15.0: irq 15, io mem 0xa0005000
+sd 0:0:0:0: [sda] Write Protect is off
 sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
  sda: sda1
 sd 0:0:0:0: [sda] Attached SCSI removable disk
@@ -162,12 +163,12 @@
 cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
 usbcore: registered new interface driver usb-storage
 i2c /dev entries driver
-cs5535-smb cs5535-smb: SCx200 device 'CS5535 ACB0' registered
+scx200_acb: can't allocate io 0x0-0x7
+cs5535-smb: probe of cs5535-smb failed with error -5
 pc87360: Device 0x09 not activated
-cs5535-mfgpt cs5535-mfgpt: registered timer 0
+geodewdt: No timers were available
 Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
-cs5535-mfgpt cs5535-mfgpt: registered timer 1
-cs5535-clockevt: Registering MFGPT timer as a clock event, using IRQ 7
+cs5535-clockevt: Could not allocate MFGPT timer
 GACT probability NOT on
 u32 classifier
     Performance counters on
@@ -179,11 +180,11 @@
 ip_tables: (C) 2000-2006 Netfilter Core Team
 TCP: cubic registered
 NET: Registered protocol family 10
+Switched to clocksource tsc
 ip6_tables: (C) 2000-2006 Netfilter Core Team
 sit: IPv6 over IPv4 tunneling driver
 NET: Registered protocol family 17
 Using IPI Shortcut mode
-Switched to clocksource tsc
 netpoll: netconsole: local port 24183
 netpoll: netconsole: local IPv4 address 192.168.14.1
 netpoll: netconsole: interface 'eth0'

.config:

CONFIG_X86_32=y
CONFIG_X86=y
CONFIG_INSTRUCTION_DECODER=y
CONFIG_PERF_EVENTS_INTEL_UNCORE=y
CONFIG_OUTPUT_FORMAT="elf32-i386"
CONFIG_ARCH_DEFCONFIG="arch/x86/configs/i386_defconfig"
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_HAVE_LATENCYTOP_SUPPORT=y
CONFIG_MMU=y
CONFIG_NEED_SG_DMA_LENGTH=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_ARCH_SUSPEND_POSSIBLE=y
CONFIG_ARCH_WANT_HUGE_PMD_SHARE=y
CONFIG_ARCH_WANT_GENERAL_HUGETLB=y
CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_X86_32_LAZY_GS=y
CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-ecx -fcall-saved-edx"
CONFIG_ARCH_SUPPORTS_UPROBES=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
CONFIG_IRQ_WORK=y
CONFIG_BUILDTIME_EXTABLE_SORT=y
CONFIG_BROKEN_ON_SMP=y
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_CROSS_COMPILE=""
CONFIG_LOCALVERSION=""
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_HAVE_KERNEL_LZO=y
CONFIG_HAVE_KERNEL_LZ4=y
CONFIG_KERNEL_GZIP=y
CONFIG_DEFAULT_HOSTNAME="fold"
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_SYSVIPC_SYSCTL=y
CONFIG_POSIX_MQUEUE=y
CONFIG_POSIX_MQUEUE_SYSCTL=y
CONFIG_FHANDLE=y
CONFIG_HAVE_ARCH_AUDITSYSCALL=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_GENERIC_IRQ_SHOW=y
CONFIG_GENERIC_IRQ_LEGACY_ALLOC_HWIRQ=y
CONFIG_IRQ_DOMAIN=y
CONFIG_IRQ_FORCED_THREADING=y
CONFIG_SPARSE_IRQ=y
CONFIG_CLOCKSOURCE_WATCHDOG=y
CONFIG_ARCH_CLOCKSOURCE_DATA=y
CONFIG_CLOCKSOURCE_VALIDATE_LAST_CYCLE=y
CONFIG_GENERIC_TIME_VSYSCALL=y
CONFIG_GENERIC_CLOCKEVENTS=y
CONFIG_GENERIC_CLOCKEVENTS_BUILD=y
CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
CONFIG_GENERIC_CMOS_UPDATE=y
CONFIG_TICK_ONESHOT=y
CONFIG_NO_HZ_COMMON=y
CONFIG_NO_HZ_IDLE=y
CONFIG_HIGH_RES_TIMERS=y
CONFIG_TICK_CPU_ACCOUNTING=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_TINY_RCU=y
CONFIG_LOG_BUF_SHIFT=14
CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
CONFIG_CGROUPS=y
CONFIG_CGROUP_SCHED=y
CONFIG_FAIR_GROUP_SCHED=y
CONFIG_SCHED_AUTOGROUP=y
CONFIG_RELAY=y
CONFIG_CC_OPTIMIZE_FOR_SIZE=y
CONFIG_SYSCTL=y
CONFIG_ANON_INODES=y
CONFIG_HAVE_UID16=y
CONFIG_SYSCTL_EXCEPTION_TRACE=y
CONFIG_HAVE_PCSPKR_PLATFORM=y
CONFIG_BPF=y
CONFIG_EXPERT=y
CONFIG_UID16=y
CONFIG_SYSCTL_SYSCALL=y
CONFIG_KALLSYMS=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SIGNALFD=y
CONFIG_TIMERFD=y
CONFIG_EVENTFD=y
CONFIG_SHMEM=y
CONFIG_AIO=y
CONFIG_ADVISE_SYSCALLS=y
CONFIG_PCI_QUIRKS=y
CONFIG_EMBEDDED=y
CONFIG_HAVE_PERF_EVENTS=y
CONFIG_PERF_EVENTS=y
CONFIG_VM_EVENT_COUNTERS=y
CONFIG_SLUB_DEBUG=y
CONFIG_SLUB=y
CONFIG_HAVE_OPROFILE=y
CONFIG_OPROFILE_NMI_TIMER=y
CONFIG_JUMP_LABEL=y
CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_ARCH_USE_BUILTIN_BSWAP=y
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_HAVE_KPROBES=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_KPROBES_ON_FTRACE=y
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_DMA_ATTRS=y
CONFIG_HAVE_DMA_CONTIGUOUS=y
CONFIG_GENERIC_SMP_IDLE_THREAD=y
CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
CONFIG_HAVE_DMA_API_DEBUG=y
CONFIG_HAVE_HW_BREAKPOINT=y
CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
CONFIG_HAVE_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_PERF_EVENTS_NMI=y
CONFIG_HAVE_PERF_REGS=y
CONFIG_HAVE_PERF_USER_STACK_DUMP=y
CONFIG_HAVE_ARCH_JUMP_LABEL=y
CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
CONFIG_HAVE_CMPXCHG_LOCAL=y
CONFIG_HAVE_CMPXCHG_DOUBLE=y
CONFIG_ARCH_WANT_IPC_PARSE_VERSION=y
CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
CONFIG_SECCOMP_FILTER=y
CONFIG_HAVE_CC_STACKPROTECTOR=y
CONFIG_CC_STACKPROTECTOR_NONE=y
CONFIG_HAVE_IRQ_TIME_ACCOUNTING=y
CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE=y
CONFIG_MODULES_USE_ELF_REL=y
CONFIG_CLONE_BACKWARDS=y
CONFIG_OLD_SIGSUSPEND3=y
CONFIG_OLD_SIGACTION=y
CONFIG_HAVE_GENERIC_DMA_COHERENT=y
CONFIG_SLABINFO=y
CONFIG_RT_MUTEXES=y
CONFIG_BASE_SMALL=0
CONFIG_BLOCK=y
CONFIG_BLK_DEV_BSG=y
CONFIG_PARTITION_ADVANCED=y
CONFIG_MSDOS_PARTITION=y
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_DEFAULT_DEADLINE=y
CONFIG_DEFAULT_IOSCHED="deadline"
CONFIG_INLINE_SPIN_UNLOCK_IRQ=y
CONFIG_INLINE_READ_UNLOCK=y
CONFIG_INLINE_READ_UNLOCK_IRQ=y
CONFIG_INLINE_WRITE_UNLOCK=y
CONFIG_INLINE_WRITE_UNLOCK_IRQ=y
CONFIG_ARCH_SUPPORTS_ATOMIC_RMW=y
CONFIG_ARCH_USE_QUEUE_RWLOCK=y
CONFIG_ZONE_DMA=y
CONFIG_X86_FEATURE_NAMES=y
CONFIG_X86_MPPARSE=y
CONFIG_IOSF_MBI=y
CONFIG_SCHED_OMIT_FRAME_POINTER=y
CONFIG_NO_BOOTMEM=y
CONFIG_MGEODE_LX=y
CONFIG_X86_INTERNODE_CACHE_SHIFT=5
CONFIG_X86_L1_CACHE_SHIFT=5
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_X86_USE_3DNOW=y
CONFIG_X86_TSC=y
CONFIG_X86_CMOV=y
CONFIG_X86_MINIMUM_CPU_FAMILY=4
CONFIG_X86_DEBUGCTLMSR=y
CONFIG_CPU_SUP_INTEL=y
CONFIG_CPU_SUP_CYRIX_32=y
CONFIG_CPU_SUP_AMD=y
CONFIG_CPU_SUP_CENTAUR=y
CONFIG_CPU_SUP_TRANSMETA_32=y
CONFIG_CPU_SUP_UMC_32=y
CONFIG_NR_CPUS=1
CONFIG_PREEMPT_NONE=y
CONFIG_X86_UP_APIC=y
CONFIG_X86_UP_APIC_MSI=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_VM86=y
CONFIG_X86_MSR=y
CONFIG_X86_CPUID=y
CONFIG_NOHIGHMEM=y
CONFIG_VMSPLIT_3G=y
CONFIG_PAGE_OFFSET=0xC0000000
CONFIG_ARCH_FLATMEM_ENABLE=y
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_ILLEGAL_POINTER_VALUE=0
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_FLATMEM_MANUAL=y
CONFIG_FLATMEM=y
CONFIG_FLAT_NODE_MEM_MAP=y
CONFIG_SPARSEMEM_STATIC=y
CONFIG_HAVE_MEMBLOCK=y
CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
CONFIG_ARCH_DISCARD_MEMBLOCK=y
CONFIG_PAGEFLAGS_EXTENDED=y
CONFIG_SPLIT_PTLOCK_CPUS=4
CONFIG_ZONE_DMA_FLAG=1
CONFIG_BOUNCE=y
CONFIG_VIRT_TO_BUS=y
CONFIG_DEFAULT_MMAP_MIN_ADDR=4096
CONFIG_NEED_PER_CPU_KM=y
CONFIG_ZSMALLOC=y
CONFIG_GENERIC_EARLY_IOREMAP=y
CONFIG_X86_RESERVE_LOW=4
CONFIG_SECCOMP=y
CONFIG_HZ_100=y
CONFIG_HZ=100
CONFIG_SCHED_HRTICK=y
CONFIG_PHYSICAL_START=0x100000
CONFIG_PHYSICAL_ALIGN=0x100000
CONFIG_PCI=y
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_DOMAINS=y
CONFIG_PCI_MSI=y
CONFIG_ISA_DMA_API=y
CONFIG_SCx200=y
CONFIG_SCx200HR_TIMER=y
CONFIG_NET5501=y
CONFIG_AMD_NB=y
CONFIG_BINFMT_ELF=y
CONFIG_ARCH_BINFMT_ELF_RANDOMIZE_PIE=y
CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=y
CONFIG_BINFMT_SCRIPT=y
CONFIG_HAVE_AOUT=y
CONFIG_BINFMT_MISC=y
CONFIG_COREDUMP=y
CONFIG_HAVE_ATOMIC_IOMAP=y
CONFIG_PMC_ATOM=y
CONFIG_NET=y
CONFIG_PACKET=y
CONFIG_PACKET_DIAG=y
CONFIG_UNIX=y
CONFIG_UNIX_DIAG=y
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_ADVANCED_ROUTER=y
CONFIG_IP_MULTIPLE_TABLES=y
CONFIG_IP_ROUTE_MULTIPATH=y
CONFIG_IP_ROUTE_CLASSID=y
CONFIG_NET_IP_TUNNEL=y
CONFIG_SYN_COOKIES=y
CONFIG_INET_TUNNEL=y
CONFIG_INET_DIAG=y
CONFIG_INET_TCP_DIAG=y
CONFIG_INET_UDP_DIAG=y
CONFIG_TCP_CONG_ADVANCED=y
CONFIG_TCP_CONG_CUBIC=y
CONFIG_DEFAULT_CUBIC=y
CONFIG_DEFAULT_TCP_CONG="cubic"
CONFIG_IPV6=y
CONFIG_IPV6_SIT=y
CONFIG_IPV6_NDISC_NODETYPE=y
CONFIG_NETFILTER=y
CONFIG_NETFILTER_ADVANCED=y
CONFIG_NETFILTER_NETLINK=y
CONFIG_NETFILTER_NETLINK_ACCT=y
CONFIG_NF_CONNTRACK=y
CONFIG_NF_LOG_COMMON=y
CONFIG_NF_CONNTRACK_MARK=y
CONFIG_NF_CONNTRACK_TIMEOUT=y
CONFIG_NF_CT_PROTO_DCCP=y
CONFIG_NF_CT_PROTO_UDPLITE=y
CONFIG_NF_CONNTRACK_FTP=y
CONFIG_NF_CONNTRACK_IRC=y
CONFIG_NF_CONNTRACK_BROADCAST=y
CONFIG_NF_CONNTRACK_SNMP=y
CONFIG_NF_CONNTRACK_SIP=y
CONFIG_NF_CT_NETLINK=y
CONFIG_NF_CT_NETLINK_TIMEOUT=y
CONFIG_NF_NAT=y
CONFIG_NF_NAT_NEEDED=y
CONFIG_NF_NAT_PROTO_DCCP=y
CONFIG_NF_NAT_PROTO_UDPLITE=y
CONFIG_NF_NAT_FTP=y
CONFIG_NF_NAT_IRC=y
CONFIG_NF_NAT_SIP=y
CONFIG_NETFILTER_XTABLES=y
CONFIG_NETFILTER_XT_TARGET_CLASSIFY=y
CONFIG_NETFILTER_XT_TARGET_DSCP=y
CONFIG_NETFILTER_XT_TARGET_LOG=y
CONFIG_NETFILTER_XT_NAT=y
CONFIG_NETFILTER_XT_TARGET_REDIRECT=y
CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=y
CONFIG_NETFILTER_XT_MATCH_DSCP=y
CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=y
CONFIG_NETFILTER_XT_MATCH_HELPER=y
CONFIG_NETFILTER_XT_MATCH_IPRANGE=y
CONFIG_NETFILTER_XT_MATCH_LIMIT=y
CONFIG_NETFILTER_XT_MATCH_MULTIPORT=y
CONFIG_NETFILTER_XT_MATCH_NFACCT=y
CONFIG_NETFILTER_XT_MATCH_OWNER=y
CONFIG_NETFILTER_XT_MATCH_PKTTYPE=y
CONFIG_NETFILTER_XT_MATCH_QUOTA=y
CONFIG_NETFILTER_XT_MATCH_STATE=y
CONFIG_NF_DEFRAG_IPV4=y
CONFIG_NF_CONNTRACK_IPV4=y
CONFIG_NF_LOG_IPV4=y
CONFIG_NF_REJECT_IPV4=y
CONFIG_NF_NAT_IPV4=y
CONFIG_IP_NF_IPTABLES=y
CONFIG_IP_NF_FILTER=y
CONFIG_IP_NF_TARGET_REJECT=y
CONFIG_IP_NF_NAT=y
CONFIG_IP_NF_TARGET_REDIRECT=y
CONFIG_IP_NF_MANGLE=y
CONFIG_NF_DEFRAG_IPV6=y
CONFIG_NF_CONNTRACK_IPV6=y
CONFIG_NF_REJECT_IPV6=y
CONFIG_NF_LOG_IPV6=y
CONFIG_IP6_NF_IPTABLES=y
CONFIG_IP6_NF_FILTER=y
CONFIG_IP6_NF_TARGET_REJECT=y
CONFIG_IP6_NF_MANGLE=y
CONFIG_HAVE_NET_DSA=y
CONFIG_NET_SCHED=y
CONFIG_NET_SCH_CBQ=y
CONFIG_NET_SCH_HTB=y
CONFIG_NET_SCH_HFSC=y
CONFIG_NET_SCH_PRIO=y
CONFIG_NET_SCH_RED=y
CONFIG_NET_SCH_SFQ=y
CONFIG_NET_SCH_TEQL=y
CONFIG_NET_SCH_TBF=y
CONFIG_NET_SCH_GRED=y
CONFIG_NET_SCH_DSMARK=y
CONFIG_NET_SCH_INGRESS=y
CONFIG_NET_CLS=y
CONFIG_NET_CLS_BASIC=y
CONFIG_NET_CLS_TCINDEX=y
CONFIG_NET_CLS_ROUTE4=y
CONFIG_NET_CLS_FW=y
CONFIG_NET_CLS_U32=y
CONFIG_CLS_U32_PERF=y
CONFIG_CLS_U32_MARK=y
CONFIG_NET_CLS_RSVP=y
CONFIG_NET_EMATCH=y
CONFIG_NET_EMATCH_STACK=32
CONFIG_NET_EMATCH_CMP=y
CONFIG_NET_EMATCH_NBYTE=y
CONFIG_NET_EMATCH_U32=y
CONFIG_NET_EMATCH_META=y
CONFIG_NET_CLS_ACT=y
CONFIG_NET_ACT_POLICE=y
CONFIG_NET_ACT_GACT=y
CONFIG_NET_ACT_PEDIT=y
CONFIG_NET_SCH_FIFO=y
CONFIG_NETLINK_DIAG=y
CONFIG_NET_RX_BUSY_POLL=y
CONFIG_BQL=y
CONFIG_FIB_RULES=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=y
CONFIG_FIRMWARE_IN_KERNEL=y
CONFIG_EXTRA_FIRMWARE=""
CONFIG_GENERIC_CPU_AUTOPROBE=y
CONFIG_ARCH_MIGHT_HAVE_PC_PARPORT=y
CONFIG_BLK_DEV=y
CONFIG_ZRAM=y
CONFIG_BLK_DEV_LOOP=y
CONFIG_BLK_DEV_LOOP_MIN_COUNT=8
CONFIG_BLK_DEV_CRYPTOLOOP=y
CONFIG_CS5535_MFGPT=y
CONFIG_CS5535_MFGPT_DEFAULT_IRQ=7
CONFIG_CS5535_CLOCK_EVENT_SRC=y
CONFIG_HAVE_IDE=y
CONFIG_SCSI_MOD=y
CONFIG_SCSI=y
CONFIG_SCSI_DMA=y
CONFIG_BLK_DEV_SD=y
CONFIG_CHR_DEV_SG=y
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_SCAN_ASYNC=y
CONFIG_SCSI_SPI_ATTRS=y
CONFIG_ATA=y
CONFIG_ATA_VERBOSE_ERROR=y
CONFIG_ATA_SFF=y
CONFIG_ATA_BMDMA=y
CONFIG_PATA_CS5536=y
CONFIG_NETDEVICES=y
CONFIG_MII=y
CONFIG_NET_CORE=y
CONFIG_DUMMY=y
CONFIG_NETCONSOLE=y
CONFIG_NETPOLL=y
CONFIG_NET_POLL_CONTROLLER=y
CONFIG_ETHERNET=y
CONFIG_NET_VENDOR_VIA=y
CONFIG_VIA_RHINE=y
CONFIG_VIA_RHINE_MMIO=y
CONFIG_ARCH_MIGHT_HAVE_PC_SERIO=y
CONFIG_TTY=y
CONFIG_UNIX98_PTYS=y
CONFIG_SERIAL_EARLYCON=y
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_SERIAL_8250_PCI=y
CONFIG_SERIAL_8250_NR_UARTS=1
CONFIG_SERIAL_8250_RUNTIME_UARTS=1
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_HW_RANDOM=y
CONFIG_HW_RANDOM_GEODE=y
CONFIG_HANGCHECK_TIMER=y
CONFIG_DEVPORT=y
CONFIG_I2C=y
CONFIG_I2C_BOARDINFO=y
CONFIG_I2C_CHARDEV=y
CONFIG_I2C_HELPER_AUTO=y
CONFIG_SCx200_ACB=y
CONFIG_ARCH_WANT_OPTIONAL_GPIOLIB=y
CONFIG_GPIOLIB=y
CONFIG_GPIO_DEVRES=y
CONFIG_GPIO_SYSFS=y
CONFIG_GPIO_CS5535=y
CONFIG_HWMON=y
CONFIG_HWMON_VID=y
CONFIG_SENSORS_PC87360=y
CONFIG_WATCHDOG=y
CONFIG_WATCHDOG_CORE=y
CONFIG_GEODE_WDT=y
CONFIG_SSB_POSSIBLE=y
CONFIG_BCMA_POSSIBLE=y
CONFIG_MFD_CORE=y
CONFIG_MFD_CS5535=y
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
CONFIG_USB_SUPPORT=y
CONFIG_USB_COMMON=y
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB=y
CONFIG_USB_DEFAULT_PERSIST=y
CONFIG_USB_DYNAMIC_MINORS=y
CONFIG_USB_EHCI_HCD=y
CONFIG_USB_EHCI_PCI=y
CONFIG_USB_OHCI_HCD=y
CONFIG_USB_OHCI_HCD_PCI=y
CONFIG_USB_ACM=y
CONFIG_USB_STORAGE=y
CONFIG_RTC_LIB=y
CONFIG_STAGING=y
CONFIG_CLKSRC_I8253=y
CONFIG_CLKEVT_I8253=y
CONFIG_CLKBLD_I8253=y
CONFIG_DCACHE_WORD_ACCESS=y
CONFIG_EXT2_FS=y
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
CONFIG_EXT2_FS_SECURITY=y
CONFIG_FS_MBCACHE=y
CONFIG_FS_POSIX_ACL=y
CONFIG_EXPORTFS=y
CONFIG_FILE_LOCKING=y
CONFIG_FSNOTIFY=y
CONFIG_DNOTIFY=y
CONFIG_INOTIFY_USER=y
CONFIG_QUOTA=y
CONFIG_PRINT_QUOTA_WARNING=y
CONFIG_QUOTA_TREE=y
CONFIG_QFMT_V2=y
CONFIG_QUOTACTL=y
CONFIG_PROC_FS=y
CONFIG_PROC_SYSCTL=y
CONFIG_PROC_PAGE_MONITOR=y
CONFIG_KERNFS=y
CONFIG_SYSFS=y
CONFIG_TMPFS=y
CONFIG_TMPFS_POSIX_ACL=y
CONFIG_TMPFS_XATTR=y
CONFIG_NETWORK_FILESYSTEMS=y
CONFIG_NFS_FS=y
CONFIG_NFS_V3=y
CONFIG_NFS_V3_ACL=y
CONFIG_NFS_SWAP=y
CONFIG_GRACE_PERIOD=y
CONFIG_LOCKD=y
CONFIG_LOCKD_V4=y
CONFIG_NFS_ACL_SUPPORT=y
CONFIG_NFS_COMMON=y
CONFIG_SUNRPC=y
CONFIG_SUNRPC_SWAP=y
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="utf8"
CONFIG_NLS_CODEPAGE_437=y
CONFIG_NLS_CODEPAGE_850=y
CONFIG_NLS_CODEPAGE_852=y
CONFIG_NLS_ASCII=y
CONFIG_NLS_ISO8859_1=y
CONFIG_NLS_ISO8859_2=y
CONFIG_NLS_ISO8859_15=y
CONFIG_NLS_UTF8=y
CONFIG_TRACE_IRQFLAGS_SUPPORT=y
CONFIG_PRINTK_TIME=y
CONFIG_MESSAGE_LOGLEVEL_DEFAULT=4
CONFIG_ENABLE_WARN_DEPRECATED=y
CONFIG_ENABLE_MUST_CHECK=y
CONFIG_FRAME_WARN=1024
CONFIG_STRIP_ASM_SYMS=y
CONFIG_ARCH_WANT_FRAME_POINTERS=y
CONFIG_DEBUG_KERNEL=y
CONFIG_HAVE_DEBUG_KMEMLEAK=y
CONFIG_HAVE_DEBUG_STACKOVERFLOW=y
CONFIG_HAVE_ARCH_KMEMCHECK=y
CONFIG_DETECT_HUNG_TASK=y
CONFIG_DEFAULT_HUNG_TASK_TIMEOUT=120
CONFIG_BOOTPARAM_HUNG_TASK_PANIC_VALUE=0
CONFIG_PANIC_ON_OOPS=y
CONFIG_PANIC_ON_OOPS_VALUE=1
CONFIG_PANIC_TIMEOUT=5
CONFIG_SCHED_STACK_END_CHECK=y
CONFIG_DEBUG_BUGVERBOSE=y
CONFIG_ARCH_HAS_DEBUG_STRICT_USER_COPY_CHECKS=y
CONFIG_USER_STACKTRACE_SUPPORT=y
CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HAVE_FUNCTION_GRAPH_FP_TEST=y
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_HAVE_DYNAMIC_FTRACE_WITH_REGS=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
CONFIG_HAVE_C_RECORDMCOUNT=y
CONFIG_TRACING_SUPPORT=y
CONFIG_HAVE_ARCH_KGDB=y
CONFIG_STRICT_DEVMEM=y
CONFIG_DEBUG_RODATA=y
CONFIG_DOUBLEFAULT=y
CONFIG_HAVE_MMIOTRACE_SUPPORT=y
CONFIG_IO_DELAY_TYPE_0X80=0
CONFIG_IO_DELAY_TYPE_0XED=1
CONFIG_IO_DELAY_TYPE_UDELAY=2
CONFIG_IO_DELAY_TYPE_NONE=3
CONFIG_IO_DELAY_0X80=y
CONFIG_DEFAULT_IO_DELAY_TYPE=0
CONFIG_SECURITY_DMESG_RESTRICT=y
CONFIG_SECURITY=y
CONFIG_SECURITYFS=y
CONFIG_SECURITY_PATH=y
CONFIG_SECURITY_YAMA=y
CONFIG_SECURITY_YAMA_STACKED=y
CONFIG_DEFAULT_SECURITY_YAMA=y
CONFIG_DEFAULT_SECURITY="yama"
CONFIG_CRYPTO=y
CONFIG_CRYPTO_ALGAPI=y
CONFIG_CRYPTO_ALGAPI2=y
CONFIG_CRYPTO_AEAD2=y
CONFIG_CRYPTO_BLKCIPHER=y
CONFIG_CRYPTO_BLKCIPHER2=y
CONFIG_CRYPTO_HASH2=y
CONFIG_CRYPTO_RNG2=y
CONFIG_CRYPTO_PCOMP2=y
CONFIG_CRYPTO_MANAGER=y
CONFIG_CRYPTO_MANAGER2=y
CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y
CONFIG_CRYPTO_WORKQUEUE=y
CONFIG_CRYPTO_CBC=y
CONFIG_CRYPTO_AES=y
CONFIG_CRYPTO_HW=y
CONFIG_CRYPTO_DEV_GEODE=y
CONFIG_HAVE_KVM=y
CONFIG_BITREVERSE=y
CONFIG_GENERIC_STRNCPY_FROM_USER=y
CONFIG_GENERIC_STRNLEN_USER=y
CONFIG_GENERIC_NET_UTILS=y
CONFIG_GENERIC_FIND_FIRST_BIT=y
CONFIG_GENERIC_PCI_IOMAP=y
CONFIG_GENERIC_IOMAP=y
CONFIG_GENERIC_IO=y
CONFIG_ARCH_HAS_FAST_MULTIPLIER=y
CONFIG_CRC32=y
CONFIG_CRC32_SLICEBY8=y
CONFIG_LZO_COMPRESS=y
CONFIG_LZO_DECOMPRESS=y
CONFIG_HAS_IOMEM=y
CONFIG_HAS_IOPORT_MAP=y
CONFIG_HAS_DMA=y
CONFIG_DQL=y
CONFIG_GLOB=y
CONFIG_NLATTR=y
CONFIG_ARCH_HAS_ATOMIC64_DEC_IF_POSITIVE=y
CONFIG_ARCH_HAS_SG_CHAIN=y

-- 
NULL && (void)

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed
  2015-01-30 21:12 [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed Nix
@ 2015-02-02  3:29 ` Myron Stowe
  2015-02-02 17:36   ` Nix
  0 siblings, 1 reply; 7+ messages in thread
From: Myron Stowe @ 2015-02-02  3:29 UTC (permalink / raw)
  To: Nix
  Cc: linux-pci, Linux Kernel Mailing List, myron.stowe, unruh, martin,
	bhelgaas, willy, gregkh

[+cc: linux-pci for visibility]

On Fri, 2015-01-30 at 21:12 +0000, Nix wrote:
> As of 3.18.3, the watchdog timer, high-res timers, etc on my Soekris
> net5501 no longer work.
> 
> dmesg says:
> 
> [    1.465681] scx200_acb: can't allocate io 0x0-0x7
> [    1.473909] cs5535-smb: probe of cs5535-smb failed with error -5
> [    1.479991] pc87360: Device 0x09 not activated
> [    1.488237] geodewdt: No timers were available
> [    1.505612] Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
> [    1.511699] cs5535-clockevt: Could not allocate MFGPT timer
> 
> rather than the expected
> 
> [    1.465987] cs5535-smb cs5535-smb: SCx200 device 'CS5535 ACB0' registered
> [    1.466747] pc87360: Device 0x09 not activated
> [    1.484989] cs5535-mfgpt cs5535-mfgpt: registered timer 0
> [    1.488096] Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
> [    1.504232] cs5535-mfgpt cs5535-mfgpt: registered timer 1
> [    1.506634] cs5535-clockevt: Registering MFGPT timer as a clock event, using IRQ 7
> 
> Bisected to:
> 
> commit efdb9b956aa06868a052f0d4387f5f34e2321e41
> Author: Myron Stowe <myron.stowe@redhat.com>
> Date:   Thu Oct 30 11:54:37 2014 -0600
> 
>     PCI: Restore detection of read-only BARs
> 
>     commit 36e8164882ca6d3c41cb91e6f09a3ed236841f80 upstream.
> 
> before which everything works OK. (Bisection confirmed by reverting this
> commit, following which everything works again.)
> 
> /proc/ioports in a good boot:
> 
> 0000-001f : dma1
>   0000-0000 : cs5535-acpi
>     0000-0000 : cs5535-pms
> 0020-0021 : pic1
> 0040-0043 : timer0
> 0050-0053 : timer1
> 0060-0060 : keyboard
> 0064-0064 : keyboard
> 0070-0071 : rtc_cmos
> 0080-008f : dma page reg
> 00a0-00a1 : pic2
> 00c0-00df : dma2
> 00f0-00ff : fpu
> 0170-0177 : 0000:00:14.2
> 01f0-01f7 : 0000:00:14.2
>   01f0-01f7 : pata_cs5536
> 0376-0376 : 0000:00:14.2
> 03f6-03f6 : 0000:00:14.2
>   03f6-03f6 : pata_cs5536
> 03f8-03ff : serial
> 0cf8-0cff : PCI conf1
> 6000-6007 : cs5535-smb
>   6000-6007 : 0000:00:14.0
>     6000-6007 : CS5535 ACB0
> 6100-61ff : cs5535-gpio
>   6100-61ff : 0000:00:14.0
>     6100-61ff : cs5535-gpio
> 6200-63ff : cs5535-mfgpt
>   6200-63ff : 0000:00:14.0
>     6200-63ff : cs5535-mfgpt
> 6620-662f : pc87360
>   6620-662f : pc87360
> 6640-664f : pc87360
>   6640-664f : pc87360
> d000-dfff : PCI Bus 0000:01
>   d000-d0ff : 0000:01:00.0
>     d000-d0ff : via-rhine
>   d100-d1ff : 0000:01:01.0
>     d100-d1ff : via-rhine
>   d200-d2ff : 0000:01:02.0
>     d200-d2ff : via-rhine
>   d300-d3ff : 0000:01:03.0
>     d300-d3ff : via-rhine
> e000-e00f : 0000:00:14.2
>   e000-e00f : pata_cs5536
> e100-e1ff : 0000:00:06.0
>   e100-e1ff : via-rhine
> e200-e2ff : 0000:00:07.0
>   e200-e2ff : via-rhine
> e300-e3ff : 0000:00:08.0
>   e300-e3ff : via-rhine
> e400-e4ff : 0000:00:09.0
>   e400-e4ff : via-rhine
> 
> Bad boot:
> 
> 0000-001f : dma1
>   0000-0007 : cs5535-smb
>     0000-0000 : cs5535-acpi
>       0000-0000 : cs5535-pms
>         0000-0000 : cs5535-mfgpt
>           0000-0000 : cs5535-gpio
> 0020-0021 : pic1
> 0040-0043 : timer0
> 0050-0053 : timer1
> 0060-0060 : keyboard
> 0064-0064 : keyboard
> 0070-0071 : rtc_cmos
> 0080-008f : dma page reg
> 00a0-00a1 : pic2
> 00c0-00df : dma2
> 00f0-00ff : fpu
> 0170-0177 : 0000:00:14.2
> 01f0-01f7 : 0000:00:14.2
>   01f0-01f7 : pata_cs5536
> 0376-0376 : 0000:00:14.2
> 03f6-03f6 : 0000:00:14.2
>   03f6-03f6 : pata_cs5536
> 03f8-03ff : serial
> 0cf8-0cff : PCI conf1
> 6620-662f : pc87360
>   6620-662f : pc87360
> 6640-664f : pc87360
>   6640-664f : pc87360
> d000-dfff : PCI Bus 0000:01
>   d000-d0ff : 0000:01:00.0
>     d000-d0ff : via-rhine
>   d100-d1ff : 0000:01:01.0
>     d100-d1ff : via-rhine
>   d200-d2ff : 0000:01:02.0
>     d200-d2ff : via-rhine
>   d300-d3ff : 0000:01:03.0
>     d300-d3ff : via-rhine
> e000-e00f : 0000:00:14.2
>   e000-e00f : pata_cs5536
> e100-e1ff : 0000:00:06.0
>   e100-e1ff : via-rhine
> e200-e2ff : 0000:00:07.0
>   e200-e2ff : via-rhine
> e300-e3ff : 0000:00:08.0
>   e300-e3ff : via-rhine
> e400-e4ff : 0000:00:09.0
>   e400-e4ff : via-rhine
> 
> A diff shows what I can only describe as an ioports traffic jam:
> 
> --- /tmp/good-ioports	2015-01-30 21:01:42.724692790 +0000
> +++ /tmp/bad-ioports	2015-01-30 21:01:51.803954107 +0000
> @@ -1,6 +1,9 @@
>  0000-001f : dma1
> -  0000-0000 : cs5535-acpi
> -    0000-0000 : cs5535-pms
> +  0000-0007 : cs5535-smb
> +    0000-0000 : cs5535-acpi
> +      0000-0000 : cs5535-pms
> +        0000-0000 : cs5535-mfgpt
> +          0000-0000 : cs5535-gpio
>  0020-0021 : pic1
>  0040-0043 : timer0
>  0050-0053 : timer1
> @@ -19,15 +22,6 @@
>    03f6-03f6 : pata_cs5536
>  03f8-03ff : serial
>  0cf8-0cff : PCI conf1
> -6000-6007 : cs5535-smb
> -  6000-6007 : 0000:00:14.0
> -    6000-6007 : CS5535 ACB0
> -6100-61ff : cs5535-gpio
> -  6100-61ff : 0000:00:14.0
> -    6100-61ff : cs5535-gpio
> -6200-63ff : cs5535-mfgpt
> -  6200-63ff : 0000:00:14.0
> -    6200-63ff : cs5535-mfgpt
>  6620-662f : pc87360
>    6620-662f : pc87360
>  6640-664f : pc87360
> 
> A diff between good and bad boot output is not very edifying: all we
> really see is ordering differences, address differences and things
> dropping out of the log because of the absent hardware (mostly, I think,
> the different time source because we're forced to fall back to the PIT
> rather than using the nice fast cs5535-clockevt):

Nix:

Thanks for the work you've already done with the bisection.  Let's see
if we can get to the bottom of this.  Would you capture two couple sets
of logs, one without the issue and another set with the commit at issue
included for comparison.

For each set please capture:
        a 'dmesg' log with the kernel boot parameters 'debug' and
        'ignore_loglevel' added (the entire log from booting),
        a capture of 'lspci -t',
        and a capture of 'lspci -vvv'.
        
I'll open a BZ for this issue tomorrow which we can use to attach the
logs while tracking this down.

Thanks,
 Myron
> 
> --- /tmp/good-boot	2015-01-30 20:57:36.464752599 +0000
> +++ /tmp/bad-boot	2015-01-30 20:50:12.541106428 +0000
> @@ -1,5 +1,5 @@
>  Initializing cgroup subsys cpu
> -Linux version 3.18.5+ (compiler@fold) (gcc version 4.8.4 20140605 (prerelease) (GCC) ) #9 Fri Jan 30 20:53:39 GMT 2015
> +Linux version 3.18.5+ (compiler@fold) (gcc version 4.8.4 20140605 (prerelease) (GCC) ) #1 Fri Jan 30 20:08:48 GMT 2015
>  e820: BIOS-provided physical RAM map:
>  BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
>  BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
> @@ -29,7 +29,7 @@
>  APIC: switched to apic NOOP
>  e820: [mem 0x20000000-0xffefffff] available for PCI devices
>  Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 129950
> -Kernel command line: BOOT_IMAGE=Linux.testing console=ttyS0,19200 root=/dev/sda1 netconsole=24183@192.168.14.1/eth0,24183@192.168.14.15/00:e0:81:c0:91:1b
> +Kernel command line: auto BOOT_IMAGE=Linux console=ttyS0,19200 root=/dev/sda1 netconsole=24183@192.168.14.1/eth0,24183@192.168.14.15/00:e0:81:c0:91:1b
>  PID hash table entries: 2048 (order: 1, 8192 bytes)
>  Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
>  Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
> @@ -40,15 +40,15 @@
>      vmalloc : 0xe0800000 - 0xfffa2000   ( 503 MB)
>      lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
>        .init : 0xc045b000 - 0xc048f000   ( 208 kB)
> -      .data : 0xc0368dd5 - 0xc0459cc0   ( 963 kB)
> -      .text : 0xc0100000 - 0xc0368dd5   (2467 kB)
> +      .data : 0xc0368e15 - 0xc0459cc0   ( 963 kB)
> +      .text : 0xc0100000 - 0xc0368e15   (2467 kB)
>  Checking if this processor honours the WP bit even in supervisor mode...Ok.
>  SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
>  NR_IRQS:2304 nr_irqs:24 0
>  console [ttyS0] enabled
>  tsc: Fast TSC calibration using PIT
> -tsc: Detected 499.923 MHz processor
> -Calibrating delay loop (skipped), value calculated using timer frequency.. 999.84 BogoMIPS (lpj=4999230)
> +tsc: Detected 499.914 MHz processor
> +Calibrating delay loop (skipped), value calculated using timer frequency.. 999.82 BogoMIPS (lpj=4999140)
>  pid_max: default: 32768 minimum: 101
>  Security Framework initialized
>  Yama: becoming mindful.
> @@ -108,9 +108,10 @@
>  Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
>  loop: module loaded
>  zram: Created 1 device(s) ...
> -cs5535-gpio cs5535-gpio: reserved resource region [io  0x6100-0x61ff]
> -cs5535-mfgpt cs5535-mfgpt: reserved resource region [io  0x6200-0x63ff]
> -cs5535-mfgpt cs5535-mfgpt: 8 MFGPT timers available
> +cs5535-gpio cs5535-gpio: can't request region
> +cs5535-gpio: probe of cs5535-gpio failed with error -5
> +cs5535-mfgpt cs5535-mfgpt: can't request region
> +cs5535-mfgpt: probe of cs5535-mfgpt failed with error -5
>  cs5535-mfd 0000:00:14.0: 5 devices registered.
>  scsi host0: pata_cs5536
>  scsi host1: pata_cs5536
> @@ -143,16 +144,16 @@
>  ehci-pci 0000:00:15.1: USB 2.0 started, EHCI 1.00
>  ata1.00: configured for MWDMA2
>  scsi 0:0:0:0: Direct-Access     ATA      SanDisk SDCFH2-0 4.32 PQ: 0 ANSI: 5
> +hub 1-0:1.0: USB hub found
>  sd 0:0:0:0: Attached scsi generic sg0 type 0
>  sd 0:0:0:0: [sda] 4001760 512-byte logical blocks: (2.04 GB/1.90 GiB)
> -hub 1-0:1.0: USB hub found
>  hub 1-0:1.0: 4 ports detected
> -sd 0:0:0:0: [sda] Write Protect is off
>  ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
>  ohci-pci: OHCI PCI platform driver
>  ohci-pci 0000:00:15.0: OHCI PCI host controller
>  ohci-pci 0000:00:15.0: new USB bus registered, assigned bus number 2
>  ohci-pci 0000:00:15.0: irq 15, io mem 0xa0005000
> +sd 0:0:0:0: [sda] Write Protect is off
>  sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
>   sda: sda1
>  sd 0:0:0:0: [sda] Attached SCSI removable disk
> @@ -162,12 +163,12 @@
>  cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
>  usbcore: registered new interface driver usb-storage
>  i2c /dev entries driver
> -cs5535-smb cs5535-smb: SCx200 device 'CS5535 ACB0' registered
> +scx200_acb: can't allocate io 0x0-0x7
> +cs5535-smb: probe of cs5535-smb failed with error -5
>  pc87360: Device 0x09 not activated
> -cs5535-mfgpt cs5535-mfgpt: registered timer 0
> +geodewdt: No timers were available
>  Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
> -cs5535-mfgpt cs5535-mfgpt: registered timer 1
> -cs5535-clockevt: Registering MFGPT timer as a clock event, using IRQ 7
> +cs5535-clockevt: Could not allocate MFGPT timer
>  GACT probability NOT on
>  u32 classifier
>      Performance counters on
> @@ -179,11 +180,11 @@
>  ip_tables: (C) 2000-2006 Netfilter Core Team
>  TCP: cubic registered
>  NET: Registered protocol family 10
> +Switched to clocksource tsc
>  ip6_tables: (C) 2000-2006 Netfilter Core Team
>  sit: IPv6 over IPv4 tunneling driver
>  NET: Registered protocol family 17
>  Using IPI Shortcut mode
> -Switched to clocksource tsc
>  netpoll: netconsole: local port 24183
>  netpoll: netconsole: local IPv4 address 192.168.14.1
>  netpoll: netconsole: interface 'eth0'
> 
> .config:
> 
> CONFIG_X86_32=y
> CONFIG_X86=y
> CONFIG_INSTRUCTION_DECODER=y
> CONFIG_PERF_EVENTS_INTEL_UNCORE=y
> CONFIG_OUTPUT_FORMAT="elf32-i386"
> CONFIG_ARCH_DEFCONFIG="arch/x86/configs/i386_defconfig"
> CONFIG_LOCKDEP_SUPPORT=y
> CONFIG_STACKTRACE_SUPPORT=y
> CONFIG_HAVE_LATENCYTOP_SUPPORT=y
> CONFIG_MMU=y
> CONFIG_NEED_SG_DMA_LENGTH=y
> CONFIG_GENERIC_ISA_DMA=y
> CONFIG_GENERIC_BUG=y
> CONFIG_GENERIC_HWEIGHT=y
> CONFIG_ARCH_MAY_HAVE_PC_FDC=y
> CONFIG_RWSEM_XCHGADD_ALGORITHM=y
> CONFIG_GENERIC_CALIBRATE_DELAY=y
> CONFIG_ARCH_HAS_CPU_RELAX=y
> CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
> CONFIG_HAVE_SETUP_PER_CPU_AREA=y
> CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
> CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
> CONFIG_ARCH_HIBERNATION_POSSIBLE=y
> CONFIG_ARCH_SUSPEND_POSSIBLE=y
> CONFIG_ARCH_WANT_HUGE_PMD_SHARE=y
> CONFIG_ARCH_WANT_GENERAL_HUGETLB=y
> CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
> CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
> CONFIG_X86_32_LAZY_GS=y
> CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-ecx -fcall-saved-edx"
> CONFIG_ARCH_SUPPORTS_UPROBES=y
> CONFIG_FIX_EARLYCON_MEM=y
> CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config"
> CONFIG_IRQ_WORK=y
> CONFIG_BUILDTIME_EXTABLE_SORT=y
> CONFIG_BROKEN_ON_SMP=y
> CONFIG_INIT_ENV_ARG_LIMIT=32
> CONFIG_CROSS_COMPILE=""
> CONFIG_LOCALVERSION=""
> CONFIG_HAVE_KERNEL_GZIP=y
> CONFIG_HAVE_KERNEL_BZIP2=y
> CONFIG_HAVE_KERNEL_LZMA=y
> CONFIG_HAVE_KERNEL_XZ=y
> CONFIG_HAVE_KERNEL_LZO=y
> CONFIG_HAVE_KERNEL_LZ4=y
> CONFIG_KERNEL_GZIP=y
> CONFIG_DEFAULT_HOSTNAME="fold"
> CONFIG_SWAP=y
> CONFIG_SYSVIPC=y
> CONFIG_SYSVIPC_SYSCTL=y
> CONFIG_POSIX_MQUEUE=y
> CONFIG_POSIX_MQUEUE_SYSCTL=y
> CONFIG_FHANDLE=y
> CONFIG_HAVE_ARCH_AUDITSYSCALL=y
> CONFIG_GENERIC_IRQ_PROBE=y
> CONFIG_GENERIC_IRQ_SHOW=y
> CONFIG_GENERIC_IRQ_LEGACY_ALLOC_HWIRQ=y
> CONFIG_IRQ_DOMAIN=y
> CONFIG_IRQ_FORCED_THREADING=y
> CONFIG_SPARSE_IRQ=y
> CONFIG_CLOCKSOURCE_WATCHDOG=y
> CONFIG_ARCH_CLOCKSOURCE_DATA=y
> CONFIG_CLOCKSOURCE_VALIDATE_LAST_CYCLE=y
> CONFIG_GENERIC_TIME_VSYSCALL=y
> CONFIG_GENERIC_CLOCKEVENTS=y
> CONFIG_GENERIC_CLOCKEVENTS_BUILD=y
> CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
> CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
> CONFIG_GENERIC_CMOS_UPDATE=y
> CONFIG_TICK_ONESHOT=y
> CONFIG_NO_HZ_COMMON=y
> CONFIG_NO_HZ_IDLE=y
> CONFIG_HIGH_RES_TIMERS=y
> CONFIG_TICK_CPU_ACCOUNTING=y
> CONFIG_BSD_PROCESS_ACCT=y
> CONFIG_TINY_RCU=y
> CONFIG_LOG_BUF_SHIFT=14
> CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
> CONFIG_CGROUPS=y
> CONFIG_CGROUP_SCHED=y
> CONFIG_FAIR_GROUP_SCHED=y
> CONFIG_SCHED_AUTOGROUP=y
> CONFIG_RELAY=y
> CONFIG_CC_OPTIMIZE_FOR_SIZE=y
> CONFIG_SYSCTL=y
> CONFIG_ANON_INODES=y
> CONFIG_HAVE_UID16=y
> CONFIG_SYSCTL_EXCEPTION_TRACE=y
> CONFIG_HAVE_PCSPKR_PLATFORM=y
> CONFIG_BPF=y
> CONFIG_EXPERT=y
> CONFIG_UID16=y
> CONFIG_SYSCTL_SYSCALL=y
> CONFIG_KALLSYMS=y
> CONFIG_PRINTK=y
> CONFIG_BUG=y
> CONFIG_ELF_CORE=y
> CONFIG_BASE_FULL=y
> CONFIG_FUTEX=y
> CONFIG_EPOLL=y
> CONFIG_SIGNALFD=y
> CONFIG_TIMERFD=y
> CONFIG_EVENTFD=y
> CONFIG_SHMEM=y
> CONFIG_AIO=y
> CONFIG_ADVISE_SYSCALLS=y
> CONFIG_PCI_QUIRKS=y
> CONFIG_EMBEDDED=y
> CONFIG_HAVE_PERF_EVENTS=y
> CONFIG_PERF_EVENTS=y
> CONFIG_VM_EVENT_COUNTERS=y
> CONFIG_SLUB_DEBUG=y
> CONFIG_SLUB=y
> CONFIG_HAVE_OPROFILE=y
> CONFIG_OPROFILE_NMI_TIMER=y
> CONFIG_JUMP_LABEL=y
> CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
> CONFIG_ARCH_USE_BUILTIN_BSWAP=y
> CONFIG_HAVE_IOREMAP_PROT=y
> CONFIG_HAVE_KPROBES=y
> CONFIG_HAVE_KRETPROBES=y
> CONFIG_HAVE_OPTPROBES=y
> CONFIG_HAVE_KPROBES_ON_FTRACE=y
> CONFIG_HAVE_ARCH_TRACEHOOK=y
> CONFIG_HAVE_DMA_ATTRS=y
> CONFIG_HAVE_DMA_CONTIGUOUS=y
> CONFIG_GENERIC_SMP_IDLE_THREAD=y
> CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
> CONFIG_HAVE_DMA_API_DEBUG=y
> CONFIG_HAVE_HW_BREAKPOINT=y
> CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
> CONFIG_HAVE_USER_RETURN_NOTIFIER=y
> CONFIG_HAVE_PERF_EVENTS_NMI=y
> CONFIG_HAVE_PERF_REGS=y
> CONFIG_HAVE_PERF_USER_STACK_DUMP=y
> CONFIG_HAVE_ARCH_JUMP_LABEL=y
> CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
> CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
> CONFIG_HAVE_CMPXCHG_LOCAL=y
> CONFIG_HAVE_CMPXCHG_DOUBLE=y
> CONFIG_ARCH_WANT_IPC_PARSE_VERSION=y
> CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
> CONFIG_SECCOMP_FILTER=y
> CONFIG_HAVE_CC_STACKPROTECTOR=y
> CONFIG_CC_STACKPROTECTOR_NONE=y
> CONFIG_HAVE_IRQ_TIME_ACCOUNTING=y
> CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE=y
> CONFIG_MODULES_USE_ELF_REL=y
> CONFIG_CLONE_BACKWARDS=y
> CONFIG_OLD_SIGSUSPEND3=y
> CONFIG_OLD_SIGACTION=y
> CONFIG_HAVE_GENERIC_DMA_COHERENT=y
> CONFIG_SLABINFO=y
> CONFIG_RT_MUTEXES=y
> CONFIG_BASE_SMALL=0
> CONFIG_BLOCK=y
> CONFIG_BLK_DEV_BSG=y
> CONFIG_PARTITION_ADVANCED=y
> CONFIG_MSDOS_PARTITION=y
> CONFIG_IOSCHED_NOOP=y
> CONFIG_IOSCHED_DEADLINE=y
> CONFIG_DEFAULT_DEADLINE=y
> CONFIG_DEFAULT_IOSCHED="deadline"
> CONFIG_INLINE_SPIN_UNLOCK_IRQ=y
> CONFIG_INLINE_READ_UNLOCK=y
> CONFIG_INLINE_READ_UNLOCK_IRQ=y
> CONFIG_INLINE_WRITE_UNLOCK=y
> CONFIG_INLINE_WRITE_UNLOCK_IRQ=y
> CONFIG_ARCH_SUPPORTS_ATOMIC_RMW=y
> CONFIG_ARCH_USE_QUEUE_RWLOCK=y
> CONFIG_ZONE_DMA=y
> CONFIG_X86_FEATURE_NAMES=y
> CONFIG_X86_MPPARSE=y
> CONFIG_IOSF_MBI=y
> CONFIG_SCHED_OMIT_FRAME_POINTER=y
> CONFIG_NO_BOOTMEM=y
> CONFIG_MGEODE_LX=y
> CONFIG_X86_INTERNODE_CACHE_SHIFT=5
> CONFIG_X86_L1_CACHE_SHIFT=5
> CONFIG_X86_USE_PPRO_CHECKSUM=y
> CONFIG_X86_USE_3DNOW=y
> CONFIG_X86_TSC=y
> CONFIG_X86_CMOV=y
> CONFIG_X86_MINIMUM_CPU_FAMILY=4
> CONFIG_X86_DEBUGCTLMSR=y
> CONFIG_CPU_SUP_INTEL=y
> CONFIG_CPU_SUP_CYRIX_32=y
> CONFIG_CPU_SUP_AMD=y
> CONFIG_CPU_SUP_CENTAUR=y
> CONFIG_CPU_SUP_TRANSMETA_32=y
> CONFIG_CPU_SUP_UMC_32=y
> CONFIG_NR_CPUS=1
> CONFIG_PREEMPT_NONE=y
> CONFIG_X86_UP_APIC=y
> CONFIG_X86_UP_APIC_MSI=y
> CONFIG_X86_LOCAL_APIC=y
> CONFIG_X86_IO_APIC=y
> CONFIG_VM86=y
> CONFIG_X86_MSR=y
> CONFIG_X86_CPUID=y
> CONFIG_NOHIGHMEM=y
> CONFIG_VMSPLIT_3G=y
> CONFIG_PAGE_OFFSET=0xC0000000
> CONFIG_ARCH_FLATMEM_ENABLE=y
> CONFIG_ARCH_SPARSEMEM_ENABLE=y
> CONFIG_ARCH_SELECT_MEMORY_MODEL=y
> CONFIG_ILLEGAL_POINTER_VALUE=0
> CONFIG_SELECT_MEMORY_MODEL=y
> CONFIG_FLATMEM_MANUAL=y
> CONFIG_FLATMEM=y
> CONFIG_FLAT_NODE_MEM_MAP=y
> CONFIG_SPARSEMEM_STATIC=y
> CONFIG_HAVE_MEMBLOCK=y
> CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
> CONFIG_ARCH_DISCARD_MEMBLOCK=y
> CONFIG_PAGEFLAGS_EXTENDED=y
> CONFIG_SPLIT_PTLOCK_CPUS=4
> CONFIG_ZONE_DMA_FLAG=1
> CONFIG_BOUNCE=y
> CONFIG_VIRT_TO_BUS=y
> CONFIG_DEFAULT_MMAP_MIN_ADDR=4096
> CONFIG_NEED_PER_CPU_KM=y
> CONFIG_ZSMALLOC=y
> CONFIG_GENERIC_EARLY_IOREMAP=y
> CONFIG_X86_RESERVE_LOW=4
> CONFIG_SECCOMP=y
> CONFIG_HZ_100=y
> CONFIG_HZ=100
> CONFIG_SCHED_HRTICK=y
> CONFIG_PHYSICAL_START=0x100000
> CONFIG_PHYSICAL_ALIGN=0x100000
> CONFIG_PCI=y
> CONFIG_PCI_GOANY=y
> CONFIG_PCI_BIOS=y
> CONFIG_PCI_DIRECT=y
> CONFIG_PCI_DOMAINS=y
> CONFIG_PCI_MSI=y
> CONFIG_ISA_DMA_API=y
> CONFIG_SCx200=y
> CONFIG_SCx200HR_TIMER=y
> CONFIG_NET5501=y
> CONFIG_AMD_NB=y
> CONFIG_BINFMT_ELF=y
> CONFIG_ARCH_BINFMT_ELF_RANDOMIZE_PIE=y
> CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=y
> CONFIG_BINFMT_SCRIPT=y
> CONFIG_HAVE_AOUT=y
> CONFIG_BINFMT_MISC=y
> CONFIG_COREDUMP=y
> CONFIG_HAVE_ATOMIC_IOMAP=y
> CONFIG_PMC_ATOM=y
> CONFIG_NET=y
> CONFIG_PACKET=y
> CONFIG_PACKET_DIAG=y
> CONFIG_UNIX=y
> CONFIG_UNIX_DIAG=y
> CONFIG_INET=y
> CONFIG_IP_MULTICAST=y
> CONFIG_IP_ADVANCED_ROUTER=y
> CONFIG_IP_MULTIPLE_TABLES=y
> CONFIG_IP_ROUTE_MULTIPATH=y
> CONFIG_IP_ROUTE_CLASSID=y
> CONFIG_NET_IP_TUNNEL=y
> CONFIG_SYN_COOKIES=y
> CONFIG_INET_TUNNEL=y
> CONFIG_INET_DIAG=y
> CONFIG_INET_TCP_DIAG=y
> CONFIG_INET_UDP_DIAG=y
> CONFIG_TCP_CONG_ADVANCED=y
> CONFIG_TCP_CONG_CUBIC=y
> CONFIG_DEFAULT_CUBIC=y
> CONFIG_DEFAULT_TCP_CONG="cubic"
> CONFIG_IPV6=y
> CONFIG_IPV6_SIT=y
> CONFIG_IPV6_NDISC_NODETYPE=y
> CONFIG_NETFILTER=y
> CONFIG_NETFILTER_ADVANCED=y
> CONFIG_NETFILTER_NETLINK=y
> CONFIG_NETFILTER_NETLINK_ACCT=y
> CONFIG_NF_CONNTRACK=y
> CONFIG_NF_LOG_COMMON=y
> CONFIG_NF_CONNTRACK_MARK=y
> CONFIG_NF_CONNTRACK_TIMEOUT=y
> CONFIG_NF_CT_PROTO_DCCP=y
> CONFIG_NF_CT_PROTO_UDPLITE=y
> CONFIG_NF_CONNTRACK_FTP=y
> CONFIG_NF_CONNTRACK_IRC=y
> CONFIG_NF_CONNTRACK_BROADCAST=y
> CONFIG_NF_CONNTRACK_SNMP=y
> CONFIG_NF_CONNTRACK_SIP=y
> CONFIG_NF_CT_NETLINK=y
> CONFIG_NF_CT_NETLINK_TIMEOUT=y
> CONFIG_NF_NAT=y
> CONFIG_NF_NAT_NEEDED=y
> CONFIG_NF_NAT_PROTO_DCCP=y
> CONFIG_NF_NAT_PROTO_UDPLITE=y
> CONFIG_NF_NAT_FTP=y
> CONFIG_NF_NAT_IRC=y
> CONFIG_NF_NAT_SIP=y
> CONFIG_NETFILTER_XTABLES=y
> CONFIG_NETFILTER_XT_TARGET_CLASSIFY=y
> CONFIG_NETFILTER_XT_TARGET_DSCP=y
> CONFIG_NETFILTER_XT_TARGET_LOG=y
> CONFIG_NETFILTER_XT_NAT=y
> CONFIG_NETFILTER_XT_TARGET_REDIRECT=y
> CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=y
> CONFIG_NETFILTER_XT_MATCH_DSCP=y
> CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=y
> CONFIG_NETFILTER_XT_MATCH_HELPER=y
> CONFIG_NETFILTER_XT_MATCH_IPRANGE=y
> CONFIG_NETFILTER_XT_MATCH_LIMIT=y
> CONFIG_NETFILTER_XT_MATCH_MULTIPORT=y
> CONFIG_NETFILTER_XT_MATCH_NFACCT=y
> CONFIG_NETFILTER_XT_MATCH_OWNER=y
> CONFIG_NETFILTER_XT_MATCH_PKTTYPE=y
> CONFIG_NETFILTER_XT_MATCH_QUOTA=y
> CONFIG_NETFILTER_XT_MATCH_STATE=y
> CONFIG_NF_DEFRAG_IPV4=y
> CONFIG_NF_CONNTRACK_IPV4=y
> CONFIG_NF_LOG_IPV4=y
> CONFIG_NF_REJECT_IPV4=y
> CONFIG_NF_NAT_IPV4=y
> CONFIG_IP_NF_IPTABLES=y
> CONFIG_IP_NF_FILTER=y
> CONFIG_IP_NF_TARGET_REJECT=y
> CONFIG_IP_NF_NAT=y
> CONFIG_IP_NF_TARGET_REDIRECT=y
> CONFIG_IP_NF_MANGLE=y
> CONFIG_NF_DEFRAG_IPV6=y
> CONFIG_NF_CONNTRACK_IPV6=y
> CONFIG_NF_REJECT_IPV6=y
> CONFIG_NF_LOG_IPV6=y
> CONFIG_IP6_NF_IPTABLES=y
> CONFIG_IP6_NF_FILTER=y
> CONFIG_IP6_NF_TARGET_REJECT=y
> CONFIG_IP6_NF_MANGLE=y
> CONFIG_HAVE_NET_DSA=y
> CONFIG_NET_SCHED=y
> CONFIG_NET_SCH_CBQ=y
> CONFIG_NET_SCH_HTB=y
> CONFIG_NET_SCH_HFSC=y
> CONFIG_NET_SCH_PRIO=y
> CONFIG_NET_SCH_RED=y
> CONFIG_NET_SCH_SFQ=y
> CONFIG_NET_SCH_TEQL=y
> CONFIG_NET_SCH_TBF=y
> CONFIG_NET_SCH_GRED=y
> CONFIG_NET_SCH_DSMARK=y
> CONFIG_NET_SCH_INGRESS=y
> CONFIG_NET_CLS=y
> CONFIG_NET_CLS_BASIC=y
> CONFIG_NET_CLS_TCINDEX=y
> CONFIG_NET_CLS_ROUTE4=y
> CONFIG_NET_CLS_FW=y
> CONFIG_NET_CLS_U32=y
> CONFIG_CLS_U32_PERF=y
> CONFIG_CLS_U32_MARK=y
> CONFIG_NET_CLS_RSVP=y
> CONFIG_NET_EMATCH=y
> CONFIG_NET_EMATCH_STACK=32
> CONFIG_NET_EMATCH_CMP=y
> CONFIG_NET_EMATCH_NBYTE=y
> CONFIG_NET_EMATCH_U32=y
> CONFIG_NET_EMATCH_META=y
> CONFIG_NET_CLS_ACT=y
> CONFIG_NET_ACT_POLICE=y
> CONFIG_NET_ACT_GACT=y
> CONFIG_NET_ACT_PEDIT=y
> CONFIG_NET_SCH_FIFO=y
> CONFIG_NETLINK_DIAG=y
> CONFIG_NET_RX_BUSY_POLL=y
> CONFIG_BQL=y
> CONFIG_FIB_RULES=y
> CONFIG_PREVENT_FIRMWARE_BUILD=y
> CONFIG_FW_LOADER=y
> CONFIG_FIRMWARE_IN_KERNEL=y
> CONFIG_EXTRA_FIRMWARE=""
> CONFIG_GENERIC_CPU_AUTOPROBE=y
> CONFIG_ARCH_MIGHT_HAVE_PC_PARPORT=y
> CONFIG_BLK_DEV=y
> CONFIG_ZRAM=y
> CONFIG_BLK_DEV_LOOP=y
> CONFIG_BLK_DEV_LOOP_MIN_COUNT=8
> CONFIG_BLK_DEV_CRYPTOLOOP=y
> CONFIG_CS5535_MFGPT=y
> CONFIG_CS5535_MFGPT_DEFAULT_IRQ=7
> CONFIG_CS5535_CLOCK_EVENT_SRC=y
> CONFIG_HAVE_IDE=y
> CONFIG_SCSI_MOD=y
> CONFIG_SCSI=y
> CONFIG_SCSI_DMA=y
> CONFIG_BLK_DEV_SD=y
> CONFIG_CHR_DEV_SG=y
> CONFIG_SCSI_CONSTANTS=y
> CONFIG_SCSI_SCAN_ASYNC=y
> CONFIG_SCSI_SPI_ATTRS=y
> CONFIG_ATA=y
> CONFIG_ATA_VERBOSE_ERROR=y
> CONFIG_ATA_SFF=y
> CONFIG_ATA_BMDMA=y
> CONFIG_PATA_CS5536=y
> CONFIG_NETDEVICES=y
> CONFIG_MII=y
> CONFIG_NET_CORE=y
> CONFIG_DUMMY=y
> CONFIG_NETCONSOLE=y
> CONFIG_NETPOLL=y
> CONFIG_NET_POLL_CONTROLLER=y
> CONFIG_ETHERNET=y
> CONFIG_NET_VENDOR_VIA=y
> CONFIG_VIA_RHINE=y
> CONFIG_VIA_RHINE_MMIO=y
> CONFIG_ARCH_MIGHT_HAVE_PC_SERIO=y
> CONFIG_TTY=y
> CONFIG_UNIX98_PTYS=y
> CONFIG_SERIAL_EARLYCON=y
> CONFIG_SERIAL_8250=y
> CONFIG_SERIAL_8250_CONSOLE=y
> CONFIG_SERIAL_8250_PCI=y
> CONFIG_SERIAL_8250_NR_UARTS=1
> CONFIG_SERIAL_8250_RUNTIME_UARTS=1
> CONFIG_SERIAL_CORE=y
> CONFIG_SERIAL_CORE_CONSOLE=y
> CONFIG_HW_RANDOM=y
> CONFIG_HW_RANDOM_GEODE=y
> CONFIG_HANGCHECK_TIMER=y
> CONFIG_DEVPORT=y
> CONFIG_I2C=y
> CONFIG_I2C_BOARDINFO=y
> CONFIG_I2C_CHARDEV=y
> CONFIG_I2C_HELPER_AUTO=y
> CONFIG_SCx200_ACB=y
> CONFIG_ARCH_WANT_OPTIONAL_GPIOLIB=y
> CONFIG_GPIOLIB=y
> CONFIG_GPIO_DEVRES=y
> CONFIG_GPIO_SYSFS=y
> CONFIG_GPIO_CS5535=y
> CONFIG_HWMON=y
> CONFIG_HWMON_VID=y
> CONFIG_SENSORS_PC87360=y
> CONFIG_WATCHDOG=y
> CONFIG_WATCHDOG_CORE=y
> CONFIG_GEODE_WDT=y
> CONFIG_SSB_POSSIBLE=y
> CONFIG_BCMA_POSSIBLE=y
> CONFIG_MFD_CORE=y
> CONFIG_MFD_CS5535=y
> CONFIG_USB_OHCI_LITTLE_ENDIAN=y
> CONFIG_USB_SUPPORT=y
> CONFIG_USB_COMMON=y
> CONFIG_USB_ARCH_HAS_HCD=y
> CONFIG_USB=y
> CONFIG_USB_DEFAULT_PERSIST=y
> CONFIG_USB_DYNAMIC_MINORS=y
> CONFIG_USB_EHCI_HCD=y
> CONFIG_USB_EHCI_PCI=y
> CONFIG_USB_OHCI_HCD=y
> CONFIG_USB_OHCI_HCD_PCI=y
> CONFIG_USB_ACM=y
> CONFIG_USB_STORAGE=y
> CONFIG_RTC_LIB=y
> CONFIG_STAGING=y
> CONFIG_CLKSRC_I8253=y
> CONFIG_CLKEVT_I8253=y
> CONFIG_CLKBLD_I8253=y
> CONFIG_DCACHE_WORD_ACCESS=y
> CONFIG_EXT2_FS=y
> CONFIG_EXT2_FS_XATTR=y
> CONFIG_EXT2_FS_POSIX_ACL=y
> CONFIG_EXT2_FS_SECURITY=y
> CONFIG_FS_MBCACHE=y
> CONFIG_FS_POSIX_ACL=y
> CONFIG_EXPORTFS=y
> CONFIG_FILE_LOCKING=y
> CONFIG_FSNOTIFY=y
> CONFIG_DNOTIFY=y
> CONFIG_INOTIFY_USER=y
> CONFIG_QUOTA=y
> CONFIG_PRINT_QUOTA_WARNING=y
> CONFIG_QUOTA_TREE=y
> CONFIG_QFMT_V2=y
> CONFIG_QUOTACTL=y
> CONFIG_PROC_FS=y
> CONFIG_PROC_SYSCTL=y
> CONFIG_PROC_PAGE_MONITOR=y
> CONFIG_KERNFS=y
> CONFIG_SYSFS=y
> CONFIG_TMPFS=y
> CONFIG_TMPFS_POSIX_ACL=y
> CONFIG_TMPFS_XATTR=y
> CONFIG_NETWORK_FILESYSTEMS=y
> CONFIG_NFS_FS=y
> CONFIG_NFS_V3=y
> CONFIG_NFS_V3_ACL=y
> CONFIG_NFS_SWAP=y
> CONFIG_GRACE_PERIOD=y
> CONFIG_LOCKD=y
> CONFIG_LOCKD_V4=y
> CONFIG_NFS_ACL_SUPPORT=y
> CONFIG_NFS_COMMON=y
> CONFIG_SUNRPC=y
> CONFIG_SUNRPC_SWAP=y
> CONFIG_NLS=y
> CONFIG_NLS_DEFAULT="utf8"
> CONFIG_NLS_CODEPAGE_437=y
> CONFIG_NLS_CODEPAGE_850=y
> CONFIG_NLS_CODEPAGE_852=y
> CONFIG_NLS_ASCII=y
> CONFIG_NLS_ISO8859_1=y
> CONFIG_NLS_ISO8859_2=y
> CONFIG_NLS_ISO8859_15=y
> CONFIG_NLS_UTF8=y
> CONFIG_TRACE_IRQFLAGS_SUPPORT=y
> CONFIG_PRINTK_TIME=y
> CONFIG_MESSAGE_LOGLEVEL_DEFAULT=4
> CONFIG_ENABLE_WARN_DEPRECATED=y
> CONFIG_ENABLE_MUST_CHECK=y
> CONFIG_FRAME_WARN=1024
> CONFIG_STRIP_ASM_SYMS=y
> CONFIG_ARCH_WANT_FRAME_POINTERS=y
> CONFIG_DEBUG_KERNEL=y
> CONFIG_HAVE_DEBUG_KMEMLEAK=y
> CONFIG_HAVE_DEBUG_STACKOVERFLOW=y
> CONFIG_HAVE_ARCH_KMEMCHECK=y
> CONFIG_DETECT_HUNG_TASK=y
> CONFIG_DEFAULT_HUNG_TASK_TIMEOUT=120
> CONFIG_BOOTPARAM_HUNG_TASK_PANIC_VALUE=0
> CONFIG_PANIC_ON_OOPS=y
> CONFIG_PANIC_ON_OOPS_VALUE=1
> CONFIG_PANIC_TIMEOUT=5
> CONFIG_SCHED_STACK_END_CHECK=y
> CONFIG_DEBUG_BUGVERBOSE=y
> CONFIG_ARCH_HAS_DEBUG_STRICT_USER_COPY_CHECKS=y
> CONFIG_USER_STACKTRACE_SUPPORT=y
> CONFIG_HAVE_FUNCTION_TRACER=y
> CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
> CONFIG_HAVE_FUNCTION_GRAPH_FP_TEST=y
> CONFIG_HAVE_DYNAMIC_FTRACE=y
> CONFIG_HAVE_DYNAMIC_FTRACE_WITH_REGS=y
> CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
> CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
> CONFIG_HAVE_C_RECORDMCOUNT=y
> CONFIG_TRACING_SUPPORT=y
> CONFIG_HAVE_ARCH_KGDB=y
> CONFIG_STRICT_DEVMEM=y
> CONFIG_DEBUG_RODATA=y
> CONFIG_DOUBLEFAULT=y
> CONFIG_HAVE_MMIOTRACE_SUPPORT=y
> CONFIG_IO_DELAY_TYPE_0X80=0
> CONFIG_IO_DELAY_TYPE_0XED=1
> CONFIG_IO_DELAY_TYPE_UDELAY=2
> CONFIG_IO_DELAY_TYPE_NONE=3
> CONFIG_IO_DELAY_0X80=y
> CONFIG_DEFAULT_IO_DELAY_TYPE=0
> CONFIG_SECURITY_DMESG_RESTRICT=y
> CONFIG_SECURITY=y
> CONFIG_SECURITYFS=y
> CONFIG_SECURITY_PATH=y
> CONFIG_SECURITY_YAMA=y
> CONFIG_SECURITY_YAMA_STACKED=y
> CONFIG_DEFAULT_SECURITY_YAMA=y
> CONFIG_DEFAULT_SECURITY="yama"
> CONFIG_CRYPTO=y
> CONFIG_CRYPTO_ALGAPI=y
> CONFIG_CRYPTO_ALGAPI2=y
> CONFIG_CRYPTO_AEAD2=y
> CONFIG_CRYPTO_BLKCIPHER=y
> CONFIG_CRYPTO_BLKCIPHER2=y
> CONFIG_CRYPTO_HASH2=y
> CONFIG_CRYPTO_RNG2=y
> CONFIG_CRYPTO_PCOMP2=y
> CONFIG_CRYPTO_MANAGER=y
> CONFIG_CRYPTO_MANAGER2=y
> CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y
> CONFIG_CRYPTO_WORKQUEUE=y
> CONFIG_CRYPTO_CBC=y
> CONFIG_CRYPTO_AES=y
> CONFIG_CRYPTO_HW=y
> CONFIG_CRYPTO_DEV_GEODE=y
> CONFIG_HAVE_KVM=y
> CONFIG_BITREVERSE=y
> CONFIG_GENERIC_STRNCPY_FROM_USER=y
> CONFIG_GENERIC_STRNLEN_USER=y
> CONFIG_GENERIC_NET_UTILS=y
> CONFIG_GENERIC_FIND_FIRST_BIT=y
> CONFIG_GENERIC_PCI_IOMAP=y
> CONFIG_GENERIC_IOMAP=y
> CONFIG_GENERIC_IO=y
> CONFIG_ARCH_HAS_FAST_MULTIPLIER=y
> CONFIG_CRC32=y
> CONFIG_CRC32_SLICEBY8=y
> CONFIG_LZO_COMPRESS=y
> CONFIG_LZO_DECOMPRESS=y
> CONFIG_HAS_IOMEM=y
> CONFIG_HAS_IOPORT_MAP=y
> CONFIG_HAS_DMA=y
> CONFIG_DQL=y
> CONFIG_GLOB=y
> CONFIG_NLATTR=y
> CONFIG_ARCH_HAS_ATOMIC64_DEC_IF_POSITIVE=y
> CONFIG_ARCH_HAS_SG_CHAIN=y
> 



^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed
  2015-02-02  3:29 ` Myron Stowe
@ 2015-02-02 17:36   ` Nix
  2015-02-03 16:50     ` Bjorn Helgaas
  0 siblings, 1 reply; 7+ messages in thread
From: Nix @ 2015-02-02 17:36 UTC (permalink / raw)
  To: Myron Stowe
  Cc: linux-pci, Linux Kernel Mailing List, myron.stowe, unruh, martin,
	bhelgaas, willy, gregkh

On 2 Feb 2015, Myron Stowe verbalised:

> Nix:
>
> Thanks for the work you've already done with the bisection.  Let's see
> if we can get to the bottom of this.  Would you capture two couple sets
> of logs, one without the issue and another set with the commit at issue
> included for comparison.

> For each set please capture:
>         a 'dmesg' log with the kernel boot parameters 'debug' and
>         'ignore_loglevel' added (the entire log from booting),

Good boot (commit reverted):

[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 3.18.5+ (compiler@fold) (gcc version 4.8.4 20140605 (prerelease) (GCC) ) #1 Fri Jan 30 21:05:54 GMT 2015
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000fff00000-0x00000000ffffffff] reserved
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] Notice: NX (Execute Disable) protection missing in CPU!
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x20000 max_arch_pfn = 0x100000
[    0.000000] initial memory mapped: [mem 0x00000000-0x007fffff]
[    0.000000] Base memory trampoline at [c009b000] 9b000 size 16384
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] init_memory_mapping: [mem 0x1fc00000-0x1fffffff]
[    0.000000]  [mem 0x1fc00000-0x1fffffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x18000000-0x1fbfffff]
[    0.000000]  [mem 0x18000000-0x1fbfffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x00100000-0x17ffffff]
[    0.000000]  [mem 0x00100000-0x003fffff] page 4k
[    0.000000]  [mem 0x00400000-0x17ffffff] page 2M
[    0.000000] 512MB LOWMEM available.
[    0.000000]   mapped low ram: 0 - 20000000
[    0.000000]   low ram: 0 - 20000000
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   Normal   [mem 0x01000000-0x1fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009efff]
[    0.000000]   node   0: [mem 0x00100000-0x1fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x1fffffff]
[    0.000000] On node 0 totalpages: 130974
[    0.000000] free_area_init_node: node 0, pgdat c0450eac, node_mem_map dfc00020
[    0.000000]   DMA zone: 32 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 3998 pages, LIFO batch:0
[    0.000000]   Normal zone: 992 pages used for memmap
[    0.000000]   Normal zone: 126976 pages, LIFO batch:31
[    0.000000] Using APIC driver default
[    0.000000] No local APIC present or hardware disabled
[    0.000000] APIC: disable apic facility
[    0.000000] APIC: switched to apic NOOP
[    0.000000] e820: [mem 0x20000000-0xffefffff] available for PCI devices
[    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[    0.000000] pcpu-alloc: [0] 0
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 129950
[    0.000000] Kernel command line: BOOT_IMAGE=Linux console=ttyS0,19200 root=/dev/sda1 netconsole=24183@192.168.14.1/eth0,24183@192.168.14.15/00:e0:81:c0:91:1b ignore_loglevel debug
[    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
[    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Initializing CPU#0
[    0.000000] Memory: 515520K/523896K available (2466K kernel code, 239K rwdata, 720K rodata, 208K init, 152K bss, 8376K reserved)
[    0.000000] virtual kernel memory layout:
[    0.000000]     fixmap  : 0xfffa4000 - 0xfffff000   ( 364 kB)
[    0.000000]     vmalloc : 0xe0800000 - 0xfffa2000   ( 503 MB)
[    0.000000]     lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
[    0.000000]       .init : 0xc045b000 - 0xc048f000   ( 208 kB)
[    0.000000]       .data : 0xc0368dd5 - 0xc0459cc0   ( 963 kB)
[    0.000000]       .text : 0xc0100000 - 0xc0368dd5   (2467 kB)
[    0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok.
[    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] NR_IRQS:2304 nr_irqs:24 0
[    0.000000] CPU 0 irqstacks, hard=df408000 soft=df40a000
[    0.000000] console [ttyS0] enabled
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 499.914 MHz processor
[    0.030019] Calibrating delay loop (skipped), value calculated using timer frequency.. 999.82 BogoMIPS (lpj=4999140)
[    0.050011] pid_max: default: 32768 minimum: 101
[    0.060118] Security Framework initialized
[    0.070019] Yama: becoming mindful.
[    0.080082] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.090016] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.100885] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.100885] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.110010] CPU: Geode(TM) Integrated Processor by AMD PCS (fam: 05, model: 0a, stepping: 02)
[    0.150385] Performance Events: no PMU driver, software events only.
[    0.182326] NET: Registered protocol family 16
[    0.201605] PCI: PCI BIOS revision 2.01 entry at 0xfac61, last bus=1
[    0.210011] PCI: Using configuration type 1 for base access
[    0.231198] SCSI subsystem initialized
[    0.240206] libata version 3.00 loaded.
[    0.250167] usbcore: registered new interface driver usbfs
[    0.260082] usbcore: registered new interface driver hub
[    0.270074] usbcore: registered new device driver usb
[    0.280108] PCI: Probing PCI hardware
[    0.290013] PCI: root bus 00: using default resources
[    0.300011] PCI: Probing PCI hardware (bus 00)
[    0.310160] PCI host bridge to bus 0000:00
[    0.320027] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
[    0.330021] pci_bus 0000:00: root bus resource [mem 0x00000000-0xffffffff]
[    0.340018] pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff]
[    0.350114] pci 0000:00:01.0: [1022:2080] type 00 class 0x060000
[    0.360972] pci 0000:00:01.2: [1022:2082] type 00 class 0x101000
[    0.370199] pci 0000:00:01.2: reg 0x10: [mem 0xa0000000-0xa0003fff]
[    0.381186] pci 0000:00:06.0: [1106:3053] type 00 class 0x020000
[    0.390038] pci 0000:00:06.0: reg 0x10: [io  0xe100-0xe1ff]
[    0.400029] pci 0000:00:06.0: reg 0x14: [mem 0xa0004000-0xa00040ff]
[    0.410089] pci 0000:00:06.0: supports D1 D2
[    0.420018] pci 0000:00:06.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.430251] pci 0000:00:07.0: [1106:3053] type 00 class 0x020000
[    0.440038] pci 0000:00:07.0: reg 0x10: [io  0xe200-0xe2ff]
[    0.450029] pci 0000:00:07.0: reg 0x14: [mem 0xa0004100-0xa00041ff]
[    0.460088] pci 0000:00:07.0: supports D1 D2
[    0.470018] pci 0000:00:07.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.480245] pci 0000:00:08.0: [1106:3053] type 00 class 0x020000
[    0.490038] pci 0000:00:08.0: reg 0x10: [io  0xe300-0xe3ff]
[    0.500028] pci 0000:00:08.0: reg 0x14: [mem 0xa0004200-0xa00042ff]
[    0.510088] pci 0000:00:08.0: supports D1 D2
[    0.520018] pci 0000:00:08.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.530251] pci 0000:00:09.0: [1106:3053] type 00 class 0x020000
[    0.540038] pci 0000:00:09.0: reg 0x10: [io  0xe400-0xe4ff]
[    0.550029] pci 0000:00:09.0: reg 0x14: [mem 0xa0004300-0xa00043ff]
[    0.560088] pci 0000:00:09.0: supports D1 D2
[    0.570018] pci 0000:00:09.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.580256] pci 0000:00:0e.0: [104c:ac23] type 01 class 0x060400
[    0.590382] pci 0000:00:14.0: [1022:2090] type 00 class 0x060100
[    0.600177] pci 0000:00:14.0: reg 0x10: [io  0x6000-0x7fff]
[    0.610140] pci 0000:00:14.0: reg 0x14: [io  0x6100-0x61ff]
[    0.620138] pci 0000:00:14.0: reg 0x18: [io  0x6200-0x63ff]
[    0.630534] pci 0000:00:14.0: CS5536 ISA bridge bug detected (incorrect header); workaround applied
[    0.640453] pci 0000:00:14.2: [1022:209a] type 00 class 0x010180
[    0.650688] pci 0000:00:14.2: reg 0x20: [io  0xe000-0xe00f]
[    0.660318] pci 0000:00:14.2: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.670018] pci 0000:00:14.2: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.680018] pci 0000:00:14.2: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.690018] pci 0000:00:14.2: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.700522] pci 0000:00:15.0: [1022:2094] type 00 class 0x0c0310
[    0.710237] pci 0000:00:15.0: reg 0x10: [mem 0xa0005000-0xa0005fff]
[    0.730400] pci 0000:00:15.1: [1022:2095] type 00 class 0x0c0320
[    0.740238] pci 0000:00:15.1: reg 0x10: [mem 0xa0006000-0xa0006fff]
[    0.751553] pci 0000:01:00.0: [1106:3053] type 00 class 0x020000
[    0.760045] pci 0000:01:00.0: reg 0x10: [io  0xd000-0xd0ff]
[    0.770033] pci 0000:01:00.0: reg 0x14: [mem 0xa4000000-0xa40000ff]
[    0.780114] pci 0000:01:00.0: supports D1 D2
[    0.790018] pci 0000:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.800254] pci 0000:01:01.0: [1106:3053] type 00 class 0x020000
[    0.810043] pci 0000:01:01.0: reg 0x10: [io  0xd100-0xd1ff]
[    0.820031] pci 0000:01:01.0: reg 0x14: [mem 0xa4000100-0xa40001ff]
[    0.830113] pci 0000:01:01.0: supports D1 D2
[    0.840018] pci 0000:01:01.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.850260] pci 0000:01:02.0: [1106:3053] type 00 class 0x020000
[    0.860044] pci 0000:01:02.0: reg 0x10: [io  0xd200-0xd2ff]
[    0.870032] pci 0000:01:02.0: reg 0x14: [mem 0xa4000200-0xa40002ff]
[    0.880114] pci 0000:01:02.0: supports D1 D2
[    0.890019] pci 0000:01:02.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.900258] pci 0000:01:03.0: [1106:3053] type 00 class 0x020000
[    0.910044] pci 0000:01:03.0: reg 0x10: [io  0xd300-0xd3ff]
[    0.920031] pci 0000:01:03.0: reg 0x14: [mem 0xa4000300-0xa40003ff]
[    0.930114] pci 0000:01:03.0: supports D1 D2
[    0.940018] pci 0000:01:03.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.950288] pci 0000:00:0e.0: PCI bridge to [bus 01]
[    0.960026] pci 0000:00:0e.0:   bridge window [io  0xd000-0xdfff]
[    0.970022] pci 0000:00:0e.0:   bridge window [mem 0xa4000000-0xa7ffffff]
[    0.980035] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 01
[    0.990607] PCI: pci_cache_line_size set to 32 bytes
[    1.000286] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[    1.011093] Switched to clocksource pit
[    1.014334] pci 0000:00:0e.0: PCI bridge to [bus 01]
[    1.024129] pci 0000:00:0e.0:   bridge window [io  0xd000-0xdfff]
[    1.030671] pci 0000:00:0e.0:   bridge window [mem 0xa4000000-0xa7ffffff]
[    1.041384] pci_bus 0000:00: resource 4 [io  0x0000-0xffff]
[    1.054807] pci_bus 0000:00: resource 5 [mem 0x00000000-0xffffffff]
[    1.062341] pci_bus 0000:01: resource 0 [io  0xd000-0xdfff]
[    1.075721] pci_bus 0000:01: resource 1 [mem 0xa4000000-0xa7ffffff]
[    1.083381] NET: Registered protocol family 2
[    1.100688] TCP established hash table entries: 4096 (order: 2, 16384 bytes)
[    1.113008] TCP bind hash table entries: 4096 (order: 2, 16384 bytes)
[    1.121666] TCP: Hash tables configured (established 4096 bind 4096)
[    1.139809] TCP: reno registered
[    1.149160] UDP hash table entries: 256 (order: 0, 4096 bytes)
[    1.154107] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
[    1.161902] NET: Registered protocol family 1
[    1.178493] RPC: Registered named UNIX socket transport module.
[    1.183970] RPC: Registered udp transport module.
[    1.192142] RPC: Registered tcp transport module.
[    1.200321] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.219528] PCI: CLS 32 bytes, default 32
[    1.224011] platform rtc_cmos: registered platform RTC device (no PNP device found)
[    1.240819] net5501: system is recognized as "net5501"
[    1.251803] NatSemi SCx200 Driver
[    1.262561] futex hash table entries: 256 (order: -1, 3072 bytes)
[    1.299641] VFS: Disk quotas dquot_6.5.2
[    1.303519] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    1.314071] msgmni has been set to 1006
[    1.328283] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    1.332644] io scheduler noop registered
[    1.346183] io scheduler deadline registered (default)
[    1.357428] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
[    1.376345] serial8250: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.383368] AMD Geode RNG detected
[    1.393899] Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
[    1.411881] loop: module loaded
[    1.421383] zram: Created 1 device(s) ...
[    1.435870] cs5535-gpio cs5535-gpio: reserved resource region [io  0x6100-0x61ff]
[    1.440961] cs5535-mfgpt cs5535-mfgpt: reserved resource region [io  0x6200-0x63ff]
[    1.456859] cs5535-mfgpt cs5535-mfgpt: 8 MFGPT timers available
[    1.462537] cs5535-mfd 0000:00:14.0: 5 devices registered.
[    1.477430] scsi host0: pata_cs5536
[    1.488855] scsi host1: pata_cs5536
[    1.500056] ata1: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0xe000 irq 14
[    1.501778] ata2: DUMMY
[    1.517956] via_rhine: v1.10-LK1.5.1 2010-10-09 Written by Donald Becker
[    1.534216] via-rhine 0000:00:06.0 eth0: VIA Rhine III (Management Adapter) at 0xe0806000, 00:00:24:cb:c6:a0, IRQ 11
[    1.548024] via-rhine 0000:00:06.0 eth0: MII PHY found at address 1, status 0x786d advertising 05e1 Link cde1
[    1.563505] via-rhine 0000:00:07.0 eth1: VIA Rhine III (Management Adapter) at 0xe0808100, 00:00:24:cb:c6:a1, IRQ 5
[    1.576792] via-rhine 0000:00:07.0 eth1: MII PHY found at address 1, status 0x786d advertising 05e1 Link 41e1
[    1.592231] via-rhine 0000:00:08.0 eth2: VIA Rhine III (Management Adapter) at 0xe080a200, 00:00:24:cb:c6:a2, IRQ 9
[    1.605540] via-rhine 0000:00:08.0 eth2: MII PHY found at address 1, status 0x786d advertising 05e1 Link 41e1
[    1.621014] via-rhine 0000:00:09.0 eth3: VIA Rhine III (Management Adapter) at 0xe080c300, 00:00:24:cb:c6:a3, IRQ 12
[    1.634840] via-rhine 0000:00:09.0 eth3: MII PHY found at address 1, status 0x786d advertising 05e1 Link 41e1
[    1.650360] via-rhine 0000:01:00.0 eth4: VIA Rhine III (Management Adapter) at 0xe080e000, 00:00:24:d1:2a:3c, IRQ 10
[    1.664203] via-rhine 0000:01:00.0 eth4: MII PHY found at address 1, status 0x786d advertising 05e1 Link 4de1
[    1.679675] via-rhine 0000:01:01.0 eth5: VIA Rhine III (Management Adapter) at 0xe0810100, 00:00:24:d1:2a:3d, IRQ 7
[    1.682988] via-rhine 0000:01:01.0 eth5: MII PHY found at address 1, status 0x7849 advertising 05e1 Link 0000
[    1.698466] via-rhine 0000:01:02.0 eth6: VIA Rhine III (Management Adapter) at 0xe0812200, 00:00:24:d1:2a:3e, IRQ 10
[    1.702288] via-rhine 0000:01:02.0 eth6: MII PHY found at address 1, status 0x7849 advertising 05e1 Link 0000
[    1.717765] via-rhine 0000:01:03.0 eth7: VIA Rhine III (Management Adapter) at 0xe0814300, 00:00:24:d1:2a:3f, IRQ 7
[    1.721069] via-rhine 0000:01:03.0 eth7: MII PHY found at address 1, status 0x7849 advertising 05e1 Link 0000
[    1.730619] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.749727] ehci-pci: EHCI PCI platform driver
[    1.756661] ehci-pci 0000:00:15.1: EHCI Host Controller
[    1.768030] ehci-pci 0000:00:15.1: new USB bus registered, assigned bus number 1
[    1.772595] ehci-pci 0000:00:15.1: irq 15, io mem 0xa0006000
[    1.787133] ata1.00: CFA: SanDisk SDCFH2-002G, HDX 4.32, max MWDMA2
[    1.794720] ata1.00: 4001760 sectors, multi 0: LBA
[    1.804227] ehci-pci 0000:00:15.1: USB 2.0 started, EHCI 1.00
[    1.819140] ata1.00: configured for MWDMA2
[    1.824097] scsi 0:0:0:0: Direct-Access     ATA      SanDisk SDCFH2-0 4.32 PQ: 0 ANSI: 5
[    1.833591] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    1.845889] sd 0:0:0:0: [sda] 4001760 512-byte logical blocks: (2.04 GB/1.90 GiB)
[    1.851583] hub 1-0:1.0: USB hub found
[    1.864318] sd 0:0:0:0: [sda] Write Protect is off
[    1.873059] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    1.883423] hub 1-0:1.0: 4 ports detected
[    1.897560] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[    1.903918] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.911026] ohci-pci: OHCI PCI platform driver
[    1.927944] ohci-pci 0000:00:15.0: OHCI PCI host controller
[    1.931400] ohci-pci 0000:00:15.0: new USB bus registered, assigned bus number 2
[    1.945769] ohci-pci 0000:00:15.0: irq 15, io mem 0xa0005000
[    1.959683]  sda: sda1
[    1.964907] sd 0:0:0:0: [sda] Attached SCSI removable disk
[    2.043064] hub 2-0:1.0: USB hub found
[    2.055607] hub 2-0:1.0: 4 ports detected
[    2.070339] usbcore: registered new interface driver cdc_acm
[    2.084266] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
[    2.092380] usbcore: registered new interface driver usb-storage
[    2.108400] i2c /dev entries driver
[    2.119724] cs5535-smb cs5535-smb: SCx200 device 'CS5535 ACB0' registered
[    2.120485] pc87360: Device 0x09 not activated
[    2.138720] cs5535-mfgpt cs5535-mfgpt: registered timer 0
[    2.141841] Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
[    2.157966] cs5535-mfgpt cs5535-mfgpt: registered timer 1
[    2.160372] cs5535-clockevt: Registering MFGPT timer as a clock event, using IRQ 7
[    2.176094] GACT probability NOT on
[    2.181159] u32 classifier
[    2.197488]     Performance counters on
[    2.200584]     Actions configured
[    2.211199] Netfilter messages via NETLINK v0.30.
[    2.229532] nfnl_acct: registering with nfnetlink.
[    2.238364] nf_conntrack version 0.5.0 (8055 buckets, 32220 max)
[    2.245122] ctnetlink v0.93: registering with nfnetlink.
[    2.258185] ip_tables: (C) 2000-2006 Netfilter Core Team
[    2.270334] TCP: cubic registered
[    2.271743] NET: Registered protocol family 10
[    2.289400] Switched to clocksource tsc
[    2.314623] ip6_tables: (C) 2000-2006 Netfilter Core Team
[    2.347315] sit: IPv6 over IPv4 tunneling driver
[    2.375941] NET: Registered protocol family 17
[    2.402863] Using IPI Shortcut mode
[    2.425557] netpoll: netconsole: local port 24183
[    2.453748] netpoll: netconsole: local IPv4 address 192.168.14.1
[    2.489711] netpoll: netconsole: interface 'eth0'
[    2.517887] netpoll: netconsole: remote port 24183
[    2.546597] netpoll: netconsole: remote IPv4 address 192.168.14.15
[    2.583602] netpoll: netconsole: remote ethernet address 00:e0:81:c0:91:1b
[    2.624782] netpoll: netconsole: device eth0 not up yet, forcing it
[    2.663368] netpoll: netconsole: carrier detect appears untrustworthy, waiting 4 seconds
[    3.010087] usb 2-1: new full-speed USB device number 2 using ohci-pci
[    3.288265] cdc_acm 2-1:1.0: This device cannot do calls on its own. It is not a modem.
[    3.336599] cdc_acm 2-1:1.0: ttyACM0: USB ACM device
[    6.723598] console [netcon0] enabled
[    6.745663] netconsole: network logging started
[    6.777256] VFS: Mounted root (ext2 filesystem) readonly on device 8:1.
[    6.817329] Freeing unused kernel memory: 208K (c045b000 - c048f000)
[    6.855847] Write protecting the kernel text: 2468k
[    6.885171] Write protecting the kernel read-only data: 724k

Bad boot (pristine 3.18.5):

[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 3.18.5+ (compiler@fold) (gcc version 4.8.4 20140605 (prerelease) (GCC) ) #1 Fri Jan 30 20:08:48 GMT 2015
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000fff00000-0x00000000ffffffff] reserved
[    0.000000] debug: ignoring loglevel setting.
[    0.000000] Notice: NX (Execute Disable) protection missing in CPU!
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x20000 max_arch_pfn = 0x100000
[    0.000000] initial memory mapped: [mem 0x00000000-0x007fffff]
[    0.000000] Base memory trampoline at [c009b000] 9b000 size 16384
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] init_memory_mapping: [mem 0x1fc00000-0x1fffffff]
[    0.000000]  [mem 0x1fc00000-0x1fffffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x18000000-0x1fbfffff]
[    0.000000]  [mem 0x18000000-0x1fbfffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x00100000-0x17ffffff]
[    0.000000]  [mem 0x00100000-0x003fffff] page 4k
[    0.000000]  [mem 0x00400000-0x17ffffff] page 2M
[    0.000000] 512MB LOWMEM available.
[    0.000000]   mapped low ram: 0 - 20000000
[    0.000000]   low ram: 0 - 20000000
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   Normal   [mem 0x01000000-0x1fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009efff]
[    0.000000]   node   0: [mem 0x00100000-0x1fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x1fffffff]
[    0.000000] On node 0 totalpages: 130974
[    0.000000] free_area_init_node: node 0, pgdat c0450eac, node_mem_map dfc00020
[    0.000000]   DMA zone: 32 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 3998 pages, LIFO batch:0
[    0.000000]   Normal zone: 992 pages used for memmap
[    0.000000]   Normal zone: 126976 pages, LIFO batch:31
[    0.000000] Using APIC driver default
[    0.000000] No local APIC present or hardware disabled
[    0.000000] APIC: disable apic facility
[    0.000000] APIC: switched to apic NOOP
[    0.000000] e820: [mem 0x20000000-0xffefffff] available for PCI devices
[    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[    0.000000] pcpu-alloc: [0] 0
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 129950
[    0.000000] Kernel command line: BOOT_IMAGE=oldLinux console=ttyS0,19200 root=/dev/sda1 netconsole=24183@192.168.14.1/eth0,24183@192.168.14.15/00:e0:81:c0:91:1b ignore_loglevel debug
[    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
[    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Initializing CPU#0
[    0.000000] Memory: 515520K/523896K available (2466K kernel code, 239K rwdata, 720K rodata, 208K init, 152K bss, 8376K reserved)
[    0.000000] virtual kernel memory layout:
[    0.000000]     fixmap  : 0xfffa4000 - 0xfffff000   ( 364 kB)
[    0.000000]     vmalloc : 0xe0800000 - 0xfffa2000   ( 503 MB)
[    0.000000]     lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
[    0.000000]       .init : 0xc045b000 - 0xc048f000   ( 208 kB)
[    0.000000]       .data : 0xc0368e15 - 0xc0459cc0   ( 963 kB)
[    0.000000]       .text : 0xc0100000 - 0xc0368e15   (2467 kB)
[    0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok.
[    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] NR_IRQS:2304 nr_irqs:24 0
[    0.000000] CPU 0 irqstacks, hard=df408000 soft=df40a000
[    0.000000] console [ttyS0] enabled
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 499.913 MHz processor
[    0.030020] Calibrating delay loop (skipped), value calculated using timer frequency.. 999.82 BogoMIPS (lpj=4999130)
[    0.050011] pid_max: default: 32768 minimum: 101
[    0.060118] Security Framework initialized
[    0.070019] Yama: becoming mindful.
[    0.080082] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.090016] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.100884] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.100884] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.110010] CPU: Geode(TM) Integrated Processor by AMD PCS (fam: 05, model: 0a, stepping: 02)
[    0.150387] Performance Events: no PMU driver, software events only.
[    0.182329] NET: Registered protocol family 16
[    0.201611] PCI: PCI BIOS revision 2.01 entry at 0xfac61, last bus=1
[    0.210011] PCI: Using configuration type 1 for base access
[    0.231202] SCSI subsystem initialized
[    0.240205] libata version 3.00 loaded.
[    0.250169] usbcore: registered new interface driver usbfs
[    0.260082] usbcore: registered new interface driver hub
[    0.270074] usbcore: registered new device driver usb
[    0.280106] PCI: Probing PCI hardware
[    0.290012] PCI: root bus 00: using default resources
[    0.300011] PCI: Probing PCI hardware (bus 00)
[    0.310159] PCI host bridge to bus 0000:00
[    0.320027] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
[    0.330021] pci_bus 0000:00: root bus resource [mem 0x00000000-0xffffffff]
[    0.340018] pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff]
[    0.350113] pci 0000:00:01.0: [1022:2080] type 00 class 0x060000
[    0.360975] pci 0000:00:01.2: [1022:2082] type 00 class 0x101000
[    0.370200] pci 0000:00:01.2: reg 0x10: [mem 0xa0000000-0xa0003fff]
[    0.381186] pci 0000:00:06.0: [1106:3053] type 00 class 0x020000
[    0.390038] pci 0000:00:06.0: reg 0x10: [io  0xe100-0xe1ff]
[    0.400029] pci 0000:00:06.0: reg 0x14: [mem 0xa0004000-0xa00040ff]
[    0.410089] pci 0000:00:06.0: supports D1 D2
[    0.420019] pci 0000:00:06.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.430251] pci 0000:00:07.0: [1106:3053] type 00 class 0x020000
[    0.440038] pci 0000:00:07.0: reg 0x10: [io  0xe200-0xe2ff]
[    0.450029] pci 0000:00:07.0: reg 0x14: [mem 0xa0004100-0xa00041ff]
[    0.460088] pci 0000:00:07.0: supports D1 D2
[    0.470018] pci 0000:00:07.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.480245] pci 0000:00:08.0: [1106:3053] type 00 class 0x020000
[    0.490038] pci 0000:00:08.0: reg 0x10: [io  0xe300-0xe3ff]
[    0.500029] pci 0000:00:08.0: reg 0x14: [mem 0xa0004200-0xa00042ff]
[    0.510088] pci 0000:00:08.0: supports D1 D2
[    0.520018] pci 0000:00:08.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.530251] pci 0000:00:09.0: [1106:3053] type 00 class 0x020000
[    0.540038] pci 0000:00:09.0: reg 0x10: [io  0xe400-0xe4ff]
[    0.550029] pci 0000:00:09.0: reg 0x14: [mem 0xa0004300-0xa00043ff]
[    0.560089] pci 0000:00:09.0: supports D1 D2
[    0.570018] pci 0000:00:09.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.580256] pci 0000:00:0e.0: [104c:ac23] type 01 class 0x060400
[    0.590382] pci 0000:00:14.0: [1022:2090] type 00 class 0x060100
[    0.600930] pci 0000:00:14.0: CS5536 ISA bridge bug detected (incorrect header); workaround applied
[    0.610448] pci 0000:00:14.2: [1022:209a] type 00 class 0x010180
[    0.620688] pci 0000:00:14.2: reg 0x20: [io  0xe000-0xe00f]
[    0.630319] pci 0000:00:14.2: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.640023] pci 0000:00:14.2: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.650019] pci 0000:00:14.2: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.660018] pci 0000:00:14.2: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.670521] pci 0000:00:15.0: [1022:2094] type 00 class 0x0c0310
[    0.680237] pci 0000:00:15.0: reg 0x10: [mem 0xa0005000-0xa0005fff]
[    0.700322] pci 0000:00:15.1: [1022:2095] type 00 class 0x0c0320
[    0.710238] pci 0000:00:15.1: reg 0x10: [mem 0xa0006000-0xa0006fff]
[    0.721548] pci 0000:01:00.0: [1106:3053] type 00 class 0x020000
[    0.730045] pci 0000:01:00.0: reg 0x10: [io  0xd000-0xd0ff]
[    0.740032] pci 0000:01:00.0: reg 0x14: [mem 0xa4000000-0xa40000ff]
[    0.750114] pci 0000:01:00.0: supports D1 D2
[    0.760018] pci 0000:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.770256] pci 0000:01:01.0: [1106:3053] type 00 class 0x020000
[    0.780043] pci 0000:01:01.0: reg 0x10: [io  0xd100-0xd1ff]
[    0.790032] pci 0000:01:01.0: reg 0x14: [mem 0xa4000100-0xa40001ff]
[    0.800115] pci 0000:01:01.0: supports D1 D2
[    0.810018] pci 0000:01:01.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.820261] pci 0000:01:02.0: [1106:3053] type 00 class 0x020000
[    0.830044] pci 0000:01:02.0: reg 0x10: [io  0xd200-0xd2ff]
[    0.840033] pci 0000:01:02.0: reg 0x14: [mem 0xa4000200-0xa40002ff]
[    0.850115] pci 0000:01:02.0: supports D1 D2
[    0.860018] pci 0000:01:02.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.870259] pci 0000:01:03.0: [1106:3053] type 00 class 0x020000
[    0.880043] pci 0000:01:03.0: reg 0x10: [io  0xd300-0xd3ff]
[    0.890032] pci 0000:01:03.0: reg 0x14: [mem 0xa4000300-0xa40003ff]
[    0.900114] pci 0000:01:03.0: supports D1 D2
[    0.910018] pci 0000:01:03.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.920287] pci 0000:00:0e.0: PCI bridge to [bus 01]
[    0.930025] pci 0000:00:0e.0:   bridge window [io  0xd000-0xdfff]
[    0.940022] pci 0000:00:0e.0:   bridge window [mem 0xa4000000-0xa7ffffff]
[    0.950034] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 01
[    0.960607] PCI: pci_cache_line_size set to 32 bytes
[    0.970284] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[    0.981088] Switched to clocksource pit
[    0.984339] pci 0000:00:0e.0: PCI bridge to [bus 01]
[    0.994133] pci 0000:00:0e.0:   bridge window [io  0xd000-0xdfff]
[    1.000679] pci 0000:00:0e.0:   bridge window [mem 0xa4000000-0xa7ffffff]
[    1.011390] pci_bus 0000:00: resource 4 [io  0x0000-0xffff]
[    1.024811] pci_bus 0000:00: resource 5 [mem 0x00000000-0xffffffff]
[    1.032347] pci_bus 0000:01: resource 0 [io  0xd000-0xdfff]
[    1.045727] pci_bus 0000:01: resource 1 [mem 0xa4000000-0xa7ffffff]
[    1.053388] NET: Registered protocol family 2
[    1.070694] TCP established hash table entries: 4096 (order: 2, 16384 bytes)
[    1.083015] TCP bind hash table entries: 4096 (order: 2, 16384 bytes)
[    1.091671] TCP: Hash tables configured (established 4096 bind 4096)
[    1.109815] TCP: reno registered
[    1.119164] UDP hash table entries: 256 (order: 0, 4096 bytes)
[    1.124112] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
[    1.131906] NET: Registered protocol family 1
[    1.148499] RPC: Registered named UNIX socket transport module.
[    1.153978] RPC: Registered udp transport module.
[    1.162147] RPC: Registered tcp transport module.
[    1.170327] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.189532] PCI: CLS 32 bytes, default 32
[    1.194010] platform rtc_cmos: registered platform RTC device (no PNP device found)
[    1.210824] net5501: system is recognized as "net5501"
[    1.221812] NatSemi SCx200 Driver
[    1.232572] futex hash table entries: 256 (order: -1, 3072 bytes)
[    1.269657] VFS: Disk quotas dquot_6.5.2
[    1.273530] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    1.284075] msgmni has been set to 1006
[    1.298292] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    1.302649] io scheduler noop registered
[    1.316186] io scheduler deadline registered (default)
[    1.327431] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
[    1.346354] serial8250: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.353378] AMD Geode RNG detected
[    1.363911] Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
[    1.381887] loop: module loaded
[    1.391395] zram: Created 1 device(s) ...
[    1.405877] cs5535-gpio cs5535-gpio: can't request region
[    1.418278] cs5535-gpio: probe of cs5535-gpio failed with error -5
[    1.425449] cs5535-mfgpt cs5535-mfgpt: can't request region
[    1.438873] cs5535-mfgpt: probe of cs5535-mfgpt failed with error -5
[    1.447163] cs5535-mfd 0000:00:14.0: 5 devices registered.
[    1.462097] scsi host0: pata_cs5536
[    1.473525] scsi host1: pata_cs5536
[    1.484730] ata1: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0xe000 irq 14
[    1.496451] ata2: DUMMY
[    1.502618] via_rhine: v1.10-LK1.5.1 2010-10-09 Written by Donald Becker
[    1.518801] via-rhine 0000:00:06.0 eth0: VIA Rhine III (Management Adapter) at 0xe0806000, 00:00:24:cb:c6:a0, IRQ 11
[    1.522645] via-rhine 0000:00:06.0 eth0: MII PHY found at address 1, status 0x786d advertising 05e1 Link cde1
[    1.538087] via-rhine 0000:00:07.0 eth1: VIA Rhine III (Management Adapter) at 0xe0808100, 00:00:24:cb:c6:a1, IRQ 5
[    1.541360] via-rhine 0000:00:07.0 eth1: MII PHY found at address 1, status 0x786d advertising 05e1 Link 41e1
[    1.556758] via-rhine 0000:00:08.0 eth2: VIA Rhine III (Management Adapter) at 0xe080a200, 00:00:24:cb:c6:a2, IRQ 9
[    1.570049] via-rhine 0000:00:08.0 eth2: MII PHY found at address 1, status 0x786d advertising 05e1 Link 41e1
[    1.585530] via-rhine 0000:00:09.0 eth3: VIA Rhine III (Management Adapter) at 0xe080c300, 00:00:24:cb:c6:a3, IRQ 12
[    1.599327] via-rhine 0000:00:09.0 eth3: MII PHY found at address 1, status 0x786d advertising 05e1 Link 41e1
[    1.614825] via-rhine 0000:01:00.0 eth4: VIA Rhine III (Management Adapter) at 0xe080e000, 00:00:24:d1:2a:3c, IRQ 10
[    1.628670] via-rhine 0000:01:00.0 eth4: MII PHY found at address 1, status 0x786d advertising 05e1 Link 4de1
[    1.644169] via-rhine 0000:01:01.0 eth5: VIA Rhine III (Management Adapter) at 0xe0810100, 00:00:24:d1:2a:3d, IRQ 7
[    1.657503] via-rhine 0000:01:01.0 eth5: MII PHY found at address 1, status 0x7849 advertising 05e1 Link 0000
[    1.673021] via-rhine 0000:01:02.0 eth6: VIA Rhine III (Management Adapter) at 0xe0812200, 00:00:24:d1:2a:3e, IRQ 10
[    1.686856] via-rhine 0000:01:02.0 eth6: MII PHY found at address 1, status 0x7849 advertising 05e1 Link 0000
[    1.702378] via-rhine 0000:01:03.0 eth7: VIA Rhine III (Management Adapter) at 0xe0814300, 00:00:24:d1:2a:3f, IRQ 7
[    1.715689] via-rhine 0000:01:03.0 eth7: MII PHY found at address 1, status 0x7849 advertising 05e1 Link 0000
[    1.725238] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.734346] ehci-pci: EHCI PCI platform driver
[    1.741279] ehci-pci 0000:00:15.1: EHCI Host Controller
[    1.752652] ehci-pci 0000:00:15.1: new USB bus registered, assigned bus number 1
[    1.767210] ehci-pci 0000:00:15.1: irq 15, io mem 0xa0006000
[    1.771753] ata1.00: CFA: SanDisk SDCFH2-002G, HDX 4.32, max MWDMA2
[    1.789340] ata1.00: 4001760 sectors, multi 0: LBA
[    1.798849] ehci-pci 0000:00:15.1: USB 2.0 started, EHCI 1.00
[    1.803766] ata1.00: configured for MWDMA2
[    1.818724] scsi 0:0:0:0: Direct-Access     ATA      SanDisk SDCFH2-0 4.32 PQ: 0 ANSI: 5
[    1.828065] hub 1-0:1.0: USB hub found
[    1.830601] hub 1-0:1.0: 4 ports detected
[    1.845607] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    1.857873] sd 0:0:0:0: [sda] 4001760 512-byte logical blocks: (2.04 GB/1.90 GiB)
[    1.862962] sd 0:0:0:0: [sda] Write Protect is off
[    1.871698] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    1.882657] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.899700] ohci-pci: OHCI PCI platform driver
[    1.906618] ohci-pci 0000:00:15.0: OHCI PCI host controller
[    1.920026] ohci-pci 0000:00:15.0: new USB bus registered, assigned bus number 2
[    1.924410] ohci-pci 0000:00:15.0: irq 15, io mem 0xa0005000
[    1.938433] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[    1.944913]  sda: sda1
[    1.960113] sd 0:0:0:0: [sda] Attached SCSI removable disk
[    2.023154] hub 2-0:1.0: USB hub found
[    2.035653] hub 2-0:1.0: 4 ports detected
[    2.050393] usbcore: registered new interface driver cdc_acm
[    2.064313] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
[    2.072426] usbcore: registered new interface driver usb-storage
[    2.088447] i2c /dev entries driver
[    2.099501] scx200_acb: can't allocate io 0x0-0x7
[    2.107733] cs5535-smb: probe of cs5535-smb failed with error -5
[    2.113818] pc87360: Device 0x09 not activated
[    2.122063] geodewdt: No timers were available
[    2.139437] Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
[    2.145579] cs5535-clockevt: Could not allocate MFGPT timer
[    2.159086] GACT probability NOT on
[    2.170991] u32 classifier
[    2.187209]     Performance counters on
[    2.200184]     Actions configured
[    2.200700] Netfilter messages via NETLINK v0.30.
[    2.218929] nfnl_acct: registering with nfnetlink.
[    2.227675] nf_conntrack version 0.5.0 (8055 buckets, 32220 max)
[    2.234361] ctnetlink v0.93: registering with nfnetlink.
[    2.247327] ip_tables: (C) 2000-2006 Netfilter Core Team
[    2.259351] TCP: cubic registered
[    2.270695] NET: Registered protocol family 10
[    2.288282] Switched to clocksource tsc
[    2.313217] ip6_tables: (C) 2000-2006 Netfilter Core Team
[    2.345915] sit: IPv6 over IPv4 tunneling driver
[    2.374551] NET: Registered protocol family 17
[    2.401476] Using IPI Shortcut mode
[    2.424131] netpoll: netconsole: local port 24183
[    2.452356] netpoll: netconsole: local IPv4 address 192.168.14.1
[    2.488319] netpoll: netconsole: interface 'eth0'
[    2.516496] netpoll: netconsole: remote port 24183
[    2.545205] netpoll: netconsole: remote IPv4 address 192.168.14.15
[    2.582213] netpoll: netconsole: remote ethernet address 00:e0:81:c0:91:1b
[    2.623390] netpoll: netconsole: device eth0 not up yet, forcing it
[    2.661947] netpoll: netconsole: carrier detect appears untrustworthy, waiting 4 seconds
[    3.010077] usb 2-1: new full-speed USB device number 2 using ohci-pci
[    3.281268] cdc_acm 2-1:1.0: This device cannot do calls on its own. It is not a modem.
[    3.329568] cdc_acm 2-1:1.0: ttyACM0: USB ACM device
[    6.723581] console [netcon0] enabled
[    6.745559] netconsole: network logging started
[    6.776857] VFS: Mounted root (ext2 filesystem) readonly on device 8:1.
[    6.816870] Freeing unused kernel memory: 208K (c045b000 - c048f000)
[    6.855270] Write protecting the kernel text: 2468k
[    6.884621] Write protecting the kernel read-only data: 724k

Diff so you don't have to (and to ensure I didn't miss a line out in the
copy-and-paste from the minicom scrollback):

--- /tmp/good-boot	2015-02-02 17:30:23.527493289 +0000
+++ /tmp/bad-boot	2015-02-02 17:30:38.506270774 +0000
@@ -1,5 +1,5 @@
 Initializing cgroup subsys cpu
-Linux version 3.18.5+ (compiler@fold) (gcc version 4.8.4 20140605 (prerelease) (GCC) ) #1 Fri Jan 30 21:05:54 GMT 2015
+Linux version 3.18.5+ (compiler@fold) (gcc version 4.8.4 20140605 (prerelease) (GCC) ) #1 Fri Jan 30 20:08:48 GMT 2015
 e820: BIOS-provided physical RAM map:
 BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
 BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
@@ -48,7 +48,7 @@
 pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
 pcpu-alloc: [0] 0
 Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 129950
-Kernel command line: BOOT_IMAGE=Linux console=ttyS0,19200 root=/dev/sda1 netconsole=24183@192.168.14.1/eth0,24183@192.168.14.15/00:e0:81:c0:91:1b ignore_loglevel debug
+Kernel command line: BOOT_IMAGE=oldLinux console=ttyS0,19200 root=/dev/sda1 netconsole=24183@192.168.14.1/eth0,24183@192.168.14.15/00:e0:81:c0:91:1b ignore_loglevel debug
 PID hash table entries: 2048 (order: 1, 8192 bytes)
 Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
 Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
@@ -59,16 +59,16 @@
     vmalloc : 0xe0800000 - 0xfffa2000   ( 503 MB)
     lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
       .init : 0xc045b000 - 0xc048f000   ( 208 kB)
-      .data : 0xc0368dd5 - 0xc0459cc0   ( 963 kB)
-      .text : 0xc0100000 - 0xc0368dd5   (2467 kB)
+      .data : 0xc0368e15 - 0xc0459cc0   ( 963 kB)
+      .text : 0xc0100000 - 0xc0368e15   (2467 kB)
 Checking if this processor honours the WP bit even in supervisor mode...Ok.
 SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
 NR_IRQS:2304 nr_irqs:24 0
 CPU 0 irqstacks, hard=df408000 soft=df40a000
 console [ttyS0] enabled
 tsc: Fast TSC calibration using PIT
-tsc: Detected 499.914 MHz processor
-Calibrating delay loop (skipped), value calculated using timer frequency.. 999.82 BogoMIPS (lpj=4999140)
+tsc: Detected 499.913 MHz processor
+Calibrating delay loop (skipped), value calculated using timer frequency.. 999.82 BogoMIPS (lpj=4999130)
 pid_max: default: 32768 minimum: 101
 Security Framework initialized
 Yama: becoming mindful.
@@ -118,9 +118,6 @@
 pci 0000:00:09.0: PME# supported from D0 D1 D2 D3hot D3cold
 pci 0000:00:0e.0: [104c:ac23] type 01 class 0x060400
 pci 0000:00:14.0: [1022:2090] type 00 class 0x060100
-pci 0000:00:14.0: reg 0x10: [io  0x6000-0x7fff]
-pci 0000:00:14.0: reg 0x14: [io  0x6100-0x61ff]
-pci 0000:00:14.0: reg 0x18: [io  0x6200-0x63ff]
 pci 0000:00:14.0: CS5536 ISA bridge bug detected (incorrect header); workaround applied
 pci 0000:00:14.2: [1022:209a] type 00 class 0x010180
 pci 0000:00:14.2: reg 0x20: [io  0xe000-0xe00f]
@@ -195,9 +192,10 @@
 Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
 loop: module loaded
 zram: Created 1 device(s) ...
-cs5535-gpio cs5535-gpio: reserved resource region [io  0x6100-0x61ff]
-cs5535-mfgpt cs5535-mfgpt: reserved resource region [io  0x6200-0x63ff]
-cs5535-mfgpt cs5535-mfgpt: 8 MFGPT timers available
+cs5535-gpio cs5535-gpio: can't request region
+cs5535-gpio: probe of cs5535-gpio failed with error -5
+cs5535-mfgpt cs5535-mfgpt: can't request region
+cs5535-mfgpt: probe of cs5535-mfgpt failed with error -5
 cs5535-mfd 0000:00:14.0: 5 devices registered.
 scsi host0: pata_cs5536
 scsi host1: pata_cs5536
@@ -230,18 +228,18 @@
 ehci-pci 0000:00:15.1: USB 2.0 started, EHCI 1.00
 ata1.00: configured for MWDMA2
 scsi 0:0:0:0: Direct-Access     ATA      SanDisk SDCFH2-0 4.32 PQ: 0 ANSI: 5
+hub 1-0:1.0: USB hub found
+hub 1-0:1.0: 4 ports detected
 sd 0:0:0:0: Attached scsi generic sg0 type 0
 sd 0:0:0:0: [sda] 4001760 512-byte logical blocks: (2.04 GB/1.90 GiB)
-hub 1-0:1.0: USB hub found
 sd 0:0:0:0: [sda] Write Protect is off
 sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
-hub 1-0:1.0: 4 ports detected
-sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
 ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
 ohci-pci: OHCI PCI platform driver
 ohci-pci 0000:00:15.0: OHCI PCI host controller
 ohci-pci 0000:00:15.0: new USB bus registered, assigned bus number 2
 ohci-pci 0000:00:15.0: irq 15, io mem 0xa0005000
+sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
  sda: sda1
 sd 0:0:0:0: [sda] Attached SCSI removable disk
 hub 2-0:1.0: USB hub found
@@ -250,12 +248,12 @@
 cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
 usbcore: registered new interface driver usb-storage
 i2c /dev entries driver
-cs5535-smb cs5535-smb: SCx200 device 'CS5535 ACB0' registered
+scx200_acb: can't allocate io 0x0-0x7
+cs5535-smb: probe of cs5535-smb failed with error -5
 pc87360: Device 0x09 not activated
-cs5535-mfgpt cs5535-mfgpt: registered timer 0
+geodewdt: No timers were available
 Geode LX AES 0000:00:01.2: GEODE AES engine enabled.
-cs5535-mfgpt cs5535-mfgpt: registered timer 1
-cs5535-clockevt: Registering MFGPT timer as a clock event, using IRQ 7
+cs5535-clockevt: Could not allocate MFGPT timer
 GACT probability NOT on
 u32 classifier
     Performance counters on

The hunk at line 118 looks like a smoking gun to me.

>         a capture of 'lspci -t',

Good boot (commit reverted), done a -tv because it's just more helpful:

-[0000:00]-+-01.0  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] Host Bridge
           +-01.2  Advanced Micro Devices, Inc. [AMD] Geode LX AES Security Block
           +-06.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-07.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-08.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-09.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-0e.0-[01]--+-00.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           |            +-01.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           |            +-02.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           |            \-03.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-14.0  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA
           +-14.2  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] IDE
           +-15.0  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] OHC
           \-15.1  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] EHC

Bad boot (pristine 3.18.5):

-[0000:00]-+-01.0  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] Host Bridge
           +-01.2  Advanced Micro Devices, Inc. [AMD] Geode LX AES Security Block
           +-06.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-07.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-08.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-09.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-0e.0-[01]--+-00.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           |            +-01.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           |            +-02.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           |            \-03.0  VIA Technologies, Inc. VT6105M [Rhine-III]
           +-14.0  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA
           +-14.2  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] IDE
           +-15.0  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] OHC
           \-15.1  Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] EHC

(identical)

>         and a capture of 'lspci -vvv'.

Good boot (commit reverted):

00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] Host Bridge (rev 33)
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] Host Bridge
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 248, Cache Line Size: 32 bytes

00:01.2 Entertainment encryption device: Advanced Micro Devices, Inc. [AMD] Geode LX AES Security Block
        Subsystem: Advanced Micro Devices, Inc. [AMD] Geode LX AES Security Block
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 10
        Region 0: Memory at a0000000 (32-bit, non-prefetchable) [size=16K]
        Kernel driver in use: Geode LX AES

00:06.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 11
        Region 0: I/O ports at e100 [size=256]
        Region 1: Memory at a0004000 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

00:07.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 5
        Region 0: I/O ports at e200 [size=256]
        Region 1: Memory at a0004100 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

00:08.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 9
        Region 0: I/O ports at e300 [size=256]
        Region 1: Memory at a0004200 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

00:09.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 12
        Region 0: I/O ports at e400 [size=256]
        Region 1: Memory at a0004300 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

00:0e.0 PCI bridge: Texas Instruments PCI2250 PCI-to-PCI Bridge (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64, Cache Line Size: 32 bytes
        Bus: primary=00, secondary=01, subordinate=01, sec-latency=64
        I/O behind bridge: 0000d000-0000dfff
        Memory behind bridge: a4000000-a7ffffff
        Prefetchable memory behind bridge: fff00000-000fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [dc] Power Management version 1
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-

00:14.0 ISA bridge: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA (rev 03)
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA
        Control: I/O+ Mem- BusMaster- SpecCycle+ MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Region 0: I/O ports at 6000 [size=8]
        Region 1: I/O ports at 6100 [size=256]
        Region 2: I/O ports at 6200 [size=512]
        Kernel driver in use: cs5535-mfd

00:14.2 IDE interface: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] IDE (rev 01) (prog-if 80 [Master])
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] IDE
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Region 0: [virtual] Memory at 000001f0 (32-bit, non-prefetchable) [size=8]
        Region 1: [virtual] Memory at 000003f0 (type 3, non-prefetchable)
        Region 2: [virtual] Memory at 00000170 (32-bit, non-prefetchable) [size=8]
        Region 3: [virtual] Memory at 00000370 (type 3, non-prefetchable)
        Region 4: I/O ports at e000 [size=16]
        Kernel driver in use: pata_cs5536

00:15.0 USB controller: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] OHC (rev 02) (prog-if 10 [OHCI])
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] OHC
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 15
        Region 0: Memory at a0005000 (32-bit, non-prefetchable) [size=4K]
        Kernel driver in use: ohci-pci

00:15.1 USB controller: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] EHC (rev 02) (prog-if 20 [EHCI])
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] EHC
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 15
        Region 0: Memory at a0006000 (32-bit, non-prefetchable) [size=4K]
        Kernel driver in use: ehci-pci

01:00.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 10
        Region 0: I/O ports at d000 [size=256]
        Region 1: Memory at a4000000 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

01:01.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 7
        Region 0: I/O ports at d100 [size=256]
        Region 1: Memory at a4000100 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

01:02.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 10
        Region 0: I/O ports at d200 [size=256]
        Region 1: Memory at a4000200 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

01:03.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 7
        Region 0: I/O ports at d300 [size=256]
        Region 1: Memory at a4000300 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

Bad boot (pristine 3.18.5):

00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] Host Bridge (rev 33)
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] Host Bridge
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 248, Cache Line Size: 32 bytes

00:01.2 Entertainment encryption device: Advanced Micro Devices, Inc. [AMD] Geode LX AES Security Block
        Subsystem: Advanced Micro Devices, Inc. [AMD] Geode LX AES Security Block
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 10
        Region 0: Memory at a0000000 (32-bit, non-prefetchable) [size=16K]
        Kernel driver in use: Geode LX AES

00:06.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 11
        Region 0: I/O ports at e100 [size=256]
        Region 1: Memory at a0004000 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

00:07.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 5
        Region 0: I/O ports at e200 [size=256]
        Region 1: Memory at a0004100 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

00:08.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 9
        Region 0: I/O ports at e300 [size=256]
        Region 1: Memory at a0004200 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

00:09.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 12
        Region 0: I/O ports at e400 [size=256]
        Region 1: Memory at a0004300 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

00:0e.0 PCI bridge: Texas Instruments PCI2250 PCI-to-PCI Bridge (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64, Cache Line Size: 32 bytes
        Bus: primary=00, secondary=01, subordinate=01, sec-latency=64
        I/O behind bridge: 0000d000-0000dfff
        Memory behind bridge: a4000000-a7ffffff
        Prefetchable memory behind bridge: fff00000-000fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [dc] Power Management version 1
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-

00:14.0 ISA bridge: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA (rev 03)
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA
        Control: I/O+ Mem- BusMaster- SpecCycle+ MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Region 0: I/O ports at 0000 [size=8]
        Region 1: I/O ports at 0000
        Region 2: I/O ports at 0000
        Kernel driver in use: cs5535-mfd

00:14.2 IDE interface: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] IDE (rev 01) (prog-if 80 [Master])
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] IDE
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Region 0: [virtual] Memory at 000001f0 (32-bit, non-prefetchable) [size=8]
        Region 1: [virtual] Memory at 000003f0 (type 3, non-prefetchable)
        Region 2: [virtual] Memory at 00000170 (32-bit, non-prefetchable) [size=8]
        Region 3: [virtual] Memory at 00000370 (type 3, non-prefetchable)
        Region 4: I/O ports at e000 [size=16]
        Kernel driver in use: pata_cs5536

00:15.0 USB controller: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] OHC (rev 02) (prog-if 10 [OHCI])
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] OHC
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 15
        Region 0: Memory at a0005000 (32-bit, non-prefetchable) [size=4K]
        Kernel driver in use: ohci-pci

00:15.1 USB controller: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] EHC (rev 02) (prog-if 20 [EHCI])
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] EHC
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 15
        Region 0: Memory at a0006000 (32-bit, non-prefetchable) [size=4K]
        Kernel driver in use: ehci-pci

01:00.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 10
        Region 0: I/O ports at d000 [size=256]
        Region 1: Memory at a4000000 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

01:01.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 7
        Region 0: I/O ports at d100 [size=256]
        Region 1: Memory at a4000100 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

01:02.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 10
        Region 0: I/O ports at d200 [size=256]
        Region 1: Memory at a4000200 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

01:03.0 Ethernet controller: VIA Technologies, Inc. VT6105M [Rhine-III] (rev 96)
        Subsystem: VIA Technologies, Inc. Device 0106
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 64 (750ns min, 2000ns max), Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 7
        Region 0: I/O ports at d300 [size=256]
        Region 1: Memory at a4000300 (32-bit, non-prefetchable) [size=256]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: via-rhine

Diff:

--- /tmp/good-lspci	2015-02-02 17:33:14.373549639 +0000
+++ /tmp/bad-lspci	2015-02-02 17:35:15.263683424 +0000
@@ -84,9 +84,9 @@
         Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA
         Control: I/O+ Mem- BusMaster- SpecCycle+ MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
         Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
-        Region 0: I/O ports at 6000 [size=8]
-        Region 1: I/O ports at 6100 [size=256]
-        Region 2: I/O ports at 6200 [size=512]
+        Region 0: I/O ports at 0000 [size=8]
+        Region 1: I/O ports at 0000
+        Region 2: I/O ports at 0000
         Kernel driver in use: cs5535-mfd
 
 00:14.2 IDE interface: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] IDE (rev 01) (prog-if 80 [Master])

i.e.

00:14.0 ISA bridge: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA (rev 03)
        Subsystem: Advanced Micro Devices, Inc. [AMD] CS5536 [Geode companion] ISA
        Control: I/O+ Mem- BusMaster- SpecCycle+ MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Region 0: I/O ports at 6000 [size=8]
        Region 1: I/O ports at 6100 [size=256]
        Region 2: I/O ports at 6200 [size=512]
        Kernel driver in use: cs5535-mfd

is broken. (Given that the IDE interface is behind it I'm fairly
surprised my disk worked at all!)

> I'll open a BZ for this issue tomorrow which we can use to attach the
> logs while tracking this down.

Thanks!

(hope this helps)

-- 
NULL && (void)

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed
  2015-02-02 17:36   ` Nix
@ 2015-02-03 16:50     ` Bjorn Helgaas
  2015-02-03 17:06       ` Myron Stowe
  0 siblings, 1 reply; 7+ messages in thread
From: Bjorn Helgaas @ 2015-02-03 16:50 UTC (permalink / raw)
  To: Nix
  Cc: Myron Stowe, linux-pci, Linux Kernel Mailing List, Myron Stowe,
	Bill Unruh, martin, Matthew Wilcox, Greg Kroah-Hartman

On Mon, Feb 2, 2015 at 11:36 AM, Nix <nix@esperi.org.uk> wrote:
> On 2 Feb 2015, Myron Stowe verbalised:
>
>> Nix:
>>
>> Thanks for the work you've already done with the bisection.  Let's see
>> if we can get to the bottom of this.  Would you capture two couple sets
>> of logs, one without the issue and another set with the commit at issue
>> included for comparison.

>  pci 0000:00:14.0: [1022:2090] type 00 class 0x060100
> -pci 0000:00:14.0: reg 0x10: [io  0x6000-0x7fff]
> -pci 0000:00:14.0: reg 0x14: [io  0x6100-0x61ff]
> -pci 0000:00:14.0: reg 0x18: [io  0x6200-0x63ff]
>  pci 0000:00:14.0: CS5536 ISA bridge bug detected (incorrect header); workaround applied

> +scx200_acb: can't allocate io 0x0-0x7

I think the problem is that these three BARs are read-only.  Prior to
36e8164882ca, we didn't detect that, and we computed the size based on
the lowest order bit that was set in the address.  This gave us
incorrect sizes, but it did work in the sense that the driver could
operate the device.

After 36e8164882ca, we detect that the BARs are read-only and ignore
them completely, which breaks this case because we don't mark the
resource as I/O and we don't fill in the starting address, so even
though the quirk runs, it just sets the first resource to [???
0x0000-0x0007], which doesn't work.

I think this is the right behavior for the PCI core because we can't
tell how big these BARs are.  The only alternative is to assume they
are as big as possible given their current addresses.  But that would
mean a 4KB read-only BAR that happened to be aligned on a 2GB boundary
would have to consume 2GB of address space, and *that* doesn't seem
reasonable.

We already have a quirk for this device, so I think the best fix is to
change the quirk so it reads these three BARs directly and restores
the resources based on its hard-coded knowledge of how big they are.

Bjorn

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed
  2015-02-03 16:50     ` Bjorn Helgaas
@ 2015-02-03 17:06       ` Myron Stowe
  2015-02-03 20:01         ` Nix
  0 siblings, 1 reply; 7+ messages in thread
From: Myron Stowe @ 2015-02-03 17:06 UTC (permalink / raw)
  To: Bjorn Helgaas
  Cc: Nix, Myron Stowe, linux-pci, Linux Kernel Mailing List,
	Myron Stowe, Bill Unruh, martin, Matthew Wilcox,
	Greg Kroah-Hartman

On Tue, Feb 3, 2015 at 9:50 AM, Bjorn Helgaas <bhelgaas@google.com> wrote:
> On Mon, Feb 2, 2015 at 11:36 AM, Nix <nix@esperi.org.uk> wrote:
>> On 2 Feb 2015, Myron Stowe verbalised:
>>
>>> Nix:
>>>
>>> Thanks for the work you've already done with the bisection.  Let's see
>>> if we can get to the bottom of this.  Would you capture two couple sets
>>> of logs, one without the issue and another set with the commit at issue
>>> included for comparison.
>
>>  pci 0000:00:14.0: [1022:2090] type 00 class 0x060100
>> -pci 0000:00:14.0: reg 0x10: [io  0x6000-0x7fff]
>> -pci 0000:00:14.0: reg 0x14: [io  0x6100-0x61ff]
>> -pci 0000:00:14.0: reg 0x18: [io  0x6200-0x63ff]
>>  pci 0000:00:14.0: CS5536 ISA bridge bug detected (incorrect header); workaround applied
>
>> +scx200_acb: can't allocate io 0x0-0x7
>
> I think the problem is that these three BARs are read-only.  Prior to
> 36e8164882ca, we didn't detect that, and we computed the size based on
> the lowest order bit that was set in the address.  This gave us
> incorrect sizes, but it did work in the sense that the driver could
> operate the device.
>
> After 36e8164882ca, we detect that the BARs are read-only and ignore
> them completely, which breaks this case because we don't mark the
> resource as I/O and we don't fill in the starting address, so even
> though the quirk runs, it just sets the first resource to [???
> 0x0000-0x0007], which doesn't work.
>
> I think this is the right behavior for the PCI core because we can't
> tell how big these BARs are.  The only alternative is to assume they
> are as big as possible given their current addresses.  But that would
> mean a 4KB read-only BAR that happened to be aligned on a 2GB boundary
> would have to consume 2GB of address space, and *that* doesn't seem
> reasonable.
>
> We already have a quirk for this device, so I think the best fix is to
> change the quirk so it reads these three BARs directly and restores
> the resources based on its hard-coded knowledge of how big they are.
>

I see Bjorn beat me to the punch.  Anyway here is what I was just
writing up in response ...

Nix:

Thanks very much for provinding the logs asked for earlier.  I've studied
the logs, code, and commit 3fdb9b9 and believe I now understand what is
occurring.

As you too pointed out, the issue concerns the device at 00:14.0.  From the
'dmesg' logs we see that on a good boot we get:
  pci 0000:00:14.0: reg 0x10: [io  0x6000-0x7fff]       // Bad: see below
  pci 0000:00:14.0: reg 0x14: [io  0x6100-0x61ff]
  pci 0000:00:14.0: reg 0x18: [io  0x6200-0x63ff]
  pci 0000:00:14.0: CS5536 ISA bridge bug detected (incorrect header);
  workaround applied
whereas with commit 3fdb9b9 applied we longer get the lines corresponding to
the device's BARs.

I believe this is due to this specific device's BARs as being non-conformant
with respect to PCI device BAR sizing.  Based on my analysis, all three BARs
always return fixed, read-only, values and thus commit 3fdb9b9 is detecting
such as it was designed to.

The difference in this case is we need these BARs.  In all the prior cases
where we detected read-only BARs we could ignore them with no consequenses
(see the patch series summary at: https://lkml.org/lkml/2014/10/30/637).

Note also that in the series I submitted upstream to detect non-conformant
BARs there were three patches and the latter added a message letting us know
such a BAR was encountered (https://lkml.org/lkml/2014/10/30/636).  It looks
like you are running a "stable" kernel, 3.18.5, and the warning message is
not present as the "stable" kernel updates only took in patch 1/3 and not
the subsequent two.

With commit 3fdb9b9 applied, no resource information was obtained for the
device.  Thus later, when the kernel's driver probed and tried to attach it
ended up failing since it could not acquire the needed resources:
  cs5535-gpio cs5535-gpio: can't request region
  cs5535-gpio: probe of cs5535-gpio failed with error -5
  cs5535-mfgpt cs5535-mfgpt: can't request region
  cs5535-mfgpt: probe of cs5535-mfgpt failed with error -5
  ...
  cs5535-smb: probe of cs5535-smb failed with error -5
  ...
  cs5535-clockevt: Could not allocate MFGPT timer


Focusing on the root issue, here is my analysis -
During PCI device discovery the kernel walks the bus and collects resource
information (see: drivers/pci/probe.c::__pci_read_base()).  Flowing the
pertinant parts based on specific values obtained from the 'dmesg' logs I
come up with this with respect to device 00:14.0 BAR 0 (prior to commit
3fdb9b9 being applied):

  #define PCI_BASE_ADDRESS_IO_MASK (~0x03UL)
  #define IO_SPACE_LIMIT ~(0UL)

  mask = 0xffffffff
  l = 0x00006001
  sz = 0x00006001       // See footnote [1] below; this is the key
  l &= PCI_BASE_ADDRESS_IO_MASK
  l = 0x00006000
  [ sz &= PCI_BASE_ADDRESS_IO_MASK ]    // commit 3fdb9b9
  [ sz = 0x00006000 ]                   // commit 3fdb9b9
  mask = PCI_BASE_ADDRESS_IO_MASK & (u32) IO_SPACE_LIMIT
  mask = 0xfffffffc

  sz = pci_size(l, sz, mask)
  sz = pci_size(base, maxbase, mask)
  sz = pci_size(0x00000000.00006000, 0x00000000.00006001, 0x00000000.fffffffc)
      u64 size = mask & maxbase
      size = 0x00000000.00006000
      size = (size & ~(size-1)) - 1
      size = (0x00000000.00006000 & ~(0x00000000.00005fff)) - 1
      size = (0x00000000.00006000 & 0xffffffff.ffffa000) - 1
      size = 0x00000000.00002000 - 1
      size = 0x00000000.00001fff
      if (base == maxbase && ((base | size) & mask) != mask)
          return 0      // base != maxbase so test is False
      return  0x00000000.00001fff
  sz = 0x1fff

  region.start = l
  region.start = 0x6000
  region.end = l + sz
  region.end = 0x7fff

The kernel ends up with an 8k IO Port region with start and end sizes of
0x6000 and 0x7fff respectively for BAR 0 as is confirmed in the "good boot"
'dmesg':
  pci 0000:00:14.0: reg 0x10: [io  0x6000-0x7fff]

[1] There are two issues here.  The largest range that an IO decoder can
request is 256 bytes.  This is rectified later by
drivers/pci/quirks.c::quirk_cs5536_vsa(), which truncates the range to 8
bytes (see: support.amd.com/TechDocs/31506_cs5535_databoot.pdf, sec 6.11, p
370 and sec 5.6.1, p 105).

The other issue is that the BARs of this device are non-conformant.  They
are not returning proper sizing infomation when sized.  Instead, they seem
to be returning hard-coded, read-only, values and this is the root cause at
play.

With commit 3fdb9b9 applied, the read-only BARs are detected and ignored:

  mask = 0xffffffff
  l = 0x00006001
  sz = 0x00006001       // For 8k, device should have returned 0xffffe001
  l &= PCI_BASE_ADDRESS_IO_MASK
  l = 0x00006000
  sz &= PCI_BASE_ADDRESS_IO_MASK        // commit 3fdb9b9
  sz = 0x00006000                       // commit 3fdb9b9
  mask = PCI_BASE_ADDRESS_IO_MASK & (u32) IO_SPACE_LIMIT
  mask = 0xfffffffc

  sz = pci_size(l, sz, mask)
  sz = pci_size(base, maxbase, mask)
  sz = pci_size(0x00000000.00006000, 0x00000000.00006000, 0x00000000.fffffffc)
      u64 size = mask & maxbase
      size = 0x00000000.00006000
      size = (size & ~(size-1)) - 1
      size = (0x00000000.00006000 & ~(0x00000000.00005fff)) - 1
      size = (0x00000000.00006000 & 0xffffffff.ffffa000) - 1
      size = 0x00000000.00002000 - 1
      size = 0x00000000.00001fff
      if (base == maxbase && ((base | size) & mask) != mask)
          // base == maxbase - this part of test is True
          // ((base | size) & mask) != mask - while this part is for
          // detecting another aspect, it is also True
          return 0
  sz = 0

  if (!sz)
    goto fail


As expressed above, I believe this device is non-conformant.  This could be
validated by instrumenting the kernel's sizing code in '__pci_read_base()';
specifically the initial 'pci_read_config_dword()'s of 'l' and 'sz'.

Whereas we have been able to ignore read-only BARs in past occurrances, this
time they are needed.  As such, I think we can solve this issue by expanding
the existing quirk for this device.  I'll work that up and post.  If you
would, please apply and test what is posted and report back.  In the mean
time, I would be interested in obtaining confirmation as to my belief that
this device's BARs are read-only (i.e. the instrumentation mentioned).  If
you have time and are willing I would appreaciate that.  If not, I'm
confident that is what is occurring and you can just stick with applying and
testing the expanded quirk patch I intend to post.

Thanks so much for your efforts,
 Myron


> Bjorn
> --
> To unsubscribe from this list: send the line "unsubscribe linux-pci" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed
  2015-02-03 17:06       ` Myron Stowe
@ 2015-02-03 20:01         ` Nix
  2015-02-03 20:33           ` Myron Stowe
  0 siblings, 1 reply; 7+ messages in thread
From: Nix @ 2015-02-03 20:01 UTC (permalink / raw)
  To: Myron Stowe
  Cc: Bjorn Helgaas, Myron Stowe, linux-pci, Linux Kernel Mailing List,
	Myron Stowe, Bill Unruh, martin, Matthew Wilcox,
	Greg Kroah-Hartman

On 3 Feb 2015, Myron Stowe uttered the following:
> As expressed above, I believe this device is non-conformant.  This could be
> validated by instrumenting the kernel's sizing code in '__pci_read_base()';
> specifically the initial 'pci_read_config_dword()'s of 'l' and 'sz'.
> 
> Whereas we have been able to ignore read-only BARs in past occurrances, this
> time they are needed.  As such, I think we can solve this issue by expanding
> the existing quirk for this device.  I'll work that up and post.  If you
> would, please apply and test what is posted and report back.  In the mean
> time, I would be interested in obtaining confirmation as to my belief that
> this device's BARs are read-only (i.e. the instrumentation mentioned).  If
> you have time and are willing I would appreaciate that.  If not, I'm
> confident that is what is occurring and you can just stick with applying and
> testing the expanded quirk patch I intend to post.

Here, and the device behind it, just in case it's useful:

[    1.050352] pci 0000:00:14.0: [1022:2090] type 00 class 0x060100
[    1.060152] name: 0000:00:14.0; l: 6001; sz: 6001
[    1.070037] pci 0000:00:14.0: reg 0x10: [io  0x6000-0x7fff]
[    1.080114] name: 0000:00:14.0; l: 6101; sz: 6101
[    1.090037] pci 0000:00:14.0: reg 0x14: [io  0x6100-0x61ff]
[    1.100113] name: 0000:00:14.0; l: 6201; sz: 6201
[    1.110036] pci 0000:00:14.0: reg 0x18: [io  0x6200-0x63ff]
[    1.120113] name: 0000:00:14.0; l: 0; sz: 0
[    1.130130] name: 0000:00:14.0; l: 0; sz: 0
[    1.140129] name: 0000:00:14.0; l: 0; sz: 0
[    1.150129] name: 0000:00:14.0; l: 0; sz: 0
[    1.160075] pci 0000:00:14.0: CS5536 ISA bridge bug detected (incorrect header); workaround applied
[    1.180018] pci 0000:00:14.2: [1022:209a] type 00 class 0x010180
[    1.190155] name: 0000:00:14.2; l: 0; sz: 0
[    1.200133] name: 0000:00:14.2; l: 0; sz: 0
[    1.210133] name: 0000:00:14.2; l: 0; sz: 0
[    1.220133] name: 0000:00:14.2; l: 0; sz: 0
[    1.230150] name: 0000:00:14.2; l: e001; sz: fffffff1
[    1.240037] pci 0000:00:14.2: reg 0x20: [io  0xe000-0xe00f]
[    1.250115] name: 0000:00:14.2; l: 0; sz: 0
[    1.260133] name: 0000:00:14.2; l: 0; sz: 0
[    1.270091] pci 0000:00:14.2: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    1.280021] pci 0000:00:14.2: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    1.290019] pci 0000:00:14.2: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    1.300018] pci 0000:00:14.2: legacy IDE quirk: reg 0x1c: [io  0x0376]

-- 
NULL && (void)

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed
  2015-02-03 20:01         ` Nix
@ 2015-02-03 20:33           ` Myron Stowe
  0 siblings, 0 replies; 7+ messages in thread
From: Myron Stowe @ 2015-02-03 20:33 UTC (permalink / raw)
  To: Nix
  Cc: Bjorn Helgaas, Myron Stowe, linux-pci, Linux Kernel Mailing List,
	Myron Stowe, Bill Unruh, martin, Matthew Wilcox,
	Greg Kroah-Hartman

On Tue, Feb 3, 2015 at 1:01 PM, Nix <nix@esperi.org.uk> wrote:
> On 3 Feb 2015, Myron Stowe uttered the following:
>> As expressed above, I believe this device is non-conformant.  This could be
>> validated by instrumenting the kernel's sizing code in '__pci_read_base()';
>> specifically the initial 'pci_read_config_dword()'s of 'l' and 'sz'.
>>
>> Whereas we have been able to ignore read-only BARs in past occurrances, this
>> time they are needed.  As such, I think we can solve this issue by expanding
>> the existing quirk for this device.  I'll work that up and post.  If you
>> would, please apply and test what is posted and report back.  In the mean
>> time, I would be interested in obtaining confirmation as to my belief that
>> this device's BARs are read-only (i.e. the instrumentation mentioned).  If
>> you have time and are willing I would appreaciate that.  If not, I'm
>> confident that is what is occurring and you can just stick with applying and
>> testing the expanded quirk patch I intend to post.
>
> Here, and the device behind it, just in case it's useful:
>
> [    1.050352] pci 0000:00:14.0: [1022:2090] type 00 class 0x060100
> [    1.060152] name: 0000:00:14.0; l: 6001; sz: 6001
> [    1.070037] pci 0000:00:14.0: reg 0x10: [io  0x6000-0x7fff]
> [    1.080114] name: 0000:00:14.0; l: 6101; sz: 6101
> [    1.090037] pci 0000:00:14.0: reg 0x14: [io  0x6100-0x61ff]
> [    1.100113] name: 0000:00:14.0; l: 6201; sz: 6201
> [    1.110036] pci 0000:00:14.0: reg 0x18: [io  0x6200-0x63ff]

Bingo - all three BARs above are not sizing, they are behaving as
read-only as suspected.

> [    1.120113] name: 0000:00:14.0; l: 0; sz: 0
> [    1.130130] name: 0000:00:14.0; l: 0; sz: 0
> [    1.140129] name: 0000:00:14.0; l: 0; sz: 0
> [    1.150129] name: 0000:00:14.0; l: 0; sz: 0
> [    1.160075] pci 0000:00:14.0: CS5536 ISA bridge bug detected (incorrect header); workaround applied
> [    1.180018] pci 0000:00:14.2: [1022:209a] type 00 class 0x010180
> [    1.190155] name: 0000:00:14.2; l: 0; sz: 0
> [    1.200133] name: 0000:00:14.2; l: 0; sz: 0
> [    1.210133] name: 0000:00:14.2; l: 0; sz: 0
> [    1.220133] name: 0000:00:14.2; l: 0; sz: 0
> [    1.230150] name: 0000:00:14.2; l: e001; sz: fffffff1

Above is from proper sizing behavior and thus the next line shows a proper,
size based region based upon such.

> [    1.240037] pci 0000:00:14.2: reg 0x20: [io  0xe000-0xe00f]
> [    1.250115] name: 0000:00:14.2; l: 0; sz: 0
> [    1.260133] name: 0000:00:14.2; l: 0; sz: 0
> [    1.270091] pci 0000:00:14.2: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
> [    1.280021] pci 0000:00:14.2: legacy IDE quirk: reg 0x14: [io  0x03f6]
> [    1.290019] pci 0000:00:14.2: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
> [    1.300018] pci 0000:00:14.2: legacy IDE quirk: reg 0x1c: [io  0x0376]

Don't be alarmed by the 'l' and 'sz' values of 0 for device 00:14.2.
Its a "legacy
IDE" device and thus is handled by special code (see:
drivers/pci/probe.c::pci_setup_device()).

The existing quirk I'm expanding - quirk_cs5536_vsa - will be similar to what
'pci_setup_device()' is doing for IDE.  I have it coded up, just need
to write up a
commit log which is often harder to come up with something good than writing the
patch.

Thanks again, stay tuned,
 Myron
>
> --
> NULL && (void)

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2015-02-03 20:33 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-01-30 21:12 [3.18.3 BISECTED REGRESSION] scx200_acb / cs5535-smb / geodewdt / cs5535-clockevt torpedoed Nix
2015-02-02  3:29 ` Myron Stowe
2015-02-02 17:36   ` Nix
2015-02-03 16:50     ` Bjorn Helgaas
2015-02-03 17:06       ` Myron Stowe
2015-02-03 20:01         ` Nix
2015-02-03 20:33           ` Myron Stowe

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.