linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
@ 2005-06-08 11:28 Ingo Molnar
  2005-06-08 14:18 ` Michal Schmidt
                   ` (9 more replies)
  0 siblings, 10 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-08 11:28 UTC (permalink / raw)
  To: linux-kernel; +Cc: Eugeny S. Mints, Daniel Walker


i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
downloaded from the usual place:

    http://redhat.com/~mingo/realtime-preempt/

this release includes an improved version of Daniel Walker's soft 
irq-flag (hardirq-disable removal) feature. It is an unconditional part
of the PREEMPT_RT preemption model - other preemption models should not
be affected that much (besides possible build issues). Non-x86 arches
wont build. Some regressions might happen, so take care..

Changes since -47-29:

 - soft IRQ flag support (Daniel Walker)

 - fix race in usbnet.c (Eugeny S. Mints)

 - further improvements to the soft IRQ flag code

to build a -V0.7.48-00 tree, the following patches should to be applied:

   http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.11.tar.bz2
   http://kernel.org/pub/linux/kernel/v2.6/testing/patch-2.6.12-rc6.bz2
   http://redhat.com/~mingo/realtime-preempt/realtime-preempt-2.6.12-rc6-V0.7.48-00

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
@ 2005-06-08 14:18 ` Michal Schmidt
  2005-06-08 14:40   ` Keith Owens
  2005-06-08 14:41   ` Paulo Marques
  2005-06-08 14:32 ` Michal Schmidt
                   ` (8 subsequent siblings)
  9 siblings, 2 replies; 139+ messages in thread
From: Michal Schmidt @ 2005-06-08 14:18 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 644 bytes --]

Ingo Molnar wrote:
> i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
> downloaded from the usual place:

The build fails with inconsistent kallsyms data:
   ...
   LD      .tmp_vmlinux1
   KSYM    .tmp_kallsyms1.S
   AS      .tmp_kallsyms1.o
   LD      .tmp_vmlinux2
   KSYM    .tmp_kallsyms2.S
   AS      .tmp_kallsyms2.o
   LD      vmlinux
   SYSMAP  System.map
   SYSMAP  .tmp_System.map
Inconsistent kallsyms data
Try setting CONFIG_KALLSYMS_EXTRA_PASS
make: *** [vmlinux] Error 1

When I enable the workaround CONFIG_KALLSYMS_EXTRA_PASS, it works.
This is on i386, Debian Sarge. I'm attaching my .config.

Michal

[-- Attachment #2: .config --]
[-- Type: text/plain, Size: 35215 bytes --]

#
# Automatically generated make config: don't edit
# Linux kernel version: 2.6.12-rc6-RT-V0.7.48-01
# Wed Jun  8 16:14:11 2005
#
CONFIG_X86=y
CONFIG_MMU=y
CONFIG_UID16=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y

#
# Code maturity level options
#
CONFIG_EXPERIMENTAL=y
CONFIG_CLEAN_COMPILE=y
CONFIG_BROKEN_ON_SMP=y
CONFIG_LOCK_KERNEL=y
CONFIG_INIT_ENV_ARG_LIMIT=32

#
# General setup
#
CONFIG_LOCALVERSION=""
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_POSIX_MQUEUE=y
CONFIG_BSD_PROCESS_ACCT=y
# CONFIG_BSD_PROCESS_ACCT_V3 is not set
CONFIG_SYSCTL=y
# CONFIG_AUDIT is not set
CONFIG_HOTPLUG=y
CONFIG_KOBJECT_UEVENT=y
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
# CONFIG_EMBEDDED is not set
CONFIG_KALLSYMS=y
# CONFIG_KALLSYMS_ALL is not set
# CONFIG_KALLSYMS_EXTRA_PASS is not set
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SHMEM=y
CONFIG_CC_ALIGN_FUNCTIONS=0
CONFIG_CC_ALIGN_LABELS=0
CONFIG_CC_ALIGN_LOOPS=0
CONFIG_CC_ALIGN_JUMPS=0
# CONFIG_TINY_SHMEM is not set
CONFIG_BASE_SMALL=0

#
# Loadable module support
#
CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y
CONFIG_MODULE_FORCE_UNLOAD=y
CONFIG_OBSOLETE_MODPARM=y
# CONFIG_MODVERSIONS is not set
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_KMOD=y

#
# Processor type and features
#
CONFIG_X86_PC=y
# CONFIG_X86_ELAN is not set
# CONFIG_X86_VOYAGER is not set
# CONFIG_X86_NUMAQ is not set
# CONFIG_X86_SUMMIT is not set
# CONFIG_X86_BIGSMP is not set
# CONFIG_X86_VISWS is not set
# CONFIG_X86_GENERICARCH is not set
# CONFIG_X86_ES7000 is not set
# CONFIG_M386 is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
# CONFIG_MPENTIUMIII is not set
# CONFIG_MPENTIUMM is not set
CONFIG_MPENTIUM4=y
# CONFIG_MK6 is not set
# CONFIG_MK7 is not set
# CONFIG_MK8 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MEFFICEON is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP2 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MGEODEGX1 is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
# CONFIG_X86_GENERIC is not set
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=7
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_HPET_TIMER=y
# CONFIG_SMP is not set
# CONFIG_PREEMPT_NONE is not set
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT_DESKTOP is not set
CONFIG_PREEMPT_RT=y
CONFIG_PREEMPT=y
CONFIG_PREEMPT_SOFTIRQS=y
CONFIG_PREEMPT_HARDIRQS=y
CONFIG_PREEMPT_RCU=y
CONFIG_PREEMPT_BKL=y
CONFIG_RWSEM_GENERIC_SPINLOCK=y
CONFIG_ASM_SEMAPHORES=y
# CONFIG_X86_UP_APIC is not set
CONFIG_X86_TSC=y
CONFIG_X86_MCE=y
CONFIG_X86_MCE_NONFATAL=m
# CONFIG_TOSHIBA is not set
# CONFIG_I8K is not set
# CONFIG_X86_REBOOTFIXUPS is not set
CONFIG_MICROCODE=m
CONFIG_X86_MSR=m
CONFIG_X86_CPUID=m

#
# Firmware Drivers
#
CONFIG_EDD=m
CONFIG_NOHIGHMEM=y
# CONFIG_HIGHMEM4G is not set
# CONFIG_HIGHMEM64G is not set
# CONFIG_MATH_EMULATION is not set
CONFIG_MTRR=y
# CONFIG_EFI is not set
CONFIG_HAVE_DEC_LOCK=y
CONFIG_SECCOMP=y

#
# Power management options (ACPI, APM)
#
CONFIG_PM=y
# CONFIG_PM_DEBUG is not set
CONFIG_SOFTWARE_SUSPEND=y
CONFIG_PM_STD_PARTITION=""

#
# ACPI (Advanced Configuration and Power Interface) Support
#
CONFIG_ACPI=y
CONFIG_ACPI_BOOT=y
CONFIG_ACPI_INTERPRETER=y
CONFIG_ACPI_SLEEP=y
CONFIG_ACPI_SLEEP_PROC_FS=y
CONFIG_ACPI_AC=m
CONFIG_ACPI_BATTERY=m
CONFIG_ACPI_BUTTON=m
CONFIG_ACPI_VIDEO=m
CONFIG_ACPI_FAN=m
CONFIG_ACPI_PROCESSOR=m
CONFIG_ACPI_THERMAL=m
CONFIG_ACPI_ASUS=m
# CONFIG_ACPI_IBM is not set
CONFIG_ACPI_TOSHIBA=m
CONFIG_ACPI_BLACKLIST_YEAR=0
# CONFIG_ACPI_DEBUG is not set
CONFIG_ACPI_BUS=y
CONFIG_ACPI_EC=y
CONFIG_ACPI_POWER=y
CONFIG_ACPI_PCI=y
CONFIG_ACPI_SYSTEM=y
CONFIG_X86_PM_TIMER=y
CONFIG_ACPI_CONTAINER=m

#
# APM (Advanced Power Management) BIOS Support
#
# CONFIG_APM is not set

#
# CPU Frequency scaling
#
CONFIG_CPU_FREQ=y
CONFIG_CPU_FREQ_TABLE=m
# CONFIG_CPU_FREQ_DEBUG is not set
CONFIG_CPU_FREQ_STAT=m
# CONFIG_CPU_FREQ_STAT_DETAILS is not set
CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE is not set
CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
CONFIG_CPU_FREQ_GOV_POWERSAVE=m
CONFIG_CPU_FREQ_GOV_USERSPACE=m
CONFIG_CPU_FREQ_GOV_ONDEMAND=m
CONFIG_CPU_FREQ_GOV_CONSERVATIVE=m

#
# CPUFreq processor drivers
#
CONFIG_X86_ACPI_CPUFREQ=m
# CONFIG_X86_POWERNOW_K6 is not set
# CONFIG_X86_POWERNOW_K7 is not set
# CONFIG_X86_POWERNOW_K8 is not set
# CONFIG_X86_GX_SUSPMOD is not set
CONFIG_X86_SPEEDSTEP_CENTRINO=m
CONFIG_X86_SPEEDSTEP_CENTRINO_ACPI=y
CONFIG_X86_SPEEDSTEP_CENTRINO_TABLE=y
CONFIG_X86_SPEEDSTEP_ICH=m
CONFIG_X86_SPEEDSTEP_SMI=m
CONFIG_X86_P4_CLOCKMOD=m
# CONFIG_X86_CPUFREQ_NFORCE2 is not set
# CONFIG_X86_LONGRUN is not set
# CONFIG_X86_LONGHAUL is not set

#
# shared options
#
# CONFIG_X86_ACPI_CPUFREQ_PROC_INTF is not set
CONFIG_X86_SPEEDSTEP_LIB=m
CONFIG_X86_SPEEDSTEP_RELAXED_CAP_CHECK=y

#
# Bus options (PCI, PCMCIA, EISA, MCA, ISA)
#
CONFIG_PCI=y
# CONFIG_PCI_GOBIOS is not set
# CONFIG_PCI_GOMMCONFIG is not set
# CONFIG_PCI_GODIRECT is not set
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
# CONFIG_PCIEPORTBUS is not set
# CONFIG_PCI_LEGACY_PROC is not set
CONFIG_PCI_NAMES=y
# CONFIG_PCI_DEBUG is not set
CONFIG_ISA_DMA_API=y
# CONFIG_ISA is not set
# CONFIG_MCA is not set
# CONFIG_SCx200 is not set

#
# PCCARD (PCMCIA/CardBus) support
#
# CONFIG_PCCARD is not set

#
# PCI Hotplug Support
#
# CONFIG_HOTPLUG_PCI is not set

#
# Executable file formats
#
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_AOUT=m
CONFIG_BINFMT_MISC=m

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=m
# CONFIG_DEBUG_DRIVER is not set

#
# Memory Technology Devices (MTD)
#
# CONFIG_MTD is not set

#
# Parallel port support
#
CONFIG_PARPORT=m
CONFIG_PARPORT_PC=m
CONFIG_PARPORT_SERIAL=m
CONFIG_PARPORT_PC_FIFO=y
# CONFIG_PARPORT_PC_SUPERIO is not set
CONFIG_PARPORT_NOT_PC=y
# CONFIG_PARPORT_GSC is not set
CONFIG_PARPORT_1284=y

#
# Plug and Play support
#
# CONFIG_PNP is not set

#
# Block devices
#
CONFIG_BLK_DEV_FD=m
# CONFIG_PARIDE is not set
# CONFIG_BLK_CPQ_DA is not set
# CONFIG_BLK_CPQ_CISS_DA is not set
# CONFIG_BLK_DEV_DAC960 is not set
# CONFIG_BLK_DEV_UMEM is not set
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=m
CONFIG_BLK_DEV_CRYPTOLOOP=m
CONFIG_BLK_DEV_NBD=m
# CONFIG_BLK_DEV_SX8 is not set
# CONFIG_BLK_DEV_UB is not set
# CONFIG_BLK_DEV_RAM is not set
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_INITRAMFS_SOURCE=""
# CONFIG_LBD is not set
CONFIG_CDROM_PKTCDVD=m
CONFIG_CDROM_PKTCDVD_BUFFERS=8
# CONFIG_CDROM_PKTCDVD_WCACHE is not set

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_ATA_OVER_ETH is not set

#
# ATA/ATAPI/MFM/RLL support
#
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y

#
# Please see Documentation/ide.txt for help/info on IDE drives
#
# CONFIG_BLK_DEV_IDE_SATA is not set
# CONFIG_BLK_DEV_HD_IDE is not set
CONFIG_BLK_DEV_IDEDISK=y
# CONFIG_IDEDISK_MULTI_MODE is not set
CONFIG_BLK_DEV_IDECD=m
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDEFLOPPY is not set
# CONFIG_BLK_DEV_IDESCSI is not set
# CONFIG_IDE_TASK_IOCTL is not set

#
# IDE chipset support/bugfixes
#
CONFIG_IDE_GENERIC=y
# CONFIG_BLK_DEV_CMD640 is not set
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_SHARE_IRQ=y
# CONFIG_BLK_DEV_OFFBOARD is not set
CONFIG_BLK_DEV_GENERIC=y
# CONFIG_BLK_DEV_OPTI621 is not set
# CONFIG_BLK_DEV_RZ1000 is not set
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_IDEDMA_FORCED is not set
CONFIG_IDEDMA_PCI_AUTO=y
# CONFIG_IDEDMA_ONLYDISK is not set
# CONFIG_BLK_DEV_AEC62XX is not set
# CONFIG_BLK_DEV_ALI15X3 is not set
# CONFIG_BLK_DEV_AMD74XX is not set
# CONFIG_BLK_DEV_ATIIXP is not set
# CONFIG_BLK_DEV_CMD64X is not set
# CONFIG_BLK_DEV_TRIFLEX is not set
# CONFIG_BLK_DEV_CY82C693 is not set
# CONFIG_BLK_DEV_CS5520 is not set
# CONFIG_BLK_DEV_CS5530 is not set
# CONFIG_BLK_DEV_HPT34X is not set
# CONFIG_BLK_DEV_HPT366 is not set
# CONFIG_BLK_DEV_SC1200 is not set
CONFIG_BLK_DEV_PIIX=y
# CONFIG_BLK_DEV_NS87415 is not set
# CONFIG_BLK_DEV_PDC202XX_OLD is not set
# CONFIG_BLK_DEV_PDC202XX_NEW is not set
# CONFIG_BLK_DEV_SVWKS is not set
# CONFIG_BLK_DEV_SIIMAGE is not set
# CONFIG_BLK_DEV_SIS5513 is not set
# CONFIG_BLK_DEV_SLC90E66 is not set
# CONFIG_BLK_DEV_TRM290 is not set
# CONFIG_BLK_DEV_VIA82CXXX is not set
# CONFIG_IDE_ARM is not set
CONFIG_BLK_DEV_IDEDMA=y
# CONFIG_IDEDMA_IVB is not set
CONFIG_IDEDMA_AUTO=y
# CONFIG_BLK_DEV_HD is not set

#
# SCSI device support
#
CONFIG_SCSI=m
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=m
# CONFIG_CHR_DEV_ST is not set
# CONFIG_CHR_DEV_OSST is not set
CONFIG_BLK_DEV_SR=m
# CONFIG_BLK_DEV_SR_VENDOR is not set
CONFIG_CHR_DEV_SG=m

#
# Some SCSI devices (e.g. CD jukebox) support multiple LUNs
#
CONFIG_SCSI_MULTI_LUN=y
CONFIG_SCSI_CONSTANTS=y
# CONFIG_SCSI_LOGGING is not set

#
# SCSI Transport Attributes
#
CONFIG_SCSI_SPI_ATTRS=m
# CONFIG_SCSI_FC_ATTRS is not set
# CONFIG_SCSI_ISCSI_ATTRS is not set

#
# SCSI low-level drivers
#
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
# CONFIG_SCSI_3W_9XXX is not set
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC7XXX_OLD is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_SCSI_DPT_I2O is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_SCSI_SATA is not set
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_SCSI_DMX3191D is not set
# CONFIG_SCSI_EATA is not set
# CONFIG_SCSI_FUTURE_DOMAIN is not set
# CONFIG_SCSI_GDTH is not set
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INITIO is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_PPA is not set
# CONFIG_SCSI_IMM is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_IPR is not set
# CONFIG_SCSI_QLOGIC_FC is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
CONFIG_SCSI_QLA2XXX=m
# CONFIG_SCSI_QLA21XX is not set
# CONFIG_SCSI_QLA22XX is not set
# CONFIG_SCSI_QLA2300 is not set
# CONFIG_SCSI_QLA2322 is not set
# CONFIG_SCSI_QLA6312 is not set
# CONFIG_SCSI_LPFC is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_DC390T is not set
# CONFIG_SCSI_NSP32 is not set
# CONFIG_SCSI_DEBUG is not set

#
# Multi-device support (RAID and LVM)
#
CONFIG_MD=y
CONFIG_BLK_DEV_MD=m
CONFIG_MD_LINEAR=m
CONFIG_MD_RAID0=m
CONFIG_MD_RAID1=m
# CONFIG_MD_RAID10 is not set
CONFIG_MD_RAID5=m
CONFIG_MD_RAID6=m
CONFIG_MD_MULTIPATH=m
# CONFIG_MD_FAULTY is not set
CONFIG_BLK_DEV_DM=m
CONFIG_DM_CRYPT=m
CONFIG_DM_SNAPSHOT=m
CONFIG_DM_MIRROR=m
CONFIG_DM_ZERO=m
CONFIG_DM_MULTIPATH=m
# CONFIG_DM_MULTIPATH_EMC is not set

#
# Fusion MPT device support
#
# CONFIG_FUSION is not set

#
# IEEE 1394 (FireWire) support
#
# CONFIG_IEEE1394 is not set

#
# I2O device support
#
# CONFIG_I2O is not set

#
# Networking support
#
CONFIG_NET=y

#
# Networking options
#
CONFIG_PACKET=m
CONFIG_PACKET_MMAP=y
CONFIG_UNIX=m
CONFIG_NET_KEY=m
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
# CONFIG_IP_ADVANCED_ROUTER is not set
# CONFIG_IP_PNP is not set
CONFIG_NET_IPIP=m
CONFIG_NET_IPGRE=m
CONFIG_NET_IPGRE_BROADCAST=y
# CONFIG_IP_MROUTE is not set
# CONFIG_ARPD is not set
CONFIG_SYN_COOKIES=y
CONFIG_INET_AH=m
CONFIG_INET_ESP=m
CONFIG_INET_IPCOMP=m
CONFIG_INET_TUNNEL=m
CONFIG_IP_TCPDIAG=m
CONFIG_IP_TCPDIAG_IPV6=y

#
# IP: Virtual Server Configuration
#
# CONFIG_IP_VS is not set
CONFIG_IPV6=m
CONFIG_IPV6_PRIVACY=y
CONFIG_INET6_AH=m
CONFIG_INET6_ESP=m
CONFIG_INET6_IPCOMP=m
CONFIG_INET6_TUNNEL=m
CONFIG_IPV6_TUNNEL=m
CONFIG_NETFILTER=y
# CONFIG_NETFILTER_DEBUG is not set

#
# IP: Netfilter Configuration
#
CONFIG_IP_NF_CONNTRACK=m
CONFIG_IP_NF_CT_ACCT=y
CONFIG_IP_NF_CONNTRACK_MARK=y
CONFIG_IP_NF_CT_PROTO_SCTP=m
CONFIG_IP_NF_FTP=m
CONFIG_IP_NF_IRC=m
CONFIG_IP_NF_TFTP=m
CONFIG_IP_NF_AMANDA=m
CONFIG_IP_NF_QUEUE=m
CONFIG_IP_NF_IPTABLES=m
CONFIG_IP_NF_MATCH_LIMIT=m
CONFIG_IP_NF_MATCH_IPRANGE=m
CONFIG_IP_NF_MATCH_MAC=m
CONFIG_IP_NF_MATCH_PKTTYPE=m
CONFIG_IP_NF_MATCH_MARK=m
CONFIG_IP_NF_MATCH_MULTIPORT=m
CONFIG_IP_NF_MATCH_TOS=m
CONFIG_IP_NF_MATCH_RECENT=m
CONFIG_IP_NF_MATCH_ECN=m
CONFIG_IP_NF_MATCH_DSCP=m
CONFIG_IP_NF_MATCH_AH_ESP=m
CONFIG_IP_NF_MATCH_LENGTH=m
CONFIG_IP_NF_MATCH_TTL=m
CONFIG_IP_NF_MATCH_TCPMSS=m
CONFIG_IP_NF_MATCH_HELPER=m
CONFIG_IP_NF_MATCH_STATE=m
CONFIG_IP_NF_MATCH_CONNTRACK=m
CONFIG_IP_NF_MATCH_OWNER=m
CONFIG_IP_NF_MATCH_ADDRTYPE=m
CONFIG_IP_NF_MATCH_REALM=m
CONFIG_IP_NF_MATCH_SCTP=m
# CONFIG_IP_NF_MATCH_COMMENT is not set
CONFIG_IP_NF_MATCH_CONNMARK=m
CONFIG_IP_NF_MATCH_HASHLIMIT=m
CONFIG_IP_NF_FILTER=m
CONFIG_IP_NF_TARGET_REJECT=m
CONFIG_IP_NF_TARGET_LOG=m
CONFIG_IP_NF_TARGET_ULOG=m
CONFIG_IP_NF_TARGET_TCPMSS=m
CONFIG_IP_NF_NAT=m
CONFIG_IP_NF_NAT_NEEDED=y
CONFIG_IP_NF_TARGET_MASQUERADE=m
CONFIG_IP_NF_TARGET_REDIRECT=m
CONFIG_IP_NF_TARGET_NETMAP=m
CONFIG_IP_NF_TARGET_SAME=m
CONFIG_IP_NF_NAT_SNMP_BASIC=m
CONFIG_IP_NF_NAT_IRC=m
CONFIG_IP_NF_NAT_FTP=m
CONFIG_IP_NF_NAT_TFTP=m
CONFIG_IP_NF_NAT_AMANDA=m
CONFIG_IP_NF_MANGLE=m
CONFIG_IP_NF_TARGET_TOS=m
CONFIG_IP_NF_TARGET_ECN=m
CONFIG_IP_NF_TARGET_DSCP=m
CONFIG_IP_NF_TARGET_MARK=m
CONFIG_IP_NF_TARGET_CLASSIFY=m
CONFIG_IP_NF_TARGET_CONNMARK=m
# CONFIG_IP_NF_TARGET_CLUSTERIP is not set
CONFIG_IP_NF_RAW=m
CONFIG_IP_NF_TARGET_NOTRACK=m
CONFIG_IP_NF_ARPTABLES=m
CONFIG_IP_NF_ARPFILTER=m
CONFIG_IP_NF_ARP_MANGLE=m

#
# IPv6: Netfilter Configuration (EXPERIMENTAL)
#
CONFIG_IP6_NF_QUEUE=m
CONFIG_IP6_NF_IPTABLES=m
CONFIG_IP6_NF_MATCH_LIMIT=m
CONFIG_IP6_NF_MATCH_MAC=m
CONFIG_IP6_NF_MATCH_RT=m
CONFIG_IP6_NF_MATCH_OPTS=m
CONFIG_IP6_NF_MATCH_FRAG=m
CONFIG_IP6_NF_MATCH_HL=m
CONFIG_IP6_NF_MATCH_MULTIPORT=m
CONFIG_IP6_NF_MATCH_OWNER=m
CONFIG_IP6_NF_MATCH_MARK=m
CONFIG_IP6_NF_MATCH_IPV6HEADER=m
CONFIG_IP6_NF_MATCH_AHESP=m
CONFIG_IP6_NF_MATCH_LENGTH=m
CONFIG_IP6_NF_MATCH_EUI64=m
CONFIG_IP6_NF_FILTER=m
CONFIG_IP6_NF_TARGET_LOG=m
CONFIG_IP6_NF_MANGLE=m
CONFIG_IP6_NF_TARGET_MARK=m
CONFIG_IP6_NF_RAW=m
CONFIG_XFRM=y
CONFIG_XFRM_USER=m

#
# SCTP Configuration (EXPERIMENTAL)
#
CONFIG_IP_SCTP=m
# CONFIG_SCTP_DBG_MSG is not set
# CONFIG_SCTP_DBG_OBJCNT is not set
# CONFIG_SCTP_HMAC_NONE is not set
CONFIG_SCTP_HMAC_SHA1=y
# CONFIG_SCTP_HMAC_MD5 is not set
# CONFIG_ATM is not set
# CONFIG_BRIDGE is not set
CONFIG_VLAN_8021Q=m
# CONFIG_DECNET is not set
CONFIG_LLC=m
CONFIG_LLC2=m
# CONFIG_IPX is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_NET_DIVERT is not set
# CONFIG_ECONET is not set
# CONFIG_WAN_ROUTER is not set

#
# QoS and/or fair queueing
#
CONFIG_NET_SCHED=y
CONFIG_NET_SCH_CLK_JIFFIES=y
# CONFIG_NET_SCH_CLK_GETTIMEOFDAY is not set
# CONFIG_NET_SCH_CLK_CPU is not set
CONFIG_NET_SCH_CBQ=m
CONFIG_NET_SCH_HTB=m
CONFIG_NET_SCH_HFSC=m
CONFIG_NET_SCH_PRIO=m
CONFIG_NET_SCH_RED=m
CONFIG_NET_SCH_SFQ=m
CONFIG_NET_SCH_TEQL=m
CONFIG_NET_SCH_TBF=m
CONFIG_NET_SCH_GRED=m
CONFIG_NET_SCH_DSMARK=m
CONFIG_NET_SCH_NETEM=m
CONFIG_NET_SCH_INGRESS=m
CONFIG_NET_QOS=y
CONFIG_NET_ESTIMATOR=y
CONFIG_NET_CLS=y
CONFIG_NET_CLS_BASIC=m
CONFIG_NET_CLS_TCINDEX=m
CONFIG_NET_CLS_ROUTE4=m
CONFIG_NET_CLS_ROUTE=y
CONFIG_NET_CLS_FW=m
CONFIG_NET_CLS_U32=m
# CONFIG_CLS_U32_PERF is not set
# CONFIG_NET_CLS_IND is not set
CONFIG_CLS_U32_MARK=y
CONFIG_NET_CLS_RSVP=m
CONFIG_NET_CLS_RSVP6=m
CONFIG_NET_EMATCH=y
CONFIG_NET_EMATCH_STACK=32
CONFIG_NET_EMATCH_CMP=m
CONFIG_NET_EMATCH_NBYTE=m
CONFIG_NET_EMATCH_U32=m
CONFIG_NET_EMATCH_META=m
# CONFIG_NET_CLS_ACT is not set
CONFIG_NET_CLS_POLICE=y

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
CONFIG_NETPOLL=y
# CONFIG_NETPOLL_RX is not set
# CONFIG_NETPOLL_TRAP is not set
CONFIG_NET_POLL_CONTROLLER=y
# CONFIG_HAMRADIO is not set
# CONFIG_IRDA is not set
# CONFIG_BT is not set
CONFIG_NETDEVICES=y
CONFIG_DUMMY=m
# CONFIG_BONDING is not set
# CONFIG_EQUALIZER is not set
CONFIG_TUN=m

#
# ARCnet devices
#
# CONFIG_ARCNET is not set

#
# Ethernet (10 or 100Mbit)
#
CONFIG_NET_ETHERNET=y
CONFIG_MII=m
# CONFIG_HAPPYMEAL is not set
# CONFIG_SUNGEM is not set
# CONFIG_NET_VENDOR_3COM is not set

#
# Tulip family network device support
#
# CONFIG_NET_TULIP is not set
# CONFIG_HP100 is not set
CONFIG_NET_PCI=y
# CONFIG_PCNET32 is not set
# CONFIG_AMD8111_ETH is not set
# CONFIG_ADAPTEC_STARFIRE is not set
# CONFIG_B44 is not set
CONFIG_FORCEDETH=m
# CONFIG_DGRS is not set
# CONFIG_EEPRO100 is not set
# CONFIG_E100 is not set
# CONFIG_FEALNX is not set
# CONFIG_NATSEMI is not set
# CONFIG_NE2K_PCI is not set
CONFIG_8139CP=m
CONFIG_8139TOO=m
CONFIG_8139TOO_PIO=y
# CONFIG_8139TOO_TUNE_TWISTER is not set
# CONFIG_8139TOO_8129 is not set
# CONFIG_8139_OLD_RX_RESET is not set
# CONFIG_SIS900 is not set
# CONFIG_EPIC100 is not set
# CONFIG_SUNDANCE is not set
# CONFIG_TLAN is not set
# CONFIG_VIA_RHINE is not set

#
# Ethernet (1000 Mbit)
#
# CONFIG_ACENIC is not set
# CONFIG_DL2K is not set
CONFIG_E1000=m
# CONFIG_E1000_NAPI is not set
# CONFIG_NS83820 is not set
# CONFIG_HAMACHI is not set
# CONFIG_YELLOWFIN is not set
# CONFIG_R8169 is not set
# CONFIG_SK98LIN is not set
# CONFIG_VIA_VELOCITY is not set
# CONFIG_TIGON3 is not set
# CONFIG_BNX2 is not set

#
# Ethernet (10000 Mbit)
#
# CONFIG_IXGB is not set
# CONFIG_S2IO is not set

#
# Token Ring devices
#
# CONFIG_TR is not set

#
# Wireless LAN (non-hamradio)
#
# CONFIG_NET_RADIO is not set

#
# Wan interfaces
#
# CONFIG_WAN is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_PLIP is not set
# CONFIG_PPP is not set
# CONFIG_SLIP is not set
# CONFIG_NET_FC is not set
# CONFIG_SHAPER is not set
CONFIG_NETCONSOLE=y

#
# ISDN subsystem
#
# CONFIG_ISDN is not set

#
# Telephony Support
#
# CONFIG_PHONE is not set

#
# Input device support
#
CONFIG_INPUT=y

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
# CONFIG_INPUT_JOYDEV is not set
# CONFIG_INPUT_TSDEV is not set
CONFIG_INPUT_EVDEV=m
CONFIG_INPUT_EVBUG=m

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_XTKBD is not set
# CONFIG_KEYBOARD_NEWTON is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=m
CONFIG_MOUSE_SERIAL=m
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
CONFIG_INPUT_MISC=y
CONFIG_INPUT_PCSPKR=y
CONFIG_INPUT_UINPUT=m

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_SERPORT=y
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PARKBD is not set
CONFIG_SERIO_PCIPS2=y
CONFIG_SERIO_LIBPS2=y
CONFIG_SERIO_RAW=m
# CONFIG_GAMEPORT is not set

#
# Character devices
#
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
# CONFIG_SERIAL_NONSTANDARD is not set

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
# CONFIG_SERIAL_8250_ACPI is not set
CONFIG_SERIAL_8250_NR_UARTS=4
# CONFIG_SERIAL_8250_EXTENDED is not set

#
# Non-8250 serial port support
#
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
# CONFIG_SERIAL_JSM is not set
CONFIG_UNIX98_PTYS=y
# CONFIG_LEGACY_PTYS is not set
# CONFIG_PRINTER is not set
CONFIG_PPDEV=m
# CONFIG_TIPAR is not set

#
# IPMI
#
# CONFIG_IPMI_HANDLER is not set

#
# Watchdog Cards
#
# CONFIG_WATCHDOG is not set
CONFIG_HW_RANDOM=m
CONFIG_NVRAM=m
CONFIG_RTC=m
CONFIG_RTC_HISTOGRAM=m
CONFIG_BLOCKER=m
CONFIG_GEN_RTC=m
CONFIG_GEN_RTC_X=y
# CONFIG_DTLK is not set
# CONFIG_R3964 is not set
# CONFIG_APPLICOM is not set
# CONFIG_SONYPI is not set

#
# Ftape, the floppy tape device driver
#
# CONFIG_FTAPE is not set
CONFIG_AGP=y
# CONFIG_AGP_ALI is not set
# CONFIG_AGP_ATI is not set
# CONFIG_AGP_AMD is not set
# CONFIG_AGP_AMD64 is not set
CONFIG_AGP_INTEL=m
# CONFIG_AGP_NVIDIA is not set
# CONFIG_AGP_SIS is not set
# CONFIG_AGP_SWORKS is not set
# CONFIG_AGP_VIA is not set
# CONFIG_AGP_EFFICEON is not set
CONFIG_DRM=y
# CONFIG_DRM_TDFX is not set
# CONFIG_DRM_R128 is not set
# CONFIG_DRM_RADEON is not set
# CONFIG_DRM_I810 is not set
# CONFIG_DRM_I830 is not set
# CONFIG_DRM_I915 is not set
# CONFIG_DRM_MGA is not set
# CONFIG_DRM_SIS is not set
# CONFIG_MWAVE is not set
# CONFIG_RAW_DRIVER is not set
CONFIG_HPET=y
# CONFIG_HPET_RTC_IRQ is not set
CONFIG_HPET_MMAP=y
# CONFIG_HANGCHECK_TIMER is not set

#
# TPM devices
#
# CONFIG_TCG_TPM is not set

#
# I2C support
#
CONFIG_I2C=m
# CONFIG_I2C_CHARDEV is not set

#
# I2C Algorithms
#
CONFIG_I2C_ALGOBIT=m
# CONFIG_I2C_ALGOPCF is not set
# CONFIG_I2C_ALGOPCA is not set

#
# I2C Hardware Bus support
#
# CONFIG_I2C_ALI1535 is not set
# CONFIG_I2C_ALI1563 is not set
# CONFIG_I2C_ALI15X3 is not set
# CONFIG_I2C_AMD756 is not set
# CONFIG_I2C_AMD8111 is not set
# CONFIG_I2C_I801 is not set
# CONFIG_I2C_I810 is not set
# CONFIG_I2C_PIIX4 is not set
CONFIG_I2C_ISA=m
# CONFIG_I2C_NFORCE2 is not set
# CONFIG_I2C_PARPORT is not set
# CONFIG_I2C_PARPORT_LIGHT is not set
# CONFIG_I2C_PROSAVAGE is not set
# CONFIG_I2C_SAVAGE4 is not set
# CONFIG_SCx200_ACB is not set
# CONFIG_I2C_SIS5595 is not set
# CONFIG_I2C_SIS630 is not set
# CONFIG_I2C_SIS96X is not set
# CONFIG_I2C_STUB is not set
# CONFIG_I2C_VIA is not set
# CONFIG_I2C_VIAPRO is not set
# CONFIG_I2C_VOODOO3 is not set
# CONFIG_I2C_PCA_ISA is not set

#
# Hardware Sensors Chip support
#
# CONFIG_I2C_SENSOR is not set
# CONFIG_SENSORS_ADM1021 is not set
# CONFIG_SENSORS_ADM1025 is not set
# CONFIG_SENSORS_ADM1026 is not set
# CONFIG_SENSORS_ADM1031 is not set
# CONFIG_SENSORS_ASB100 is not set
# CONFIG_SENSORS_DS1621 is not set
# CONFIG_SENSORS_FSCHER is not set
# CONFIG_SENSORS_FSCPOS is not set
# CONFIG_SENSORS_GL518SM is not set
# CONFIG_SENSORS_GL520SM is not set
# CONFIG_SENSORS_IT87 is not set
# CONFIG_SENSORS_LM63 is not set
# CONFIG_SENSORS_LM75 is not set
# CONFIG_SENSORS_LM77 is not set
# CONFIG_SENSORS_LM78 is not set
# CONFIG_SENSORS_LM80 is not set
# CONFIG_SENSORS_LM83 is not set
# CONFIG_SENSORS_LM85 is not set
# CONFIG_SENSORS_LM87 is not set
# CONFIG_SENSORS_LM90 is not set
# CONFIG_SENSORS_LM92 is not set
# CONFIG_SENSORS_MAX1619 is not set
# CONFIG_SENSORS_PC87360 is not set
# CONFIG_SENSORS_SMSC47B397 is not set
# CONFIG_SENSORS_SIS5595 is not set
# CONFIG_SENSORS_SMSC47M1 is not set
# CONFIG_SENSORS_VIA686A is not set
# CONFIG_SENSORS_W83781D is not set
# CONFIG_SENSORS_W83L785TS is not set
# CONFIG_SENSORS_W83627HF is not set

#
# Other I2C Chip support
#
# CONFIG_SENSORS_DS1337 is not set
# CONFIG_SENSORS_EEPROM is not set
# CONFIG_SENSORS_PCF8574 is not set
# CONFIG_SENSORS_PCF8591 is not set
# CONFIG_SENSORS_RTC8564 is not set
# CONFIG_I2C_DEBUG_CORE is not set
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
# CONFIG_I2C_DEBUG_CHIP is not set

#
# Dallas's 1-wire bus
#
# CONFIG_W1 is not set

#
# Misc devices
#
# CONFIG_IBM_ASM is not set

#
# Multimedia devices
#
CONFIG_VIDEO_DEV=m

#
# Video For Linux
#

#
# Video Adapters
#
# CONFIG_VIDEO_BT848 is not set
# CONFIG_VIDEO_BWQCAM is not set
# CONFIG_VIDEO_CQCAM is not set
# CONFIG_VIDEO_W9966 is not set
# CONFIG_VIDEO_CPIA is not set
# CONFIG_VIDEO_SAA5246A is not set
# CONFIG_VIDEO_SAA5249 is not set
# CONFIG_TUNER_3036 is not set
# CONFIG_VIDEO_STRADIS is not set
# CONFIG_VIDEO_ZORAN is not set
# CONFIG_VIDEO_SAA7134 is not set
# CONFIG_VIDEO_MXB is not set
# CONFIG_VIDEO_DPC is not set
# CONFIG_VIDEO_HEXIUM_ORION is not set
# CONFIG_VIDEO_HEXIUM_GEMINI is not set
# CONFIG_VIDEO_CX88 is not set
# CONFIG_VIDEO_OVCAMCHIP is not set

#
# Radio Adapters
#
# CONFIG_RADIO_GEMTEK_PCI is not set
# CONFIG_RADIO_MAXIRADIO is not set
# CONFIG_RADIO_MAESTRO is not set

#
# Digital Video Broadcasting Devices
#
# CONFIG_DVB is not set

#
# Graphics support
#
# CONFIG_FB is not set
CONFIG_VIDEO_SELECT=y

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
CONFIG_DUMMY_CONSOLE=y

#
# Sound
#
CONFIG_SOUND=m

#
# Advanced Linux Sound Architecture
#
CONFIG_SND=m
CONFIG_SND_TIMER=m
CONFIG_SND_PCM=m
CONFIG_SND_RAWMIDI=m
CONFIG_SND_SEQUENCER=m
CONFIG_SND_SEQ_DUMMY=m
CONFIG_SND_OSSEMUL=y
CONFIG_SND_MIXER_OSS=m
CONFIG_SND_PCM_OSS=m
CONFIG_SND_SEQUENCER_OSS=y
CONFIG_SND_RTCTIMER=m
# CONFIG_SND_VERBOSE_PRINTK is not set
# CONFIG_SND_DEBUG is not set

#
# Generic devices
#
CONFIG_SND_MPU401_UART=m
CONFIG_SND_DUMMY=m
CONFIG_SND_VIRMIDI=m
CONFIG_SND_MTPAV=m
CONFIG_SND_SERIAL_U16550=m
CONFIG_SND_MPU401=m

#
# PCI devices
#
CONFIG_SND_AC97_CODEC=m
# CONFIG_SND_ALI5451 is not set
# CONFIG_SND_ATIIXP is not set
# CONFIG_SND_ATIIXP_MODEM is not set
# CONFIG_SND_AU8810 is not set
# CONFIG_SND_AU8820 is not set
# CONFIG_SND_AU8830 is not set
# CONFIG_SND_AZT3328 is not set
# CONFIG_SND_BT87X is not set
# CONFIG_SND_CS46XX is not set
# CONFIG_SND_CS4281 is not set
# CONFIG_SND_EMU10K1 is not set
# CONFIG_SND_EMU10K1X is not set
# CONFIG_SND_CA0106 is not set
# CONFIG_SND_KORG1212 is not set
# CONFIG_SND_MIXART is not set
# CONFIG_SND_NM256 is not set
# CONFIG_SND_RME32 is not set
# CONFIG_SND_RME96 is not set
# CONFIG_SND_RME9652 is not set
# CONFIG_SND_HDSP is not set
# CONFIG_SND_TRIDENT is not set
# CONFIG_SND_YMFPCI is not set
# CONFIG_SND_ALS4000 is not set
# CONFIG_SND_CMIPCI is not set
# CONFIG_SND_ENS1370 is not set
# CONFIG_SND_ENS1371 is not set
# CONFIG_SND_ES1938 is not set
# CONFIG_SND_ES1968 is not set
# CONFIG_SND_MAESTRO3 is not set
# CONFIG_SND_FM801 is not set
# CONFIG_SND_ICE1712 is not set
# CONFIG_SND_ICE1724 is not set
CONFIG_SND_INTEL8X0=m
CONFIG_SND_INTEL8X0M=m
# CONFIG_SND_SONICVIBES is not set
# CONFIG_SND_VIA82XX is not set
# CONFIG_SND_VIA82XX_MODEM is not set
# CONFIG_SND_VX222 is not set
# CONFIG_SND_HDA_INTEL is not set

#
# USB devices
#
# CONFIG_SND_USB_AUDIO is not set
# CONFIG_SND_USB_USX2Y is not set

#
# Open Sound System
#
# CONFIG_SOUND_PRIME is not set

#
# USB support
#
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB=m
# CONFIG_USB_DEBUG is not set

#
# Miscellaneous USB options
#
CONFIG_USB_DEVICEFS=y
CONFIG_USB_BANDWIDTH=y
# CONFIG_USB_DYNAMIC_MINORS is not set
# CONFIG_USB_SUSPEND is not set
# CONFIG_USB_OTG is not set

#
# USB Host Controller Drivers
#
CONFIG_USB_EHCI_HCD=m
CONFIG_USB_EHCI_SPLIT_ISO=y
CONFIG_USB_EHCI_ROOT_HUB_TT=y
CONFIG_USB_OHCI_HCD=m
# CONFIG_USB_OHCI_BIG_ENDIAN is not set
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
CONFIG_USB_UHCI_HCD=m
# CONFIG_USB_SL811_HCD is not set

#
# USB Device Class drivers
#
CONFIG_USB_AUDIO=m
# CONFIG_USB_BLUETOOTH_TTY is not set
CONFIG_USB_MIDI=m
CONFIG_USB_ACM=m
CONFIG_USB_PRINTER=m

#
# NOTE: USB_STORAGE enables SCSI, and 'SCSI disk support' may also be needed; see USB_STORAGE Help for more information
#
CONFIG_USB_STORAGE=m
# CONFIG_USB_STORAGE_DEBUG is not set
CONFIG_USB_STORAGE_DATAFAB=y
CONFIG_USB_STORAGE_FREECOM=y
CONFIG_USB_STORAGE_ISD200=y
CONFIG_USB_STORAGE_DPCM=y
# CONFIG_USB_STORAGE_USBAT is not set
CONFIG_USB_STORAGE_SDDR09=y
CONFIG_USB_STORAGE_SDDR55=y
CONFIG_USB_STORAGE_JUMPSHOT=y

#
# USB Input Devices
#
CONFIG_USB_HID=m
CONFIG_USB_HIDINPUT=y
# CONFIG_HID_FF is not set
CONFIG_USB_HIDDEV=y

#
# USB HID Boot Protocol drivers
#
CONFIG_USB_KBD=m
CONFIG_USB_MOUSE=m
CONFIG_USB_AIPTEK=m
CONFIG_USB_WACOM=m
CONFIG_USB_KBTAB=m
CONFIG_USB_POWERMATE=m
CONFIG_USB_MTOUCH=m
CONFIG_USB_EGALAX=m
CONFIG_USB_XPAD=m
CONFIG_USB_ATI_REMOTE=m

#
# USB Imaging devices
#
CONFIG_USB_MDC800=m
CONFIG_USB_MICROTEK=m

#
# USB Multimedia devices
#
# CONFIG_USB_DABUSB is not set
CONFIG_USB_VICAM=m
CONFIG_USB_DSBR=m
CONFIG_USB_IBMCAM=m
CONFIG_USB_KONICAWC=m
CONFIG_USB_OV511=m
CONFIG_USB_SE401=m
CONFIG_USB_SN9C102=m
CONFIG_USB_STV680=m
# CONFIG_USB_PWC is not set

#
# USB Network Adapters
#
CONFIG_USB_CATC=m
CONFIG_USB_KAWETH=m
CONFIG_USB_PEGASUS=m
CONFIG_USB_RTL8150=m
CONFIG_USB_USBNET=m

#
# USB Host-to-Host Cables
#
CONFIG_USB_ALI_M5632=y
CONFIG_USB_AN2720=y
CONFIG_USB_BELKIN=y
CONFIG_USB_GENESYS=y
CONFIG_USB_NET1080=y
CONFIG_USB_PL2301=y
# CONFIG_USB_KC2190 is not set

#
# Intelligent USB Devices/Gadgets
#
CONFIG_USB_ARMLINUX=y
CONFIG_USB_EPSON2888=y
CONFIG_USB_ZAURUS=y
CONFIG_USB_CDCETHER=y

#
# USB Network Adapters
#
CONFIG_USB_AX8817X=y
# CONFIG_USB_MON is not set

#
# USB port drivers
#
CONFIG_USB_USS720=m

#
# USB Serial Converter support
#
CONFIG_USB_SERIAL=m
CONFIG_USB_SERIAL_GENERIC=y
# CONFIG_USB_SERIAL_AIRPRIME is not set
CONFIG_USB_SERIAL_BELKIN=m
# CONFIG_USB_SERIAL_WHITEHEAT is not set
CONFIG_USB_SERIAL_DIGI_ACCELEPORT=m
# CONFIG_USB_SERIAL_CP2101 is not set
# CONFIG_USB_SERIAL_CYPRESS_M8 is not set
CONFIG_USB_SERIAL_EMPEG=m
CONFIG_USB_SERIAL_FTDI_SIO=m
CONFIG_USB_SERIAL_VISOR=m
CONFIG_USB_SERIAL_IPAQ=m
CONFIG_USB_SERIAL_IR=m
CONFIG_USB_SERIAL_EDGEPORT=m
CONFIG_USB_SERIAL_EDGEPORT_TI=m
# CONFIG_USB_SERIAL_GARMIN is not set
# CONFIG_USB_SERIAL_IPW is not set
CONFIG_USB_SERIAL_KEYSPAN_PDA=m
CONFIG_USB_SERIAL_KEYSPAN=m
# CONFIG_USB_SERIAL_KEYSPAN_MPR is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28 is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28X is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28XA is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28XB is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA19 is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA18X is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA19W is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA19QW is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA19QI is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA49W is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA49WLC is not set
CONFIG_USB_SERIAL_KLSI=m
CONFIG_USB_SERIAL_KOBIL_SCT=m
CONFIG_USB_SERIAL_MCT_U232=m
CONFIG_USB_SERIAL_PL2303=m
# CONFIG_USB_SERIAL_HP4X is not set
CONFIG_USB_SERIAL_SAFE=m
# CONFIG_USB_SERIAL_SAFE_PADDED is not set
# CONFIG_USB_SERIAL_TI is not set
CONFIG_USB_SERIAL_CYBERJACK=m
CONFIG_USB_SERIAL_XIRCOM=m
CONFIG_USB_SERIAL_OMNINET=m
CONFIG_USB_EZUSB=y

#
# USB Miscellaneous drivers
#
# CONFIG_USB_EMI62 is not set
# CONFIG_USB_EMI26 is not set
CONFIG_USB_AUERSWALD=m
CONFIG_USB_RIO500=m
CONFIG_USB_LEGOTOWER=m
CONFIG_USB_LCD=m
CONFIG_USB_LED=m
CONFIG_USB_CYTHERM=m
# CONFIG_USB_PHIDGETKIT is not set
CONFIG_USB_PHIDGETSERVO=m
# CONFIG_USB_IDMOUSE is not set
# CONFIG_USB_SISUSBVGA is not set
CONFIG_USB_TEST=m

#
# USB ATM/DSL drivers
#

#
# USB Gadget Support
#
# CONFIG_USB_GADGET is not set

#
# MMC/SD Card support
#
# CONFIG_MMC is not set

#
# InfiniBand support
#
# CONFIG_INFINIBAND is not set

#
# File systems
#
# CONFIG_EXT2_FS is not set
CONFIG_EXT3_FS=y
CONFIG_EXT3_FS_XATTR=y
# CONFIG_EXT3_FS_POSIX_ACL is not set
# CONFIG_EXT3_FS_SECURITY is not set
CONFIG_JBD=y
# CONFIG_JBD_DEBUG is not set
CONFIG_FS_MBCACHE=y
CONFIG_REISERFS_FS=m
# CONFIG_REISERFS_CHECK is not set
# CONFIG_REISERFS_PROC_INFO is not set
# CONFIG_REISERFS_FS_XATTR is not set
# CONFIG_JFS_FS is not set

#
# XFS support
#
# CONFIG_XFS_FS is not set
CONFIG_MINIX_FS=m
CONFIG_ROMFS_FS=m
# CONFIG_QUOTA is not set
CONFIG_DNOTIFY=y
# CONFIG_AUTOFS_FS is not set
CONFIG_AUTOFS4_FS=m

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=m
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_ZISOFS_FS=m
CONFIG_UDF_FS=m
CONFIG_UDF_NLS=y

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
CONFIG_NTFS_FS=m
# CONFIG_NTFS_DEBUG is not set
CONFIG_NTFS_RW=y

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_SYSFS=y
# CONFIG_DEVFS_FS is not set
CONFIG_DEVPTS_FS_XATTR=y
# CONFIG_DEVPTS_FS_SECURITY is not set
CONFIG_TMPFS=y
# CONFIG_TMPFS_XATTR is not set
# CONFIG_HUGETLBFS is not set
# CONFIG_HUGETLB_PAGE is not set
CONFIG_RAMFS=y

#
# Miscellaneous filesystems
#
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
CONFIG_CRAMFS=y
# CONFIG_VXFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
# CONFIG_SYSV_FS is not set
# CONFIG_UFS_FS is not set

#
# Network File Systems
#
# CONFIG_NFS_FS is not set
# CONFIG_NFSD is not set
CONFIG_SMB_FS=m
# CONFIG_SMB_NLS_DEFAULT is not set
CONFIG_CIFS=m
# CONFIG_CIFS_STATS is not set
# CONFIG_CIFS_XATTR is not set
# CONFIG_CIFS_EXPERIMENTAL is not set
# CONFIG_NCP_FS is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not set

#
# Partition Types
#
# CONFIG_PARTITION_ADVANCED is not set
CONFIG_MSDOS_PARTITION=y

#
# Native Language Support
#
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="cp437"
CONFIG_NLS_CODEPAGE_437=m
CONFIG_NLS_CODEPAGE_737=m
CONFIG_NLS_CODEPAGE_775=m
CONFIG_NLS_CODEPAGE_850=m
CONFIG_NLS_CODEPAGE_852=m
CONFIG_NLS_CODEPAGE_855=m
CONFIG_NLS_CODEPAGE_857=m
CONFIG_NLS_CODEPAGE_860=m
CONFIG_NLS_CODEPAGE_861=m
CONFIG_NLS_CODEPAGE_862=m
CONFIG_NLS_CODEPAGE_863=m
CONFIG_NLS_CODEPAGE_864=m
CONFIG_NLS_CODEPAGE_865=m
CONFIG_NLS_CODEPAGE_866=m
CONFIG_NLS_CODEPAGE_869=m
CONFIG_NLS_CODEPAGE_936=m
CONFIG_NLS_CODEPAGE_950=m
CONFIG_NLS_CODEPAGE_932=m
CONFIG_NLS_CODEPAGE_949=m
CONFIG_NLS_CODEPAGE_874=m
CONFIG_NLS_ISO8859_8=m
CONFIG_NLS_CODEPAGE_1250=m
CONFIG_NLS_CODEPAGE_1251=m
CONFIG_NLS_ASCII=m
CONFIG_NLS_ISO8859_1=m
CONFIG_NLS_ISO8859_2=m
CONFIG_NLS_ISO8859_3=m
CONFIG_NLS_ISO8859_4=m
CONFIG_NLS_ISO8859_5=m
CONFIG_NLS_ISO8859_6=m
CONFIG_NLS_ISO8859_7=m
CONFIG_NLS_ISO8859_9=m
CONFIG_NLS_ISO8859_13=m
CONFIG_NLS_ISO8859_14=m
CONFIG_NLS_ISO8859_15=m
CONFIG_NLS_KOI8_R=m
CONFIG_NLS_KOI8_U=m
CONFIG_NLS_UTF8=m

#
# Profiling support
#
CONFIG_PROFILING=y
CONFIG_OPROFILE=m

#
# Kernel hacking
#
# CONFIG_PRINTK_TIME is not set
CONFIG_DEBUG_KERNEL=y
CONFIG_MAGIC_SYSRQ=y
CONFIG_LOG_BUF_SHIFT=18
# CONFIG_SCHEDSTATS is not set
# CONFIG_DEBUG_SLAB is not set
CONFIG_DEBUG_PREEMPT=y
CONFIG_WAKEUP_TIMING=y
CONFIG_PREEMPT_TRACE=y
CONFIG_CRITICAL_PREEMPT_TIMING=y
CONFIG_CRITICAL_IRQSOFF_TIMING=y
CONFIG_CRITICAL_TIMING=y
CONFIG_LATENCY_TIMING=y
CONFIG_LATENCY_TRACE=y
CONFIG_MCOUNT=y
# CONFIG_RT_DEADLOCK_DETECT is not set
# CONFIG_DEBUG_RT_LOCKING_MODE is not set
# CONFIG_DEBUG_KOBJECT is not set
CONFIG_DEBUG_BUGVERBOSE=y
# CONFIG_DEBUG_INFO is not set
# CONFIG_DEBUG_FS is not set
CONFIG_FRAME_POINTER=y
CONFIG_EARLY_PRINTK=y
CONFIG_DEBUG_STACKOVERFLOW=y
# CONFIG_KPROBES is not set
# CONFIG_DEBUG_STACK_USAGE is not set

#
# Page alloc debug is incompatible with Software Suspend on i386
#
# CONFIG_4KSTACKS is not set

#
# Security options
#
# CONFIG_KEYS is not set
# CONFIG_SECURITY is not set

#
# Cryptographic options
#
CONFIG_CRYPTO=y
CONFIG_CRYPTO_HMAC=y
CONFIG_CRYPTO_NULL=m
CONFIG_CRYPTO_MD4=m
CONFIG_CRYPTO_MD5=m
CONFIG_CRYPTO_SHA1=m
CONFIG_CRYPTO_SHA256=m
CONFIG_CRYPTO_SHA512=m
CONFIG_CRYPTO_WP512=m
CONFIG_CRYPTO_TGR192=m
CONFIG_CRYPTO_DES=m
CONFIG_CRYPTO_BLOWFISH=m
CONFIG_CRYPTO_TWOFISH=m
CONFIG_CRYPTO_SERPENT=m
CONFIG_CRYPTO_AES_586=m
CONFIG_CRYPTO_CAST5=m
CONFIG_CRYPTO_CAST6=m
CONFIG_CRYPTO_TEA=m
CONFIG_CRYPTO_ARC4=m
CONFIG_CRYPTO_KHAZAD=m
# CONFIG_CRYPTO_ANUBIS is not set
CONFIG_CRYPTO_DEFLATE=m
CONFIG_CRYPTO_MICHAEL_MIC=m
CONFIG_CRYPTO_CRC32C=m
CONFIG_CRYPTO_TEST=m

#
# Hardware crypto devices
#
# CONFIG_CRYPTO_DEV_PADLOCK is not set

#
# Library routines
#
CONFIG_CRC_CCITT=m
CONFIG_CRC32=m
CONFIG_LIBCRC32C=m
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=m
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_X86_BIOS_REBOOT=y
CONFIG_PC=y

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
  2005-06-08 14:18 ` Michal Schmidt
@ 2005-06-08 14:32 ` Michal Schmidt
  2005-06-08 15:48 ` K.R. Foley
                   ` (7 subsequent siblings)
  9 siblings, 0 replies; 139+ messages in thread
From: Michal Schmidt @ 2005-06-08 14:32 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

Ingo Molnar wrote:
> i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
> downloaded from the usual place:

With -V0.7.48-01 I get interestingly long latency traces. For example 
this one is 277 us. This is on i386. I've put the full trace to:
http://www.uamt.feec.vutbr.cz/rizeni/pom/latency_trace-RT-V0.7.48-01.txt

Because of the presence of __wake_up_sync there, I'd guess it has 
something to do with the NEED_RESCHED_DELAYED thing.

Here's an excerpt of it:
preemption latency trace v1.1.4 on 2.6.12-rc6-RT-V0.7.48-01
--------------------------------------------------------------------
  latency: 277 us, #2349/2349, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
     -----------------
     | task: XFree86-5780 (uid:0 nice:-10 policy:0 rt_prio:0)
     -----------------

                  _------=> CPU#
                 / _-----=> irqs-off
                | / _----=> need-resched
                || / _---=> hardirq/softirq
                ||| / _--=> preempt-depth
                |||| /
                |||||     delay
    cmd     pid ||||| time  |   caller
       \   /    |||||   \   |   /
mozilla--6007  0Dnh2    0us!: <697a6f6d> (<2d616c6c>)
mozilla--6007  0Dnh2    0us : __trace_start_sched_wakeup (try_to_wake_up)
mozilla--6007  0....    0us : _spin_unlock_irqrestore (__wake_up_sync)
mozilla--6007  0....    0us : up_mutex (__wake_up_sync)
mozilla--6007  0....    0us : __up_mutex (up_mutex)
mozilla--6007  0....    0us : _read_unlock (sock_wfree)
mozilla--6007  0....    0us : up_read_mutex (sock_wfree)
mozilla--6007  0....    1us : up_write_mutex (sock_wfree)
mozilla--6007  0....    1us : __up_mutex (up_write_mutex)
mozilla--6007  0....    1us : kfree_skbmem (unix_stream_recvmsg)
mozilla--6007  0....    1us : skb_release_data (kfree_skbmem)
mozilla--6007  0....    1us : kfree (kfree_skbmem)
mozilla--6007  0....    1us : __local_save_flags (kfree)
mozilla--6007  0....    1us : _spin_lock (kfree)
mozilla--6007  0....    2us : __spin_lock (_spin_lock)
mozilla--6007  0....    2us : __might_sleep (__spin_lock)
mozilla--6007  0....    2us : irqs_disabled (__might_sleep)
mozilla--6007  0....    2us : _down_mutex (__spin_lock)
mozilla--6007  0....    2us : __down_mutex (__spin_lock)
mozilla--6007  0...1    2us : grab_lock (__down_mutex)
mozilla--6007  0...1    2us : __down_mutex <mozilla--6007> (7d 0)
mozilla--6007  0....    2us : _spin_unlock (kfree)
mozilla--6007  0....    2us : up_mutex (kfree)
mozilla--6007  0....    3us : __up_mutex (up_mutex)
mozilla--6007  0....    3us : kmem_cache_free (kfree_skbmem)
mozilla--6007  0....    3us : __local_save_flags (kmem_cache_free)
mozilla--6007  0....    3us : _spin_lock (kmem_cache_free)
mozilla--6007  0....    3us : __spin_lock (_spin_lock)
mozilla--6007  0....    3us : __might_sleep (__spin_lock)
mozilla--6007  0....    3us : irqs_disabled (__might_sleep)
mozilla--6007  0....    3us : _down_mutex (__spin_lock)
mozilla--6007  0....    3us : __down_mutex (__spin_lock)
mozilla--6007  0...1    4us : grab_lock (__down_mutex)
mozilla--6007  0...1    4us : __down_mutex <mozilla--6007> (7d 0)
mozilla--6007  0....    4us : _spin_unlock (kmem_cache_free)
mozilla--6007  0....    4us : up_mutex (kmem_cache_free)
mozilla--6007  0....    4us : __up_mutex (up_mutex)
mozilla--6007  0....    4us : skb_dequeue (unix_stream_recvmsg)
mozilla--6007  0....    4us : _spin_lock_irqsave (skb_dequeue)
mozilla--6007  0....    4us : __spin_lock (_spin_lock_irqsave)
mozilla--6007  0....    5us : __might_sleep (__spin_lock)
mozilla--6007  0....    5us : irqs_disabled (__might_sleep)
mozilla--6007  0....    5us : _down_mutex (__spin_lock)
mozilla--6007  0....    5us : __down_mutex (__spin_lock)
mozilla--6007  0...1    5us : grab_lock (__down_mutex)
mozilla--6007  0...1    5us : __down_mutex <mozilla--6007> (7d 0)
mozilla--6007  0....    5us : __local_save_flags (_spin_lock_irqsave)
mozilla--6007  0....    5us : _spin_unlock_irqrestore (skb_dequeue)
.
.
.
mozilla--6007  0....  268us : __wake_up_common (__wake_up_sync)
mozilla--6007  0....  268us : default_wake_function (__wake_up_common)
mozilla--6007  0....  268us : try_to_wake_up (__wake_up_common)
mozilla--6007  0....  268us : _spin_unlock_irqrestore (__wake_up_sync)
mozilla--6007  0....  268us : up_mutex (__wake_up_sync)
mozilla--6007  0....  269us : __up_mutex (up_mutex)
mozilla--6007  0....  269us : _read_unlock (sock_wfree)
mozilla--6007  0....  269us : up_read_mutex (sock_wfree)
mozilla--6007  0....  269us : up_write_mutex (sock_wfree)
mozilla--6007  0....  269us : __up_mutex (up_write_mutex)
mozilla--6007  0....  269us : kfree_skbmem (unix_stream_recvmsg)
mozilla--6007  0....  269us : skb_release_data (kfree_skbmem)
mozilla--6007  0....  269us : kfree (kfree_skbmem)
mozilla--6007  0....  270us : __local_save_flags (kfree)
mozilla--6007  0....  270us : _spin_lock (kfree)
mozilla--6007  0....  270us : __spin_lock (_spin_lock)
mozilla--6007  0....  270us : __might_sleep (__spin_lock)
mozilla--6007  0....  270us : irqs_disabled (__might_sleep)
mozilla--6007  0....  270us : _down_mutex (__spin_lock)
mozilla--6007  0....  270us : __down_mutex (__spin_lock)
mozilla--6007  0...1  270us : grab_lock (__down_mutex)
mozilla--6007  0...1  270us : __down_mutex <mozilla--6007> (7d 0)
mozilla--6007  0....  270us : _spin_unlock (kfree)
mozilla--6007  0....  271us : up_mutex (kfree)
mozilla--6007  0....  271us : __up_mutex (up_mutex)
mozilla--6007  0....  271us : kmem_cache_free (kfree_skbmem)
mozilla--6007  0....  271us : __local_save_flags (kmem_cache_free)
mozilla--6007  0....  271us : _spin_lock (kmem_cache_free)
mozilla--6007  0....  271us : __spin_lock (_spin_lock)
mozilla--6007  0....  271us : __might_sleep (__spin_lock)
mozilla--6007  0....  271us : irqs_disabled (__might_sleep)
mozilla--6007  0....  271us : _down_mutex (__spin_lock)
mozilla--6007  0....  271us : __down_mutex (__spin_lock)
mozilla--6007  0...1  272us : grab_lock (__down_mutex)
mozilla--6007  0...1  272us : __down_mutex <mozilla--6007> (7d 0)
mozilla--6007  0....  272us : _spin_unlock (kmem_cache_free)
mozilla--6007  0....  272us : up_mutex (kmem_cache_free)
mozilla--6007  0....  272us : __up_mutex (up_mutex)
mozilla--6007  0....  272us : rt_up (unix_stream_recvmsg)
mozilla--6007  0...1  272us : __up_mutex (rt_up)
mozilla--6007  0....  273us : dnotify_parent (vfs_read)
mozilla--6007  0....  273us : _spin_lock (dnotify_parent)
mozilla--6007  0....  273us : __spin_lock (_spin_lock)
mozilla--6007  0....  273us : __might_sleep (__spin_lock)
mozilla--6007  0....  273us : irqs_disabled (__might_sleep)
mozilla--6007  0....  273us : _down_mutex (__spin_lock)
mozilla--6007  0....  273us : __down_mutex (__spin_lock)
mozilla--6007  0...1  273us : grab_lock (__down_mutex)
mozilla--6007  0...1  274us : __down_mutex <mozilla--6007> (7d 0)
mozilla--6007  0....  274us : _spin_unlock (vfs_read)
mozilla--6007  0....  274us : up_mutex (vfs_read)
mozilla--6007  0....  274us : __up_mutex (up_mutex)
mozilla--6007  0....  274us : fput (sys_read)
mozilla--6007  0Dnh.  274us : __schedule (work_resched)
mozilla--6007  0Dnh.  275us : profile_hit (__schedule)
mozilla--6007  0Dnh1  275us : sched_clock (__schedule)
mozilla--6007  0Dnh1  275us : local_irq_disable (__schedule)
    <...>-5780  0dnh2  276us : __switch_to (__schedule)
    <...>-5780  0dnh2  276us : __schedule <mozilla--6007> (7d 73)
    <...>-5780  0dnh1  276us : trace_stop_sched_switched (__schedule)
    <...>-5780  0dnh1  276us : trace_stop_sched_switched <<...>-5780> (73 0)
    <...>-5780  0dnh1  277us : trace_stop_sched_switched (__schedule)



^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 14:18 ` Michal Schmidt
@ 2005-06-08 14:40   ` Keith Owens
  2005-06-08 14:41   ` Paulo Marques
  1 sibling, 0 replies; 139+ messages in thread
From: Keith Owens @ 2005-06-08 14:40 UTC (permalink / raw)
  To: Michal Schmidt; +Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

On Wed, 08 Jun 2005 16:18:58 +0200, 
Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:
>Ingo Molnar wrote:
>> i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
>> downloaded from the usual place:
>
>The build fails with inconsistent kallsyms data:
>   ...
>   LD      .tmp_vmlinux1
>   KSYM    .tmp_kallsyms1.S
>   AS      .tmp_kallsyms1.o
>   LD      .tmp_vmlinux2
>   KSYM    .tmp_kallsyms2.S
>   AS      .tmp_kallsyms2.o
>   LD      vmlinux
>   SYSMAP  System.map
>   SYSMAP  .tmp_System.map
>Inconsistent kallsyms data

Apply this patch, make debug_kallsyms, 'tar czvf map.tar.gz .tmp_map*'
and mail map.tar.gz to me, not the list.

Index: linux/Makefile
===================================================================
--- linux.orig/Makefile	2005-06-07 12:04:16.674163303 +1000
+++ linux/Makefile	2005-06-09 00:38:50.270431501 +1000
@@ -723,6 +723,16 @@ quiet_cmd_kallsyms = KSYM    $@
 # Needs to visit scripts/ before $(KALLSYMS) can be used.
 $(KALLSYMS): scripts ;
 
+# Generate some data for debugging strange kallsyms problems
+debug_kallsyms: .tmp_map$(last_kallsyms)
+
+.tmp_map%: .tmp_vmlinux% FORCE
+	($(OBJDUMP) -h $< | $(AWK) '/^ +[0-9]/{print $$4 " 0 " $$2}'; $(NM) $<) | sort > $@
+
+.tmp_map3: .tmp_map2
+
+.tmp_map2: .tmp_map1
+
 endif # ifdef CONFIG_KALLSYMS
 
 # vmlinux image - including updated kernel symbols


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 14:18 ` Michal Schmidt
  2005-06-08 14:40   ` Keith Owens
@ 2005-06-08 14:41   ` Paulo Marques
  2005-06-08 15:04     ` Michal Schmidt
  1 sibling, 1 reply; 139+ messages in thread
From: Paulo Marques @ 2005-06-08 14:41 UTC (permalink / raw)
  To: Michal Schmidt; +Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

Michal Schmidt wrote:
> [...]
> The build fails with inconsistent kallsyms data:
>[...]
>   SYSMAP  .tmp_System.map
> Inconsistent kallsyms data
> Try setting CONFIG_KALLSYMS_EXTRA_PASS
> make: *** [vmlinux] Error 1
> 
> When I enable the workaround CONFIG_KALLSYMS_EXTRA_PASS, it works.
> This is on i386, Debian Sarge. I'm attaching my .config.

This is probably just bad luck and a known problem that I'm trying to 
fix (but hadn't have much time lately).

Can you try to change the line:

#define WORKING_SET		1024

in scripts/kallsyms.c to:

#define WORKING_SET		65536

and disable CONFIG_KALLSYMS_EXTRA_PASS, to see if the problem goes away?

It it does go away, then it is the same problem, and I'm working on it...

-- 
Paulo Marques - www.grupopie.com

An expert is a person who has made all the mistakes that can be
made in a very narrow field.
Niels Bohr (1885 - 1962)

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 14:41   ` Paulo Marques
@ 2005-06-08 15:04     ` Michal Schmidt
  2005-06-08 15:23       ` Keith Owens
  0 siblings, 1 reply; 139+ messages in thread
From: Michal Schmidt @ 2005-06-08 15:04 UTC (permalink / raw)
  To: Paulo Marques; +Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

Paulo Marques wrote:
> This is probably just bad luck and a known problem that I'm trying to 
> fix (but hadn't have much time lately).
> 
> Can you try to change the line:
> 
> #define WORKING_SET        1024
> 
> in scripts/kallsyms.c to:
> 
> #define WORKING_SET        65536
> 
> and disable CONFIG_KALLSYMS_EXTRA_PASS, to see if the problem goes away?

Yes, this helps.

> It it does go away, then it is the same problem, and I'm working on it...

OK, thanks.

Michal

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 15:04     ` Michal Schmidt
@ 2005-06-08 15:23       ` Keith Owens
  2005-06-08 15:56         ` Paulo Marques
  0 siblings, 1 reply; 139+ messages in thread
From: Keith Owens @ 2005-06-08 15:23 UTC (permalink / raw)
  To: Michal Schmidt
  Cc: Paulo Marques, Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

On Wed, 08 Jun 2005 17:04:23 +0200, 
Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:
>Paulo Marques wrote:
>> This is probably just bad luck and a known problem that I'm trying to 
>> fix (but hadn't have much time lately).
>> 
>> Can you try to change the line:
>> 
>> #define WORKING_SET        1024
>> 
>> in scripts/kallsyms.c to:
>> 
>> #define WORKING_SET        65536
>> 
>> and disable CONFIG_KALLSYMS_EXTRA_PASS, to see if the problem goes away?
>
>Yes, this helps.
>
>> It it does go away, then it is the same problem, and I'm working on it...

Not the same problem.  The significant difference in the maps is :-

--- .tmp_map1   2005-06-09 01:14:50.303658655 +1000
+++ .tmp_map2   2005-06-09 01:14:52.829274854 +1000
@@ -8326,8 +8326,8 @@
 c02b93b0 T ipv6_skip_exthdr
 c02b9500 T sha_transform
 c02b96e0 T sha_init
-c02b970f T __sched_text_start
 c02b9710 t __compat_down
+c02b9710 T __sched_text_start
 c02b9810 t __compat_down_interruptible
 c02b9948 T __compat_down_failed
 c02b9958 T __compat_down_failed_interruptible

__sched_text_start has moved up by 1 byte between pass 1 and 2.  Text
addresses are not allowed to move between kallsyms passes, kallsyms
only adds data, it never touches the text segment.  Paulo's change to
the working set hides this peculiarity, rather than fixing the real
cause.  This looks like a toolchain bug, it is moving symbols for no
good reason.


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
  2005-06-08 14:18 ` Michal Schmidt
  2005-06-08 14:32 ` Michal Schmidt
@ 2005-06-08 15:48 ` K.R. Foley
  2005-06-08 16:08   ` K.R. Foley
  2005-06-08 17:26   ` K.R. Foley
  2005-06-08 17:51 ` Michal Schmidt
                   ` (6 subsequent siblings)
  9 siblings, 2 replies; 139+ messages in thread
From: K.R. Foley @ 2005-06-08 15:48 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 1390 bytes --]

Ingo Molnar wrote:
> i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
> downloaded from the usual place:
> 
>     http://redhat.com/~mingo/realtime-preempt/
> 
> this release includes an improved version of Daniel Walker's soft 
> irq-flag (hardirq-disable removal) feature. It is an unconditional part
> of the PREEMPT_RT preemption model - other preemption models should not
> be affected that much (besides possible build issues). Non-x86 arches
> wont build. Some regressions might happen, so take care..
> 
> Changes since -47-29:
> 
>  - soft IRQ flag support (Daniel Walker)
> 
>  - fix race in usbnet.c (Eugeny S. Mints)
> 
>  - further improvements to the soft IRQ flag code
> 
> to build a -V0.7.48-00 tree, the following patches should to be applied:
> 
>    http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.11.tar.bz2
>    http://kernel.org/pub/linux/kernel/v2.6/testing/patch-2.6.12-rc6.bz2
>    http://redhat.com/~mingo/realtime-preempt/realtime-preempt-2.6.12-rc6-V0.7.48-00
> 
> 	Ingo

Ingo,

I can't get any version of RT-preempt applied to 2.6.12-rc6 up to and 
including 48-01 to boot on any of my SMP systems. I get no log because 
it dies right after the "Uncompressing kernel" message. 2.6.12-rc6 boots 
fine.  I am attaching my config. Am I missing something obvious? I am 
building 48-01 with voluntary-preempt now to try that.

-- 
    kr

[-- Attachment #2: config-rc6-RT-V0.7.48-01 --]
[-- Type: text/plain, Size: 33737 bytes --]

#
# Automatically generated make config: don't edit
# Linux kernel version: 2.6.12-rc6-RT-V0.7.48-01
# Wed Jun  8 10:15:47 2005
#
CONFIG_X86=y
CONFIG_MMU=y
CONFIG_UID16=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y

#
# Code maturity level options
#
CONFIG_EXPERIMENTAL=y
CONFIG_CLEAN_COMPILE=y
CONFIG_LOCK_KERNEL=y
CONFIG_INIT_ENV_ARG_LIMIT=32

#
# General setup
#
CONFIG_LOCALVERSION=""
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_POSIX_MQUEUE=y
CONFIG_BSD_PROCESS_ACCT=y
# CONFIG_BSD_PROCESS_ACCT_V3 is not set
CONFIG_SYSCTL=y
# CONFIG_AUDIT is not set
CONFIG_HOTPLUG=y
CONFIG_KOBJECT_UEVENT=y
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
# CONFIG_CPUSETS is not set
# CONFIG_EMBEDDED is not set
CONFIG_KALLSYMS=y
# CONFIG_KALLSYMS_ALL is not set
# CONFIG_KALLSYMS_EXTRA_PASS is not set
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SHMEM=y
CONFIG_CC_ALIGN_FUNCTIONS=0
CONFIG_CC_ALIGN_LABELS=0
CONFIG_CC_ALIGN_LOOPS=0
CONFIG_CC_ALIGN_JUMPS=0
# CONFIG_TINY_SHMEM is not set
CONFIG_BASE_SMALL=0

#
# Loadable module support
#
CONFIG_MODULES=y
# CONFIG_MODULE_UNLOAD is not set
CONFIG_OBSOLETE_MODPARM=y
CONFIG_MODVERSIONS=y
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_KMOD=y

#
# Processor type and features
#
CONFIG_X86_PC=y
# CONFIG_X86_ELAN is not set
# CONFIG_X86_VOYAGER is not set
# CONFIG_X86_NUMAQ is not set
# CONFIG_X86_SUMMIT is not set
# CONFIG_X86_BIGSMP is not set
# CONFIG_X86_VISWS is not set
# CONFIG_X86_GENERICARCH is not set
# CONFIG_X86_ES7000 is not set
# CONFIG_M386 is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
# CONFIG_MPENTIUMIII is not set
# CONFIG_MPENTIUMM is not set
CONFIG_MPENTIUM4=y
# CONFIG_MK6 is not set
# CONFIG_MK7 is not set
# CONFIG_MK8 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MEFFICEON is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP2 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MGEODEGX1 is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
CONFIG_X86_GENERIC=y
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=7
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
# CONFIG_HPET_TIMER is not set
CONFIG_SMP=y
CONFIG_NR_CPUS=8
CONFIG_SCHED_SMT=y
# CONFIG_PREEMPT_NONE is not set
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT_DESKTOP is not set
CONFIG_PREEMPT_RT=y
CONFIG_PREEMPT=y
CONFIG_PREEMPT_SOFTIRQS=y
CONFIG_PREEMPT_HARDIRQS=y
CONFIG_PREEMPT_RCU=y
CONFIG_PREEMPT_BKL=y
CONFIG_RWSEM_GENERIC_SPINLOCK=y
CONFIG_ASM_SEMAPHORES=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_TSC=y
CONFIG_X86_MCE=y
# CONFIG_X86_MCE_NONFATAL is not set
# CONFIG_X86_MCE_P4THERMAL is not set
# CONFIG_TOSHIBA is not set
# CONFIG_I8K is not set
# CONFIG_X86_REBOOTFIXUPS is not set
# CONFIG_MICROCODE is not set
CONFIG_X86_MSR=m
CONFIG_X86_CPUID=m

#
# Firmware Drivers
#
CONFIG_EDD=m
CONFIG_NOHIGHMEM=y
# CONFIG_HIGHMEM4G is not set
# CONFIG_HIGHMEM64G is not set
# CONFIG_MATH_EMULATION is not set
CONFIG_MTRR=y
CONFIG_IRQBALANCE=y
CONFIG_HAVE_DEC_LOCK=y
CONFIG_SECCOMP=y

#
# Power management options (ACPI, APM)
#
# CONFIG_PM is not set

#
# ACPI (Advanced Configuration and Power Interface) Support
#
# CONFIG_ACPI is not set

#
# CPU Frequency scaling
#
# CONFIG_CPU_FREQ is not set

#
# Bus options (PCI, PCMCIA, EISA, MCA, ISA)
#
CONFIG_PCI=y
# CONFIG_PCI_GOBIOS is not set
# CONFIG_PCI_GOMMCONFIG is not set
# CONFIG_PCI_GODIRECT is not set
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
# CONFIG_PCIEPORTBUS is not set
# CONFIG_PCI_MSI is not set
# CONFIG_PCI_LEGACY_PROC is not set
CONFIG_PCI_NAMES=y
# CONFIG_PCI_DEBUG is not set
CONFIG_ISA_DMA_API=y
CONFIG_ISA=y
# CONFIG_EISA is not set
# CONFIG_MCA is not set
# CONFIG_SCx200 is not set

#
# PCCARD (PCMCIA/CardBus) support
#
# CONFIG_PCCARD is not set

#
# PCI Hotplug Support
#
# CONFIG_HOTPLUG_PCI is not set

#
# Executable file formats
#
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_AOUT=m
CONFIG_BINFMT_MISC=m

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=m
# CONFIG_DEBUG_DRIVER is not set

#
# Memory Technology Devices (MTD)
#
# CONFIG_MTD is not set

#
# Parallel port support
#
# CONFIG_PARPORT is not set

#
# Plug and Play support
#
CONFIG_PNP=y
# CONFIG_PNP_DEBUG is not set

#
# Protocols
#
CONFIG_ISAPNP=y
# CONFIG_PNPBIOS is not set

#
# Block devices
#
CONFIG_BLK_DEV_FD=m
# CONFIG_BLK_DEV_XD is not set
CONFIG_BLK_CPQ_DA=m
CONFIG_BLK_CPQ_CISS_DA=m
CONFIG_CISS_SCSI_TAPE=y
# CONFIG_BLK_DEV_DAC960 is not set
# CONFIG_BLK_DEV_UMEM is not set
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=m
# CONFIG_BLK_DEV_CRYPTOLOOP is not set
CONFIG_BLK_DEV_NBD=m
# CONFIG_BLK_DEV_SX8 is not set
# CONFIG_BLK_DEV_UB is not set
CONFIG_BLK_DEV_RAM=y
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=8192
CONFIG_BLK_DEV_INITRD=y
CONFIG_INITRAMFS_SOURCE=""
# CONFIG_LBD is not set
# CONFIG_CDROM_PKTCDVD is not set

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_ATA_OVER_ETH is not set

#
# ATA/ATAPI/MFM/RLL support
#
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y

#
# Please see Documentation/ide.txt for help/info on IDE drives
#
# CONFIG_BLK_DEV_IDE_SATA is not set
# CONFIG_BLK_DEV_HD_IDE is not set
CONFIG_BLK_DEV_IDEDISK=y
CONFIG_IDEDISK_MULTI_MODE=y
CONFIG_BLK_DEV_IDECD=m
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDEFLOPPY is not set
# CONFIG_BLK_DEV_IDESCSI is not set
# CONFIG_IDE_TASK_IOCTL is not set

#
# IDE chipset support/bugfixes
#
CONFIG_IDE_GENERIC=y
CONFIG_BLK_DEV_CMD640=y
# CONFIG_BLK_DEV_CMD640_ENHANCED is not set
# CONFIG_BLK_DEV_IDEPNP is not set
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_SHARE_IRQ=y
# CONFIG_BLK_DEV_OFFBOARD is not set
CONFIG_BLK_DEV_GENERIC=y
# CONFIG_BLK_DEV_OPTI621 is not set
CONFIG_BLK_DEV_RZ1000=y
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_IDEDMA_FORCED is not set
CONFIG_IDEDMA_PCI_AUTO=y
# CONFIG_IDEDMA_ONLYDISK is not set
CONFIG_BLK_DEV_AEC62XX=y
CONFIG_BLK_DEV_ALI15X3=y
# CONFIG_WDC_ALI15X3 is not set
CONFIG_BLK_DEV_AMD74XX=y
# CONFIG_BLK_DEV_ATIIXP is not set
CONFIG_BLK_DEV_CMD64X=y
CONFIG_BLK_DEV_TRIFLEX=y
CONFIG_BLK_DEV_CY82C693=y
# CONFIG_BLK_DEV_CS5520 is not set
CONFIG_BLK_DEV_CS5530=y
CONFIG_BLK_DEV_HPT34X=y
# CONFIG_HPT34X_AUTODMA is not set
CONFIG_BLK_DEV_HPT366=y
# CONFIG_BLK_DEV_SC1200 is not set
CONFIG_BLK_DEV_PIIX=y
# CONFIG_BLK_DEV_NS87415 is not set
CONFIG_BLK_DEV_PDC202XX_OLD=y
# CONFIG_PDC202XX_BURST is not set
CONFIG_BLK_DEV_PDC202XX_NEW=y
# CONFIG_PDC202XX_FORCE is not set
CONFIG_BLK_DEV_SVWKS=y
CONFIG_BLK_DEV_SIIMAGE=y
CONFIG_BLK_DEV_SIS5513=y
CONFIG_BLK_DEV_SLC90E66=y
# CONFIG_BLK_DEV_TRM290 is not set
CONFIG_BLK_DEV_VIA82CXXX=y
# CONFIG_IDE_ARM is not set
# CONFIG_IDE_CHIPSETS is not set
CONFIG_BLK_DEV_IDEDMA=y
# CONFIG_IDEDMA_IVB is not set
CONFIG_IDEDMA_AUTO=y
# CONFIG_BLK_DEV_HD is not set

#
# SCSI device support
#
CONFIG_SCSI=m
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=m
CONFIG_CHR_DEV_ST=m
CONFIG_CHR_DEV_OSST=m
CONFIG_BLK_DEV_SR=m
CONFIG_BLK_DEV_SR_VENDOR=y
CONFIG_CHR_DEV_SG=m

#
# Some SCSI devices (e.g. CD jukebox) support multiple LUNs
#
# CONFIG_SCSI_MULTI_LUN is not set
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y

#
# SCSI Transport Attributes
#
CONFIG_SCSI_SPI_ATTRS=m
# CONFIG_SCSI_FC_ATTRS is not set
# CONFIG_SCSI_ISCSI_ATTRS is not set

#
# SCSI low-level drivers
#
CONFIG_BLK_DEV_3W_XXXX_RAID=m
# CONFIG_SCSI_3W_9XXX is not set
CONFIG_SCSI_7000FASST=m
CONFIG_SCSI_ACARD=m
CONFIG_SCSI_AHA152X=m
CONFIG_SCSI_AHA1542=m
CONFIG_SCSI_AACRAID=m
CONFIG_SCSI_AIC7XXX=m
CONFIG_AIC7XXX_CMDS_PER_DEVICE=32
CONFIG_AIC7XXX_RESET_DELAY_MS=15000
# CONFIG_AIC7XXX_DEBUG_ENABLE is not set
CONFIG_AIC7XXX_DEBUG_MASK=0
# CONFIG_AIC7XXX_REG_PRETTY_PRINT is not set
CONFIG_SCSI_AIC7XXX_OLD=m
CONFIG_SCSI_AIC79XX=m
CONFIG_AIC79XX_CMDS_PER_DEVICE=32
CONFIG_AIC79XX_RESET_DELAY_MS=15000
# CONFIG_AIC79XX_ENABLE_RD_STRM is not set
# CONFIG_AIC79XX_DEBUG_ENABLE is not set
CONFIG_AIC79XX_DEBUG_MASK=0
# CONFIG_AIC79XX_REG_PRETTY_PRINT is not set
# CONFIG_SCSI_DPT_I2O is not set
CONFIG_SCSI_IN2000=m
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
CONFIG_SCSI_SATA=y
# CONFIG_SCSI_SATA_AHCI is not set
CONFIG_SCSI_SATA_SVW=m
CONFIG_SCSI_ATA_PIIX=m
# CONFIG_SCSI_SATA_NV is not set
CONFIG_SCSI_SATA_PROMISE=m
# CONFIG_SCSI_SATA_QSTOR is not set
# CONFIG_SCSI_SATA_SX4 is not set
CONFIG_SCSI_SATA_SIL=m
# CONFIG_SCSI_SATA_SIS is not set
# CONFIG_SCSI_SATA_ULI is not set
CONFIG_SCSI_SATA_VIA=m
# CONFIG_SCSI_SATA_VITESSE is not set
CONFIG_SCSI_BUSLOGIC=m
# CONFIG_SCSI_OMIT_FLASHPOINT is not set
CONFIG_SCSI_DMX3191D=m
CONFIG_SCSI_DTC3280=m
CONFIG_SCSI_EATA=m
CONFIG_SCSI_EATA_TAGGED_QUEUE=y
# CONFIG_SCSI_EATA_LINKED_COMMANDS is not set
CONFIG_SCSI_EATA_MAX_TAGS=16
CONFIG_SCSI_FUTURE_DOMAIN=m
CONFIG_SCSI_GDTH=m
CONFIG_SCSI_GENERIC_NCR5380=m
# CONFIG_SCSI_GENERIC_NCR5380_MMIO is not set
# CONFIG_SCSI_GENERIC_NCR53C400 is not set
CONFIG_SCSI_IPS=m
# CONFIG_SCSI_INITIO is not set
CONFIG_SCSI_INIA100=m
CONFIG_SCSI_NCR53C406A=m
CONFIG_SCSI_SYM53C8XX_2=m
CONFIG_SCSI_SYM53C8XX_DMA_ADDRESSING_MODE=1
CONFIG_SCSI_SYM53C8XX_DEFAULT_TAGS=16
CONFIG_SCSI_SYM53C8XX_MAX_TAGS=64
# CONFIG_SCSI_SYM53C8XX_IOMAPPED is not set
# CONFIG_SCSI_IPR is not set
CONFIG_SCSI_PAS16=m
CONFIG_SCSI_PSI240I=m
CONFIG_SCSI_QLOGIC_FAS=m
CONFIG_SCSI_QLOGIC_FC=m
# CONFIG_SCSI_QLOGIC_FC_FIRMWARE is not set
CONFIG_SCSI_QLOGIC_1280=m
# CONFIG_SCSI_QLOGIC_1280_1040 is not set
CONFIG_SCSI_QLA2XXX=m
# CONFIG_SCSI_QLA21XX is not set
# CONFIG_SCSI_QLA22XX is not set
# CONFIG_SCSI_QLA2300 is not set
# CONFIG_SCSI_QLA2322 is not set
# CONFIG_SCSI_QLA6312 is not set
# CONFIG_SCSI_LPFC is not set
CONFIG_SCSI_SYM53C416=m
# CONFIG_SCSI_DC395x is not set
CONFIG_SCSI_DC390T=m
CONFIG_SCSI_T128=m
CONFIG_SCSI_U14_34F=m
# CONFIG_SCSI_U14_34F_TAGGED_QUEUE is not set
# CONFIG_SCSI_U14_34F_LINKED_COMMANDS is not set
CONFIG_SCSI_U14_34F_MAX_TAGS=8
CONFIG_SCSI_ULTRASTOR=m
CONFIG_SCSI_NSP32=m
CONFIG_SCSI_DEBUG=m

#
# Old CD-ROM drivers (not SCSI, not IDE)
#
# CONFIG_CD_NO_IDESCSI is not set

#
# Multi-device support (RAID and LVM)
#
CONFIG_MD=y
CONFIG_BLK_DEV_MD=y
CONFIG_MD_LINEAR=m
CONFIG_MD_RAID0=m
CONFIG_MD_RAID1=m
# CONFIG_MD_RAID10 is not set
CONFIG_MD_RAID5=m
# CONFIG_MD_RAID6 is not set
CONFIG_MD_MULTIPATH=m
# CONFIG_MD_FAULTY is not set
CONFIG_BLK_DEV_DM=m
# CONFIG_DM_CRYPT is not set
# CONFIG_DM_SNAPSHOT is not set
# CONFIG_DM_MIRROR is not set
# CONFIG_DM_ZERO is not set
# CONFIG_DM_MULTIPATH is not set

#
# Fusion MPT device support
#
# CONFIG_FUSION is not set

#
# IEEE 1394 (FireWire) support
#
# CONFIG_IEEE1394 is not set

#
# I2O device support
#
# CONFIG_I2O is not set

#
# Networking support
#
CONFIG_NET=y

#
# Networking options
#
CONFIG_PACKET=y
CONFIG_PACKET_MMAP=y
CONFIG_UNIX=y
CONFIG_NET_KEY=m
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
# CONFIG_IP_ADVANCED_ROUTER is not set
# CONFIG_IP_PNP is not set
CONFIG_NET_IPIP=m
CONFIG_NET_IPGRE=m
CONFIG_NET_IPGRE_BROADCAST=y
# CONFIG_IP_MROUTE is not set
# CONFIG_ARPD is not set
CONFIG_SYN_COOKIES=y
CONFIG_INET_AH=m
CONFIG_INET_ESP=m
CONFIG_INET_IPCOMP=m
CONFIG_INET_TUNNEL=m
CONFIG_IP_TCPDIAG=m
# CONFIG_IP_TCPDIAG_IPV6 is not set
# CONFIG_IPV6 is not set
# CONFIG_NETFILTER is not set
CONFIG_XFRM=y
# CONFIG_XFRM_USER is not set

#
# SCTP Configuration (EXPERIMENTAL)
#
# CONFIG_IP_SCTP is not set
# CONFIG_ATM is not set
CONFIG_BRIDGE=m
CONFIG_VLAN_8021Q=m
# CONFIG_DECNET is not set
CONFIG_LLC=y
# CONFIG_LLC2 is not set
CONFIG_IPX=m
# CONFIG_IPX_INTERN is not set
CONFIG_ATALK=m
CONFIG_DEV_APPLETALK=y
CONFIG_LTPC=m
CONFIG_COPS=m
CONFIG_COPS_DAYNA=y
CONFIG_COPS_TANGENT=y
CONFIG_IPDDP=m
CONFIG_IPDDP_ENCAP=y
CONFIG_IPDDP_DECAP=y
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
CONFIG_NET_DIVERT=y
# CONFIG_ECONET is not set
CONFIG_WAN_ROUTER=m

#
# QoS and/or fair queueing
#
CONFIG_NET_SCHED=y
CONFIG_NET_SCH_CLK_JIFFIES=y
# CONFIG_NET_SCH_CLK_GETTIMEOFDAY is not set
# CONFIG_NET_SCH_CLK_CPU is not set
CONFIG_NET_SCH_CBQ=m
CONFIG_NET_SCH_HTB=m
# CONFIG_NET_SCH_HFSC is not set
CONFIG_NET_SCH_PRIO=m
CONFIG_NET_SCH_RED=m
CONFIG_NET_SCH_SFQ=m
CONFIG_NET_SCH_TEQL=m
CONFIG_NET_SCH_TBF=m
CONFIG_NET_SCH_GRED=m
CONFIG_NET_SCH_DSMARK=m
# CONFIG_NET_SCH_NETEM is not set
CONFIG_NET_SCH_INGRESS=m
CONFIG_NET_QOS=y
CONFIG_NET_ESTIMATOR=y
CONFIG_NET_CLS=y
# CONFIG_NET_CLS_BASIC is not set
CONFIG_NET_CLS_TCINDEX=m
CONFIG_NET_CLS_ROUTE4=m
CONFIG_NET_CLS_ROUTE=y
CONFIG_NET_CLS_FW=m
CONFIG_NET_CLS_U32=m
# CONFIG_CLS_U32_PERF is not set
# CONFIG_NET_CLS_IND is not set
CONFIG_NET_CLS_RSVP=m
CONFIG_NET_CLS_RSVP6=m
# CONFIG_NET_EMATCH is not set
# CONFIG_NET_CLS_ACT is not set
CONFIG_NET_CLS_POLICE=y

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
CONFIG_NETPOLL=y
# CONFIG_NETPOLL_RX is not set
# CONFIG_NETPOLL_TRAP is not set
CONFIG_NET_POLL_CONTROLLER=y
# CONFIG_HAMRADIO is not set
# CONFIG_IRDA is not set
# CONFIG_BT is not set
CONFIG_NETDEVICES=y
CONFIG_DUMMY=m
# CONFIG_BONDING is not set
# CONFIG_EQUALIZER is not set
CONFIG_TUN=m
# CONFIG_NET_SB1000 is not set

#
# ARCnet devices
#
# CONFIG_ARCNET is not set

#
# Ethernet (10 or 100Mbit)
#
CONFIG_NET_ETHERNET=y
CONFIG_MII=m
CONFIG_HAPPYMEAL=m
CONFIG_SUNGEM=m
CONFIG_NET_VENDOR_3COM=y
CONFIG_EL1=m
CONFIG_EL2=m
CONFIG_ELPLUS=m
CONFIG_EL16=m
CONFIG_EL3=m
CONFIG_3C515=m
CONFIG_VORTEX=m
CONFIG_TYPHOON=m
CONFIG_LANCE=m
CONFIG_NET_VENDOR_SMC=y
CONFIG_WD80x3=m
CONFIG_ULTRA=m
CONFIG_SMC9194=m
CONFIG_NET_VENDOR_RACAL=y
CONFIG_NI52=m
CONFIG_NI65=m

#
# Tulip family network device support
#
# CONFIG_NET_TULIP is not set
CONFIG_AT1700=m
CONFIG_DEPCA=m
CONFIG_HP100=m
CONFIG_NET_ISA=y
CONFIG_E2100=m
CONFIG_EWRK3=m
CONFIG_EEXPRESS=m
CONFIG_EEXPRESS_PRO=m
CONFIG_HPLAN_PLUS=m
CONFIG_HPLAN=m
CONFIG_LP486E=m
CONFIG_ETH16I=m
CONFIG_NE2000=m
# CONFIG_ZNET is not set
# CONFIG_SEEQ8005 is not set
CONFIG_NET_PCI=y
CONFIG_PCNET32=m
CONFIG_AMD8111_ETH=m
# CONFIG_AMD8111E_NAPI is not set
CONFIG_ADAPTEC_STARFIRE=m
# CONFIG_ADAPTEC_STARFIRE_NAPI is not set
CONFIG_AC3200=m
CONFIG_APRICOT=m
CONFIG_B44=m
# CONFIG_FORCEDETH is not set
CONFIG_CS89x0=m
CONFIG_DGRS=m
CONFIG_EEPRO100=m
CONFIG_E100=m
CONFIG_FEALNX=m
CONFIG_NATSEMI=m
CONFIG_NE2K_PCI=m
CONFIG_8139CP=m
CONFIG_8139TOO=m
CONFIG_8139TOO_PIO=y
# CONFIG_8139TOO_TUNE_TWISTER is not set
CONFIG_8139TOO_8129=y
# CONFIG_8139_OLD_RX_RESET is not set
CONFIG_SIS900=m
CONFIG_EPIC100=m
CONFIG_SUNDANCE=m
# CONFIG_SUNDANCE_MMIO is not set
CONFIG_TLAN=m
CONFIG_VIA_RHINE=m
# CONFIG_VIA_RHINE_MMIO is not set
CONFIG_NET_POCKET=y
CONFIG_ATP=m
CONFIG_DE600=m
CONFIG_DE620=m

#
# Ethernet (1000 Mbit)
#
CONFIG_ACENIC=m
# CONFIG_ACENIC_OMIT_TIGON_I is not set
CONFIG_DL2K=m
CONFIG_E1000=m
CONFIG_E1000_NAPI=y
CONFIG_NS83820=m
CONFIG_HAMACHI=m
CONFIG_YELLOWFIN=m
CONFIG_R8169=m
# CONFIG_R8169_NAPI is not set
# CONFIG_R8169_VLAN is not set
CONFIG_SK98LIN=m
# CONFIG_VIA_VELOCITY is not set
CONFIG_TIGON3=m
# CONFIG_BNX2 is not set

#
# Ethernet (10000 Mbit)
#
# CONFIG_IXGB is not set
# CONFIG_S2IO is not set

#
# Token Ring devices
#
CONFIG_TR=y
CONFIG_IBMTR=m
CONFIG_IBMOL=m
CONFIG_IBMLS=m
CONFIG_3C359=m
CONFIG_TMS380TR=m
CONFIG_TMSPCI=m
# CONFIG_SKISA is not set
# CONFIG_PROTEON is not set
CONFIG_ABYSS=m
CONFIG_SMCTR=m

#
# Wireless LAN (non-hamradio)
#
# CONFIG_NET_RADIO is not set

#
# Wan interfaces
#
# CONFIG_WAN is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
CONFIG_PPP=m
CONFIG_PPP_MULTILINK=y
CONFIG_PPP_FILTER=y
CONFIG_PPP_ASYNC=m
CONFIG_PPP_SYNC_TTY=m
CONFIG_PPP_DEFLATE=m
# CONFIG_PPP_BSDCOMP is not set
CONFIG_PPPOE=m
CONFIG_SLIP=m
CONFIG_SLIP_COMPRESSED=y
CONFIG_SLIP_SMART=y
CONFIG_SLIP_MODE_SLIP6=y
CONFIG_NET_FC=y
CONFIG_SHAPER=m
CONFIG_NETCONSOLE=m

#
# ISDN subsystem
#
# CONFIG_ISDN is not set

#
# Telephony Support
#
# CONFIG_PHONE is not set

#
# Input device support
#
CONFIG_INPUT=y

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
# CONFIG_INPUT_MOUSEDEV_PSAUX is not set
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
CONFIG_INPUT_JOYDEV=m
# CONFIG_INPUT_TSDEV is not set
CONFIG_INPUT_EVDEV=m
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_XTKBD is not set
# CONFIG_KEYBOARD_NEWTON is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
# CONFIG_MOUSE_SERIAL is not set
# CONFIG_MOUSE_INPORT is not set
# CONFIG_MOUSE_LOGIBM is not set
# CONFIG_MOUSE_PC110PAD is not set
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
CONFIG_INPUT_MISC=y
# CONFIG_INPUT_PCSPKR is not set
# CONFIG_INPUT_UINPUT is not set

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_SERPORT=y
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PCIPS2 is not set
CONFIG_SERIO_LIBPS2=y
# CONFIG_SERIO_RAW is not set
# CONFIG_GAMEPORT is not set

#
# Character devices
#
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
CONFIG_SERIAL_NONSTANDARD=y
CONFIG_ROCKETPORT=m
CONFIG_CYCLADES=m
# CONFIG_CYZ_INTR is not set
# CONFIG_MOXA_SMARTIO is not set
# CONFIG_ISI is not set
CONFIG_SYNCLINK=m
# CONFIG_SYNCLINKMP is not set
CONFIG_N_HDLC=m
# CONFIG_SPECIALIX is not set
# CONFIG_SX is not set
CONFIG_STALDRV=y

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_SERIAL_8250_NR_UARTS=4
# CONFIG_SERIAL_8250_EXTENDED is not set

#
# Non-8250 serial port support
#
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
# CONFIG_SERIAL_JSM is not set
CONFIG_UNIX98_PTYS=y
CONFIG_LEGACY_PTYS=y
CONFIG_LEGACY_PTY_COUNT=256

#
# IPMI
#
# CONFIG_IPMI_HANDLER is not set

#
# Watchdog Cards
#
CONFIG_WATCHDOG=y
# CONFIG_WATCHDOG_NOWAYOUT is not set

#
# Watchdog Device Drivers
#
CONFIG_SOFT_WATCHDOG=m
CONFIG_ACQUIRE_WDT=m
CONFIG_ADVANTECH_WDT=m
CONFIG_ALIM1535_WDT=m
CONFIG_ALIM7101_WDT=m
CONFIG_SC520_WDT=m
CONFIG_EUROTECH_WDT=m
CONFIG_IB700_WDT=m
CONFIG_WAFER_WDT=m
# CONFIG_I8XX_TCO is not set
CONFIG_SC1200_WDT=m
# CONFIG_60XX_WDT is not set
# CONFIG_CPU5_WDT is not set
# CONFIG_W83627HF_WDT is not set
CONFIG_W83877F_WDT=m
CONFIG_MACHZ_WDT=m

#
# ISA-based Watchdog Cards
#
CONFIG_PCWATCHDOG=m
# CONFIG_MIXCOMWD is not set
CONFIG_WDT=m
# CONFIG_WDT_501 is not set

#
# PCI-based Watchdog Cards
#
# CONFIG_PCIPCWATCHDOG is not set
CONFIG_WDTPCI=m
# CONFIG_WDT_501_PCI is not set

#
# USB-based Watchdog Cards
#
# CONFIG_USBPCWATCHDOG is not set
# CONFIG_HW_RANDOM is not set
CONFIG_NVRAM=m
CONFIG_RTC=y
CONFIG_RTC_HISTOGRAM=y
CONFIG_BLOCKER=y
CONFIG_DTLK=m
CONFIG_R3964=m
# CONFIG_APPLICOM is not set
CONFIG_SONYPI=m

#
# Ftape, the floppy tape device driver
#
CONFIG_AGP=m
CONFIG_AGP_ALI=m
CONFIG_AGP_ATI=m
CONFIG_AGP_AMD=m
# CONFIG_AGP_AMD64 is not set
CONFIG_AGP_INTEL=m
CONFIG_AGP_NVIDIA=m
CONFIG_AGP_SIS=m
CONFIG_AGP_SWORKS=m
CONFIG_AGP_VIA=m
# CONFIG_AGP_EFFICEON is not set
# CONFIG_DRM is not set
CONFIG_MWAVE=m
# CONFIG_RAW_DRIVER is not set
# CONFIG_HANGCHECK_TIMER is not set

#
# TPM devices
#
# CONFIG_TCG_TPM is not set

#
# I2C support
#
CONFIG_I2C=m
CONFIG_I2C_CHARDEV=m

#
# I2C Algorithms
#
CONFIG_I2C_ALGOBIT=m
CONFIG_I2C_ALGOPCF=m
# CONFIG_I2C_ALGOPCA is not set

#
# I2C Hardware Bus support
#
CONFIG_I2C_ALI1535=m
# CONFIG_I2C_ALI1563 is not set
CONFIG_I2C_ALI15X3=m
CONFIG_I2C_AMD756=m
# CONFIG_I2C_AMD756_S4882 is not set
# CONFIG_I2C_AMD8111 is not set
CONFIG_I2C_I801=m
CONFIG_I2C_I810=m
CONFIG_I2C_PIIX4=m
CONFIG_I2C_ISA=m
# CONFIG_I2C_NFORCE2 is not set
# CONFIG_I2C_PARPORT_LIGHT is not set
# CONFIG_I2C_PROSAVAGE is not set
# CONFIG_I2C_SAVAGE4 is not set
# CONFIG_SCx200_ACB is not set
CONFIG_I2C_SIS5595=m
# CONFIG_I2C_SIS630 is not set
# CONFIG_I2C_SIS96X is not set
# CONFIG_I2C_STUB is not set
CONFIG_I2C_VIA=m
CONFIG_I2C_VIAPRO=m
CONFIG_I2C_VOODOO3=m
# CONFIG_I2C_PCA_ISA is not set

#
# Hardware Sensors Chip support
#
CONFIG_I2C_SENSOR=m
CONFIG_SENSORS_ADM1021=m
# CONFIG_SENSORS_ADM1025 is not set
# CONFIG_SENSORS_ADM1026 is not set
# CONFIG_SENSORS_ADM1031 is not set
# CONFIG_SENSORS_ASB100 is not set
CONFIG_SENSORS_DS1621=m
# CONFIG_SENSORS_FSCHER is not set
# CONFIG_SENSORS_FSCPOS is not set
CONFIG_SENSORS_GL518SM=m
# CONFIG_SENSORS_GL520SM is not set
CONFIG_SENSORS_IT87=m
# CONFIG_SENSORS_LM63 is not set
CONFIG_SENSORS_LM75=m
# CONFIG_SENSORS_LM77 is not set
CONFIG_SENSORS_LM78=m
CONFIG_SENSORS_LM80=m
# CONFIG_SENSORS_LM83 is not set
# CONFIG_SENSORS_LM85 is not set
# CONFIG_SENSORS_LM87 is not set
# CONFIG_SENSORS_LM90 is not set
# CONFIG_SENSORS_LM92 is not set
# CONFIG_SENSORS_MAX1619 is not set
# CONFIG_SENSORS_PC87360 is not set
# CONFIG_SENSORS_SMSC47B397 is not set
# CONFIG_SENSORS_SIS5595 is not set
# CONFIG_SENSORS_SMSC47M1 is not set
CONFIG_SENSORS_VIA686A=m
CONFIG_SENSORS_W83781D=m
# CONFIG_SENSORS_W83L785TS is not set
# CONFIG_SENSORS_W83627HF is not set

#
# Other I2C Chip support
#
# CONFIG_SENSORS_DS1337 is not set
CONFIG_SENSORS_EEPROM=m
CONFIG_SENSORS_PCF8574=m
CONFIG_SENSORS_PCF8591=m
# CONFIG_SENSORS_RTC8564 is not set
# CONFIG_I2C_DEBUG_CORE is not set
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
# CONFIG_I2C_DEBUG_CHIP is not set

#
# Dallas's 1-wire bus
#
# CONFIG_W1 is not set

#
# Misc devices
#
# CONFIG_IBM_ASM is not set

#
# Multimedia devices
#
# CONFIG_VIDEO_DEV is not set

#
# Digital Video Broadcasting Devices
#
# CONFIG_DVB is not set

#
# Graphics support
#
CONFIG_FB=y
CONFIG_FB_CFB_FILLRECT=y
CONFIG_FB_CFB_COPYAREA=y
CONFIG_FB_CFB_IMAGEBLIT=y
CONFIG_FB_SOFT_CURSOR=y
# CONFIG_FB_MACMODES is not set
CONFIG_FB_MODE_HELPERS=y
CONFIG_FB_TILEBLITTING=y
# CONFIG_FB_CIRRUS is not set
CONFIG_FB_PM2=m
# CONFIG_FB_PM2_FIFO_DISCONNECT is not set
# CONFIG_FB_CYBER2000 is not set
# CONFIG_FB_ASILIANT is not set
# CONFIG_FB_IMSTT is not set
CONFIG_FB_VGA16=m
CONFIG_FB_VESA=y
CONFIG_VIDEO_SELECT=y
CONFIG_FB_HGA=m
# CONFIG_FB_HGA_ACCEL is not set
# CONFIG_FB_NVIDIA is not set
CONFIG_FB_RIVA=m
# CONFIG_FB_RIVA_I2C is not set
# CONFIG_FB_RIVA_DEBUG is not set
# CONFIG_FB_I810 is not set
# CONFIG_FB_INTEL is not set
CONFIG_FB_MATROX=m
CONFIG_FB_MATROX_MILLENIUM=y
CONFIG_FB_MATROX_MYSTIQUE=y
# CONFIG_FB_MATROX_G is not set
CONFIG_FB_MATROX_I2C=m
CONFIG_FB_MATROX_MULTIHEAD=y
# CONFIG_FB_RADEON_OLD is not set
CONFIG_FB_RADEON=m
CONFIG_FB_RADEON_I2C=y
# CONFIG_FB_RADEON_DEBUG is not set
CONFIG_FB_ATY128=m
CONFIG_FB_ATY=m
CONFIG_FB_ATY_CT=y
# CONFIG_FB_ATY_GENERIC_LCD is not set
# CONFIG_FB_ATY_XL_INIT is not set
CONFIG_FB_ATY_GX=y
# CONFIG_FB_SAVAGE is not set
CONFIG_FB_SIS=m
CONFIG_FB_SIS_300=y
CONFIG_FB_SIS_315=y
CONFIG_FB_NEOMAGIC=m
# CONFIG_FB_KYRO is not set
CONFIG_FB_3DFX=m
# CONFIG_FB_3DFX_ACCEL is not set
CONFIG_FB_VOODOO1=m
# CONFIG_FB_TRIDENT is not set
# CONFIG_FB_GEODE is not set
# CONFIG_FB_S1D13XXX is not set
# CONFIG_FB_VIRTUAL is not set

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
CONFIG_MDA_CONSOLE=m
CONFIG_DUMMY_CONSOLE=y
# CONFIG_FRAMEBUFFER_CONSOLE is not set

#
# Logo configuration
#
# CONFIG_LOGO is not set
# CONFIG_BACKLIGHT_LCD_SUPPORT is not set

#
# Sound
#
CONFIG_SOUND=m

#
# Advanced Linux Sound Architecture
#
# CONFIG_SND is not set

#
# Open Sound System
#
# CONFIG_SOUND_PRIME is not set

#
# USB support
#
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB=m
# CONFIG_USB_DEBUG is not set

#
# Miscellaneous USB options
#
CONFIG_USB_DEVICEFS=y
# CONFIG_USB_BANDWIDTH is not set
# CONFIG_USB_DYNAMIC_MINORS is not set
# CONFIG_USB_OTG is not set

#
# USB Host Controller Drivers
#
CONFIG_USB_EHCI_HCD=m
# CONFIG_USB_EHCI_SPLIT_ISO is not set
# CONFIG_USB_EHCI_ROOT_HUB_TT is not set
# CONFIG_USB_OHCI_HCD is not set
CONFIG_USB_UHCI_HCD=m
# CONFIG_USB_SL811_HCD is not set

#
# USB Device Class drivers
#
CONFIG_USB_AUDIO=m
# CONFIG_USB_BLUETOOTH_TTY is not set
CONFIG_USB_MIDI=m
CONFIG_USB_ACM=m
CONFIG_USB_PRINTER=m

#
# NOTE: USB_STORAGE enables SCSI, and 'SCSI disk support' may also be needed; see USB_STORAGE Help for more information
#
CONFIG_USB_STORAGE=m
# CONFIG_USB_STORAGE_DEBUG is not set
CONFIG_USB_STORAGE_DATAFAB=y
CONFIG_USB_STORAGE_FREECOM=y
CONFIG_USB_STORAGE_ISD200=y
CONFIG_USB_STORAGE_DPCM=y
# CONFIG_USB_STORAGE_USBAT is not set
CONFIG_USB_STORAGE_SDDR09=y
CONFIG_USB_STORAGE_SDDR55=y
CONFIG_USB_STORAGE_JUMPSHOT=y

#
# USB Input Devices
#
CONFIG_USB_HID=m
CONFIG_USB_HIDINPUT=y
# CONFIG_HID_FF is not set
# CONFIG_USB_HIDDEV is not set

#
# USB HID Boot Protocol drivers
#
# CONFIG_USB_KBD is not set
# CONFIG_USB_MOUSE is not set
CONFIG_USB_AIPTEK=m
CONFIG_USB_WACOM=m
# CONFIG_USB_KBTAB is not set
# CONFIG_USB_POWERMATE is not set
# CONFIG_USB_MTOUCH is not set
# CONFIG_USB_EGALAX is not set
# CONFIG_USB_XPAD is not set
# CONFIG_USB_ATI_REMOTE is not set

#
# USB Imaging devices
#
CONFIG_USB_MDC800=m
CONFIG_USB_MICROTEK=m

#
# USB Multimedia devices
#
CONFIG_USB_DABUSB=m

#
# Video4Linux support is needed for USB Multimedia device support
#

#
# USB Network Adapters
#
CONFIG_USB_CATC=m
CONFIG_USB_KAWETH=m
CONFIG_USB_PEGASUS=m
CONFIG_USB_RTL8150=m
CONFIG_USB_USBNET=m

#
# USB Host-to-Host Cables
#
CONFIG_USB_ALI_M5632=y
CONFIG_USB_AN2720=y
CONFIG_USB_BELKIN=y
CONFIG_USB_GENESYS=y
CONFIG_USB_NET1080=y
CONFIG_USB_PL2301=y
CONFIG_USB_KC2190=y

#
# Intelligent USB Devices/Gadgets
#
CONFIG_USB_ARMLINUX=y
CONFIG_USB_EPSON2888=y
CONFIG_USB_ZAURUS=y
CONFIG_USB_CDCETHER=y

#
# USB Network Adapters
#
CONFIG_USB_AX8817X=y
CONFIG_USB_MON=m

#
# USB port drivers
#

#
# USB Serial Converter support
#
CONFIG_USB_SERIAL=m
CONFIG_USB_SERIAL_GENERIC=y
# CONFIG_USB_SERIAL_AIRPRIME is not set
CONFIG_USB_SERIAL_BELKIN=m
CONFIG_USB_SERIAL_DIGI_ACCELEPORT=m
# CONFIG_USB_SERIAL_CP2101 is not set
# CONFIG_USB_SERIAL_CYPRESS_M8 is not set
CONFIG_USB_SERIAL_EMPEG=m
CONFIG_USB_SERIAL_FTDI_SIO=m
CONFIG_USB_SERIAL_VISOR=m
CONFIG_USB_SERIAL_IPAQ=m
CONFIG_USB_SERIAL_IR=m
CONFIG_USB_SERIAL_EDGEPORT=m
CONFIG_USB_SERIAL_EDGEPORT_TI=m
# CONFIG_USB_SERIAL_GARMIN is not set
# CONFIG_USB_SERIAL_IPW is not set
CONFIG_USB_SERIAL_KEYSPAN_PDA=m
CONFIG_USB_SERIAL_KEYSPAN=m
# CONFIG_USB_SERIAL_KEYSPAN_MPR is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA28 is not set
CONFIG_USB_SERIAL_KEYSPAN_USA28X=y
CONFIG_USB_SERIAL_KEYSPAN_USA28XA=y
CONFIG_USB_SERIAL_KEYSPAN_USA28XB=y
# CONFIG_USB_SERIAL_KEYSPAN_USA19 is not set
# CONFIG_USB_SERIAL_KEYSPAN_USA18X is not set
CONFIG_USB_SERIAL_KEYSPAN_USA19W=y
CONFIG_USB_SERIAL_KEYSPAN_USA19QW=y
CONFIG_USB_SERIAL_KEYSPAN_USA19QI=y
CONFIG_USB_SERIAL_KEYSPAN_USA49W=y
CONFIG_USB_SERIAL_KEYSPAN_USA49WLC=y
CONFIG_USB_SERIAL_KLSI=m
CONFIG_USB_SERIAL_KOBIL_SCT=m
CONFIG_USB_SERIAL_MCT_U232=m
CONFIG_USB_SERIAL_PL2303=m
# CONFIG_USB_SERIAL_HP4X is not set
# CONFIG_USB_SERIAL_SAFE is not set
# CONFIG_USB_SERIAL_TI is not set
CONFIG_USB_SERIAL_CYBERJACK=m
CONFIG_USB_SERIAL_XIRCOM=m
CONFIG_USB_SERIAL_OMNINET=m
CONFIG_USB_EZUSB=y

#
# USB Miscellaneous drivers
#
# CONFIG_USB_EMI62 is not set
# CONFIG_USB_EMI26 is not set
CONFIG_USB_AUERSWALD=m
CONFIG_USB_RIO500=m
# CONFIG_USB_LEGOTOWER is not set
CONFIG_USB_LCD=m
# CONFIG_USB_LED is not set
# CONFIG_USB_CYTHERM is not set
# CONFIG_USB_PHIDGETKIT is not set
# CONFIG_USB_PHIDGETSERVO is not set
# CONFIG_USB_IDMOUSE is not set
# CONFIG_USB_SISUSBVGA is not set
# CONFIG_USB_TEST is not set

#
# USB ATM/DSL drivers
#

#
# USB Gadget Support
#
# CONFIG_USB_GADGET is not set

#
# MMC/SD Card support
#
# CONFIG_MMC is not set

#
# InfiniBand support
#
# CONFIG_INFINIBAND is not set

#
# File systems
#
CONFIG_EXT2_FS=y
# CONFIG_EXT2_FS_XATTR is not set
CONFIG_EXT3_FS=m
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
# CONFIG_EXT3_FS_SECURITY is not set
CONFIG_JBD=m
# CONFIG_JBD_DEBUG is not set
CONFIG_FS_MBCACHE=y
CONFIG_REISERFS_FS=m
# CONFIG_REISERFS_CHECK is not set
CONFIG_REISERFS_PROC_INFO=y
# CONFIG_REISERFS_FS_XATTR is not set
CONFIG_JFS_FS=m
# CONFIG_JFS_POSIX_ACL is not set
# CONFIG_JFS_SECURITY is not set
CONFIG_JFS_DEBUG=y
# CONFIG_JFS_STATISTICS is not set
CONFIG_FS_POSIX_ACL=y

#
# XFS support
#
# CONFIG_XFS_FS is not set
CONFIG_MINIX_FS=m
CONFIG_ROMFS_FS=m
CONFIG_QUOTA=y
# CONFIG_QFMT_V1 is not set
CONFIG_QFMT_V2=y
CONFIG_QUOTACTL=y
CONFIG_DNOTIFY=y
CONFIG_AUTOFS_FS=m
CONFIG_AUTOFS4_FS=m

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_ZISOFS_FS=y
CONFIG_UDF_FS=m
CONFIG_UDF_NLS=y

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
# CONFIG_NTFS_FS is not set

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_SYSFS=y
# CONFIG_DEVFS_FS is not set
# CONFIG_DEVPTS_FS_XATTR is not set
CONFIG_TMPFS=y
# CONFIG_TMPFS_XATTR is not set
# CONFIG_HUGETLBFS is not set
# CONFIG_HUGETLB_PAGE is not set
CONFIG_RAMFS=y

#
# Miscellaneous filesystems
#
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
CONFIG_CRAMFS=m
# CONFIG_VXFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
CONFIG_SYSV_FS=m
CONFIG_UFS_FS=m
# CONFIG_UFS_FS_WRITE is not set

#
# Network File Systems
#
CONFIG_NFS_FS=m
CONFIG_NFS_V3=y
# CONFIG_NFS_V4 is not set
CONFIG_NFS_DIRECTIO=y
CONFIG_NFSD=m
CONFIG_NFSD_V3=y
# CONFIG_NFSD_V4 is not set
CONFIG_NFSD_TCP=y
CONFIG_LOCKD=m
CONFIG_LOCKD_V4=y
CONFIG_EXPORTFS=m
CONFIG_SUNRPC=m
# CONFIG_RPCSEC_GSS_KRB5 is not set
# CONFIG_RPCSEC_GSS_SPKM3 is not set
CONFIG_SMB_FS=m
# CONFIG_SMB_NLS_DEFAULT is not set
# CONFIG_CIFS is not set
CONFIG_NCP_FS=m
CONFIG_NCPFS_PACKET_SIGNING=y
CONFIG_NCPFS_IOCTL_LOCKING=y
CONFIG_NCPFS_STRONG=y
CONFIG_NCPFS_NFS_NS=y
CONFIG_NCPFS_OS2_NS=y
CONFIG_NCPFS_SMALLDOS=y
CONFIG_NCPFS_NLS=y
CONFIG_NCPFS_EXTRAS=y
CONFIG_CODA_FS=m
# CONFIG_CODA_FS_OLD_API is not set
CONFIG_AFS_FS=m
CONFIG_RXRPC=m

#
# Partition Types
#
CONFIG_PARTITION_ADVANCED=y
# CONFIG_ACORN_PARTITION is not set
CONFIG_OSF_PARTITION=y
# CONFIG_AMIGA_PARTITION is not set
# CONFIG_ATARI_PARTITION is not set
# CONFIG_MAC_PARTITION is not set
CONFIG_MSDOS_PARTITION=y
CONFIG_BSD_DISKLABEL=y
CONFIG_MINIX_SUBPARTITION=y
CONFIG_SOLARIS_X86_PARTITION=y
CONFIG_UNIXWARE_DISKLABEL=y
# CONFIG_LDM_PARTITION is not set
CONFIG_SGI_PARTITION=y
# CONFIG_ULTRIX_PARTITION is not set
CONFIG_SUN_PARTITION=y
# CONFIG_EFI_PARTITION is not set

#
# Native Language Support
#
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-1"
CONFIG_NLS_CODEPAGE_437=m
CONFIG_NLS_CODEPAGE_737=m
CONFIG_NLS_CODEPAGE_775=m
CONFIG_NLS_CODEPAGE_850=m
CONFIG_NLS_CODEPAGE_852=m
CONFIG_NLS_CODEPAGE_855=m
CONFIG_NLS_CODEPAGE_857=m
CONFIG_NLS_CODEPAGE_860=m
CONFIG_NLS_CODEPAGE_861=m
CONFIG_NLS_CODEPAGE_862=m
CONFIG_NLS_CODEPAGE_863=m
CONFIG_NLS_CODEPAGE_864=m
CONFIG_NLS_CODEPAGE_865=m
CONFIG_NLS_CODEPAGE_866=m
CONFIG_NLS_CODEPAGE_869=m
CONFIG_NLS_CODEPAGE_936=m
CONFIG_NLS_CODEPAGE_950=m
CONFIG_NLS_CODEPAGE_932=m
CONFIG_NLS_CODEPAGE_949=m
CONFIG_NLS_CODEPAGE_874=m
CONFIG_NLS_ISO8859_8=m
CONFIG_NLS_CODEPAGE_1250=m
CONFIG_NLS_CODEPAGE_1251=m
# CONFIG_NLS_ASCII is not set
CONFIG_NLS_ISO8859_1=m
CONFIG_NLS_ISO8859_2=m
CONFIG_NLS_ISO8859_3=m
CONFIG_NLS_ISO8859_4=m
CONFIG_NLS_ISO8859_5=m
CONFIG_NLS_ISO8859_6=m
CONFIG_NLS_ISO8859_7=m
CONFIG_NLS_ISO8859_9=m
CONFIG_NLS_ISO8859_13=m
CONFIG_NLS_ISO8859_14=m
CONFIG_NLS_ISO8859_15=m
CONFIG_NLS_KOI8_R=m
CONFIG_NLS_KOI8_U=m
CONFIG_NLS_UTF8=m

#
# Profiling support
#
CONFIG_PROFILING=y
CONFIG_OPROFILE=m

#
# Kernel hacking
#
# CONFIG_PRINTK_TIME is not set
CONFIG_DEBUG_KERNEL=y
CONFIG_MAGIC_SYSRQ=y
CONFIG_LOG_BUF_SHIFT=14
# CONFIG_SCHEDSTATS is not set
# CONFIG_DEBUG_SLAB is not set
CONFIG_DEBUG_PREEMPT=y
CONFIG_WAKEUP_TIMING=y
CONFIG_PREEMPT_TRACE=y
# CONFIG_CRITICAL_PREEMPT_TIMING is not set
# CONFIG_CRITICAL_IRQSOFF_TIMING is not set
CONFIG_LATENCY_TIMING=y
CONFIG_LATENCY_TRACE=y
CONFIG_MCOUNT=y
CONFIG_RT_DEADLOCK_DETECT=y
CONFIG_DEBUG_RT_LOCKING_MODE=y
# CONFIG_DEBUG_KOBJECT is not set
CONFIG_DEBUG_BUGVERBOSE=y
# CONFIG_DEBUG_INFO is not set
# CONFIG_DEBUG_FS is not set
CONFIG_FRAME_POINTER=y
CONFIG_EARLY_PRINTK=y
# CONFIG_DEBUG_STACKOVERFLOW is not set
# CONFIG_KPROBES is not set
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_DEBUG_PAGEALLOC is not set
# CONFIG_4KSTACKS is not set
CONFIG_X86_FIND_SMP_CONFIG=y
CONFIG_X86_MPPARSE=y

#
# Security options
#
# CONFIG_KEYS is not set
CONFIG_SECURITY=y
CONFIG_SECURITY_NETWORK=y
CONFIG_SECURITY_CAPABILITIES=y
# CONFIG_SECURITY_ROOTPLUG is not set
# CONFIG_SECURITY_SECLVL is not set
# CONFIG_SECURITY_SELINUX is not set

#
# Cryptographic options
#
CONFIG_CRYPTO=y
CONFIG_CRYPTO_HMAC=y
CONFIG_CRYPTO_NULL=m
CONFIG_CRYPTO_MD4=m
CONFIG_CRYPTO_MD5=m
CONFIG_CRYPTO_SHA1=m
CONFIG_CRYPTO_SHA256=m
CONFIG_CRYPTO_SHA512=m
# CONFIG_CRYPTO_WP512 is not set
# CONFIG_CRYPTO_TGR192 is not set
CONFIG_CRYPTO_DES=m
CONFIG_CRYPTO_BLOWFISH=m
# CONFIG_CRYPTO_TWOFISH is not set
CONFIG_CRYPTO_SERPENT=m
# CONFIG_CRYPTO_AES_586 is not set
CONFIG_CRYPTO_CAST5=m
# CONFIG_CRYPTO_CAST6 is not set
# CONFIG_CRYPTO_TEA is not set
# CONFIG_CRYPTO_ARC4 is not set
# CONFIG_CRYPTO_KHAZAD is not set
# CONFIG_CRYPTO_ANUBIS is not set
CONFIG_CRYPTO_DEFLATE=m
# CONFIG_CRYPTO_MICHAEL_MIC is not set
# CONFIG_CRYPTO_CRC32C is not set
# CONFIG_CRYPTO_TEST is not set

#
# Hardware crypto devices
#
# CONFIG_CRYPTO_DEV_PADLOCK is not set

#
# Library routines
#
CONFIG_CRC_CCITT=m
CONFIG_CRC32=y
# CONFIG_LIBCRC32C is not set
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=m
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_X86_SMP=y
CONFIG_X86_HT=y
CONFIG_X86_BIOS_REBOOT=y
CONFIG_X86_TRAMPOLINE=y
CONFIG_PC=y

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 15:23       ` Keith Owens
@ 2005-06-08 15:56         ` Paulo Marques
  0 siblings, 0 replies; 139+ messages in thread
From: Paulo Marques @ 2005-06-08 15:56 UTC (permalink / raw)
  To: Keith Owens
  Cc: Michal Schmidt, Ingo Molnar, linux-kernel, Eugeny S. Mints,
	Daniel Walker

Keith Owens wrote:
> On Wed, 08 Jun 2005 17:04:23 +0200, 
> Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:
>>Paulo Marques wrote:
>>
>>>[...]
>>>and disable CONFIG_KALLSYMS_EXTRA_PASS, to see if the problem goes away?
>>
>>Yes, this helps.
>>
>>>It it does go away, then it is the same problem, and I'm working on it...
> 
> Not the same problem.  The significant difference in the maps is :-
> 
> --- .tmp_map1   2005-06-09 01:14:50.303658655 +1000
> +++ .tmp_map2   2005-06-09 01:14:52.829274854 +1000
> @@ -8326,8 +8326,8 @@
>  c02b93b0 T ipv6_skip_exthdr
>  c02b9500 T sha_transform
>  c02b96e0 T sha_init
> -c02b970f T __sched_text_start
>  c02b9710 t __compat_down
> +c02b9710 T __sched_text_start
>  c02b9810 t __compat_down_interruptible
>  c02b9948 T __compat_down_failed
>  c02b9958 T __compat_down_failed_interruptible
> 
> __sched_text_start has moved up by 1 byte between pass 1 and 2.  Text
> addresses are not allowed to move between kallsyms passes, kallsyms
> only adds data, it never touches the text segment.  Paulo's change to
> the working set hides this peculiarity, rather than fixing the real
> cause.  This looks like a toolchain bug, it is moving symbols for no
> good reason.

Actually this is exactly the same problem we've seen in other threads: 
the symbol that marks the beggining of a section gets aligned to a 
different boundary on the second pass. Because it has now the same 
address as the next symbol, it gets sorted in reverse order.

I agree that this is the toolchain's fault, but I think kallsyms could 
be a little more robust and handle this without preventing the kernel 
from building properly.

-- 
Paulo Marques - www.grupopie.com

An expert is a person who has made all the mistakes that can be
made in a very narrow field.
Niels Bohr (1885 - 1962)

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 15:48 ` K.R. Foley
@ 2005-06-08 16:08   ` K.R. Foley
  2005-06-08 16:26     ` K.R. Foley
  2005-06-08 17:26   ` K.R. Foley
  1 sibling, 1 reply; 139+ messages in thread
From: K.R. Foley @ 2005-06-08 16:08 UTC (permalink / raw)
  To: K.R. Foley; +Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

K.R. Foley wrote:
> Ingo Molnar wrote:
> 
>> i have released the -V0.7.48-00 Real-Time Preemption patch, which can 
>> be downloaded from the usual place:
>>
>>     http://redhat.com/~mingo/realtime-preempt/
>>
>> this release includes an improved version of Daniel Walker's soft 
>> irq-flag (hardirq-disable removal) feature. It is an unconditional part
>> of the PREEMPT_RT preemption model - other preemption models should not
>> be affected that much (besides possible build issues). Non-x86 arches
>> wont build. Some regressions might happen, so take care..
>>
>> Changes since -47-29:
>>
>>  - soft IRQ flag support (Daniel Walker)
>>
>>  - fix race in usbnet.c (Eugeny S. Mints)
>>
>>  - further improvements to the soft IRQ flag code
>>
>> to build a -V0.7.48-00 tree, the following patches should to be applied:
>>
>>    http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.11.tar.bz2
>>    http://kernel.org/pub/linux/kernel/v2.6/testing/patch-2.6.12-rc6.bz2
>>    
>> http://redhat.com/~mingo/realtime-preempt/realtime-preempt-2.6.12-rc6-V0.7.48-00 
>>
>>
>>     Ingo
> 
> 
> Ingo,
> 
> I can't get any version of RT-preempt applied to 2.6.12-rc6 up to and 
> including 48-01 to boot on any of my SMP systems. I get no log because 
> it dies right after the "Uncompressing kernel" message. 2.6.12-rc6 boots 
> fine.  I am attaching my config. Am I missing something obvious? I am 
> building 48-01 with voluntary-preempt now to try that.
> 
> 

Just confirmed that CONFIG_PREEMPT_VOLUNTARY works OK. Building 
CONFIG_PREEMPT_DESKTOP=y now.

-- 
    kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 16:08   ` K.R. Foley
@ 2005-06-08 16:26     ` K.R. Foley
  0 siblings, 0 replies; 139+ messages in thread
From: K.R. Foley @ 2005-06-08 16:26 UTC (permalink / raw)
  To: K.R. Foley; +Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

K.R. Foley wrote:
> K.R. Foley wrote:
> 
>> Ingo Molnar wrote:
>>
>>> i have released the -V0.7.48-00 Real-Time Preemption patch, which can 
>>> be downloaded from the usual place:
>>>
>>>     http://redhat.com/~mingo/realtime-preempt/
>>>
>>> this release includes an improved version of Daniel Walker's soft 
>>> irq-flag (hardirq-disable removal) feature. It is an unconditional part
>>> of the PREEMPT_RT preemption model - other preemption models should not
>>> be affected that much (besides possible build issues). Non-x86 arches
>>> wont build. Some regressions might happen, so take care..
>>>
>>> Changes since -47-29:
>>>
>>>  - soft IRQ flag support (Daniel Walker)
>>>
>>>  - fix race in usbnet.c (Eugeny S. Mints)
>>>
>>>  - further improvements to the soft IRQ flag code
>>>
>>> to build a -V0.7.48-00 tree, the following patches should to be applied:
>>>
>>>    http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.11.tar.bz2
>>>    http://kernel.org/pub/linux/kernel/v2.6/testing/patch-2.6.12-rc6.bz2
>>>    
>>> http://redhat.com/~mingo/realtime-preempt/realtime-preempt-2.6.12-rc6-V0.7.48-00 
>>>
>>>
>>>     Ingo
>>
>>
>>
>> Ingo,
>>
>> I can't get any version of RT-preempt applied to 2.6.12-rc6 up to and 
>> including 48-01 to boot on any of my SMP systems. I get no log because 
>> it dies right after the "Uncompressing kernel" message. 2.6.12-rc6 
>> boots fine.  I am attaching my config. Am I missing something obvious? 
>> I am building 48-01 with voluntary-preempt now to try that.
>>
>>
> 
> Just confirmed that CONFIG_PREEMPT_VOLUNTARY works OK. Building 
> CONFIG_PREEMPT_DESKTOP=y now.
> 
This too, works OK. Ideas?

-- 
    kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 15:48 ` K.R. Foley
  2005-06-08 16:08   ` K.R. Foley
@ 2005-06-08 17:26   ` K.R. Foley
  2005-06-08 19:18     ` Ingo Molnar
  2005-06-09  8:47     ` Serge Noiraud
  1 sibling, 2 replies; 139+ messages in thread
From: K.R. Foley @ 2005-06-08 17:26 UTC (permalink / raw)
  To: K.R. Foley; +Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

K.R. Foley wrote:
> Ingo Molnar wrote:
> 
>> i have released the -V0.7.48-00 Real-Time Preemption patch, which can 
>> be downloaded from the usual place:
>>
>>     http://redhat.com/~mingo/realtime-preempt/
>>
>> this release includes an improved version of Daniel Walker's soft 
>> irq-flag (hardirq-disable removal) feature. It is an unconditional part
>> of the PREEMPT_RT preemption model - other preemption models should not
>> be affected that much (besides possible build issues). Non-x86 arches
>> wont build. Some regressions might happen, so take care..
>>
>> Changes since -47-29:
>>
>>  - soft IRQ flag support (Daniel Walker)
>>
>>  - fix race in usbnet.c (Eugeny S. Mints)
>>
>>  - further improvements to the soft IRQ flag code
>>
>> to build a -V0.7.48-00 tree, the following patches should to be applied:
>>
>>    http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.11.tar.bz2
>>    http://kernel.org/pub/linux/kernel/v2.6/testing/patch-2.6.12-rc6.bz2
>>    
>> http://redhat.com/~mingo/realtime-preempt/realtime-preempt-2.6.12-rc6-V0.7.48-00 
>>
>>
>>     Ingo
> 
> 
> Ingo,
> 
> I can't get any version of RT-preempt applied to 2.6.12-rc6 up to and 
> including 48-01 to boot on any of my SMP systems. I get no log because 
> it dies right after the "Uncompressing kernel" message. 2.6.12-rc6 boots 
> fine.  I am attaching my config. Am I missing something obvious? I am 
> building 48-01 with voluntary-preempt now to try that.
> 
> 

Well crap. Perhaps I should have tried this first. If I disable the 
runtime selectable locking

# CONFIG_DEBUG_RT_LOCKING_MODE is not set

it seems to work fine. With the above enabled it hangs on both of my SMP 
systems as described above. :-/

-- 
    kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
                   ` (2 preceding siblings ...)
  2005-06-08 15:48 ` K.R. Foley
@ 2005-06-08 17:51 ` Michal Schmidt
  2005-06-09 11:45   ` Ingo Molnar
  2005-06-08 19:58 ` Daniel Walker
                   ` (5 subsequent siblings)
  9 siblings, 1 reply; 139+ messages in thread
From: Michal Schmidt @ 2005-06-08 17:51 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 153 bytes --]

Hi,

I've made the soft IRQ flag feature work on x86_64. It compiles and 
boots for me.
Attached is the patch against -RT-2.6.12-rc6-V0.7.48-01.

Michal

[-- Attachment #2: rt-x86_64-hard-irq-disable-removal.diff --]
[-- Type: text/plain, Size: 10724 bytes --]

diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/apic.c linux-RT.mich/arch/x86_64/kernel/apic.c
--- linux-RT/arch/x86_64/kernel/apic.c	2005-06-07 14:05:16.000000000 +0200
+++ linux-RT.mich/arch/x86_64/kernel/apic.c	2005-06-08 18:51:21.000000000 +0200
@@ -478,10 +478,9 @@ static int lapic_suspend(struct sys_devi
 	apic_pm_state.apic_tmict = apic_read(APIC_TMICT);
 	apic_pm_state.apic_tdcr = apic_read(APIC_TDCR);
 	apic_pm_state.apic_thmr = apic_read(APIC_LVTTHMR);
-	local_save_flags(flags);
-	local_irq_disable();
+	raw_local_irq_save(flags);
 	disable_local_APIC();
-	local_irq_restore(flags);
+	raw_local_irq_restore(flags);
 	return 0;
 }
 
@@ -496,7 +495,7 @@ static int lapic_resume(struct sys_devic
 	/* XXX: Pavel needs this for S3 resume, but can't explain why */
 	set_fixmap_nocache(FIX_APIC_BASE, APIC_DEFAULT_PHYS_BASE);
 
-	local_irq_save(flags);
+	raw_local_irq_save(flags);
 	rdmsr(MSR_IA32_APICBASE, l, h);
 	l &= ~MSR_IA32_APICBASE_BASE;
 	l |= MSR_IA32_APICBASE_ENABLE | APIC_DEFAULT_PHYS_BASE;
@@ -519,7 +518,7 @@ static int lapic_resume(struct sys_devic
 	apic_write(APIC_LVTERR, apic_pm_state.apic_lvterr);
 	apic_write(APIC_ESR, 0);
 	apic_read(APIC_ESR);
-	local_irq_restore(flags);
+	raw_local_irq_restore(flags);
 	return 0;
 }
 
@@ -676,7 +675,7 @@ static void setup_APIC_timer(unsigned in
 {
 	unsigned long flags;
 
-	local_irq_save(flags);
+	raw_local_irq_save(flags);
 
 	/* For some reasons this doesn't work on Simics, so fake it for now */ 
 	if (!strstr(boot_cpu_data.x86_model_id, "Screwdriver")) { 
@@ -706,7 +705,7 @@ static void setup_APIC_timer(unsigned in
 
 	__setup_APIC_LVTT(clocks);
 
-	local_irq_restore(flags);
+	raw_local_irq_restore(flags);
 }
 
 /*
@@ -763,7 +762,7 @@ void __init setup_boot_APIC_clock (void)
 	printk(KERN_INFO "Using local APIC timer interrupts.\n");
 	using_apic_timer = 1;
 
-	local_irq_disable();
+	raw_local_irq_disable();
 
 	calibration_result = calibrate_APIC_clock();
 	/*
@@ -771,14 +770,14 @@ void __init setup_boot_APIC_clock (void)
 	 */
 	setup_APIC_timer(calibration_result);
 
-	local_irq_enable();
+	raw_local_irq_enable();
 }
 
 void __init setup_secondary_APIC_clock(void)
 {
-	local_irq_disable(); /* FIXME: Do we need this? --RR */
+	raw_local_irq_disable(); /* FIXME: Do we need this? --RR */
 	setup_APIC_timer(calibration_result);
-	local_irq_enable();
+	raw_local_irq_enable();
 }
 
 void __init disable_APIC_timer(void)
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/irq.c linux-RT.mich/arch/x86_64/kernel/irq.c
--- linux-RT/arch/x86_64/kernel/irq.c	2005-03-02 08:38:07.000000000 +0100
+++ linux-RT.mich/arch/x86_64/kernel/irq.c	2005-06-08 19:13:26.000000000 +0200
@@ -43,7 +43,8 @@ int show_interrupts(struct seq_file *p, 
 	}
 
 	if (i < NR_IRQS) {
-		spin_lock_irqsave(&irq_desc[i].lock, flags);
+		raw_local_irq_save(flags);
+		spin_lock(&irq_desc[i].lock);
 		action = irq_desc[i].action;
 		if (!action) 
 			goto skip;
@@ -63,7 +64,8 @@ int show_interrupts(struct seq_file *p, 
 			seq_printf(p, ", %s", action->name);
 		seq_putc(p, '\n');
 skip:
-		spin_unlock_irqrestore(&irq_desc[i].lock, flags);
+		spin_unlock(&irq_desc[i].lock);
+		raw_local_irq_restore(flags);
 	} else if (i == NR_IRQS) {
 		seq_printf(p, "NMI: ");
 		for (j = 0; j < NR_CPUS; j++)
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/process.c linux-RT.mich/arch/x86_64/kernel/process.c
--- linux-RT/arch/x86_64/kernel/process.c	2005-06-08 19:28:13.000000000 +0200
+++ linux-RT.mich/arch/x86_64/kernel/process.c	2005-06-08 19:01:05.000000000 +0200
@@ -85,13 +85,13 @@ EXPORT_SYMBOL(enable_hlt);
 void default_idle(void)
 {
 	if (!atomic_read(&hlt_counter)) {
-		local_irq_disable();
+		raw_local_irq_disable();
 		if (!need_resched())
-			safe_halt();
+			raw_safe_halt();
 		else
-			local_irq_enable();
+			raw_local_irq_enable();
 	} else
-		local_irq_enable();
+		raw_local_irq_enable();
 }
 
 /*
@@ -103,7 +103,7 @@ static void poll_idle (void)
 {
 	int oldval;
 
-	local_irq_enable();
+	raw_local_irq_enable();
 
 	/*
 	 * Deal with another CPU just having chosen a thread to
@@ -164,6 +164,8 @@ void cpu_idle (void)
 {
 	/* endless idle loop with no priority at all */
 	while (1) {
+		BUG_ON(raw_irqs_disabled());
+
 		while (!need_resched()) {
 			void (*idle)(void);
 
@@ -178,7 +180,9 @@ void cpu_idle (void)
 			propagate_preempt_locks_value();
 			idle();
 		}
+		raw_local_irq_disable();
 		__schedule();
+		raw_local_irq_enable();
 	}
 }
 
@@ -191,7 +195,7 @@ void cpu_idle (void)
  */
 static void mwait_idle(void)
 {
-	local_irq_enable();
+	raw_local_irq_enable();
 
 	if (!need_resched()) {
 		set_thread_flag(TIF_POLLING_NRFLAG);
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/signal.c linux-RT.mich/arch/x86_64/kernel/signal.c
--- linux-RT/arch/x86_64/kernel/signal.c	2005-06-07 14:05:16.000000000 +0200
+++ linux-RT.mich/arch/x86_64/kernel/signal.c	2005-06-08 18:53:24.000000000 +0200
@@ -411,6 +411,13 @@ int do_signal(struct pt_regs *regs, sigs
 	siginfo_t info;
 	int signr;
 
+#ifdef CONFIG_PREEMPT_RT
+	/*
+	 * Fully-preemptible kernel does not need interrupts disabled:
+	 */
+	raw_local_irq_enable();
+	preempt_check_resched();
+#endif
 	/*
 	 * We want the common case to go fast, which
 	 * is why we may in certain cases get here from
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/smpboot.c linux-RT.mich/arch/x86_64/kernel/smpboot.c
--- linux-RT/arch/x86_64/kernel/smpboot.c	2005-06-07 14:05:16.000000000 +0200
+++ linux-RT.mich/arch/x86_64/kernel/smpboot.c	2005-06-08 19:23:36.000000000 +0200
@@ -207,7 +207,7 @@ static __cpuinit void sync_master(void *
 
 	go[MASTER] = 0;
 
-	local_irq_save(flags);
+	raw_local_irq_save(flags);
 	{
 		for (i = 0; i < NUM_ROUNDS*NUM_ITERS; ++i) {
 			while (!go[MASTER])
@@ -216,7 +216,7 @@ static __cpuinit void sync_master(void *
 			rdtscll(go[SLAVE]);
 		}
 	}
-	local_irq_restore(flags);
+	raw_local_irq_restore(flags);
 }
 
 /*
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/smp.c linux-RT.mich/arch/x86_64/kernel/smp.c
--- linux-RT/arch/x86_64/kernel/smp.c	2005-06-08 19:28:13.000000000 +0200
+++ linux-RT.mich/arch/x86_64/kernel/smp.c	2005-06-08 19:10:50.000000000 +0200
@@ -359,9 +359,9 @@ void smp_stop_cpu(void)
 	 * Remove this CPU:
 	 */
 	cpu_clear(smp_processor_id(), cpu_online_map);
-	local_irq_disable();
+	raw_local_irq_disable();
 	disable_local_APIC();
-	local_irq_enable(); 
+	raw_local_irq_enable(); 
 }
 
 static void smp_really_stop_cpu(void *dummy)
@@ -385,9 +385,9 @@ void smp_send_stop(void)
 	if (!nolock)
 		spin_unlock(&call_lock);
 
-	local_irq_disable();
+	raw_local_irq_disable();
 	disable_local_APIC();
-	local_irq_enable();
+	raw_local_irq_enable();
 }
 
 /*
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/traps.c linux-RT.mich/arch/x86_64/kernel/traps.c
--- linux-RT/arch/x86_64/kernel/traps.c	2005-06-08 19:28:13.000000000 +0200
+++ linux-RT.mich/arch/x86_64/kernel/traps.c	2005-06-08 19:09:25.000000000 +0200
@@ -90,7 +90,7 @@ int register_die_notifier(struct notifie
 static inline void conditional_sti(struct pt_regs *regs)
 {
 	if (regs->eflags & X86_EFLAGS_IF)
-		local_irq_enable();
+		raw_local_irq_enable();
 }
 
 static int kstack_depth_to_print = 10;
@@ -347,7 +347,7 @@ void oops_begin(void)
 {
 	int cpu = safe_smp_processor_id(); 
 	/* racy, but better than risking deadlock. */ 
-	local_irq_disable();
+	raw_local_irq_disable();
 	if (!spin_trylock(&die_lock)) { 
 		if (cpu == die_owner) 
 			/* nested oops. should stop eventually */;
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/mm/fault.c linux-RT.mich/arch/x86_64/mm/fault.c
--- linux-RT/arch/x86_64/mm/fault.c	2005-06-08 19:28:13.000000000 +0200
+++ linux-RT.mich/arch/x86_64/mm/fault.c	2005-06-08 18:47:49.000000000 +0200
@@ -327,7 +327,7 @@ asmlinkage void do_page_fault(struct pt_
 		return;
 
 	if (likely(regs->eflags & X86_EFLAGS_IF))
-		local_irq_enable();
+		raw_local_irq_enable();
 
 	if (unlikely(page_fault_trace))
 		printk("pagefault rip:%lx rsp:%lx cs:%lu ss:%lu address %lx error %lx\n",
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/include/asm-x86_64/system.h linux-RT.mich/include/asm-x86_64/system.h
--- linux-RT/include/asm-x86_64/system.h	2005-06-08 19:28:13.000000000 +0200
+++ linux-RT.mich/include/asm-x86_64/system.h	2005-06-08 19:22:44.000000000 +0200
@@ -309,27 +309,31 @@ static inline unsigned long __cmpxchg(vo
 #define warn_if_not_ulong(x) do { unsigned long foo; (void) (&(x) == &foo); } while (0)
 
 /* interrupt control.. */
-#define local_save_flags(x)	do { warn_if_not_ulong(x); __asm__ __volatile__("# save_flags \n\t pushfq ; popq %q0":"=g" (x): /* no input */ :"memory"); } while (0)
-#define local_irq_restore(x) 	__asm__ __volatile__("# restore_flags \n\t pushq %0 ; popfq": /* no output */ :"g" (x):"memory", "cc")
-#define local_irq_disable() 	__asm__ __volatile__("cli": : :"memory")
-#define local_irq_enable()	__asm__ __volatile__("sti": : :"memory")
+#define __raw_local_save_flags(x)	do { warn_if_not_ulong(x); __asm__ __volatile__("# save_flags \n\t pushfq ; popq %q0":"=g" (x): /* no input */ :"memory"); } while (0)
+#define __raw_local_irq_restore(x) 	__asm__ __volatile__("# restore_flags \n\t pushq %0 ; popfq": /* no output */ :"g" (x):"memory", "cc")
+#define __raw_local_irq_disable() 	__asm__ __volatile__("cli": : :"memory")
+#define __raw_local_irq_enable()	__asm__ __volatile__("sti": : :"memory")
 /* used in the idle loop; sti takes one instruction cycle to complete */
-#define safe_halt()		__asm__ __volatile__("sti; hlt": : :"memory")
+#define __raw_safe_halt()		__asm__ __volatile__("sti; hlt": : :"memory")
 
-#define irqs_disabled_flags(flags)	\
-({					\
-	!(flags & (1<<9));		\
+#define __raw_irqs_disabled_flags(flags)	\
+({						\
+	!(flags & (1<<9));			\
 })
 
-#define irqs_disabled()			\
-({					\
-	unsigned long flags;		\
-	local_save_flags(flags);	\
-	irqs_disabled_flags(flags);	\
+#define __raw_irqs_disabled()			\
+({						\
+	unsigned long flags;			\
+	__raw_local_save_flags(flags);		\
+	__raw_irqs_disabled_flags(flags);		\
 })
 
 /* For spinlocks etc */
-#define local_irq_save(x) 	do { warn_if_not_ulong(x); __asm__ __volatile__("# local_irq_save \n\t pushfq ; popq %0 ; cli":"=g" (x): /* no input */ :"memory"); } while (0)
+#define __raw_local_irq_save(x) 	do { warn_if_not_ulong(x); __asm__ __volatile__("# local_irq_save \n\t pushfq ; popq %0 ; cli":"=g" (x): /* no input */ :"memory"); } while (0)
+
+#include <linux/rt_irq.h>
+
+#define safe_halt()	do { local_irq_enable(); __asm__ __volatile__("hlt": : :"memory"); } while (0)
 
 void cpu_idle_wait(void);
 

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 17:26   ` K.R. Foley
@ 2005-06-08 19:18     ` Ingo Molnar
  2005-06-09 11:39       ` Ingo Molnar
  2005-06-09  8:47     ` Serge Noiraud
  1 sibling, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-08 19:18 UTC (permalink / raw)
  To: K.R. Foley; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* K.R. Foley <kr@cybsft.com> wrote:

> Well crap. Perhaps I should have tried this first. If I disable the 
> runtime selectable locking
> 
> # CONFIG_DEBUG_RT_LOCKING_MODE is not set
> 
> it seems to work fine. With the above enabled it hangs on both of my 
> SMP systems as described above. :-/

ahh ... i'll try to reproduce it that way.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
                   ` (3 preceding siblings ...)
  2005-06-08 17:51 ` Michal Schmidt
@ 2005-06-08 19:58 ` Daniel Walker
  2005-06-09 21:24 ` Michal Schmidt
                   ` (4 subsequent siblings)
  9 siblings, 0 replies; 139+ messages in thread
From: Daniel Walker @ 2005-06-08 19:58 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints

On Wed, 2005-06-08 at 13:28 +0200, Ingo Molnar wrote:

>  - fix race in usbnet.c (Eugeny S. Mints)


--- linux/drivers/usb/net/usbnet.c.orig
+++ linux/drivers/usb/net/usbnet.c
@@ -3490,6 +3490,8 @@ static void tx_complete (struct urb *urb
 
 	urb->dev = NULL;
 	entry->state = tx_done;
+	spin_lock_rt(&dev->txq.lock);
+	spin_unlock_rt(&dev->txq.lock);
 	defer_bh (dev, skb);
 }


What are these lines fixing again ? It seems rather odd that locking and
then unlocking a mutex could fix anything ..

Daniel


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 17:26   ` K.R. Foley
  2005-06-08 19:18     ` Ingo Molnar
@ 2005-06-09  8:47     ` Serge Noiraud
  2005-06-09 11:55       ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Serge Noiraud @ 2005-06-09  8:47 UTC (permalink / raw)
  To: K.R. Foley; +Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

Le mer 08/06/2005 à 19:26, K.R. Foley a écrit :
> K.R. Foley wrote:
> > Ingo Molnar wrote:
> > 
> >> i have released the -V0.7.48-00 Real-Time Preemption patch, which can 
> >> be downloaded from the usual place:
...
> >>     Ingo
> > 
> > 
> > Ingo,
> > 
> > I can't get any version of RT-preempt applied to 2.6.12-rc6 up to and 
> > including 48-01 to boot on any of my SMP systems. I get no log because 
> > it dies right after the "Uncompressing kernel" message. 2.6.12-rc6 boots 
> > fine.  I am attaching my config. Am I missing something obvious? I am 
> > building 48-01 with voluntary-preempt now to try that.
> > 
> > 
> 
> Well crap. Perhaps I should have tried this first. If I disable the 
> runtime selectable locking
> 
> # CONFIG_DEBUG_RT_LOCKING_MODE is not set
> 
> it seems to work fine. With the above enabled it hangs on both of my SMP 
> systems as described above. :-/

Same problem here. OK unsetting the CONFIG_DEBUG_RT_LOCKING_MODE.

I have another problem :
I can't boot. 
With 47-15 I had the following with dmesg :
...
Intel machine check reporting enabled on CPU#1.
CPU1: Intel P4/Xeon Extended MCE MSRs (12) available
CPU1: Thermal monitoring enabled
CPU1: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Total of 2 processors activated (7110.65 BogoMIPS).
WARNING: 1 siblings found for CPU0, should be 2
WARNING: 1 siblings found for CPU1, should be 2
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 pin1=2 pin2=-1
..MP-BIOS bug: 8254 timer not connected to IO-APIC
...trying to set up timer (IRQ0) through the 8259A ...  failed.
...trying to set up timer as Virtual Wire IRQ... works.
checking TSC synchronization across 2 CPUs: passed.
spawn_desched_task(00000000)
desched cpu_callback 3/00000000
ksoftirqd started up.
softirq RT prio: 24.
desched cpu_callback 2/00000000
desched thread 0 started up.
desched cpu_callback 3/00000001
desched cpu_callback 2/00000001
ksoftirqd started up.
...

Now I have this with 48-01 :

Intel machine check reporting enabled on CPU#1.
CPU1: Intel P4/Xeon Extended MCE MSRs (12) available
CPU1: Thermal monitoring enabled
CPU1: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Total of 2 processors activated (7110.65 BogoMIPS).
WARNING: 1 siblings found for CPU0, should be 2
                                                  <======= missing CPU1
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 pin1=2 pin2=-1
..MP-BIOS bug: 8254 timer not connected to IO-APIC
...trying to set up timer (IRQ0) through the 8259A ...  failed.
...trying to set up timer as Virtual Wire IRQ...  <======= freeze

Is it a problem or a CONFIG parameter ?



^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 19:18     ` Ingo Molnar
@ 2005-06-09 11:39       ` Ingo Molnar
  2005-06-10 13:34         ` K.R. Foley
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-09 11:39 UTC (permalink / raw)
  To: K.R. Foley; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* Ingo Molnar <mingo@elte.hu> wrote:

> > # CONFIG_DEBUG_RT_LOCKING_MODE is not set
> > 
> > it seems to work fine. With the above enabled it hangs on both of my 
> > SMP systems as described above. :-/
> 
> ahh ... i'll try to reproduce it that way.

found the bug - it was the incorrect initialization of 
debug_slock/rwlock. I've uploaded -48-02 with the fix. This release also 
includes a new debugging feature: CONFIG_DETECT_SOFTLOCKUP, which works 
similar to the NMI watchdog but detects soft (==no reschedules) lockups.  
I've also converted a few more local_irq_*() calls to raw_local_irq_*() 
calls.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 17:51 ` Michal Schmidt
@ 2005-06-09 11:45   ` Ingo Molnar
  2005-06-09 12:09     ` Michal Schmidt
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-09 11:45 UTC (permalink / raw)
  To: Michal Schmidt; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:

> Hi,
> 
> I've made the soft IRQ flag feature work on x86_64. It compiles and 
> boots for me. Attached is the patch against -RT-2.6.12-rc6-V0.7.48-01.

thanks - i have added it to my tree and have uploaded the -48-03 release 
with your patch included.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09  8:47     ` Serge Noiraud
@ 2005-06-09 11:55       ` Ingo Molnar
  2005-06-09 15:12         ` Serge Noiraud
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-09 11:55 UTC (permalink / raw)
  To: Serge Noiraud; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* Serge Noiraud <serge.noiraud@bull.net> wrote:

> > # CONFIG_DEBUG_RT_LOCKING_MODE is not set
> > 
> > it seems to work fine. With the above enabled it hangs on both of my SMP 
> > systems as described above. :-/
> 
> Same problem here. OK unsetting the CONFIG_DEBUG_RT_LOCKING_MODE.

this one should be fixed in the latest patch. (note that when 
DEBUG_RT_LOCKING_MODE is set the spinlocks/rwlocks default to 
non-preemptible. You can set preemption it via 
/proc/sys/kernel/preempt_locks. You normally dont want to enable this 
option.)

> I have another problem :
> I can't boot. 

could you try the latest (-48-03) patch? I fixed a couple of things that 
might impact SMP booting.

> ...trying to set up timer (IRQ0) through the 8259A ...  failed.
> ...trying to set up timer as Virtual Wire IRQ...  <======= freeze
> 
> Is it a problem or a CONFIG parameter ?

a freeze is always a problem, whether it can be worked around via a 
CONFIG parameter or not. Generally if you see any reduction in 
functionality that deviates from the stock Linux kernel, it's a bug.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 11:45   ` Ingo Molnar
@ 2005-06-09 12:09     ` Michal Schmidt
  2005-06-09 12:13       ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Michal Schmidt @ 2005-06-09 12:09 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

Ingo Molnar wrote:
> thanks - i have added it to my tree and have uploaded the -48-03 release 
> with your patch included.

This hunk should not be in the patch:

@@ -190,8 +190,8 @@ SUBARCH := $(shell uname -m | sed -e s/i
  # Default value for CROSS_COMPILE is not to prefix executables
  # Note: Some architectures assign CROSS_COMPILE in their arch/*/Makefile

-ARCH		?= $(SUBARCH)
-CROSS_COMPILE	?=
+ARCH = x86_64
+CROSS_COMPILE = x86_64-linux-

  # Architecture as present in compile.h
  UTS_MACHINE := $(ARCH)



Michal

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 12:09     ` Michal Schmidt
@ 2005-06-09 12:13       ` Ingo Molnar
  2005-06-09 12:48         ` Michal Schmidt
  2005-06-10  8:56         ` Esben Nielsen
  0 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-09 12:13 UTC (permalink / raw)
  To: Michal Schmidt; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:

> Ingo Molnar wrote:
> >thanks - i have added it to my tree and have uploaded the -48-03 release 
> >with your patch included.
> 
> This hunk should not be in the patch:

indeed - new patch uploaded.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 12:13       ` Ingo Molnar
@ 2005-06-09 12:48         ` Michal Schmidt
  2005-06-10  8:56         ` Esben Nielsen
  1 sibling, 0 replies; 139+ messages in thread
From: Michal Schmidt @ 2005-06-09 12:48 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 249 bytes --]

Ingo Molnar wrote:
> indeed - new patch uploaded.

The attached patch against V0.7.48-04 replaces some more local_irq_* 
operation with their raw variants on x86_64. It should be the equivalent 
of your changes done for i386 in -V0.7.48-02.

Michal

[-- Attachment #2: rt-x86_64-more-local_irqs.diff --]
[-- Type: text/plain, Size: 2018 bytes --]

diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/io_apic.c linux-RT.mich/arch/x86_64/kernel/io_apic.c
--- linux-RT/arch/x86_64/kernel/io_apic.c	2005-06-09 14:16:53.563982208 +0200
+++ linux-RT.mich/arch/x86_64/kernel/io_apic.c	2005-06-09 14:22:20.326306784 +0200
@@ -1218,7 +1218,7 @@ static int __init timer_irq_works(void)
 {
 	unsigned long t1 = jiffies;
 
-	local_irq_enable();
+	raw_local_irq_enable();
 	/* Let ten ticks pass... */
 	mdelay((10 * 1000) / HZ);
 
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/nmi.c linux-RT.mich/arch/x86_64/kernel/nmi.c
--- linux-RT/arch/x86_64/kernel/nmi.c	2005-06-09 14:16:53.566981752 +0200
+++ linux-RT.mich/arch/x86_64/kernel/nmi.c	2005-06-09 14:25:17.092434248 +0200
@@ -128,7 +128,7 @@ void __init nmi_watchdog_default(void)
 static __init void nmi_cpu_busy(void *data)
 {
 	volatile int *endflag = data;
-	local_irq_enable();
+	raw_local_irq_enable();
 	/* Intentionally don't use cpu_relax here. This is
 	   to make sure that the performance counter really ticks,
 	   even if there is a simulator or similar that catches the
@@ -157,7 +157,7 @@ int __init check_nmi_watchdog (void)
 
 	for (cpu = 0; cpu < NR_CPUS; cpu++)
 		counts[cpu] = cpu_pda[cpu].__nmi_count; 
-	local_irq_enable();
+	raw_local_irq_enable();
 	mdelay((10*1000)/nmi_hz); // wait 10 ticks
 
 	for (cpu = 0; cpu < NR_CPUS; cpu++) {
diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/arch/x86_64/kernel/reboot.c linux-RT.mich/arch/x86_64/kernel/reboot.c
--- linux-RT/arch/x86_64/kernel/reboot.c	2005-03-02 08:38:25.000000000 +0100
+++ linux-RT.mich/arch/x86_64/kernel/reboot.c	2005-06-09 14:29:06.181607400 +0200
@@ -114,12 +114,12 @@ void machine_restart(char * __unused)
 #endif
 
 	if (!reboot_force) {
-		local_irq_disable();
+		raw_local_irq_disable();
 #ifndef CONFIG_SMP
 		disable_local_APIC();
 #endif
 		disable_IO_APIC();
-		local_irq_enable();
+		raw_local_irq_enable();
 	}
 	
 	/* Tell the BIOS if we want cold or warm reboot */

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 11:55       ` Ingo Molnar
@ 2005-06-09 15:12         ` Serge Noiraud
  2005-06-09 16:34           ` Daniel Walker
  0 siblings, 1 reply; 139+ messages in thread
From: Serge Noiraud @ 2005-06-09 15:12 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 1258 bytes --]

Le jeu 09/06/2005 à 13:55, Ingo Molnar a écrit :
> * Serge Noiraud <serge.noiraud@bull.net> wrote:
> 
> > > # CONFIG_DEBUG_RT_LOCKING_MODE is not set
> > > 
> > > it seems to work fine. With the above enabled it hangs on both of my SMP 
> > > systems as described above. :-/
> > 
> > Same problem here. OK unsetting the CONFIG_DEBUG_RT_LOCKING_MODE.
> 
> this one should be fixed in the latest patch. (note that when 
> DEBUG_RT_LOCKING_MODE is set the spinlocks/rwlocks default to 
> non-preemptible. You can set preemption it via 
> /proc/sys/kernel/preempt_locks. You normally dont want to enable this 
> option.)
> 
> > I have another problem :
> > I can't boot. 
> 
> could you try the latest (-48-03) patch? I fixed a couple of things that 
> might impact SMP booting.
> 
> > ...trying to set up timer (IRQ0) through the 8259A ...  failed.
> > ...trying to set up timer as Virtual Wire IRQ...  <======= freeze
> > 
Same problem with 48-04 and 48-05
It works great with rc6 without RT patch.
Here is my .config
The cmdline options at boot time are :
#more /proc/cmdline
BOOT_IMAGE=2.6.12rc6RTV0.7.4805 ro root=306 console=ttyS0 console=tty1 \
acpi=force apm=smp resume=/dev/hda5

attached : gunzip -c /proc/config.gz


[-- Attachment #2: config.48-05.gz --]
[-- Type: application/x-gzip, Size: 15128 bytes --]

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 15:12         ` Serge Noiraud
@ 2005-06-09 16:34           ` Daniel Walker
  2005-06-13  8:53             ` Serge Noiraud
  0 siblings, 1 reply; 139+ messages in thread
From: Daniel Walker @ 2005-06-09 16:34 UTC (permalink / raw)
  To: Serge Noiraud; +Cc: Ingo Molnar, K.R. Foley, linux-kernel, Eugeny S. Mints

On Thu, 9 Jun 2005, Serge Noiraud wrote:

> Same problem with 48-04 and 48-05
> It works great with rc6 without RT patch.
> Here is my .config
> The cmdline options at boot time are :
> #more /proc/cmdline
> BOOT_IMAGE=2.6.12rc6RTV0.7.4805 ro root=306 console=ttyS0 console=tty1 \
> acpi=force apm=smp resume=/dev/hda5



Does this patch get you any further?


Daniel

Index: linux-2.6.11/arch/i386/kernel/io_apic.c
===================================================================
--- linux-2.6.11.orig/arch/i386/kernel/io_apic.c	2005-06-09 16:31:54.000000000 +0000
+++ linux-2.6.11/arch/i386/kernel/io_apic.c	2005-06-09 16:31:20.000000000 +0000
@@ -1804,8 +1804,9 @@ static void __init setup_ioapic_ids_from
  */
 static int __init timer_irq_works(void)
 {
-	unsigned long t1 = jiffies;
+	unsigned long t1 = jiffies, flags;
 
+	raw_local_save_flags(flags);
 	raw_local_irq_enable();
 	/* Let ten ticks pass... */
 	mdelay((10 * 1000) / HZ);
@@ -1820,6 +1821,7 @@ static int __init timer_irq_works(void)
 	if (jiffies - t1 > 4)
 		return 1;
 
+	raw_local_irq_restore(flags);
 	return 0;
 }
 


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
                   ` (4 preceding siblings ...)
  2005-06-08 19:58 ` Daniel Walker
@ 2005-06-09 21:24 ` Michal Schmidt
  2005-06-09 21:34   ` Michal Schmidt
  2005-06-11  7:32   ` Ingo Molnar
  2005-06-11 16:35 ` Peter Zijlstra
                   ` (3 subsequent siblings)
  9 siblings, 2 replies; 139+ messages in thread
From: Michal Schmidt @ 2005-06-09 21:24 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 795 bytes --]

Hi Ingo,

Since the introduction of the delayed preemption feature in V0.7.47-20 
my KDE desktop has been jerky. The sound from artsd often skips. The 
mouse pointer jumps when I compile anything the background and try to 
browse the web with Firefox.

I think that try_to_wake_up is broken for the !sync case. We have:

		__activate_task(p, rq);
                 if (TASK_PREEMPTS_CURR(p, rq)) {
                         if (sync)
                                 set_tsk_need_resched_delayed(rq->curr);
                         else
                                 resched_task(rq->curr);
                 }

Shouldn't we call the full activate_task(...) instead of 
__activate_task(...) in the !sync case?


The attached patch fixes seems to fix it for me. It is against V0.7.48-05.

Michal

[-- Attachment #2: rt-fix-delayed-preemption-lags.diff --]
[-- Type: text/plain, Size: 680 bytes --]

diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/kernel/sched.c linux-RT.mich/kernel/sched.c
--- linux-RT/kernel/sched.c	2005-06-09 23:09:43.000000000 +0200
+++ linux-RT.mich/kernel/sched.c	2005-06-09 23:07:43.000000000 +0200
@@ -1195,11 +1195,13 @@ out_activate:
 		if (TASK_PREEMPTS_CURR(p, rq))
 			resched_task(rq->curr);
 	} else {
-		__activate_task(p, rq);
-		if (TASK_PREEMPTS_CURR(p, rq)) {
-			if (sync)
+		if (sync) {
+			__activate_task(p, rq);
+			if (TASK_PREEMPTS_CURR(p, rq))
 				set_tsk_need_resched_delayed(rq->curr);
-			else
+		} else {
+			activate_task(p, rq, cpu == this_cpu);
+			if (TASK_PREEMPTS_CURR(p, rq))
 				resched_task(rq->curr);
 		}
 	}

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 21:24 ` Michal Schmidt
@ 2005-06-09 21:34   ` Michal Schmidt
  2005-06-11  7:32   ` Ingo Molnar
  1 sibling, 0 replies; 139+ messages in thread
From: Michal Schmidt @ 2005-06-09 21:34 UTC (permalink / raw)
  To: Michal Schmidt; +Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 255 bytes --]

I wrote:
> Shouldn't we call the full activate_task(...) instead of 
> __activate_task(...) in the !sync case?
> 
> 
> The attached patch fixes seems to fix it for me. It is against V0.7.48-05.


This patch should work the same and is a bit nicer.
Michal

[-- Attachment #2: rt-fix-delayed-preemption-lags2.diff --]
[-- Type: text/plain, Size: 867 bytes --]

diff -Nurp -X linux-RT/Documentation/dontdiff linux-RT/kernel/sched.c linux-RT.mich/kernel/sched.c
--- linux-RT/kernel/sched.c	2005-06-09 23:09:43.000000000 +0200
+++ linux-RT.mich/kernel/sched.c	2005-06-09 23:29:20.000000000 +0200
@@ -1190,18 +1190,14 @@ out_activate:
 	 * this cpu. Delayed preemption is guaranteed to happen upon
 	 * return to userspace.
 	 */
-	if (cpu != this_cpu) {
+	if (!sync || cpu != this_cpu) {
 		activate_task(p, rq, cpu == this_cpu);
 		if (TASK_PREEMPTS_CURR(p, rq))
 			resched_task(rq->curr);
 	} else {
 		__activate_task(p, rq);
-		if (TASK_PREEMPTS_CURR(p, rq)) {
-			if (sync)
-				set_tsk_need_resched_delayed(rq->curr);
-			else
-				resched_task(rq->curr);
-		}
+		if (TASK_PREEMPTS_CURR(p, rq))
+			set_tsk_need_resched_delayed(rq->curr);
 	}
 	trace_start_sched_wakeup(p, rq);
 	if (rq->curr && p && rq && _need_resched())

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 12:13       ` Ingo Molnar
  2005-06-09 12:48         ` Michal Schmidt
@ 2005-06-10  8:56         ` Esben Nielsen
  1 sibling, 0 replies; 139+ messages in thread
From: Esben Nielsen @ 2005-06-10  8:56 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Michal Schmidt, linux-kernel, Eugeny S. Mints, Daniel Walker

Does latency tracing work correctly?
After leaving my labtop "working" all night I see the /proc/latency_trace
below. It doesn't look right.  Normally the worst case latency is ~70 us
but this tells me it is 1.1ms!! Looking at the trace it looks like it was
really just < 70 us and just an error in the trace. It does look like 3
irq-off periods have been merged into one long period overestimating the
worst case latency by a huge factor.

Esben

preemption latency trace v1.1.4 on 2.6.12-rc6-RT-V0.7.48-04
--------------------------------------------------------------------
 latency: 1178 us, #121/121, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: ksoftirqd/0-2 (uid:0 nice:-10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
automoun-9953  0dnh3    0us : <6f747561> (<6e756f6d>)
automoun-9953  0dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
automoun-9953  0dnh2    0us : preempt_schedule (try_to_wake_up)
automoun-9953  0dnh2    1us : try_to_wake_up <<...>-2> (73 79)
automoun-9953  0dnh1    1us : preempt_schedule (try_to_wake_up)
automoun-9953  0dnh1    1us : wake_up_process (do_softirq)
automoun-9953  0dnh1    2us : local_irq_restore (do_softirq)
automoun-9953  0dnh1    2us : check_soft_flags (local_irq_restore)
automoun-9953  0dnh.    3us+< (608)
automoun-9953  0dn..   10us : vgacon_dummy (vt_console_print)
automoun-9953  0dn..   11us : lf (vt_console_print)
automoun-9953  0dn..   11us : scrup (lf)
automoun-9953  0dn..   11us!: vgacon_scroll (scrup)
automoun-9953  0dnh.  972us : do_IRQ (c02174dc 0 0)
automoun-9953  0dnh.  973us : __local_irq_save (__do_IRQ)
automoun-9953  0dnh1  973us : mask_and_ack_8259A (__do_IRQ)
automoun-9953  0dnh1  974us : __local_irq_save (mask_and_ack_8259A)
automoun-9953  0dnh1  975us : local_irq_restore (mask_and_ack_8259A)
automoun-9953  0dnh1  976us : check_soft_flags (local_irq_restore)
automoun-9953  0dnh1  976us : preempt_schedule (mask_and_ack_8259A)
automoun-9953  0dnh1  976us : redirect_hardirq (__do_IRQ)
automoun-9953  0dnh.  977us : preempt_schedule (__do_IRQ)
automoun-9953  0dnh.  977us : handle_IRQ_event (__do_IRQ)
automoun-9953  0dnh.  977us : timer_interrupt (handle_IRQ_event)
automoun-9953  0dnh1  978us : mark_offset_tsc (timer_interrupt)
automoun-9953  0dnh2  978us+: __local_irq_save (mark_offset_tsc)
automoun-9953  0dnh2  981us : local_irq_restore (mark_offset_tsc)
automoun-9953  0dnh2  982us : check_soft_flags (local_irq_restore)
automoun-9953  0dnh2  982us : preempt_schedule (mark_offset_tsc)
automoun-9953  0dnh1  983us : preempt_schedule (mark_offset_tsc)
automoun-9953  0dnh1  983us : preempt_schedule (mark_offset_tsc)
automoun-9953  0dnh1  983us : do_timer (timer_interrupt)
automoun-9953  0dnh1  984us : softlockup_tick (timer_interrupt)
automoun-9953  0dnh1  984us : update_process_times (timer_interrupt)
automoun-9953  0dnh1  984us : account_system_time (update_process_times)
automoun-9953  0dnh1  985us : update_mem_hiwater (update_process_times)
automoun-9953  0dnh1  985us : run_local_timers (update_process_times)
automoun-9953  0dnh1  985us : raise_softirq (update_process_times)
automoun-9953  0dnh1  985us : __local_irq_save (raise_softirq)
automoun-9953  0dnh1  986us : local_irq_restore (raise_softirq)
automoun-9953  0dnh1  986us : check_soft_flags (local_irq_restore)
automoun-9953  0dnh1  986us : rcu_check_callbacks (update_process_times)
automoun-9953  0dnh1  987us : idle_cpu (rcu_check_callbacks)
automoun-9953  0dnh1  987us : scheduler_tick (timer_interrupt)
automoun-9953  0dnh1  987us : sched_clock (scheduler_tick)
automoun-9953  0dnh1  988us : preempt_schedule (scheduler_tick)
automoun-9953  0dnh1  988us : profile_hit (timer_interrupt)
automoun-9953  0dnh.  988us : preempt_schedule (timer_interrupt)
automoun-9953  0dnh.  989us : local_irq_disable (handle_IRQ_event)
automoun-9953  0dnh1  989us : note_interrupt (__do_IRQ)
automoun-9953  0dnh1  990us : end_8259A_irq (__do_IRQ)
automoun-9953  0dnh1  990us : enable_8259A_irq (__do_IRQ)
automoun-9953  0dnh1  990us : __local_irq_save (enable_8259A_irq)
automoun-9953  0dnh1  991us : local_irq_restore (enable_8259A_irq)
automoun-9953  0dnh1  991us : check_soft_flags (local_irq_restore)
automoun-9953  0dnh1  992us : preempt_schedule (enable_8259A_irq)
automoun-9953  0dnh.  992us : preempt_schedule (__do_IRQ)
automoun-9953  0dnh.  992us : local_irq_restore (__do_IRQ)
automoun-9953  0dnh.  993us : check_soft_flags (local_irq_restore)
automoun-9953  0dnh.  993us : irq_exit (do_IRQ)
automoun-9953  0dnh1  993us : do_softirq (irq_exit)
automoun-9953  0dnh1  994us : __local_irq_save (do_softirq)
automoun-9953  0dnh1  994us : __do_softirq (do_softirq)
automoun-9953  0dnh1  994us : local_irq_restore (do_softirq)
automoun-9953  0dnh1  995us : check_soft_flags (local_irq_restore)
automoun-9953  0dnh.  995us!< (66144)
automoun-9953  0dn.. 1138us+: __local_irq_save (vgacon_scroll)
automoun-9953  0dn.. 1140us : local_irq_restore (vgacon_scroll)
automoun-9953  0dn.. 1140us : check_soft_flags (local_irq_restore)
automoun-9953  0dn.. 1141us+: preempt_schedule (vgacon_scroll)
automoun-9953  0dn.. 1145us : vgacon_dummy (vt_console_print)
automoun-9953  0dn.. 1145us : lf (vt_console_print)
automoun-9953  0dn.. 1145us : scrup (lf)
automoun-9953  0dn.. 1146us+: vgacon_scroll (scrup)
automoun-9953  0dn.. 1152us : __local_irq_save (vgacon_scroll)
automoun-9953  0dn.. 1154us : local_irq_restore (vgacon_scroll)
automoun-9953  0dn.. 1154us : check_soft_flags (local_irq_restore)
automoun-9953  0dn.. 1154us : preempt_schedule (vgacon_scroll)
automoun-9953  0dn.. 1155us : set_cursor (vt_console_print)
automoun-9953  0dn.. 1155us : add_softcursor (set_cursor)
automoun-9953  0dn.. 1156us : vgacon_cursor (set_cursor)
automoun-9953  0dn.. 1156us : __local_irq_save (vgacon_cursor)
automoun-9953  0dn.. 1157us : local_irq_restore (vgacon_cursor)
automoun-9953  0dn.. 1158us : check_soft_flags (local_irq_restore)
automoun-9953  0dn.. 1158us : preempt_schedule (vgacon_cursor)
automoun-9953  0dn.. 1158us : vgacon_set_cursor_size (vgacon_cursor)
automoun-9953  0dn.. 1159us : _call_console_drivers (call_console_drivers)
automoun-9953  0dn.. 1159us : local_irq_restore (release_console_sem)
automoun-9953  0dn.. 1159us : check_soft_flags (local_irq_restore)
automoun-9953  0Dn.. 1160us : preempt_schedule (release_console_sem)
automoun-9953  0Dn.. 1160us : irqs_disabled (preempt_schedule)
automoun-9953  0Dnh. 1160us : local_irq_disable (preempt_schedule)
automoun-9953  0dnh. 1161us : __schedule (preempt_schedule)
automoun-9953  0dnh. 1161us : profile_hit (__schedule)
automoun-9953  0dnh1 1162us : sched_clock (__schedule)
automoun-9953  0dnh1 1162us : local_irq_disable (__schedule)
automoun-9953  0dnh2 1163us+: trace_array (__schedule)
automoun-9953  0dnh2 1166us : trace_array <<...>-2> (73 6e)
automoun-9953  0dnh2 1167us : trace_array <automoun-9953> (79 74)
automoun-9953  0dnh2 1167us : trace_array <<...>-3278> (7d 78)
automoun-9953  0dnh2 1167us : trace_array <<...>-3155> (7d 78)
automoun-9953  0dnh2 1168us : trace_array <<...>-4062> (7d 78)
automoun-9953  0dnh2 1168us : trace_array <<...>-4562> (7d 78)
automoun-9953  0dnh2 1168us : trace_array <<...>-9929> (7d 78)
automoun-9953  0dnh2 1168us : trace_array <<...>-3282> (7d 78)
automoun-9953  0dnh2 1169us : trace_array <<...>-4787> (7d 78)
automoun-9953  0dnh2 1169us : trace_array <<...>-3269> (7d 78)
automoun-9953  0dnh2 1169us : trace_array <<...>-3443> (7d 78)
automoun-9953  0dnh2 1170us : trace_array <<...>-9949> (7d 78)
automoun-9953  0dnh2 1170us : trace_array <<...>-4633> (7d 78)
automoun-9953  0dnh2 1170us : trace_array <<...>-3105> (7d 78)
automoun-9953  0dnh2 1171us : trace_array <<...>-9946> (7d 78)
automoun-9953  0dnh2 1171us : trace_array <<...>-839> (7d 78)
automoun-9953  0dnh2 1171us : trace_array <<...>-2952> (7d 78)
automoun-9953  0dnh2 1172us+: trace_array (__schedule)
   <...>-2     0dnh2 1176us : __switch_to (__schedule)
   <...>-2     0dnh2 1176us : __schedule <automoun-9953> (79 73)
   <...>-2     0dnh1 1177us : trace_stop_sched_switched (__schedule)
   <...>-2     0dnh1 1177us : trace_stop_sched_switched <<...>-2> (73 0)
   <...>-2     0dnh1 1178us : trace_stop_sched_switched (__schedule)


vim:ft=help


On Thu, 9 Jun 2005, Ingo Molnar wrote:

> 
> * Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:
> 
> > Ingo Molnar wrote:
> > >thanks - i have added it to my tree and have uploaded the -48-03 release 
> > >with your patch included.
> > 
> > This hunk should not be in the patch:
> 
> indeed - new patch uploaded.
> 
> 	Ingo
> -
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
> 


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 11:39       ` Ingo Molnar
@ 2005-06-10 13:34         ` K.R. Foley
  0 siblings, 0 replies; 139+ messages in thread
From: K.R. Foley @ 2005-06-10 13:34 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

Ingo Molnar wrote:
> * Ingo Molnar <mingo@elte.hu> wrote:
> 
> 
>>># CONFIG_DEBUG_RT_LOCKING_MODE is not set
>>>
>>>it seems to work fine. With the above enabled it hangs on both of my 
>>>SMP systems as described above. :-/
>>
>>ahh ... i'll try to reproduce it that way.
> 
> 
> found the bug - it was the incorrect initialization of 
> debug_slock/rwlock. I've uploaded -48-02 with the fix. This release also 
> includes a new debugging feature: CONFIG_DETECT_SOFTLOCKUP, which works 
> similar to the NMI watchdog but detects soft (==no reschedules) lockups.  
> I've also converted a few more local_irq_*() calls to raw_local_irq_*() 
> calls.
> 
> 	Ingo
> 

Sorry for not reporting back sooner on this, I just kept getting 
interrupted. My problems seem to be resolved on my SMP systems, even when

CONFIG_DEBUG_RT_LOCKING_MODE=y

I should note that I didn't actually try with the version above because 
it had been updated before I got to it.

-- 
    kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 21:24 ` Michal Schmidt
  2005-06-09 21:34   ` Michal Schmidt
@ 2005-06-11  7:32   ` Ingo Molnar
  2005-06-11  8:10     ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-11  7:32 UTC (permalink / raw)
  To: Michal Schmidt; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:

> Hi Ingo,
> 
> Since the introduction of the delayed preemption feature in V0.7.47-20 
> my KDE desktop has been jerky. The sound from artsd often skips. The 
> mouse pointer jumps when I compile anything the background and try to 
> browse the web with Firefox.

yeah.

> I think that try_to_wake_up is broken for the !sync case. We have:
> 
> 		__activate_task(p, rq);
>                 if (TASK_PREEMPTS_CURR(p, rq)) {
>                         if (sync)
>                                 set_tsk_need_resched_delayed(rq->curr);
>                         else
>                                 resched_task(rq->curr);
>                 }
> 
> Shouldn't we call the full activate_task(...) instead of 
> __activate_task(...) in the !sync case?

indeed.

> The attached patch fixes seems to fix it for me. It is against 
> V0.7.48-05.

thanks, applied - but this does not end all of the reschedule problems 
that the latest patches have. More on that later.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-11  7:32   ` Ingo Molnar
@ 2005-06-11  8:10     ` Ingo Molnar
  0 siblings, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-11  8:10 UTC (permalink / raw)
  To: Michal Schmidt; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* Ingo Molnar <mingo@elte.hu> wrote:

> > The attached patch fixes seems to fix it for me. It is against 
> > V0.7.48-05.
> 
> thanks, applied - but this does not end all of the reschedule problems 
> that the latest patches have. More on that later.

one problem was that the WORK_MASK definitions in thread_info.h were not 
updated - neither the word-sized tests in entry.S. This meant we missed 
delayed-preemption on return-from-kernel. But we've got one free bit in 
the first by - bit 6, so i moved the DELAYED bit there. Another bug was 
that the idle thread did not check for delayed preemption. I fixed these 
in the -48-07 patch.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
                   ` (5 preceding siblings ...)
  2005-06-09 21:24 ` Michal Schmidt
@ 2005-06-11 16:35 ` Peter Zijlstra
  2005-06-11 18:48   ` Ingo Molnar
  2005-06-14 18:24 ` K.R. Foley
                   ` (2 subsequent siblings)
  9 siblings, 1 reply; 139+ messages in thread
From: Peter Zijlstra @ 2005-06-11 16:35 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

Hi Ingo,

I'm having some difficulty with your latest patches; more specifically
linux-2.6.12-rc6-git4-RT-V0.7.48-10 floods me with BUGs like these:

BUG: sleeping function called from invalid context ksoftirqd/1(7) at kernel/rt.c:1657
in_atomic():0 [20000000], irqs_disabled():536870912
 [<c01041c3>] dump_stack+0x23/0x30 (20)
 [<c011c981>] __might_sleep+0xe1/0x100 (36)
 [<c013dbe8>] __spin_lock+0x38/0x60 (24)
 [<c013dc2d>] _spin_lock+0x1d/0x20 (16)
 [<c02c627f>] rh_report_status+0x2f/0x110 (36)
 [<c012a754>] run_timer_softirq+0x1e4/0x3f0 (64)
 [<c0125c7f>] ___do_softirq+0x7f/0x140 (48)
 [<c0125df7>] _do_softirq+0x27/0x30 (8)
 [<c0126431>] ksoftirqd+0xb1/0x150 (28)
 [<c0137426>] kthread+0xb6/0xf0 (48)
 [<c0101149>] kernel_thread_helper+0x5/0xc (268648476)
---------------------------
| preempt count: 20000001 ]
| 1-level deep critical section nesting:
----------------------------------------
.. [<c0141bdb>] .... print_traces+0x1b/0x60
.....[<c01041c3>] ..   ( <= dump_stack+0x23/0x30)

I gather these are because of:

drivers/usb/code/hcd.c:rh_report_status

static void rh_report_status (unsigned long ptr)
{
	struct urb	*urb;
	struct usb_hcd	*hcd;
	int		length = 0;
	unsigned long	flags;

	urb = (struct urb *) ptr;
	local_irq_save (flags);
	spin_lock (&urb->lock);


	...
}

where local_irq_save() would disable pre-emption while spin_lock(); the
urb->lock is not a raw lock; can sleep.

I'm not well versed in that code; do you have a suggestion?

On another note; X seems to have trouble getting up. It consumes a full
CPU right after mode switching (afaict) without getting any progress.
I'll try and get a nice trace of X using sysrq-t.

-- 
Peter Zijlstra <a.p.zijlstra@chello.nl>



^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-11 16:35 ` Peter Zijlstra
@ 2005-06-11 18:48   ` Ingo Molnar
  2005-06-11 21:14     ` Peter Zijlstra
  2005-06-12  1:40     ` Gene Heskett
  0 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-11 18:48 UTC (permalink / raw)
  To: Peter Zijlstra; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* Peter Zijlstra <a.p.zijlstra@chello.nl> wrote:

> Hi Ingo,
> 
> I'm having some difficulty with your latest patches; more specifically
> linux-2.6.12-rc6-git4-RT-V0.7.48-10 floods me with BUGs like these:

> I gather these are because of:
> 
> drivers/usb/code/hcd.c:rh_report_status
> 
> static void rh_report_status (unsigned long ptr)

does the patch below help?

> On another note; X seems to have trouble getting up. It consumes a 
> full CPU right after mode switching (afaict) without getting any 
> progress. I'll try and get a nice trace of X using sysrq-t.

could this be due to the messages spamming the console?

	Ingo

--- usb/core/hcd.c.orig
+++ usb/core/hcd.c
@@ -353,7 +353,9 @@ static int rh_call_control (struct usb_h
 	const u8	*bufp = tbuf;
 	int		len = 0;
 	int		patch_wakeup = 0;
+#ifndef CONFIG_PREEMPT_RT
 	unsigned long	flags;
+#endif
 	int		status = 0;
 	int		n;
 
@@ -506,13 +508,17 @@ error:
 	}
 
 	/* any errors get returned through the urb completion */
+#ifndef CONFIG_PREEMPT_RT
 	local_irq_save (flags);
+#endif
 	spin_lock (&urb->lock);
 	if (urb->status == -EINPROGRESS)
 		urb->status = status;
 	spin_unlock (&urb->lock);
 	usb_hcd_giveback_urb (hcd, urb, NULL);
+#ifndef CONFIG_PREEMPT_RT
 	local_irq_restore (flags);
+#endif
 	return 0;
 }
 
@@ -562,15 +568,13 @@ static void rh_report_status (unsigned l
 	unsigned long	flags;
 
 	urb = (struct urb *) ptr;
-	local_irq_save (flags);
-	spin_lock (&urb->lock);
+	spin_lock_irqsave (&urb->lock, flags);
 
 	/* do nothing if the urb's been unlinked */
 	if (!urb->dev
 			|| urb->status != -EINPROGRESS
 			|| (hcd = urb->dev->bus->hcpriv) == NULL) {
-		spin_unlock (&urb->lock);
-		local_irq_restore (flags);
+		spin_unlock_irqrestore (&urb->lock, flags);
 		return;
 	}
 
@@ -588,12 +592,12 @@ static void rh_report_status (unsigned l
 			mod_timer (&hcd->rh_timer, jiffies + HZ/4);
 	}
 	spin_unlock (&hcd_data_lock);
-	spin_unlock (&urb->lock);
 
 	/* local irqs are always blocked in completions */
 	if (length > 0)
 		usb_hcd_giveback_urb (hcd, urb, NULL);
-	local_irq_restore (flags);
+
+	spin_unlock_irqrestore (&urb->lock, flags);
 }
 
 /*-------------------------------------------------------------------------*/
@@ -619,17 +623,23 @@ static int rh_urb_enqueue (struct usb_hc
 
 static int usb_rh_urb_dequeue (struct usb_hcd *hcd, struct urb *urb)
 {
+#ifndef CONFIG_PREEMPT_RT
 	unsigned long	flags;
+#endif
 
 	/* note:  always a synchronous unlink */
 	if ((unsigned long) urb == hcd->rh_timer.data) {
 		del_timer_sync (&hcd->rh_timer);
 		hcd->rh_timer.data = 0;
 
+#ifndef CONFIG_PREEMPT_RT
 		local_irq_save (flags);
+#endif
 		urb->hcpriv = NULL;
 		usb_hcd_giveback_urb (hcd, urb, NULL);
+#ifndef CONFIG_PREEMPT_RT
 		local_irq_restore (flags);
+#endif
 
 	} else if (usb_pipeendpoint(urb->pipe) == 0) {
 		spin_lock_irq(&urb->lock);	/* from usb_kill_urb */
@@ -1357,15 +1367,13 @@ hcd_endpoint_disable (struct usb_device 
 
 	WARN_ON (!HC_IS_RUNNING (hcd->state) && hcd->state != HC_STATE_HALT);
 
-	local_irq_disable ();
-
 	/* FIXME move most of this into message.c as part of its
 	 * endpoint disable logic
 	 */
 
 	/* ep is already gone from udev->ep_{in,out}[]; no more submits */
 rescan:
-	spin_lock (&hcd_data_lock);
+	spin_lock_irq (&hcd_data_lock);
 	list_for_each_entry (urb, &ep->urb_list, urb_list) {
 		int	tmp;
 
@@ -1378,13 +1386,13 @@ rescan:
 		if (urb->status != -EINPROGRESS)
 			continue;
 		usb_get_urb (urb);
-		spin_unlock (&hcd_data_lock);
+		spin_unlock_irq (&hcd_data_lock);
 
-		spin_lock (&urb->lock);
+		spin_lock_irq (&urb->lock);
 		tmp = urb->status;
 		if (tmp == -EINPROGRESS)
 			urb->status = -ESHUTDOWN;
-		spin_unlock (&urb->lock);
+		spin_unlock_irq (&urb->lock);
 
 		/* kick hcd unless it's already returning this */
 		if (tmp == -EINPROGRESS) {
@@ -1407,8 +1415,7 @@ rescan:
 		/* list contents may have changed */
 		goto rescan;
 	}
-	spin_unlock (&hcd_data_lock);
-	local_irq_enable ();
+	spin_unlock_irq (&hcd_data_lock);
 
 	/* synchronize with the hardware, so old configuration state
 	 * clears out immediately (and will be freed).

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-11 18:48   ` Ingo Molnar
@ 2005-06-11 21:14     ` Peter Zijlstra
  2005-06-12  1:40     ` Gene Heskett
  1 sibling, 0 replies; 139+ messages in thread
From: Peter Zijlstra @ 2005-06-11 21:14 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Daniel Walker, Eugeny S. Mints, linux-kernel

On Sat, 2005-06-11 at 20:48 +0200, Ingo Molnar wrote: 
> * Peter Zijlstra <a.p.zijlstra@chello.nl> wrote:
> 
> > Hi Ingo,
> > 
> > I'm having some difficulty with your latest patches; more specifically
> > linux-2.6.12-rc6-git4-RT-V0.7.48-10 floods me with BUGs like these:
> 
> > I gather these are because of:
> > 
> > drivers/usb/code/hcd.c:rh_report_status
> > 
> > static void rh_report_status (unsigned long ptr)
> 
> does the patch below help?
> 
Yes, it does.

> > On another note; X seems to have trouble getting up. It consumes a 
> > full CPU right after mode switching (afaict) without getting any 
> > progress. I'll try and get a nice trace of X using sysrq-t.
> 
> could this be due to the messages spamming the console?

No, no output at all on my (serial) console. Nor does sysrq work; except
for powerOff which really doesn't help :-|, nor does it work with my
current 'good' kernel 2.6.12-rc5-git4-RT-V0.7.47-12. Also any process
touching the X process hangs along with it. I tried strace, gdb etc..

I'll try some more tomorrow..

Peter Zijlstra


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-11 18:48   ` Ingo Molnar
  2005-06-11 21:14     ` Peter Zijlstra
@ 2005-06-12  1:40     ` Gene Heskett
  2005-06-12  6:49       ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-12  1:40 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar, Peter Zijlstra, Eugeny S. Mints, Daniel Walker

On Saturday 11 June 2005 14:48, Ingo Molnar wrote:
>* Peter Zijlstra <a.p.zijlstra@chello.nl> wrote:
>> Hi Ingo,
>>
>> I'm having some difficulty with your latest patches; more
>> specifically linux-2.6.12-rc6-git4-RT-V0.7.48-10 floods me with
>> BUGs like these:
>>
>> I gather these are because of:
>>
>> drivers/usb/code/hcd.c:rh_report_status
>>
>> static void rh_report_status (unsigned long ptr)
>
>does the patch below help?
>
>> On another note; X seems to have trouble getting up. It consumes a
>> full CPU right after mode switching (afaict) without getting any
>> progress. I'll try and get a nice trace of X using sysrq-t.
>
>could this be due to the messages spamming the console?
>
> Ingo
>
>--- usb/core/hcd.c.orig
>+++ usb/core/hcd.c
>@@ -353,7 +353,9 @@ static int rh_call_control (struct usb_h
>  const u8 *bufp = tbuf;
>  int  len = 0;
>  int  patch_wakeup = 0;
>+#ifndef CONFIG_PREEMPT_RT
>  unsigned long flags;
>+#endif
>  int  status = 0;
>  int  n;
>
>@@ -506,13 +508,17 @@ error:
>  }
>
>  /* any errors get returned through the urb completion */
>+#ifndef CONFIG_PREEMPT_RT
>  local_irq_save (flags);
>+#endif
>  spin_lock (&urb->lock);
>  if (urb->status == -EINPROGRESS)
>   urb->status = status;
>  spin_unlock (&urb->lock);
>  usb_hcd_giveback_urb (hcd, urb, NULL);
>+#ifndef CONFIG_PREEMPT_RT
>  local_irq_restore (flags);
>+#endif
>  return 0;
> }
>
>@@ -562,15 +568,13 @@ static void rh_report_status (unsigned l
>  unsigned long flags;
>
>  urb = (struct urb *) ptr;
>- local_irq_save (flags);
>- spin_lock (&urb->lock);
>+ spin_lock_irqsave (&urb->lock, flags);
>
>  /* do nothing if the urb's been unlinked */
>  if (!urb->dev
>
>    || urb->status != -EINPROGRESS
>    || (hcd = urb->dev->bus->hcpriv) == NULL) {
>
>-  spin_unlock (&urb->lock);
>-  local_irq_restore (flags);
>+  spin_unlock_irqrestore (&urb->lock, flags);
>   return;
>  }
>
>@@ -588,12 +592,12 @@ static void rh_report_status (unsigned l
>    mod_timer (&hcd->rh_timer, jiffies + HZ/4);
>  }
>  spin_unlock (&hcd_data_lock);
>- spin_unlock (&urb->lock);
>
>  /* local irqs are always blocked in completions */
>  if (length > 0)
>   usb_hcd_giveback_urb (hcd, urb, NULL);
>- local_irq_restore (flags);
>+
>+ spin_unlock_irqrestore (&urb->lock, flags);
> }
>
> /*-----------------------------------------------------------------
>--------*/ @@ -619,17 +623,23 @@ static int rh_urb_enqueue (struct
> usb_hc
>
> static int usb_rh_urb_dequeue (struct usb_hcd *hcd, struct urb
> *urb) {
>+#ifndef CONFIG_PREEMPT_RT
>  unsigned long flags;
>+#endif
>
>  /* note:  always a synchronous unlink */
>  if ((unsigned long) urb == hcd->rh_timer.data) {
>   del_timer_sync (&hcd->rh_timer);
>   hcd->rh_timer.data = 0;
>
>+#ifndef CONFIG_PREEMPT_RT
>   local_irq_save (flags);
>+#endif
>   urb->hcpriv = NULL;
>   usb_hcd_giveback_urb (hcd, urb, NULL);
>+#ifndef CONFIG_PREEMPT_RT
>   local_irq_restore (flags);
>+#endif
>
>  } else if (usb_pipeendpoint(urb->pipe) == 0) {
>   spin_lock_irq(&urb->lock); /* from usb_kill_urb */
>@@ -1357,15 +1367,13 @@ hcd_endpoint_disable (struct usb_device
>
>  WARN_ON (!HC_IS_RUNNING (hcd->state) && hcd->state !=
> HC_STATE_HALT);
>
>- local_irq_disable ();
>-
>  /* FIXME move most of this into message.c as part of its
>   * endpoint disable logic
>   */
>
>  /* ep is already gone from udev->ep_{in,out}[]; no more submits */
> rescan:
>- spin_lock (&hcd_data_lock);
>+ spin_lock_irq (&hcd_data_lock);
>  list_for_each_entry (urb, &ep->urb_list, urb_list) {
>   int tmp;
>
>@@ -1378,13 +1386,13 @@ rescan:
>   if (urb->status != -EINPROGRESS)
>    continue;
>   usb_get_urb (urb);
>-  spin_unlock (&hcd_data_lock);
>+  spin_unlock_irq (&hcd_data_lock);
>
>-  spin_lock (&urb->lock);
>+  spin_lock_irq (&urb->lock);
>   tmp = urb->status;
>   if (tmp == -EINPROGRESS)
>    urb->status = -ESHUTDOWN;
>-  spin_unlock (&urb->lock);
>+  spin_unlock_irq (&urb->lock);
>
>   /* kick hcd unless it's already returning this */
>   if (tmp == -EINPROGRESS) {
>@@ -1407,8 +1415,7 @@ rescan:
>   /* list contents may have changed */
>   goto rescan;
>  }
>- spin_unlock (&hcd_data_lock);
>- local_irq_enable ();
>+ spin_unlock_irq (&hcd_data_lock);
>
>  /* synchronize with the hardware, so old configuration state
>   * clears out immediately (and will be freed).
>-

I just tried to build the V0.7.48-12 version, preempt mode 3,
no hardirq's, and got this:

CC      arch/i386/kernel/init_task.o
arch/i386/kernel/init_task.c:17: error: `SPIN_LOCK_UNLOCKED' undeclared here (not in a function)
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.mmap_sem.wait_lock')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.mmap_sem.wait_list')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.mmap_sem')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.page_table_lock')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.mmlist')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.cpu_vm_mask')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.default_kioctx.users')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.default_kioctx.wait.lock')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.default_kioctx.wai
t.task_list')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.default_kioctx.wait')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.default_kioctx.ctx_lock')
arch/i386/kernel/init_task.c:17: error: initializer element is not constant
arch/i386/kernel/init_task.c:17: error: (near initialization for `init_mm.default_kioctx')
make[1]: *** [arch/i386/kernel/init_task.o] Error 1
make: *** [arch/i386/kernel] Error 2

???

Essentially the same .config as was used to build 48-10 earlier today

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-12  1:40     ` Gene Heskett
@ 2005-06-12  6:49       ` Ingo Molnar
  2005-06-12  9:02         ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-12  6:49 UTC (permalink / raw)
  To: Gene Heskett; +Cc: linux-kernel, Peter Zijlstra, Eugeny S. Mints, Daniel Walker


* Gene Heskett <gene.heskett@verizon.net> wrote:

> >   * clears out immediately (and will be freed).
> >-
> 
> I just tried to build the V0.7.48-12 version, preempt mode 3, no 
> hardirq's, and got this:

does -48-13 work any better?

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-12  6:49       ` Ingo Molnar
@ 2005-06-12  9:02         ` Gene Heskett
  2005-06-12 10:35           ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-12  9:02 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar, Peter Zijlstra, Eugeny S. Mints, Daniel Walker

On Sunday 12 June 2005 02:49, Ingo Molnar wrote:
>* Gene Heskett <gene.heskett@verizon.net> wrote:
>> >   * clears out immediately (and will be freed).
>> >-
>>
>> I just tried to build the V0.7.48-12 version, preempt mode 3, no
>> hardirq's, and got this:
>
>does -48-13 work any better?
>
> Ingo

Dunno, twasn't there till I looked just now.  And it made it past that 
little roadblock ok.  Gonna be slow, logrotate & updatedb are running 
as its just past 4am local.  Like any good geek, I had to check my 
email when I got up to p. :-)

Yes, it built, and I'm rebooted to it.  Feels rather normal so far. A 
quick game of klondike lagged for the first 3 or 4 moves but smoothed 
right up.

Glitch reports as they develop of course.

Q:  Whats the diff between turning on hardirq's in mode 3, and mode 4?


-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-12  9:02         ` Gene Heskett
@ 2005-06-12 10:35           ` Ingo Molnar
  2005-06-12 13:40             ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-12 10:35 UTC (permalink / raw)
  To: Gene Heskett; +Cc: linux-kernel, Peter Zijlstra, Eugeny S. Mints, Daniel Walker


* Gene Heskett <gene.heskett@verizon.net> wrote:

> Glitch reports as they develop of course.
> 
> Q: Whats the diff between turning on hardirq's in mode 3, and mode 4?

well, "mode 3" is PREEMPT_DESKTOP - normal CONFIG_PREEMPT on the 
mainstream kernel. If you turn on hardirq/softirq threading then you can 
e.g. chprio your sound IRQ to have better audio latencies. It will cause 
runtime overhead though. On "mode 4" (PREEMPT_RT) hardirq/softirq 
threading is mandatory (due to the processing model).

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-12 10:35           ` Ingo Molnar
@ 2005-06-12 13:40             ` Gene Heskett
  2005-06-12 13:49               ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-12 13:40 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar, Peter Zijlstra, Eugeny S. Mints, Daniel Walker

On Sunday 12 June 2005 06:35, Ingo Molnar wrote:
>* Gene Heskett <gene.heskett@verizon.net> wrote:
>> Glitch reports as they develop of course.
>>
>> Q: Whats the diff between turning on hardirq's in mode 3, and mode
>> 4?
>
>well, "mode 3" is PREEMPT_DESKTOP - normal CONFIG_PREEMPT on the
>mainstream kernel. If you turn on hardirq/softirq threading then you
> can e.g. chprio your sound IRQ to have better audio latencies. It
> will cause runtime overhead though. On "mode 4" (PREEMPT_RT)
> hardirq/softirq threading is mandatory (due to the processing
> model).
>
> Ingo

I think I see.  Do you have a swag as to how much runtime overhead 
using softirq's only might cause?  My normal seti production is about 
7 per day, and it seems to have dropped to about 6 while running the 
RT versions.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-12 13:40             ` Gene Heskett
@ 2005-06-12 13:49               ` Ingo Molnar
  2005-06-12 14:23                 ` Gene Heskett
  2005-06-13  2:11                 ` Gene Heskett
  0 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-12 13:49 UTC (permalink / raw)
  To: Gene Heskett; +Cc: linux-kernel, Peter Zijlstra, Eugeny S. Mints, Daniel Walker


* Gene Heskett <gene.heskett@verizon.net> wrote:

> I think I see.  Do you have a swag as to how much runtime overhead 
> using softirq's only might cause? [...]

should be barely measurable for desktop workloads. For servers it might 
be significant, depending on the amount of IRQ traffic. For any box 
doing less than 2000-3000 irqs/sec it should be very small.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-12 13:49               ` Ingo Molnar
@ 2005-06-12 14:23                 ` Gene Heskett
  2005-06-13  2:11                 ` Gene Heskett
  1 sibling, 0 replies; 139+ messages in thread
From: Gene Heskett @ 2005-06-12 14:23 UTC (permalink / raw)
  To: linux-kernel

On Sunday 12 June 2005 09:49, Ingo Molnar wrote:
>* Gene Heskett <gene.heskett@verizon.net> wrote:
>> I think I see.  Do you have a swag as to how much runtime overhead
>> using softirq's only might cause? [...]
>
>should be barely measurable for desktop workloads. For servers it
> might be significant, depending on the amount of IRQ traffic. For
> any box doing less than 2000-3000 irqs/sec it should be very small.
>
> Ingo

Chuckle, for me that would be a 'mox nix' using the english 
spelling. :-)  And seti made a liar out of me, it did do 7 units 
yesterday.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-12 13:49               ` Ingo Molnar
  2005-06-12 14:23                 ` Gene Heskett
@ 2005-06-13  2:11                 ` Gene Heskett
  2005-06-13  6:09                   ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-13  2:11 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar, Peter Zijlstra, Eugeny S. Mints, Daniel Walker

Humm, I think I hijacked a thread.  Anyway, for exercise I just built 48-17,
but had to interrupt the boot & go back to 48-13 as I was drowning in 
a near DOS caused by:

Jun 12 21:54:16 coyote kernel: ACPI: PCI Interrupt 0000:00:04.0[A] -> Link [LMAC] -> GSI 11 (level, low) -> IRQ 11
Jun 12 21:54:16 coyote kernel: BUG: scheduling while atomic: softirq-timer/0/0x10000100/3
Jun 12 21:54:16 coyote kernel: caller is __cond_resched+0x3d/0x50
Jun 12 21:54:16 coyote kernel:  [<c036fb7f>] __schedule+0x67f/0x6d0 (8)
Jun 12 21:54:16 coyote kernel:  [<c0113c3d>] __cond_resched+0x3d/0x50 (8)
Jun 12 21:54:16 coyote kernel:  [<c0120c40>] process_timeout+0x0/0x10 (32)
Jun 12 21:54:16 coyote kernel:  [<c0120999>] run_timer_softirq+0x259/0x400 (4)
Jun 12 21:54:16 coyote kernel:  [<c0113c3d>] __cond_resched+0x3d/0x50 (32)
Jun 12 21:54:16 coyote kernel:  [<c03704ac>] cond_resched+0x1c/0x30 (12)
Jun 12 21:54:16 coyote kernel:  [<c011c74c>] ksoftirqd+0xec/0x150 (8)
Jun 12 21:54:16 coyote kernel:  [<c011c660>] ksoftirqd+0x0/0x150 (24)
Jun 12 21:54:16 coyote kernel:  [<c012c825>] kthread+0xa5/0xb0 (4)
Jun 12 21:54:16 coyote kernel:  [<c012c780>] kthread+0x0/0xb0 (28)
Jun 12 21:54:16 coyote kernel:  [<c0100e41>] kernel_thread_helper+0x5/0x14 (16)
Jun 12 21:54:16 coyote random: Initializing random number generator:  succeeded

That was the first of several hundred that went by by the time I 3 fingered it.
Virtually all were carbon copies of each other.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-13  2:11                 ` Gene Heskett
@ 2005-06-13  6:09                   ` Ingo Molnar
  2005-06-13  8:37                     ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-13  6:09 UTC (permalink / raw)
  To: Gene Heskett; +Cc: linux-kernel, Peter Zijlstra, Eugeny S. Mints, Daniel Walker


* Gene Heskett <gene.heskett@verizon.net> wrote:

> but had to interrupt the boot & go back to 48-13 as I was drowning in 
> a near DOS caused by:
> 
> Jun 12 21:54:16 coyote kernel: BUG: scheduling while atomic: softirq-timer/0/0x10000100/3
> Jun 12 21:54:16 coyote kernel: caller is __cond_resched+0x3d/0x50

ok, fixed this one - does -48-19 work for you? (PREEMPT_DESKTOP was 
broken by the new split-softirqs code)

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-13  6:09                   ` Ingo Molnar
@ 2005-06-13  8:37                     ` Gene Heskett
  0 siblings, 0 replies; 139+ messages in thread
From: Gene Heskett @ 2005-06-13  8:37 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar, Peter Zijlstra, Eugeny S. Mints, Daniel Walker

On Monday 13 June 2005 02:09, Ingo Molnar wrote:
>* Gene Heskett <gene.heskett@verizon.net> wrote:
>> but had to interrupt the boot & go back to 48-13 as I was drowning
>> in a near DOS caused by:
>>
>> Jun 12 21:54:16 coyote kernel: BUG: scheduling while atomic:
>> softirq-timer/0/0x10000100/3 Jun 12 21:54:16 coyote kernel: caller
>> is __cond_resched+0x3d/0x50
>
>ok, fixed this one - does -48-19 work for you? (PREEMPT_DESKTOP was
>broken by the new split-softirqs code)
>
> Ingo

Its running apparently ok Ingo, but it fussed during the boot because 
CONFIG_LATENCY_TRACE was still on, so my ./makeit script is running 
again after turning that off.  I'd turned its parent in the xconfig 
display off mistakenly figureing that got the child.  kconfig 
miss-cue?

Rebooted to it, no warnings.  Glitch reports as they are found. :-)

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-09 16:34           ` Daniel Walker
@ 2005-06-13  8:53             ` Serge Noiraud
  2005-06-13  9:07               ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Serge Noiraud @ 2005-06-13  8:53 UTC (permalink / raw)
  To: Daniel Walker; +Cc: Ingo Molnar, K.R. Foley, linux-kernel, Eugeny S. Mints

Le jeu 09/06/2005 à 18:34, Daniel Walker a écrit :
> On Thu, 9 Jun 2005, Serge Noiraud wrote:
> 
> > Same problem with 48-04 and 48-05
> > It works great with rc6 without RT patch.
> > Here is my .config
> > The cmdline options at boot time are :
> > #more /proc/cmdline
> > BOOT_IMAGE=2.6.12rc6RTV0.7.4805 ro root=306 console=ttyS0 console=tty1 \
> > acpi=force apm=smp resume=/dev/hda5
> 
> 
> 
> Does this patch get you any further?
> 
Sorry for the delay , I was out of my office.
I tested 48-19 and no more problem.
So, is it useful to test it anymore ?
Do you fix it another way ?


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-13  8:53             ` Serge Noiraud
@ 2005-06-13  9:07               ` Ingo Molnar
  0 siblings, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-13  9:07 UTC (permalink / raw)
  To: Serge Noiraud; +Cc: Daniel Walker, K.R. Foley, linux-kernel, Eugeny S. Mints


* Serge Noiraud <serge.noiraud@bull.net> wrote:

> Le jeu 09/06/2005 à 18:34, Daniel Walker a écrit :
> > On Thu, 9 Jun 2005, Serge Noiraud wrote:
> > 
> > > Same problem with 48-04 and 48-05
> > > It works great with rc6 without RT patch.
> > > Here is my .config
> > > The cmdline options at boot time are :
> > > #more /proc/cmdline
> > > BOOT_IMAGE=2.6.12rc6RTV0.7.4805 ro root=306 console=ttyS0 console=tty1 \
> > > acpi=force apm=smp resume=/dev/hda5
> > 
> > 
> > 
> > Does this patch get you any further?
> > 
> Sorry for the delay , I was out of my office.
> I tested 48-19 and no more problem.
> So, is it useful to test it anymore ?
> Do you fix it another way ?

yes, the patch is in 48-19 - no need to do any further testing, thanks.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
                   ` (6 preceding siblings ...)
  2005-06-11 16:35 ` Peter Zijlstra
@ 2005-06-14 18:24 ` K.R. Foley
  2005-06-14 18:54   ` Ingo Molnar
  2005-06-14 20:37 ` Paul E. McKenney
  2005-06-16  3:51 ` K.R. Foley
  9 siblings, 1 reply; 139+ messages in thread
From: K.R. Foley @ 2005-06-14 18:24 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

Ingo Molnar wrote:
> i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
> downloaded from the usual place:

Ingo,

I just got this soft lock with -RT-2.6.12-rc6-V0.7.48-32 on my dual 2.6G 
Xeon W/HT. Not sure what causes it. Just typing away and its like a key 
sticks. It keeps printing the same key, even if I use the mouse to 
change focus the typing follows the focus, and then it finally hangs.


Jun 14 13:07:40 swdev14 kernel: BUG: soft lockup detected on CPU#1!
Jun 14 13:07:40 swdev14 kernel:
Jun 14 13:07:40 swdev14 kernel: Pid: 13, comm:      softirq-timer/1
Jun 14 13:07:40 swdev14 kernel: EIP: 0060:[<c02c5608>] CPU: 1
Jun 14 13:07:40 swdev14 kernel: EIP is at _raw_spin_lock+0x69/0x85
Jun 14 13:07:40 swdev14 kernel:  EFLAGS: 00000202    Not tainted 
(2.6.12-rc6-RT-V0.7.48-32)
Jun 14 13:07:40 swdev14 kernel: EAX: 00000001 EBX: c141f804 ECX: 
c02c55ba EDX: 00000000
Jun 14 13:07:40 swdev14 kernel: ESI: c1560000 EDI: c0727520 EBP: 
c1561e2c DS: 007b ES: 007b
Jun 14 13:07:40 swdev14 kernel: CR0: 8005003b CR2: b7fe0000 CR3: 
1ff55000 CR4: 000006d0
Jun 14 13:07:40 swdev14 kernel:  [<c01014d2>] show_regs+0x14b/0x175 (36)
Jun 14 13:07:40 swdev14 kernel:  [<c01436b2>] softlockup_tick+0x75/0x86 (28)
Jun 14 13:07:40 swdev14 kernel:  [<c010815c>] timer_interrupt+0x39/0x9e (20)
Jun 14 13:07:40 swdev14 kernel:  [<c0143981>] handle_IRQ_event+0x6a/0xe4 
(52)
Jun 14 13:07:40 swdev14 kernel:  [<c0143b03>] __do_IRQ+0xec/0x159 (52)
Jun 14 13:07:40 swdev14 kernel:  [<c01059fa>] do_IRQ+0x3a/0x4b (28)
Jun 14 13:07:40 swdev14 kernel:  [<c0103d26>] common_interrupt+0x1a/0x20 
(72)
Jun 14 13:07:40 swdev14 kernel:  [<c0127a17>] __mod_timer+0xaa/0x17c (44)
Jun 14 13:07:40 swdev14 kernel:  [<c020d302>] i8042_interrupt+0x26/0x241 
(56)
Jun 14 13:07:40 swdev14 kernel:  [<c0143981>] handle_IRQ_event+0x6a/0xe4 
(52)
Jun 14 13:07:40 swdev14 kernel:  [<c0143b03>] __do_IRQ+0xec/0x159 (52)
Jun 14 13:07:40 swdev14 kernel:  [<c01059fa>] do_IRQ+0x3a/0x4b (28)
Jun 14 13:07:40 swdev14 kernel:  [<c0103d26>] common_interrupt+0x1a/0x20 
(64)
Jun 14 13:07:40 swdev14 kernel:  [<c0128562>] 
run_timer_softirq+0x25c/0x404 (64)
Jun 14 13:07:40 swdev14 kernel:  [<c01245b2>] ksoftirqd+0xe9/0x19d (32)
Jun 14 13:07:40 swdev14 kernel:  [<c013416b>] kthread+0xab/0xd3 (48)
Jun 14 13:07:40 swdev14 kernel:  [<c0101501>] 
kernel_thread_helper+0x5/0xb (1051320348)
Jun 14 13:07:40 swdev14 kernel: ---------------------------
Jun 14 13:07:40 swdev14 kernel: | preempt count: 20020005 ]
Jun 14 13:07:40 swdev14 kernel: | 5-level deep critical section nesting:
Jun 14 13:07:40 swdev14 kernel: ----------------------------------------
Jun 14 13:07:40 swdev14 kernel: .. [<c02c55ba>] .... 
_raw_spin_lock+0x1b/0x85
Jun 14 13:07:40 swdev14 kernel: .....[<c012841e>] ..   ( <= 
run_timer_softirq+0x118/0x404)
Jun 14 13:07:40 swdev14 kernel: .. [<c02c55ba>] .... 
_raw_spin_lock+0x1b/0x85
Jun 14 13:07:40 swdev14 kernel: .....[<c01279b1>] ..   ( <= 
__mod_timer+0x44/0x17c)
Jun 14 13:07:40 swdev14 kernel: .. [<c02c55ba>] .... 
_raw_spin_lock+0x1b/0x85
Jun 14 13:07:40 swdev14 kernel: .....[<c010813c>] ..   ( <= 
timer_interrupt+0x19/0x9e)
Jun 14 13:07:40 swdev14 kernel: .. [<c02c55ba>] .... 
_raw_spin_lock+0x1b/0x85
Jun 14 13:07:40 swdev14 kernel: .....[<c0143697>] ..   ( <= 
softlockup_tick+0x5a/0x86)
Jun 14 13:07:40 swdev14 kernel: .. [<c013d423>] .... print_traces+0x1b/0x52
Jun 14 13:07:40 swdev14 kernel: .....[<c01014d2>] ..   ( <= 
show_regs+0x14b/0x175)

-- 
    kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-14 18:24 ` K.R. Foley
@ 2005-06-14 18:54   ` Ingo Molnar
  2005-06-14 22:45     ` Daniel Walker
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-14 18:54 UTC (permalink / raw)
  To: K.R. Foley; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* K.R. Foley <kr@cybsft.com> wrote:

> Ingo Molnar wrote:
> >i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
> >downloaded from the usual place:
> 
> Ingo,
> 
> I just got this soft lock with -RT-2.6.12-rc6-V0.7.48-32 on my dual 
> 2.6G Xeon W/HT. Not sure what causes it. Just typing away and its like 
> a key sticks. It keeps printing the same key, even if I use the mouse 
> to change focus the typing follows the focus, and then it finally 
> hangs.

ah ... accidentaly had debug_direct_keyboard = 1 in kernel/irq/handle.c.  
Change it to 0 & recompile, or pick up the -48-33 patch i just uploaded.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
                   ` (7 preceding siblings ...)
  2005-06-14 18:24 ` K.R. Foley
@ 2005-06-14 20:37 ` Paul E. McKenney
  2005-06-16  3:51 ` K.R. Foley
  9 siblings, 0 replies; 139+ messages in thread
From: Paul E. McKenney @ 2005-06-14 20:37 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

On Wed, Jun 08, 2005 at 01:28:01PM +0200, Ingo Molnar wrote:
> 
> i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
> downloaded from the usual place:

FYI, -V0.7.48-25 runs a round of kernbench and LTP on a 4-CPU x86 box.

						Thanx, Paul

>     http://redhat.com/~mingo/realtime-preempt/
> 
> this release includes an improved version of Daniel Walker's soft 
> irq-flag (hardirq-disable removal) feature. It is an unconditional part
> of the PREEMPT_RT preemption model - other preemption models should not
> be affected that much (besides possible build issues). Non-x86 arches
> wont build. Some regressions might happen, so take care..
> 
> Changes since -47-29:
> 
>  - soft IRQ flag support (Daniel Walker)
> 
>  - fix race in usbnet.c (Eugeny S. Mints)
> 
>  - further improvements to the soft IRQ flag code
> 
> to build a -V0.7.48-00 tree, the following patches should to be applied:
> 
>    http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.11.tar.bz2
>    http://kernel.org/pub/linux/kernel/v2.6/testing/patch-2.6.12-rc6.bz2
>    http://redhat.com/~mingo/realtime-preempt/realtime-preempt-2.6.12-rc6-V0.7.48-00
> 
> 	Ingo
> -
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
> 
> 

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-14 18:54   ` Ingo Molnar
@ 2005-06-14 22:45     ` Daniel Walker
  2005-06-15  6:12       ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Daniel Walker @ 2005-06-14 22:45 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints

On Tue, 2005-06-14 at 20:54 +0200, Ingo Molnar wrote:
> * K.R. Foley <kr@cybsft.com> wrote:
> 
> > Ingo Molnar wrote:
> > >i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
> > >downloaded from the usual place:
> > 
> > Ingo,
> > 
> > I just got this soft lock with -RT-2.6.12-rc6-V0.7.48-32 on my dual 
> > 2.6G Xeon W/HT. Not sure what causes it. Just typing away and its like 
> > a key sticks. It keeps printing the same key, even if I use the mouse 
> > to change focus the typing follows the focus, and then it finally 
> > hangs.
> 
> ah ... accidentaly had debug_direct_keyboard = 1 in kernel/irq/handle.c.  
> Change it to 0 & recompile, or pick up the -48-33 patch i just uploaded.

I think your putting to many raw_local_irq_disable calls back in .. Are
you planning to do an audit at some point ?

Daniel




^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-14 22:45     ` Daniel Walker
@ 2005-06-15  6:12       ` Ingo Molnar
  2005-06-15  9:13         ` Esben Nielsen
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-15  6:12 UTC (permalink / raw)
  To: Daniel Walker; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints


* Daniel Walker <dwalker@mvista.com> wrote:

> > ah ... accidentaly had debug_direct_keyboard = 1 in kernel/irq/handle.c.  
> > Change it to 0 & recompile, or pick up the -48-33 patch i just uploaded.
> 
> I think your putting to many raw_local_irq_disable calls back in .. 
> Are you planning to do an audit at some point ?

correctness comes first. The softirq code needs to use the raw irq flag, 
because direct interrupts (the timer irq) may modify 
local_softirq_pending().

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-15  6:12       ` Ingo Molnar
@ 2005-06-15  9:13         ` Esben Nielsen
  0 siblings, 0 replies; 139+ messages in thread
From: Esben Nielsen @ 2005-06-15  9:13 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Daniel Walker, K.R. Foley, linux-kernel, Eugeny S. Mints

[-- Attachment #1: Type: TEXT/PLAIN, Size: 2136 bytes --]

I have made a patch renaming 
 local_irq_disable() 
to 
 rt_preempt_irq_disable()

local_irq_disable() is a macro for rt_preempt_irq_disable() (see below).

I think the latter name is tells you more when considering both PREEMPT_RT
and !PREEMPT_RT
In PREEMPT_RT: It disables preemption and threaded irq handlers.
In !PREEMPT_RT: it disables irqs and preemption and it has something to do
with RT_PREEMPT, so keep your hands off!

Furthermore I have made an option to make all local_irq_disable() stop
compiling (CONFIG_NO_LOCAL_IRQ_DISABLE). local_irq_disable() removes
preemption. We don't want that in PREEMPT_RT. All places where it is used
it ought to be reviewed wrt. RT. When that is done we can replace them
with rt_preempt_irq_disable() or better: a lock. When I get time I'll try
to make a lock type which is spinlock_t in PREEMPT_RT but a local cpu lock
with no spin in !PREEMPT_RT.

I also started on a small document Documentation/rt-locking.txt - you are
welcome to skip it. It is certainly not the best document ever written but
I think someone ought to write some short documentation of the new
locking structure and how people wanting to have PREEMPT_RT and people
only caring about !PREEMPT_RT should behave and still be live in the same
code-tree without being of too much anoyance to each other.

Esben

On Wed, 15 Jun 2005, Ingo Molnar wrote:

> 
> * Daniel Walker <dwalker@mvista.com> wrote:
> 
> > > ah ... accidentaly had debug_direct_keyboard = 1 in kernel/irq/handle.c.  
> > > Change it to 0 & recompile, or pick up the -48-33 patch i just uploaded.
> > 
> > I think your putting to many raw_local_irq_disable calls back in .. 
> > Are you planning to do an audit at some point ?
> 
> correctness comes first. The softirq code needs to use the raw irq flag, 
> because direct interrupts (the timer irq) may modify 
> local_softirq_pending().
> 
> 	Ingo
> -
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
> 

[-- Attachment #2: Type: TEXT/PLAIN, Size: 13171 bytes --]

diff -Naur -X diff_exclude linux-2.6.12-rc6-V0.7.48-25/Documentation/rt-locking.txt linux-2.6.12-rc6-V0.7.48-25.new/Documentation/rt-locking.txt
--- linux-2.6.12-rc6-V0.7.48-25/Documentation/rt-locking.txt	1970-01-01 01:00:00.000000000 +0100
+++ linux-2.6.12-rc6-V0.7.48-25.new/Documentation/rt-locking.txt	2005-06-15 00:34:24.000000000 +0200
@@ -0,0 +1,81 @@
+		      About locks in PREEMPT_RT mode
+
+                     Esben Nielsen <simlo@phys.au.dk>
+
+			     14 Juny 2005
+
+The goal of PREEMPT_RT option is to make Linux into a determnistic RT system.
+I.e. worst case the latency of any only depends on the tasks running at higher
+priority and hard irqs (see below). If the task, waiting for some external 
+event, has the highest priority, the task should be running within a 
+deterministic amount of time after the external event has happened. That amount
+of time depends on the hardware, the irq handler delivering the event but 
+nothing else.
+
+To obtain this the following has been done:
+
+1) All normal Linux interrupt handlers (hard and soft) run in threads. You can
+add non-threaded interrupt handlers but we then assume you are familiar with
+real-time programming and know the rules.
+
+2) A lot of locks and irq-macros have been redefined to make a lot sections
+in the kernel preemptible. New ones have also been introduced. The new
+locks translates into some old well known lock for !PREEMPT_RT. The following
+table says which translation is going on.
+
+
+!PREEMPT_RT                           | PREEMPT_RT
+------------------------------------------------------------------------------
+spinlock_t                            | semaphore
+   Disable interrupts locally  and    |   Fully preemptible mutex with priority
+   spins.                             |   inheritance.
+                                      |
+rwlock_t                              | rwlock_t
+   Like spinlock_t but allows many    |   Fully preemptible mutex. Can be used
+   readers.                           |   recursively. Only 1 reader.
+                                      |
+local_irq_XX                          | rt_preempt_irq_XX
+   Disable interrupts locally.        |   Disables preemption locally. Thus
+                                      |   also disables all normal Linux irq
+                                      |   handlers, which are threaded.
+                                      |
+raw_spinlock                          | raw_spinlock
+   Same as spinlock.                  |  Same as spinlock for !PREEMPT_RT
+                                      |
+raw_local_irq_XX                      | raw_local_irq_XX
+   Same as local_irq_XX.              |   Same as local_irq_XX for !PREEMPT_RT
+
+raw_X translates to X when !PREEMPT_RT.
+
+Rules for use:
+If you do only code under !PREEMPT_RT and do not care about real-time don't use
+ raw_*
+ rt_preempt_*
+If you want change code protected with these kind of locks: Change them to the
+corresponding !PREEMPT_RT locks before submitting a patch. People carring
+about real-time will prefer this breakage over getting a system not being 
+real-time.
+Use the usual locks as you have always done.
+
+If you want to make stuff under PREEMPT_RT:
+Use rt_preempt_irq_* and raw_* with ONLY around code sections which are
+1) Deterministic in execution time. I.e. no algoritms being O(N), N not a 
+constant.
+2) Execution time must be in the order of schedule() or less.
+
+Otherwise use the non-raw versions. Or even better: use a mutex (which by 
+tradition is called semaphore although I find that highly missleading!). Even 
+!PREEMPT_RT it wont be nice to use a spinlock, but you have to do it if you 
+share data with an interrupt handler.
+
+If you want to make non-thread irq-handlers you must use raw_local_irq_XX
+to protect data shared with threads. raw_spin_lock does _not_ protect data
+as it only turns off preemption!!
+
+
+
+
+
+
+
+
diff -Naur -X diff_exclude linux-2.6.12-rc6-V0.7.48-25/arch/i386/kernel/entry.S linux-2.6.12-rc6-V0.7.48-25.new/arch/i386/kernel/entry.S
--- linux-2.6.12-rc6-V0.7.48-25/arch/i386/kernel/entry.S	2005-06-13 22:56:34.000000000 +0200
+++ linux-2.6.12-rc6-V0.7.48-25.new/arch/i386/kernel/entry.S	2005-06-14 23:53:31.000000000 +0200
@@ -332,7 +332,7 @@
 	cli
 	call __schedule
 #ifdef CONFIG_PREEMPT_RT
-	call local_irq_enable_noresched
+	call rt_preempt_irq_enable_noresched
 #endif
 					# make sure we don't miss an interrupt
 					# setting need_resched or sigpending
diff -Naur -X diff_exclude linux-2.6.12-rc6-V0.7.48-25/arch/i386/kernel/process.c linux-2.6.12-rc6-V0.7.48-25.new/arch/i386/kernel/process.c
--- linux-2.6.12-rc6-V0.7.48-25/arch/i386/kernel/process.c	2005-06-13 22:56:34.000000000 +0200
+++ linux-2.6.12-rc6-V0.7.48-25.new/arch/i386/kernel/process.c	2005-06-15 00:42:34.000000000 +0200
@@ -211,7 +211,8 @@
  */
 static void mwait_idle(void)
 {
-	local_irq_enable();
+	rt_preempt_irq_enable(); /* Safe wrt. RT because the need_resched() is 
+				    polled below */
 
 	if (!need_resched() && !need_resched_delayed()) {
 		set_thread_flag(TIF_POLLING_NRFLAG);
diff -Naur -X diff_exclude linux-2.6.12-rc6-V0.7.48-25/include/linux/interrupt.h linux-2.6.12-rc6-V0.7.48-25.new/include/linux/interrupt.h
--- linux-2.6.12-rc6-V0.7.48-25/include/linux/interrupt.h	2005-06-13 22:56:35.000000000 +0200
+++ linux-2.6.12-rc6-V0.7.48-25.new/include/linux/interrupt.h	2005-06-15 00:40:23.000000000 +0200
@@ -61,6 +61,7 @@
  * Temporary defines for UP kernels, until all code gets fixed.
  */
 #ifndef CONFIG_SMP
+#ifndef CONFIG_NO_LOCAL_IRQ_DISABLE
 static inline void __deprecated cli(void)
 {
 	local_irq_disable();
@@ -84,6 +85,7 @@
 	local_irq_save(*x);
 }
 #define save_and_cli(x)	save_and_cli(&x)
+#endif /* CONFIG_NO_LOCAL_IRQ_DISABLE */
 #endif /* CONFIG_SMP */
 
 #ifdef CONFIG_PREEMPT_RT
diff -Naur -X diff_exclude linux-2.6.12-rc6-V0.7.48-25/include/linux/rt_irq.h linux-2.6.12-rc6-V0.7.48-25.new/include/linux/rt_irq.h
--- linux-2.6.12-rc6-V0.7.48-25/include/linux/rt_irq.h	2005-06-13 22:56:35.000000000 +0200
+++ linux-2.6.12-rc6-V0.7.48-25.new/include/linux/rt_irq.h	2005-06-15 09:46:01.000000000 +0200
@@ -6,17 +6,34 @@
  */
 #ifdef CONFIG_PREEMPT_RT
 
-extern void local_irq_enable(void);
-extern void local_irq_enable_noresched(void);
-extern void local_irq_disable(void);
-extern void local_irq_restore(unsigned long flags);
-extern void __local_save_flags(unsigned long *flags);
-extern void __local_irq_save(unsigned long *flags);
+
+extern void rt_preempt_irq_enable(void);
+extern void rt_preempt_irq_enable_noresched(void);
+extern void rt_preempt_irq_disable(void);
+extern void rt_preempt_irq_restore(unsigned long flags);
+extern void __rt_preempt_save_flags(unsigned long *flags);
+extern void __rt_preempt_irq_save(unsigned long *flags);
 extern int irqs_disabled(void);
 extern int irqs_disabled_flags(unsigned long flags);
 
-# define local_save_flags(flags)	__local_save_flags(&(flags))
-# define local_irq_save(flags)		__local_irq_save(&(flags))
+# define rt_preempt_save_flags(flags)	__rt_preempt_save_flags(&(flags))
+# define rt_preempt_irq_save(flags)	__rt_preempt_irq_save(&(flags))
+
+#ifdef CONFIG_NO_LOCAL_IRQ_DISABLE
+#define local_irq_enable()           local_irq_not_allowed()
+#define local_irq_disable()          local_irq_not_allowed()
+#define local_irq_restore(flags)     local_irq_not_allowed()
+#define local_irq_save(flags)        local_irq_not_allowed()
+#define local_irq_enable_noresched() local_irq_not_allowed()
+#else /* CONFIG_NO_LOCAL_IRQ_DISABLE */
+#define local_irq_enable()           rt_preempt_irq_enable()
+#define local_irq_enable_noresched() rt_preempt_irq_enable_noresched()
+#define local_irq_disable()          rt_preempt_irq_disable()
+#define local_irq_restore(flags)     rt_preempt_irq_restore(flags)
+#define local_irq_save(flags)        rt_preempt_irq_save(flags)
+#define local_save_flags(flags)      rt_preempt_save_flags(flags)
+#endif /* CONFIG_NO_LOCAL_IRQ_DISABLE */
+
 
 /* soft state does not follow the hard state */
 # define raw_local_save_flags(flags)	__raw_local_save_flags(flags)
@@ -25,7 +42,7 @@
 # define raw_local_irq_save(flags)	__raw_local_irq_save(flags)
 # define raw_local_irq_restore(flags)	__raw_local_irq_restore(flags)
 # define raw_safe_halt()		__raw_safe_halt()
-#else
+#else /* CONFIG_PREEMPT_RT */
 # define raw_local_save_flags		__raw_local_save_flags
 # define raw_local_irq_enable		__raw_local_irq_enable
 # define raw_local_irq_disable		__raw_local_irq_disable
@@ -40,7 +57,14 @@
 # define local_irq_restore		__raw_local_irq_restore
 # define irqs_disabled			__raw_irqs_disabled
 # define irqs_disabled_flags		__raw_irqs_disabled_flags
-#endif
+
+# define rt_preempt_irq_enable()           local_irq_enable()           
+# define rt_preempt_irq_enable_noresched() local_irq_enable_noresched() 
+# define rt_preempt_irq_disable()          local_irq_disable()          
+# define rt_preempt_irq_restore(flags)     local_irq_restore(flags)     
+# define rt_preempt_irq_save(flags)        local_irq_save(flags)        
+# define rt_preempt_save_flags(flags)      local_save_flags(flags)      
+#endif /* CONFIG_PREEMPT_RT */
 
 #define raw_irqs_disabled		__raw_irqs_disabled
 #define raw_irqs_disabled_flags		__raw_irqs_disabled_flags
diff -Naur -X diff_exclude linux-2.6.12-rc6-V0.7.48-25/init/main.c linux-2.6.12-rc6-V0.7.48-25.new/init/main.c
--- linux-2.6.12-rc6-V0.7.48-25/init/main.c	2005-06-13 22:56:33.000000000 +0200
+++ linux-2.6.12-rc6-V0.7.48-25.new/init/main.c	2005-06-15 00:40:45.000000000 +0200
@@ -433,7 +433,7 @@
  	 * Force the soft IRQ state to mimic the hard state until
 	 * we finish boot-up.
 	 */
-	local_irq_disable();
+	rt_preempt_irq_disable();
 #endif
 
 /*
@@ -468,7 +468,7 @@
 	/*
 	 * Reset the irqs off flag after sched_init resets the preempt_count.
 	 */
-	local_irq_disable();
+	rt_preempt_irq_disable();
 #endif
 
 	build_all_zonelists();
@@ -589,7 +589,7 @@
 		}
 		if (irqs_disabled()) {
 			msg = "disabled interrupts";
-			local_irq_enable();
+			rt_preempt_irq_enable();
 		}
 #ifdef CONFIG_PREEMPT_RT
 		if (raw_irqs_disabled()) {
diff -Naur -X diff_exclude linux-2.6.12-rc6-V0.7.48-25/kernel/rt.c linux-2.6.12-rc6-V0.7.48-25.new/kernel/rt.c
--- linux-2.6.12-rc6-V0.7.48-25/kernel/rt.c	2005-06-13 22:56:33.000000000 +0200
+++ linux-2.6.12-rc6-V0.7.48-25.new/kernel/rt.c	2005-06-15 00:23:29.000000000 +0200
@@ -2020,24 +2020,24 @@
 }
 #endif
 
-void local_irq_enable_noresched(void)
+void rt_preempt_irq_enable_noresched(void)
 {
 	unmask_preempt_count(IRQSOFF_MASK);
 }
-EXPORT_SYMBOL(local_irq_enable_noresched);
+EXPORT_SYMBOL(rt_preempt_irq_enable_noresched);
 
-void local_irq_enable(void)
+void rt_preempt_irq_enable(void)
 {
 	unmask_preempt_count(IRQSOFF_MASK);
 	preempt_check_resched();
 }
-EXPORT_SYMBOL(local_irq_enable);
+EXPORT_SYMBOL(rt_preempt_irq_enable);
 
-void local_irq_disable(void)
+void rt_preempt_irq_disable(void)
 {
 	mask_preempt_count(IRQSOFF_MASK);
 }
-EXPORT_SYMBOL(local_irq_disable);
+EXPORT_SYMBOL(rt_preempt_irq_disable);
 
 int irqs_disabled_flags(unsigned long flags)
 {
@@ -2047,20 +2047,20 @@
 }
 EXPORT_SYMBOL(irqs_disabled_flags);
 
-void __local_save_flags(unsigned long *flags)
+void __rt_preempt_save_flags(unsigned long *flags)
 {
 	*flags = irqs_off();
 }
-EXPORT_SYMBOL(__local_save_flags);
+EXPORT_SYMBOL(__rt_preempt_save_flags);
 
-void __local_irq_save(unsigned long *flags)
+void __rt_preempt_irq_save(unsigned long *flags)
 {
 	*flags = irqs_off();
 	mask_preempt_count(IRQSOFF_MASK);
 }
-EXPORT_SYMBOL(__local_irq_save);
+EXPORT_SYMBOL(__rt_preempt_irq_save);
 
-void local_irq_restore(unsigned long flags)
+void rt_preempt_irq_restore(unsigned long flags)
 {
 	check_soft_flags(flags);
 	if (flags)
@@ -2070,7 +2070,7 @@
 		preempt_check_resched();
 	}
 }
-EXPORT_SYMBOL(local_irq_restore);
+EXPORT_SYMBOL(rt_preempt_irq_restore);
 
 int irqs_disabled(void)
 {
diff -Naur -X diff_exclude linux-2.6.12-rc6-V0.7.48-25/lib/Kconfig.RT linux-2.6.12-rc6-V0.7.48-25.new/lib/Kconfig.RT
--- linux-2.6.12-rc6-V0.7.48-25/lib/Kconfig.RT	2005-06-13 22:56:35.000000000 +0200
+++ linux-2.6.12-rc6-V0.7.48-25.new/lib/Kconfig.RT	2005-06-15 00:35:35.000000000 +0200
@@ -81,6 +81,20 @@
 
 endchoice
 
+config NO_LOCAL_IRQ_DISABLE
+	bool '  Compile no code with local_irq_disable()'
+	depends on PREEMPT_RT
+	default n
+	help
+	  This will make any code containing local_irq_disable() and similar
+          stop compiling under PREEMPT_RT. These functions are dangerous to
+          the RT behaviour but otherwise ok. This option prevents code using
+          these functions from being compiled for your kernel.
+          Look at Documentation/rt-locking.txt.
+          Say N here.
+
+
+
 config PREEMPT
 	bool
 	default y
@@ -150,3 +164,4 @@
 	depends on PREEMPT_RT || !SPINLOCK_BKL
 	default n if !PREEMPT
 	default y
+

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
                   ` (8 preceding siblings ...)
  2005-06-14 20:37 ` Paul E. McKenney
@ 2005-06-16  3:51 ` K.R. Foley
  2005-06-16  7:29   ` Ingo Molnar
  9 siblings, 1 reply; 139+ messages in thread
From: K.R. Foley @ 2005-06-16  3:51 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 1262 bytes --]

Ingo Molnar wrote:
> i have released the -V0.7.48-00 Real-Time Preemption patch, which can be 
> downloaded from the usual place:
> 
>     http://redhat.com/~mingo/realtime-preempt/
> 
> this release includes an improved version of Daniel Walker's soft 
> irq-flag (hardirq-disable removal) feature. It is an unconditional part
> of the PREEMPT_RT preemption model - other preemption models should not
> be affected that much (besides possible build issues). Non-x86 arches
> wont build. Some regressions might happen, so take care..
> 
> Changes since -47-29:
> 
>  - soft IRQ flag support (Daniel Walker)
> 
>  - fix race in usbnet.c (Eugeny S. Mints)
> 
>  - further improvements to the soft IRQ flag code
> 
> to build a -V0.7.48-00 tree, the following patches should to be applied:
> 
>    http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.11.tar.bz2
>    http://kernel.org/pub/linux/kernel/v2.6/testing/patch-2.6.12-rc6.bz2
>    http://redhat.com/~mingo/realtime-preempt/realtime-preempt-2.6.12-rc6-V0.7.48-00
> 
> 	Ingo

Ingo,

Having problems with -RT-2.6.12-rc6-V0.7.48-33 booting on my older SMP
system (dual 933). Looking at the log apic.log it indicates a problem
with APIC. noapic.log is a log when I add "noapic" to the boot parameters.

-- 
   kr

[-- Attachment #2: apic.log --]
[-- Type: text/plain, Size: 8978 bytes --]

Linux version 2.6.12-rc6-RT-V0.7.48-33 (kr@porky.cybersoft.int) (gcc version 3.4.3 20050227 (Red Hat 3.4.3-22.fc3)) #5 SMP Wed Jun 15 06:25:04 CDT 2005
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
 BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 000000001ff9e000 (usable)
 BIOS-e820: 000000001ff9e000 - 0000000020000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
 BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
511MB LOWMEM available.
found SMP MP-table at 000fe710
DMI 2.3 present.
Intel MultiProcessor Specification v1.4
    Virtual Wire compatibility mode.
OEM ID: DELL     Product ID: WS 620       APIC at: 0xFEE00000
Processor #0 6:8 APIC version 17
Processor #1 6:8 APIC version 17
I/O APIC #2 Version 32 at 0xFEC00000.
Enabling APIC mode:  Flat.  Using 1 I/O APICs
Processors: 2
Allocating PCI resources starting at 20000000 (gap: 20000000:dec00000)
Real-Time Preemption Support (c) Ingo Molnar
Built 1 zonelists
Kernel command line: ro root=LABEL=/ console=ttyS0,38400 console=tty0 nmi_watchdog=1 
Initializing CPU#0
PID hash table entries: 2048 (order: 11, 32768 bytes)
Detected 931.130 MHz processor.
Using tsc for high-res timesource
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 513760k/523896k available (2221k kernel code, 9752k reserved, 1222k data, 232k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Security Framework v1.0.0 initialized
Capability LSM initialized
Mount-cache hash table entries: 512
CPU: L1 I cache: 16K, L1 D cache: 16K
CPU: L2 cache: 256K
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... OK.
CPU0: Intel Pentium III (Coppermine) stepping 06
Booting processor 1/1 eip 2000
Initializing CPU#1
CPU: L1 I cache: 16K, L1 D cache: 16K
CPU: L2 cache: 256K
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel Pentium III (Coppermine) stepping 06
Total of 2 processors activated (3715.07 BogoMIPS).
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 pin1=2 pin2=0
checking TSC synchronization across 2 CPUs: passed.
spawn_desched_task(00000000)
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
desched cpu_callback 3/00000000
desched cpu_callback 2/00000000
desched thread 0 started up.
softlockup thread 0 started up.
desched cpu_callback 3/00000001
ksoftirqd started up.
desched cpu_callback 2/00000001
Brought up 2 CPUs
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
checking if image is initramfs... it is
Freeing initrd memory: 295k freed
softirq RT prio: 24.
ksoftirqd started up.
ksoftirqd started up.
softirq RT prio: 24.
desched thread 1 started up.
softlockup thread 1 started up.
NET: Registered protocol family 16
PCI: PCI BIOS revision 2.10 entry at 0xfc03e, last bus=4
PCI: Using configuration type 1
mtrr: v2.0 (20020519)
softirq RT prio: 24.
Linux Plug and Play Support v0.97 (c) Adam Belay
SCSI subsystem initialized
PCI: Probing PCI hardware
PCI: Probing PCI hardware (bus 00)
PCI: Transparent bridge - 0000:00:1e.0
PCI: Using IRQ router PIIX/ICH [8086/2410] at 0000:00:1f.0
PCI->APIC IRQ transform: 0000:00:1f.2[D] -> IRQ 19
PCI->APIC IRQ transform: 0000:00:1f.3[B] -> IRQ 17
PCI->APIC IRQ transform: 0000:01:00.0[A] -> IRQ 16
PCI->APIC IRQ transform: 0000:04:04.0[A] -> IRQ 16
PCI->APIC IRQ transform: 0000:04:05.0[A] -> IRQ 17
PCI->APIC IRQ transform: 0000:04:05.1[B] -> IRQ 18
PCI->APIC IRQ transform: 0000:04:0a.0[A] -> IRQ 18
PCI: Failed to allocate mem resource #0:1000@0 for 0000:03:00.0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Initializing Cryptographic API
nvidiafb: nVidia device/chipset 10DE0103
nvidiafb: nVidia Corporation NV10GL [Quadro]
nvidiafb: HW is currently programmed for CRT
nvidiafb: Using CRT on CRTC 0
nvidiafb: MTRR set to ON
nvidiafb: PCI nVidia NV10 framebuffer (64MB @ 0xE8000000)
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Real Time Clock Driver v1.12
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 8 ports, IRQ sharing disabled
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 8192K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
ICH: IDE controller at PCI slot 0000:00:1f.1
ICH: chipset revision 2
ICH: not 100% native mode: will probe irqs later
    ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:DMA, hdb:pio
    ide1: BM-DMA at 0xffa8-0xffaf, BIOS settings: hdc:DMA, hdd:pio
hda: SAMSUNG CD-R/RW SW-248F, ATAPI CD/DVD-ROM drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
hdc: Lite-On LTN483S 48x Max, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
scsi0 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
        <Adaptec aic7899 Ultra160 SCSI adapter>
        aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs

  Vendor: QUANTUM   Model: ATLAS10K2-TY092L  Rev: DA40
  Type:   Direct-Access                      ANSI SCSI revision: 03
scsi0:A:0:0: Tagged Queuing enabled.  Depth 32
 target0:0:0: Beginning Domain Validation
WIDTH IS 1
(scsi0:A:0): 6.600MB/s transfers (16bit)
(scsi0:A:0): 160.000MB/s transfers (80.000MHz DT, offset 127, 16bit)
 target0:0:0: Ending Domain Validation
scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
        <Adaptec aic7899 Ultra160 SCSI adapter>
        aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs

  Vendor: SEAGATE   Model: SX118273LC        Rev: 6679
  Type:   Direct-Access                      ANSI SCSI revision: 02
scsi1:A:0:0: Tagged Queuing enabled.  Depth 32
 target1:0:0: Beginning Domain Validation
 target1:0:0: Domain Validation skipping write tests
(scsi1:A:0): 20.000MB/s transfers (20.000MHz, offset 15)
 target1:0:0: Ending Domain Validation
SCSI device sda: 17783239 512-byte hdwr sectors (9105 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 17783239 512-byte hdwr sectors (9105 MB)
SCSI device sda: drive cache: write back
 sda: sda1 sda2 sda3
Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
SCSI device sdb: 35566480 512-byte hdwr sectors (18210 MB)
SCSI device sdb: drive cache: write through
SCSI device sdb: 35566480 512-byte hdwr sectors (18210 MB)
SCSI device sdb: drive cache: write through
 sdb: sdb1
Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
Attached scsi generic sg0 at scsi0, channel 0, id 0, lun 0,  type 0
Attached scsi generic sg1 at scsi1, channel 0, id 0, lun 0,  type 0
mice: PS/2 mouse device common for all mice
md: md driver 0.90.1 MAX_MD_DEVS=256, MD_SB_DISKS=27
NET: Registered protocol family 2
IP: routing cache hash table of 256 buckets, 22Kbytes
TCP established hash table entries: 32768 (order: 9, 3145728 bytes)
TCP bind hash table entries: 32768 (order: 9, 2883584 bytes)
TCP: Hash tables configured (established 32768 bind 32768)
NET: Registered protocol family 1
NET: Registered protocol family 17
NET: Registered protocol family 8
NET: Registered protocol family 20
Testing NMI watchdog ... OK.
Starting balanced_irq
*****************************************************************************
*                                                                           *
*  WARNING, the following debugging options are turned on in your .config:  *
*                                                                           *
*        CONFIG_DEBUG_RT_LOCKING_MODE                                       *
*        CONFIG_RT_DEADLOCK_DETECT                                          *
*        CONFIG_DEBUG_PREEMPT                                               *
*                                                                           *
*  they may increase runtime overhead and latencies considerably!           *
*                                                                           *
*****************************************************************************
Freeing unused kernel memory: 232k freed
<<7>APIC error on CPU1: 08(08)

[-- Attachment #3: noapic.log --]
[-- Type: text/plain, Size: 25266 bytes --]

Linux version 2.6.12-rc6-RT-V0.7.48-33 (kr@porky.cybersoft.int) (gcc version 3.4.3 20050227 (Red Hat 3.4.3-22.fc3)) #5 SMP Wed Jun 15 06:25:04 CDT 2005
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
 BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 000000001ff9e000 (usable)
 BIOS-e820: 000000001ff9e000 - 0000000020000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
 BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
511MB LOWMEM available.
found SMP MP-table at 000fe710
DMI 2.3 present.
Intel MultiProcessor Specification v1.4
    Virtual Wire compatibility mode.
OEM ID: DELL     Product ID: WS 620       APIC at: 0xFEE00000
Processor #0 6:8 APIC version 17
Processor #1 6:8 APIC version 17
I/O APIC #2 Version 32 at 0xFEC00000.
Enabling APIC mode:  Flat.  Using 1 I/O APICs
Processors: 2
Allocating PCI resources starting at 20000000 (gap: 20000000:dec00000)
Real-Time Preemption Support (c) Ingo Molnar
Built 1 zonelists
Kernel command line: ro root=LABEL=/ console=ttyS0,38400 console=tty0 nmi_watchdog=1 noapic
Initializing CPU#0
PID hash table entries: 2048 (order: 11, 32768 bytes)
Detected 931.130 MHz processor.
Using tsc for high-res timesource
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 513760k/523896k available (2221k kernel code, 9752k reserved, 1222k data, 232k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Security Framework v1.0.0 initialized
Capability LSM initialized
Mount-cache hash table entries: 512
CPU: L1 I cache: 16K, L1 D cache: 16K
CPU: L2 cache: 256K
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... OK.
CPU0: Intel Pentium III (Coppermine) stepping 06
Booting processor 1/1 eip 2000
Initializing CPU#1
CPU: L1 I cache: 16K, L1 D cache: 16K
CPU: L2 cache: 256K
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel Pentium III (Coppermine) stepping 06
Total of 2 processors activated (3715.07 BogoMIPS).
checking TSC synchronization across 2 CPUs: passed.
spawn_desched_task(00000000)
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
desched cpu_callback 3/00000000
desched cpu_callback 2/00000000
desched thread 0 started up.
softlockup thread 0 started up.
desched cpu_callback 3/00000001
desched cpu_callback 2/00000001
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
Brought up 2 CPUs
desched thread 1 started up.
softlockup thread 1 started up.
checking if image is initramfs... it is
Freeing initrd memory: 295k freed
NET: Registered protocol family 16
PCI: PCI BIOS revision 2.10 entry at 0xfc03e, last bus=4
PCI: Using configuration type 1
mtrr: v2.0 (20020519)
Linux Plug and Play Support v0.97 (c) Adam Belay
SCSI subsystem initialized
PCI: Probing PCI hardware
PCI: Probing PCI hardware (bus 00)
PCI: Transparent bridge - 0000:00:1e.0
PCI: Using IRQ router PIIX/ICH [8086/2410] at 0000:00:1f.0
PCI: Failed to allocate mem resource #0:1000@0 for 0000:03:00.0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Initializing Cryptographic API
PCI: Found IRQ 9 for device 0000:01:00.0
PCI: Sharing IRQ 9 with 0000:04:04.0
nvidiafb: nVidia device/chipset 10DE0103
nvidiafb: nVidia Corporation NV10GL [Quadro]
nvidiafb: HW is currently programmed for CRT
nvidiafb: Using CRT on CRTC 0
nvidiafb: MTRR set to ON
nvidiafb: PCI nVidia NV10 framebuffer (64MB @ 0xE8000000)
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Real Time Clock Driver v1.12
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 8 ports, IRQ sharing disabled
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 8192K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
ICH: IDE controller at PCI slot 0000:00:1f.1
ICH: chipset revision 2
ICH: not 100% native mode: will probe irqs later
    ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:DMA, hdb:pio
    ide1: BM-DMA at 0xffa8-0xffaf, BIOS settings: hdc:DMA, hdd:pio
hda: SAMSUNG CD-R/RW SW-248F, ATAPI CD/DVD-ROM drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
hdc: Lite-On LTN483S 48x Max, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
PCI: Found IRQ 10 for device 0000:04:05.0
PCI: Sharing IRQ 10 with 0000:00:1f.3
PCI: Found IRQ 5 for device 0000:04:05.1
PCI: Sharing IRQ 5 with 0000:04:0a.0
scsi0 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
        <Adaptec aic7899 Ultra160 SCSI adapter>
        aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs

  Vendor: QUANTUM   Model: ATLAS10K2-TY092L  Rev: DA40
  Type:   Direct-Access                      ANSI SCSI revision: 03
scsi0:A:0:0: Tagged Queuing enabled.  Depth 32
 target0:0:0: Beginning Domain Validation
WIDTH IS 1
(scsi0:A:0): 6.600MB/s transfers (16bit)
(scsi0:A:0): 160.000MB/s transfers (80.000MHz DT, offset 127, 16bit)
 target0:0:0: Ending Domain Validation
scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
        <Adaptec aic7899 Ultra160 SCSI adapter>
        aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs

  Vendor: SEAGATE   Model: SX118273LC        Rev: 6679
  Type:   Direct-Access                      ANSI SCSI revision: 02
scsi1:A:0:0: Tagged Queuing enabled.  Depth 32
 target1:0:0: Beginning Domain Validation
 target1:0:0: Domain Validation skipping write tests
(scsi1:A:0): 20.000MB/s transfers (20.000MHz, offset 15)
 target1:0:0: Ending Domain Validation
SCSI device sda: 17783239 512-byte hdwr sectors (9105 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 17783239 512-byte hdwr sectors (9105 MB)
SCSI device sda: drive cache: write back
 sda: sda1 sda2 sda3
Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
SCSI device sdb: 35566480 512-byte hdwr sectors (18210 MB)
SCSI device sdb: drive cache: write through
SCSI device sdb: 35566480 512-byte hdwr sectors (18210 MB)
SCSI device sdb: drive cache: write through
 sdb: sdb1
Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
Attached scsi generic sg0 at scsi0, channel 0, id 0, lun 0,  type 0
Attached scsi generic sg1 at scsi1, channel 0, id 0, lun 0,  type 0
mice: PS/2 mouse device common for all mice
md: md driver 0.90.1 MAX_MD_DEVS=256, MD_SB_DISKS=27
NET: Registered protocol family 2
IP: routing cache hash table of 256 buckets, 22Kbytes
TCP established hash table entries: 32768 (order: 9, 3145728 bytes)
TCP bind hash table entries: 32768 (order: 9, 2883584 bytes)
TCP: Hash tables configured (established 32768 bind 32768)
NET: Registered protocol family 1
NET: Registered protocol family 17
NET: Registered protocol family 8
NET: Registered protocol family 20
Testing NMI watchdog ... OK.
Starting balanced_irq
*****************************************************************************
*                                                                           *
*  WARNING, the following debugging options are turned on in your .config:  *
*                                                                           *
*        CONFIG_DEBUG_RT_LOCKING_MODE                                       *
*        CONFIG_RT_DEADLOCK_DETECT                                          *
*        CONFIG_DEBUG_PREEMPT                                               *
*                                                                           *
*  they may increase runtime overhead and latencies considerably!           *
*                                                                           *
*****************************************************************************
Freeing unused kernel memory: 232k freed
input: AT Translated Set 2 keyboard on isa0060/serio0
input: ImPS/2 Generic Wheel Mouse on isa0060/serio1
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
------------[ cut here ]------------
kernel BUG at drivers/ide/ide-io.c:1109!
invalid operand: 0000 [#1]
PREEMPT SMP 
Modules linked in: ide_cd cdrom
CPU:    1
EIP:    0060:[<c025cf63>]    Not tainted VLI
EFLAGS: 00010282   (2.6.12-rc6-RT-V0.7.48-33) 
EIP is at ide_do_request+0x3a3/0x3d0
eax: 00000025   ebx: 00000000   ecx: 00000000   edx: 00000079
esi: df227d68   edi: 00000000   ebp: 00000001   esp: df227bf0
ds: 007b   es: 007b   ss: 0068   preempt: 00000002
Process modprobe (pid: 1342, threadinfo=df226000 task=de83e920)
Stack: c03388a8 c034c013 00000455 df227d68 00000000 df227d68 00000000 00000001 
       c025d691 dfd7e200 ffffffff 00000002 00000000 00000002 dfd7e200 00000001 
       00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 
Call Trace:
 [<c025d691>] ide_do_drive_cmd+0x121/0x190 (36)
 [<c0101940>] __switch_to+0x30/0x200 (116)
 [<e0839b8a>] cdrom_queue_packet_command+0x4a/0xd0 [ide_cd] (120)
 [<c0117490>] default_wake_function+0x0/0x30 (20)
 [<c012f195>] queue_work+0x55/0xa0 (12)
 [<c012f0b0>] call_usermodehelper+0x160/0x180 (28)
 [<e083b516>] ide_cdrom_packet+0xb6/0x100 [ide_cd] (36)
 [<c023a4e0>] blk_end_sync_rq+0x0/0x30 (152)
 [<e083be1b>] ide_cdrom_get_capabilities+0x9b/0xb0 [ide_cd] (36)
 [<e083bede>] ide_cdrom_probe_capabilities+0xae/0x4e0 [ide_cd] (92)
 [<e083c7bc>] ide_cdrom_setup+0x2ac/0x460 [ide_cd] (68)
 [<e083ceea>] ide_cd_probe+0x14a/0x2b0 [ide_cd] (32)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (28)
 [<c01e8010>] kobject_hotplug+0x2a0/0x2f0 (20)
 [<c01a9256>] sysfs_create_dir+0x36/0xa0 (20)
 [<c0232552>] driver_probe_device+0x32/0x80 (36)
 [<c02326b2>] driver_attach+0x52/0xa0 (20)
 [<c0232c37>] bus_add_driver+0x97/0xe0 (32)
 [<e083d05f>] ide_cdrom_init+0xf/0x20 [ide_cd] (32)
 [<c013ff97>] sys_init_module+0x157/0x240 (8)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (28)
---------------------------
| preempt count: 00000003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a3c9>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a459>] .... _raw_spin_lock_irqsave+0x19/0xa0
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b544>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

Code: 24 c7 40 08 00 00 00 00 e9 eb fe ff ff c7 04 24 a8 88 33 c0 b9 55 04 00 00 ba 13 c0 34 c0 89 4c 24 08 89 54 24 04 e8 7d 04 ec ff <0f> 0b 55 04 13 c0 34 c0 e9 64 fc ff ff c7 04 24 84 76 35 c0 e8 
 <6>note: modprobe[1342] exited with preempt_count 1
BUG: scheduling while atomic: modprobe/0x10000001/1342
caller is __cond_resched+0x42/0x60
 [<c032782b>] __schedule+0x52b/0x920 (8)
 [<c01183c2>] __cond_resched+0x42/0x60 (8)
 [<c015cbb6>] page_remove_rmap+0x36/0x90 (12)
 [<c01510e4>] mark_page_accessed+0x34/0x40 (12)
 [<c0155995>] zap_pte_range+0xe5/0x1e0 (8)
 [<c01514fd>] release_pages+0x14d/0x180 (12)
 [<c013b2a3>] add_preempt_count+0x23/0xe0 (4)
 [<c013b2a3>] add_preempt_count+0x23/0xe0 (8)
 [<c01183c2>] __cond_resched+0x42/0x60 (28)
 [<c032852c>] cond_resched+0x1c/0x30 (16)
 [<c0155cc2>] unmap_vmas+0x142/0x1b0 (8)
 [<c015abdb>] exit_mmap+0x5b/0x110 (64)
 [<c0104950>] do_invalid_op+0x0/0xb0 (48)
 [<c011a1db>] mmput+0x3b/0xb0 (8)
 [<c011ffe1>] do_exit+0xc1/0x420 (16)
 [<c0104950>] do_invalid_op+0x0/0xb0 (32)
 [<c01045bc>] die+0x18c/0x190 (8)
 [<c01049f6>] do_invalid_op+0xa6/0xb0 (60)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (76)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (4)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (20)
 [<c011d585>] vprintk+0x185/0x270 (28)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (20)
 [<c0101940>] __switch_to+0x30/0x200 (16)
 [<c0103d5f>] error_code+0x4f/0x54 (36)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (44)
 [<c025d691>] ide_do_drive_cmd+0x121/0x190 (44)
 [<c0101940>] __switch_to+0x30/0x200 (116)
 [<e0839b8a>] cdrom_queue_packet_command+0x4a/0xd0 [ide_cd] (120)
 [<c0117490>] default_wake_function+0x0/0x30 (20)
 [<c012f195>] queue_work+0x55/0xa0 (12)
 [<c012f0b0>] call_usermodehelper+0x160/0x180 (28)
 [<e083b516>] ide_cdrom_packet+0xb6/0x100 [ide_cd] (36)
 [<c023a4e0>] blk_end_sync_rq+0x0/0x30 (152)
 [<e083be1b>] ide_cdrom_get_capabilities+0x9b/0xb0 [ide_cd] (36)
 [<e083bede>] ide_cdrom_probe_capabilities+0xae/0x4e0 [ide_cd] (92)
 [<e083c7bc>] ide_cdrom_setup+0x2ac/0x460 [ide_cd] (68)
 [<e083ceea>] ide_cd_probe+0x14a/0x2b0 [ide_cd] (32)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (28)
 [<c01e8010>] kobject_hotplug+0x2a0/0x2f0 (20)
 [<c01a9256>] sysfs_create_dir+0x36/0xa0 (20)
 [<c0232552>] driver_probe_device+0x32/0x80 (36)
 [<c02326b2>] driver_attach+0x52/0xa0 (20)
 [<c0232c37>] bus_add_driver+0x97/0xe0 (32)
 [<e083d05f>] ide_cdrom_init+0xf/0x20 [ide_cd] (32)
 [<c013ff97>] sys_init_module+0x157/0x240 (8)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (28)
---------------------------
| preempt count: 10000002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a3c9>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b544>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: sleeping function called from invalid context modprobe(1342) at mm/mmap.c:186
in_atomic():1 [00000001], irqs_disabled():0
 [<c01199cb>] __might_sleep+0xdb/0x100 (8)
 [<c015891f>] remove_vm_struct+0x2f/0xb0 (36)
 [<c015ac4e>] exit_mmap+0xce/0x110 (32)
 [<c0104950>] do_invalid_op+0x0/0xb0 (48)
 [<c011a1db>] mmput+0x3b/0xb0 (8)
 [<c011ffe1>] do_exit+0xc1/0x420 (16)
 [<c0104950>] do_invalid_op+0x0/0xb0 (32)
 [<c01045bc>] die+0x18c/0x190 (8)
 [<c01049f6>] do_invalid_op+0xa6/0xb0 (60)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (76)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (4)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (20)
 [<c011d585>] vprintk+0x185/0x270 (28)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (20)
 [<c0101940>] __switch_to+0x30/0x200 (16)
 [<c0103d5f>] error_code+0x4f/0x54 (36)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (44)
 [<c025d691>] ide_do_drive_cmd+0x121/0x190 (44)
 [<c0101940>] __switch_to+0x30/0x200 (116)
 [<e0839b8a>] cdrom_queue_packet_command+0x4a/0xd0 [ide_cd] (120)
 [<c0117490>] default_wake_function+0x0/0x30 (20)
 [<c012f195>] queue_work+0x55/0xa0 (12)
 [<c012f0b0>] call_usermodehelper+0x160/0x180 (28)
 [<e083b516>] ide_cdrom_packet+0xb6/0x100 [ide_cd] (36)
 [<c023a4e0>] blk_end_sync_rq+0x0/0x30 (152)
 [<e083be1b>] ide_cdrom_get_capabilities+0x9b/0xb0 [ide_cd] (36)
 [<e083bede>] ide_cdrom_probe_capabilities+0xae/0x4e0 [ide_cd] (92)
 [<e083c7bc>] ide_cdrom_setup+0x2ac/0x460 [ide_cd] (68)
 [<e083ceea>] ide_cd_probe+0x14a/0x2b0 [ide_cd] (32)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (28)
 [<c01e8010>] kobject_hotplug+0x2a0/0x2f0 (20)
 [<c01a9256>] sysfs_create_dir+0x36/0xa0 (20)
 [<c0232552>] driver_probe_device+0x32/0x80 (36)
 [<c02326b2>] driver_attach+0x52/0xa0 (20)
 [<c0232c37>] bus_add_driver+0x97/0xe0 (32)
 [<e083d05f>] ide_cdrom_init+0xf/0x20 [ide_cd] (32)
 [<c013ff97>] sys_init_module+0x157/0x240 (8)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (28)
---------------------------
| preempt count: 00000002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a3c9>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b544>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: scheduling while atomic: modprobe/0x10000001/1342
caller is __cond_resched+0x42/0x60
 [<c032782b>] __schedule+0x52b/0x920 (8)
 [<c01183c2>] __cond_resched+0x42/0x60 (8)
 [<c013b2a3>] add_preempt_count+0x23/0xe0 (12)
 [<c013b2a3>] add_preempt_count+0x23/0xe0 (12)
 [<c013b2a3>] add_preempt_count+0x23/0xe0 (32)
 [<c01183c2>] __cond_resched+0x42/0x60 (28)
 [<c032852c>] cond_resched+0x1c/0x30 (16)
 [<c011f1af>] put_files_struct+0x6f/0xe0 (8)
 [<c0120016>] do_exit+0xf6/0x420 (28)
 [<c0104950>] do_invalid_op+0x0/0xb0 (32)
 [<c01045bc>] die+0x18c/0x190 (8)
 [<c01049f6>] do_invalid_op+0xa6/0xb0 (60)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (76)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (4)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (20)
 [<c011d585>] vprintk+0x185/0x270 (28)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (20)
 [<c0101940>] __switch_to+0x30/0x200 (16)
 [<c0103d5f>] error_code+0x4f/0x54 (36)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (44)
 [<c025d691>] ide_do_drive_cmd+0x121/0x190 (44)
 [<c0101940>] __switch_to+0x30/0x200 (116)
 [<e0839b8a>] cdrom_queue_packet_command+0x4a/0xd0 [ide_cd] (120)
 [<c0117490>] default_wake_function+0x0/0x30 (20)
 [<c012f195>] queue_work+0x55/0xa0 (12)
 [<c012f0b0>] call_usermodehelper+0x160/0x180 (28)
 [<e083b516>] ide_cdrom_packet+0xb6/0x100 [ide_cd] (36)
 [<c023a4e0>] blk_end_sync_rq+0x0/0x30 (152)
 [<e083be1b>] ide_cdrom_get_capabilities+0x9b/0xb0 [ide_cd] (36)
 [<e083bede>] ide_cdrom_probe_capabilities+0xae/0x4e0 [ide_cd] (92)
 [<e083c7bc>] ide_cdrom_setup+0x2ac/0x460 [ide_cd] (68)
 [<e083ceea>] ide_cd_probe+0x14a/0x2b0 [ide_cd] (32)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (28)
 [<c01e8010>] kobject_hotplug+0x2a0/0x2f0 (20)
 [<c01a9256>] sysfs_create_dir+0x36/0xa0 (20)
 [<c0232552>] driver_probe_device+0x32/0x80 (36)
 [<c02326b2>] driver_attach+0x52/0xa0 (20)
 [<c0232c37>] bus_add_driver+0x97/0xe0 (32)
 [<e083d05f>] ide_cdrom_init+0xf/0x20 [ide_cd] (32)
 [<c013ff97>] sys_init_module+0x157/0x240 (8)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (28)
---------------------------
| preempt count: 10000002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a3c9>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b544>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: sleeping function called from invalid context modprobe(1342) at fs/file_table.c:125
in_atomic():1 [00000001], irqs_disabled():0
 [<c01199cb>] __might_sleep+0xdb/0x100 (8)
 [<c0168637>] __fput+0x37/0x1b0 (36)
 [<c0166c32>] filp_close+0x52/0xa0 (32)
 [<c011f1aa>] put_files_struct+0x6a/0xe0 (24)
 [<c0120016>] do_exit+0xf6/0x420 (28)
 [<c0104950>] do_invalid_op+0x0/0xb0 (32)
 [<c01045bc>] die+0x18c/0x190 (8)
 [<c01049f6>] do_invalid_op+0xa6/0xb0 (60)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (76)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (4)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (20)
 [<c011d585>] vprintk+0x185/0x270 (28)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (20)
 [<c0101940>] __switch_to+0x30/0x200 (16)
 [<c0103d5f>] error_code+0x4f/0x54 (36)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (44)
 [<c025d691>] ide_do_drive_cmd+0x121/0x190 (44)
 [<c0101940>] __switch_to+0x30/0x200 (116)
 [<e0839b8a>] cdrom_queue_packet_command+0x4a/0xd0 [ide_cd] (120)
 [<c0117490>] default_wake_function+0x0/0x30 (20)
 [<c012f195>] queue_work+0x55/0xa0 (12)
 [<c012f0b0>] call_usermodehelper+0x160/0x180 (28)
 [<e083b516>] ide_cdrom_packet+0xb6/0x100 [ide_cd] (36)
 [<c023a4e0>] blk_end_sync_rq+0x0/0x30 (152)
 [<e083be1b>] ide_cdrom_get_capabilities+0x9b/0xb0 [ide_cd] (36)
 [<e083bede>] ide_cdrom_probe_capabilities+0xae/0x4e0 [ide_cd] (92)
 [<e083c7bc>] ide_cdrom_setup+0x2ac/0x460 [ide_cd] (68)
 [<e083ceea>] ide_cd_probe+0x14a/0x2b0 [ide_cd] (32)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (28)
 [<c01e8010>] kobject_hotplug+0x2a0/0x2f0 (20)
 [<c01a9256>] sysfs_create_dir+0x36/0xa0 (20)
 [<c0232552>] driver_probe_device+0x32/0x80 (36)
 [<c02326b2>] driver_attach+0x52/0xa0 (20)
 [<c0232c37>] bus_add_driver+0x97/0xe0 (32)
 [<e083d05f>] ide_cdrom_init+0xf/0x20 [ide_cd] (32)
 [<c013ff97>] sys_init_module+0x157/0x240 (8)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (28)
---------------------------
| preempt count: 00000002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a3c9>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b544>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: scheduling while atomic: modprobe/0x10000001/1342
caller is __cond_resched+0x42/0x60
 [<c032782b>] __schedule+0x52b/0x920 (8)
 [<c01183c2>] __cond_resched+0x42/0x60 (8)
 [<c0182246>] dput+0x1f6/0x210 (28)
 [<c0168710>] __fput+0x110/0x1b0 (24)
 [<c013b2a3>] add_preempt_count+0x23/0xe0 (4)
 [<c01183c2>] __cond_resched+0x42/0x60 (28)
 [<c032852c>] cond_resched+0x1c/0x30 (16)
 [<c011f1af>] put_files_struct+0x6f/0xe0 (8)
 [<c0120016>] do_exit+0xf6/0x420 (28)
 [<c0104950>] do_invalid_op+0x0/0xb0 (32)
 [<c01045bc>] die+0x18c/0x190 (8)
 [<c01049f6>] do_invalid_op+0xa6/0xb0 (60)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (76)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (4)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (20)
 [<c011d585>] vprintk+0x185/0x270 (28)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (20)
 [<c0101940>] __switch_to+0x30/0x200 (16)
 [<c0103d5f>] error_code+0x4f/0x54 (36)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (44)
 [<c025d691>] ide_do_drive_cmd+0x121/0x190 (44)
 [<c0101940>] __switch_to+0x30/0x200 (116)
 [<e0839b8a>] cdrom_queue_packet_command+0x4a/0xd0 [ide_cd] (120)
 [<c0117490>] default_wake_function+0x0/0x30 (20)
 [<c012f195>] queue_work+0x55/0xa0 (12)
 [<c012f0b0>] call_usermodehelper+0x160/0x180 (28)
 [<e083b516>] ide_cdrom_packet+0xb6/0x100 [ide_cd] (36)
 [<c023a4e0>] blk_end_sync_rq+0x0/0x30 (152)
 [<e083be1b>] ide_cdrom_get_capabilities+0x9b/0xb0 [ide_cd] (36)
 [<e083bede>] ide_cdrom_probe_capabilities+0xae/0x4e0 [ide_cd] (92)
 [<e083c7bc>] ide_cdrom_setup+0x2ac/0x460 [ide_cd] (68)
 [<e083ceea>] ide_cd_probe+0x14a/0x2b0 [ide_cd] (32)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (28)
 [<c01e8010>] kobject_hotplug+0x2a0/0x2f0 (20)
 [<c01a9256>] sysfs_create_dir+0x36/0xa0 (20)
 [<c0232552>] driver_probe_device+0x32/0x80 (36)
 [<c02326b2>] driver_attach+0x52/0xa0 (20)
 [<c0232c37>] bus_add_driver+0x97/0xe0 (32)
 [<e083d05f>] ide_cdrom_init+0xf/0x20 [ide_cd] (32)
 [<c013ff97>] sys_init_module+0x157/0x240 (8)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (28)
---------------------------
| preempt count: 10000002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a3c9>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b544>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: modprobe/1342, lock held at task exit time!
 [c03d3e00] {(struct rw_semaphore *)(&s->rwsem)}
.. held by:          modprobe: 1342 [de83e920, 125]
... acquired at:  bus_add_driver+0x8f/0xe0
BUG: scheduling while atomic: modprobe/0x00000001/1342
caller is do_exit+0x261/0x420
 [<c032782b>] __schedule+0x52b/0x920 (8)
 [<c0120181>] do_exit+0x261/0x420 (8)
 [<c0232c2f>] bus_add_driver+0x8f/0xe0 (52)
 [<c0120181>] do_exit+0x261/0x420 (32)
 [<c0104950>] do_invalid_op+0x0/0xb0 (32)
 [<c01045bc>] die+0x18c/0x190 (8)
 [<c01049f6>] do_invalid_op+0xa6/0xb0 (60)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (76)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (4)
 [<c011d7a9>] release_console_sem+0x79/0xe0 (20)
 [<c011d585>] vprintk+0x185/0x270 (28)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (20)
 [<c0101940>] __switch_to+0x30/0x200 (16)
 [<c0103d5f>] error_code+0x4f/0x54 (36)
 [<c025cf63>] ide_do_request+0x3a3/0x3d0 (44)
 [<c025d691>] ide_do_drive_cmd+0x121/0x190 (44)
 [<c0101940>] __switch_to+0x30/0x200 (116)
 [<e0839b8a>] cdrom_queue_packet_command+0x4a/0xd0 [ide_cd] (120)
 [<c0117490>] default_wake_function+0x0/0x30 (20)
 [<c012f195>] queue_work+0x55/0xa0 (12)
 [<c012f0b0>] call_usermodehelper+0x160/0x180 (28)
 [<e083b516>] ide_cdrom_packet+0xb6/0x100 [ide_cd] (36)
 [<c023a4e0>] blk_end_sync_rq+0x0/0x30 (152)
 [<e083be1b>] ide_cdrom_get_capabilities+0x9b/0xb0 [ide_cd] (36)
 [<e083bede>] ide_cdrom_probe_capabilities+0xae/0x4e0 [ide_cd] (92)
 [<e083c7bc>] ide_cdrom_setup+0x2ac/0x460 [ide_cd] (68)
 [<e083ceea>] ide_cd_probe+0x14a/0x2b0 [ide_cd] (32)
 [<c032a802>] _raw_spin_unlock+0x12/0x30 (28)
 [<c01e8010>] kobject_hotplug+0x2a0/0x2f0 (20)
 [<c01a9256>] sysfs_create_dir+0x36/0xa0 (20)
 [<c0232552>] driver_probe_device+0x32/0x80 (36)
 [<c02326b2>] driver_attach+0x52/0xa0 (20)
 [<c0232c37>] bus_add_driver+0x97/0xe0 (32)
 [<e083d05f>] ide_cdrom_init+0xf/0x20 [ide_cd] (32)
 [<c013ff97>] sys_init_module+0x157/0x240 (8)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (28)
---------------------------
| preempt count: 00000002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a3c9>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b544>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16  3:51 ` K.R. Foley
@ 2005-06-16  7:29   ` Ingo Molnar
  2005-06-16 11:22     ` K.R. Foley
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-16  7:29 UTC (permalink / raw)
  To: K.R. Foley; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* K.R. Foley <kr@cybsft.com> wrote:

> Having problems with -RT-2.6.12-rc6-V0.7.48-33 booting on my older SMP 
> system (dual 933). Looking at the log apic.log it indicates a problem 
> with APIC. noapic.log is a log when I add "noapic" to the boot 
> parameters.

could you uncomment the IO_APIC_CACHE define in 
arch/i386/kernel/io_apic.c, and could you uncomment line 1109 in 
drivers/ide/ide-io.c - does this fix things? (in apic mode)

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16  7:29   ` Ingo Molnar
@ 2005-06-16 11:22     ` K.R. Foley
  2005-06-16 17:32       ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: K.R. Foley @ 2005-06-16 11:22 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 1045 bytes --]

Ingo Molnar wrote:
> * K.R. Foley <kr@cybsft.com> wrote:
> 
> 
>>Having problems with -RT-2.6.12-rc6-V0.7.48-33 booting on my older SMP 
>>system (dual 933). Looking at the log apic.log it indicates a problem 
>>with APIC. noapic.log is a log when I add "noapic" to the boot 
>>parameters.
> 
> 
> could you uncomment the IO_APIC_CACHE define in 
> arch/i386/kernel/io_apic.c, and could you uncomment line 1109 in 
> drivers/ide/ide-io.c - does this fix things? (in apic mode)
> 
> 	Ingo
> 

Couple of things: 1) I could not find IO_APIC_CACHE anywhere. I could
find IOAPIC_CACHE but the define was not commented in io_apic.c. Also
the BUG_ON at line 1109 in ide-io.c was not commented out either. So I
made the mental leap that you actually meant to comment these out
instead of uncomment them??? That works to get the system booted.
Although I am getting many soft lockups now, minutes after the boot. Log
attached. 2) In my infinite wisdom before :-) I failed to attach my
config as I should have done before. Also, commenting out

-- 
   kr

[-- Attachment #2: config.porky2 --]
[-- Type: text/plain, Size: 35229 bytes --]

#
# Automatically generated make config: don't edit
# Linux kernel version: 2.6.12-rc6-RT-V0.7.48-33
# Wed Jun 15 06:00:55 2005
#
CONFIG_X86=y
CONFIG_MMU=y
CONFIG_UID16=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y

#
# Code maturity level options
#
CONFIG_EXPERIMENTAL=y
CONFIG_CLEAN_COMPILE=y
CONFIG_LOCK_KERNEL=y
CONFIG_INIT_ENV_ARG_LIMIT=32

#
# General setup
#
CONFIG_LOCALVERSION=""
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_POSIX_MQUEUE=y
CONFIG_BSD_PROCESS_ACCT=y
# CONFIG_BSD_PROCESS_ACCT_V3 is not set
CONFIG_SYSCTL=y
# CONFIG_AUDIT is not set
CONFIG_HOTPLUG=y
CONFIG_KOBJECT_UEVENT=y
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_CPUSETS=y
# CONFIG_EMBEDDED is not set
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
CONFIG_KALLSYMS_EXTRA_PASS=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SHMEM=y
CONFIG_CC_ALIGN_FUNCTIONS=0
CONFIG_CC_ALIGN_LABELS=0
CONFIG_CC_ALIGN_LOOPS=0
CONFIG_CC_ALIGN_JUMPS=0
# CONFIG_TINY_SHMEM is not set
CONFIG_BASE_SMALL=0

#
# Loadable module support
#
CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y
# CONFIG_MODULE_FORCE_UNLOAD is not set
CONFIG_OBSOLETE_MODPARM=y
CONFIG_MODVERSIONS=y
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_KMOD=y
CONFIG_STOP_MACHINE=y

#
# Processor type and features
#
CONFIG_X86_PC=y
# CONFIG_X86_ELAN is not set
# CONFIG_X86_VOYAGER is not set
# CONFIG_X86_NUMAQ is not set
# CONFIG_X86_SUMMIT is not set
# CONFIG_X86_BIGSMP is not set
# CONFIG_X86_VISWS is not set
# CONFIG_X86_GENERICARCH is not set
# CONFIG_X86_ES7000 is not set
# CONFIG_M386 is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
CONFIG_MPENTIUMIII=y
# CONFIG_MPENTIUMM is not set
# CONFIG_MPENTIUM4 is not set
# CONFIG_MK6 is not set
# CONFIG_MK7 is not set
# CONFIG_MK8 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MEFFICEON is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP2 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MGEODEGX1 is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
CONFIG_X86_GENERIC=y
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=7
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
# CONFIG_HPET_TIMER is not set
CONFIG_SMP=y
CONFIG_NR_CPUS=8
# CONFIG_SCHED_SMT is not set
# CONFIG_PREEMPT_NONE is not set
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT_DESKTOP is not set
CONFIG_PREEMPT_RT=y
CONFIG_PREEMPT=y
CONFIG_PREEMPT_SOFTIRQS=y
CONFIG_PREEMPT_HARDIRQS=y
CONFIG_PREEMPT_RCU=y
CONFIG_PREEMPT_BKL=y
CONFIG_RWSEM_GENERIC_SPINLOCK=y
CONFIG_ASM_SEMAPHORES=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_TSC=y
CONFIG_X86_MCE=y
# CONFIG_X86_MCE_NONFATAL is not set
# CONFIG_X86_MCE_P4THERMAL is not set
# CONFIG_TOSHIBA is not set
# CONFIG_I8K is not set
# CONFIG_X86_REBOOTFIXUPS is not set
CONFIG_MICROCODE=m
CONFIG_X86_MSR=m
CONFIG_X86_CPUID=m

#
# Firmware Drivers
#
CONFIG_EDD=m
CONFIG_NOHIGHMEM=y
# CONFIG_HIGHMEM4G is not set
# CONFIG_HIGHMEM64G is not set
# CONFIG_MATH_EMULATION is not set
CONFIG_MTRR=y
CONFIG_IRQBALANCE=y
CONFIG_HAVE_DEC_LOCK=y
# CONFIG_REGPARM is not set
# CONFIG_SECCOMP is not set

#
# Power management options (ACPI, APM)
#
# CONFIG_PM is not set

#
# ACPI (Advanced Configuration and Power Interface) Support
#
# CONFIG_ACPI is not set

#
# CPU Frequency scaling
#
# CONFIG_CPU_FREQ is not set

#
# Bus options (PCI, PCMCIA, EISA, MCA, ISA)
#
CONFIG_PCI=y
# CONFIG_PCI_GOBIOS is not set
# CONFIG_PCI_GOMMCONFIG is not set
# CONFIG_PCI_GODIRECT is not set
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
# CONFIG_PCIEPORTBUS is not set
# CONFIG_PCI_MSI is not set
# CONFIG_PCI_LEGACY_PROC is not set
CONFIG_PCI_NAMES=y
# CONFIG_PCI_DEBUG is not set
CONFIG_ISA_DMA_API=y
CONFIG_ISA=y
# CONFIG_EISA is not set
# CONFIG_MCA is not set
# CONFIG_SCx200 is not set

#
# PCCARD (PCMCIA/CardBus) support
#
# CONFIG_PCCARD is not set

#
# PCI Hotplug Support
#
# CONFIG_HOTPLUG_PCI is not set

#
# Executable file formats
#
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_AOUT=m
CONFIG_BINFMT_MISC=m

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=m
# CONFIG_DEBUG_DRIVER is not set

#
# Memory Technology Devices (MTD)
#
# CONFIG_MTD is not set

#
# Parallel port support
#
# CONFIG_PARPORT is not set

#
# Plug and Play support
#
CONFIG_PNP=y
# CONFIG_PNP_DEBUG is not set

#
# Protocols
#
CONFIG_ISAPNP=y
# CONFIG_PNPBIOS is not set

#
# Block devices
#
CONFIG_BLK_DEV_FD=m
# CONFIG_BLK_DEV_XD is not set
CONFIG_BLK_CPQ_DA=m
CONFIG_BLK_CPQ_CISS_DA=m
CONFIG_CISS_SCSI_TAPE=y
# CONFIG_BLK_DEV_DAC960 is not set
# CONFIG_BLK_DEV_UMEM is not set
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=m
# CONFIG_BLK_DEV_CRYPTOLOOP is not set
CONFIG_BLK_DEV_NBD=m
# CONFIG_BLK_DEV_SX8 is not set
# CONFIG_BLK_DEV_UB is not set
CONFIG_BLK_DEV_RAM=y
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=8192
CONFIG_BLK_DEV_INITRD=y
CONFIG_INITRAMFS_SOURCE=""
# CONFIG_LBD is not set
# CONFIG_CDROM_PKTCDVD is not set

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_ATA_OVER_ETH is not set

#
# ATA/ATAPI/MFM/RLL support
#
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y

#
# Please see Documentation/ide.txt for help/info on IDE drives
#
# CONFIG_BLK_DEV_IDE_SATA is not set
# CONFIG_BLK_DEV_HD_IDE is not set
CONFIG_BLK_DEV_IDEDISK=y
CONFIG_IDEDISK_MULTI_MODE=y
CONFIG_BLK_DEV_IDECD=m
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDEFLOPPY is not set
# CONFIG_BLK_DEV_IDESCSI is not set
# CONFIG_IDE_TASK_IOCTL is not set

#
# IDE chipset support/bugfixes
#
CONFIG_IDE_GENERIC=y
CONFIG_BLK_DEV_CMD640=y
# CONFIG_BLK_DEV_CMD640_ENHANCED is not set
# CONFIG_BLK_DEV_IDEPNP is not set
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_SHARE_IRQ=y
# CONFIG_BLK_DEV_OFFBOARD is not set
CONFIG_BLK_DEV_GENERIC=y
# CONFIG_BLK_DEV_OPTI621 is not set
CONFIG_BLK_DEV_RZ1000=y
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_IDEDMA_FORCED is not set
CONFIG_IDEDMA_PCI_AUTO=y
# CONFIG_IDEDMA_ONLYDISK is not set
CONFIG_BLK_DEV_AEC62XX=y
CONFIG_BLK_DEV_ALI15X3=y
# CONFIG_WDC_ALI15X3 is not set
CONFIG_BLK_DEV_AMD74XX=y
# CONFIG_BLK_DEV_ATIIXP is not set
CONFIG_BLK_DEV_CMD64X=y
CONFIG_BLK_DEV_TRIFLEX=y
CONFIG_BLK_DEV_CY82C693=y
# CONFIG_BLK_DEV_CS5520 is not set
CONFIG_BLK_DEV_CS5530=y
CONFIG_BLK_DEV_HPT34X=y
# CONFIG_HPT34X_AUTODMA is not set
CONFIG_BLK_DEV_HPT366=y
# CONFIG_BLK_DEV_SC1200 is not set
CONFIG_BLK_DEV_PIIX=y
# CONFIG_BLK_DEV_NS87415 is not set
CONFIG_BLK_DEV_PDC202XX_OLD=y
# CONFIG_PDC202XX_BURST is not set
CONFIG_BLK_DEV_PDC202XX_NEW=y
# CONFIG_PDC202XX_FORCE is not set
CONFIG_BLK_DEV_SVWKS=y
CONFIG_BLK_DEV_SIIMAGE=y
CONFIG_BLK_DEV_SIS5513=y
CONFIG_BLK_DEV_SLC90E66=y
# CONFIG_BLK_DEV_TRM290 is not set
CONFIG_BLK_DEV_VIA82CXXX=y
# CONFIG_IDE_ARM is not set
# CONFIG_IDE_CHIPSETS is not set
CONFIG_BLK_DEV_IDEDMA=y
# CONFIG_IDEDMA_IVB is not set
CONFIG_IDEDMA_AUTO=y
# CONFIG_BLK_DEV_HD is not set

#
# SCSI device support
#
CONFIG_SCSI=y
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=y
CONFIG_CHR_DEV_ST=m
CONFIG_CHR_DEV_OSST=m
CONFIG_BLK_DEV_SR=m
CONFIG_BLK_DEV_SR_VENDOR=y
CONFIG_CHR_DEV_SG=y

#
# Some SCSI devices (e.g. CD jukebox) support multiple LUNs
#
# CONFIG_SCSI_MULTI_LUN is not set
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y

#
# SCSI Transport Attributes
#
CONFIG_SCSI_SPI_ATTRS=y
# CONFIG_SCSI_FC_ATTRS is not set
# CONFIG_SCSI_ISCSI_ATTRS is not set

#
# SCSI low-level drivers
#
CONFIG_BLK_DEV_3W_XXXX_RAID=m
# CONFIG_SCSI_3W_9XXX is not set
CONFIG_SCSI_7000FASST=m
CONFIG_SCSI_ACARD=m
CONFIG_SCSI_AHA152X=m
CONFIG_SCSI_AHA1542=m
# CONFIG_SCSI_AACRAID is not set
CONFIG_SCSI_AIC7XXX=y
CONFIG_AIC7XXX_CMDS_PER_DEVICE=32
CONFIG_AIC7XXX_RESET_DELAY_MS=15000
# CONFIG_AIC7XXX_DEBUG_ENABLE is not set
CONFIG_AIC7XXX_DEBUG_MASK=0
# CONFIG_AIC7XXX_REG_PRETTY_PRINT is not set
CONFIG_SCSI_AIC7XXX_OLD=m
CONFIG_SCSI_AIC79XX=m
CONFIG_AIC79XX_CMDS_PER_DEVICE=32
CONFIG_AIC79XX_RESET_DELAY_MS=15000
# CONFIG_AIC79XX_ENABLE_RD_STRM is not set
# CONFIG_AIC79XX_DEBUG_ENABLE is not set
CONFIG_AIC79XX_DEBUG_MASK=0
# CONFIG_AIC79XX_REG_PRETTY_PRINT is not set
# CONFIG_SCSI_DPT_I2O is not set
CONFIG_SCSI_IN2000=m
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_SCSI_SATA is not set
CONFIG_SCSI_BUSLOGIC=m
# CONFIG_SCSI_OMIT_FLASHPOINT is not set
CONFIG_SCSI_DMX3191D=m
CONFIG_SCSI_DTC3280=m
CONFIG_SCSI_EATA=m
CONFIG_SCSI_EATA_TAGGED_QUEUE=y
# CONFIG_SCSI_EATA_LINKED_COMMANDS is not set
CONFIG_SCSI_EATA_MAX_TAGS=16
CONFIG_SCSI_FUTURE_DOMAIN=m
CONFIG_SCSI_GDTH=m
CONFIG_SCSI_GENERIC_NCR5380=m
# CONFIG_SCSI_GENERIC_NCR5380_MMIO is not set
# CONFIG_SCSI_GENERIC_NCR53C400 is not set
CONFIG_SCSI_IPS=m
# CONFIG_SCSI_INITIO is not set
CONFIG_SCSI_INIA100=m
CONFIG_SCSI_NCR53C406A=m
CONFIG_SCSI_SYM53C8XX_2=m
CONFIG_SCSI_SYM53C8XX_DMA_ADDRESSING_MODE=1
CONFIG_SCSI_SYM53C8XX_DEFAULT_TAGS=16
CONFIG_SCSI_SYM53C8XX_MAX_TAGS=64
# CONFIG_SCSI_SYM53C8XX_IOMAPPED is not set
# CONFIG_SCSI_IPR is not set
CONFIG_SCSI_PAS16=m
CONFIG_SCSI_PSI240I=m
CONFIG_SCSI_QLOGIC_FAS=m
CONFIG_SCSI_QLOGIC_FC=m
# CONFIG_SCSI_QLOGIC_FC_FIRMWARE is not set
CONFIG_SCSI_QLOGIC_1280=m
# CONFIG_SCSI_QLOGIC_1280_1040 is not set
CONFIG_SCSI_QLA2XXX=y
# CONFIG_SCSI_QLA21XX is not set
# CONFIG_SCSI_QLA22XX is not set
# CONFIG_SCSI_QLA2300 is not set
# CONFIG_SCSI_QLA2322 is not set
# CONFIG_SCSI_QLA6312 is not set
# CONFIG_SCSI_LPFC is not set
CONFIG_SCSI_SYM53C416=m
# CONFIG_SCSI_DC395x is not set
CONFIG_SCSI_DC390T=m
CONFIG_SCSI_T128=m
CONFIG_SCSI_U14_34F=m
# CONFIG_SCSI_U14_34F_TAGGED_QUEUE is not set
# CONFIG_SCSI_U14_34F_LINKED_COMMANDS is not set
CONFIG_SCSI_U14_34F_MAX_TAGS=8
CONFIG_SCSI_ULTRASTOR=m
CONFIG_SCSI_NSP32=m
CONFIG_SCSI_DEBUG=m

#
# Old CD-ROM drivers (not SCSI, not IDE)
#
# CONFIG_CD_NO_IDESCSI is not set

#
# Multi-device support (RAID and LVM)
#
CONFIG_MD=y
CONFIG_BLK_DEV_MD=y
CONFIG_MD_LINEAR=m
CONFIG_MD_RAID0=m
CONFIG_MD_RAID1=m
# CONFIG_MD_RAID10 is not set
CONFIG_MD_RAID5=m
# CONFIG_MD_RAID6 is not set
CONFIG_MD_MULTIPATH=m
# CONFIG_MD_FAULTY is not set
CONFIG_BLK_DEV_DM=m
# CONFIG_DM_CRYPT is not set
# CONFIG_DM_SNAPSHOT is not set
# CONFIG_DM_MIRROR is not set
# CONFIG_DM_ZERO is not set
# CONFIG_DM_MULTIPATH is not set

#
# Fusion MPT device support
#
# CONFIG_FUSION is not set

#
# IEEE 1394 (FireWire) support
#
# CONFIG_IEEE1394 is not set

#
# I2O device support
#
# CONFIG_I2O is not set

#
# Networking support
#
CONFIG_NET=y

#
# Networking options
#
CONFIG_PACKET=y
CONFIG_PACKET_MMAP=y
CONFIG_UNIX=y
CONFIG_NET_KEY=m
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_ADVANCED_ROUTER=y
CONFIG_IP_MULTIPLE_TABLES=y
CONFIG_IP_ROUTE_FWMARK=y
CONFIG_IP_ROUTE_MULTIPATH=y
# CONFIG_IP_ROUTE_MULTIPATH_CACHED is not set
CONFIG_IP_ROUTE_VERBOSE=y
# CONFIG_IP_PNP is not set
CONFIG_NET_IPIP=m
CONFIG_NET_IPGRE=m
CONFIG_NET_IPGRE_BROADCAST=y
CONFIG_IP_MROUTE=y
CONFIG_IP_PIMSM_V1=y
CONFIG_IP_PIMSM_V2=y
# CONFIG_ARPD is not set
CONFIG_SYN_COOKIES=y
CONFIG_INET_AH=m
CONFIG_INET_ESP=m
CONFIG_INET_IPCOMP=m
CONFIG_INET_TUNNEL=m
CONFIG_IP_TCPDIAG=y
# CONFIG_IP_TCPDIAG_IPV6 is not set

#
# IP: Virtual Server Configuration
#
CONFIG_IP_VS=m
# CONFIG_IP_VS_DEBUG is not set
CONFIG_IP_VS_TAB_BITS=16

#
# IPVS transport protocol load balancing support
#
# CONFIG_IP_VS_PROTO_TCP is not set
# CONFIG_IP_VS_PROTO_UDP is not set
# CONFIG_IP_VS_PROTO_ESP is not set
# CONFIG_IP_VS_PROTO_AH is not set

#
# IPVS scheduler
#
CONFIG_IP_VS_RR=m
CONFIG_IP_VS_WRR=m
CONFIG_IP_VS_LC=m
CONFIG_IP_VS_WLC=m
CONFIG_IP_VS_LBLC=m
CONFIG_IP_VS_LBLCR=m
CONFIG_IP_VS_DH=m
CONFIG_IP_VS_SH=m
# CONFIG_IP_VS_SED is not set
# CONFIG_IP_VS_NQ is not set

#
# IPVS application helper
#
# CONFIG_IPV6 is not set
CONFIG_NETFILTER=y
# CONFIG_NETFILTER_DEBUG is not set
CONFIG_BRIDGE_NETFILTER=y

#
# IP: Netfilter Configuration
#
CONFIG_IP_NF_CONNTRACK=m
# CONFIG_IP_NF_CT_ACCT is not set
# CONFIG_IP_NF_CONNTRACK_MARK is not set
# CONFIG_IP_NF_CT_PROTO_SCTP is not set
CONFIG_IP_NF_FTP=m
CONFIG_IP_NF_IRC=m
CONFIG_IP_NF_TFTP=m
CONFIG_IP_NF_AMANDA=m
CONFIG_IP_NF_QUEUE=m
CONFIG_IP_NF_IPTABLES=m
CONFIG_IP_NF_MATCH_LIMIT=m
# CONFIG_IP_NF_MATCH_IPRANGE is not set
CONFIG_IP_NF_MATCH_MAC=m
CONFIG_IP_NF_MATCH_PKTTYPE=m
CONFIG_IP_NF_MATCH_MARK=m
CONFIG_IP_NF_MATCH_MULTIPORT=m
CONFIG_IP_NF_MATCH_TOS=m
CONFIG_IP_NF_MATCH_RECENT=m
CONFIG_IP_NF_MATCH_ECN=m
CONFIG_IP_NF_MATCH_DSCP=m
CONFIG_IP_NF_MATCH_AH_ESP=m
CONFIG_IP_NF_MATCH_LENGTH=m
CONFIG_IP_NF_MATCH_TTL=m
CONFIG_IP_NF_MATCH_TCPMSS=m
CONFIG_IP_NF_MATCH_HELPER=m
CONFIG_IP_NF_MATCH_STATE=m
CONFIG_IP_NF_MATCH_CONNTRACK=m
CONFIG_IP_NF_MATCH_OWNER=m
# CONFIG_IP_NF_MATCH_PHYSDEV is not set
# CONFIG_IP_NF_MATCH_ADDRTYPE is not set
# CONFIG_IP_NF_MATCH_REALM is not set
# CONFIG_IP_NF_MATCH_SCTP is not set
# CONFIG_IP_NF_MATCH_COMMENT is not set
# CONFIG_IP_NF_MATCH_HASHLIMIT is not set
CONFIG_IP_NF_FILTER=m
CONFIG_IP_NF_TARGET_REJECT=m
CONFIG_IP_NF_TARGET_LOG=m
CONFIG_IP_NF_TARGET_ULOG=m
CONFIG_IP_NF_TARGET_TCPMSS=m
CONFIG_IP_NF_NAT=m
CONFIG_IP_NF_NAT_NEEDED=y
CONFIG_IP_NF_TARGET_MASQUERADE=m
CONFIG_IP_NF_TARGET_REDIRECT=m
# CONFIG_IP_NF_TARGET_NETMAP is not set
# CONFIG_IP_NF_TARGET_SAME is not set
CONFIG_IP_NF_NAT_SNMP_BASIC=m
CONFIG_IP_NF_NAT_IRC=m
CONFIG_IP_NF_NAT_FTP=m
CONFIG_IP_NF_NAT_TFTP=m
CONFIG_IP_NF_NAT_AMANDA=m
CONFIG_IP_NF_MANGLE=m
CONFIG_IP_NF_TARGET_TOS=m
CONFIG_IP_NF_TARGET_ECN=m
CONFIG_IP_NF_TARGET_DSCP=m
CONFIG_IP_NF_TARGET_MARK=m
# CONFIG_IP_NF_TARGET_CLASSIFY is not set
# CONFIG_IP_NF_RAW is not set
CONFIG_IP_NF_ARPTABLES=m
CONFIG_IP_NF_ARPFILTER=m
CONFIG_IP_NF_ARP_MANGLE=m

#
# Bridge: Netfilter Configuration
#
# CONFIG_BRIDGE_NF_EBTABLES is not set
CONFIG_XFRM=y
CONFIG_XFRM_USER=m

#
# SCTP Configuration (EXPERIMENTAL)
#
# CONFIG_IP_SCTP is not set
CONFIG_ATM=y
CONFIG_ATM_CLIP=y
# CONFIG_ATM_CLIP_NO_ICMP is not set
CONFIG_ATM_LANE=m
CONFIG_ATM_MPOA=m
CONFIG_ATM_BR2684=m
CONFIG_ATM_BR2684_IPFILTER=y
CONFIG_BRIDGE=m
CONFIG_VLAN_8021Q=m
# CONFIG_DECNET is not set
CONFIG_LLC=m
# CONFIG_LLC2 is not set
CONFIG_IPX=m
# CONFIG_IPX_INTERN is not set
CONFIG_ATALK=m
CONFIG_DEV_APPLETALK=y
CONFIG_LTPC=m
CONFIG_COPS=m
CONFIG_COPS_DAYNA=y
CONFIG_COPS_TANGENT=y
CONFIG_IPDDP=m
CONFIG_IPDDP_ENCAP=y
CONFIG_IPDDP_DECAP=y
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
CONFIG_NET_DIVERT=y
# CONFIG_ECONET is not set
# CONFIG_WAN_ROUTER is not set

#
# QoS and/or fair queueing
#
CONFIG_NET_SCHED=y
CONFIG_NET_SCH_CLK_JIFFIES=y
# CONFIG_NET_SCH_CLK_GETTIMEOFDAY is not set
# CONFIG_NET_SCH_CLK_CPU is not set
CONFIG_NET_SCH_CBQ=m
CONFIG_NET_SCH_HTB=m
# CONFIG_NET_SCH_HFSC is not set
# CONFIG_NET_SCH_ATM is not set
CONFIG_NET_SCH_PRIO=m
CONFIG_NET_SCH_RED=m
CONFIG_NET_SCH_SFQ=m
CONFIG_NET_SCH_TEQL=m
CONFIG_NET_SCH_TBF=m
CONFIG_NET_SCH_GRED=m
CONFIG_NET_SCH_DSMARK=m
# CONFIG_NET_SCH_NETEM is not set
CONFIG_NET_SCH_INGRESS=m
CONFIG_NET_QOS=y
CONFIG_NET_ESTIMATOR=y
CONFIG_NET_CLS=y
# CONFIG_NET_CLS_BASIC is not set
CONFIG_NET_CLS_TCINDEX=m
CONFIG_NET_CLS_ROUTE4=m
CONFIG_NET_CLS_ROUTE=y
CONFIG_NET_CLS_FW=m
CONFIG_NET_CLS_U32=m
# CONFIG_CLS_U32_PERF is not set
# CONFIG_NET_CLS_IND is not set
# CONFIG_CLS_U32_MARK is not set
CONFIG_NET_CLS_RSVP=m
CONFIG_NET_CLS_RSVP6=m
# CONFIG_NET_EMATCH is not set
# CONFIG_NET_CLS_ACT is not set
CONFIG_NET_CLS_POLICE=y

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
CONFIG_NETPOLL=y
# CONFIG_NETPOLL_RX is not set
# CONFIG_NETPOLL_TRAP is not set
CONFIG_NET_POLL_CONTROLLER=y
# CONFIG_HAMRADIO is not set
# CONFIG_IRDA is not set
# CONFIG_BT is not set
CONFIG_NETDEVICES=y
CONFIG_DUMMY=m
# CONFIG_BONDING is not set
# CONFIG_EQUALIZER is not set
CONFIG_TUN=m
# CONFIG_NET_SB1000 is not set

#
# ARCnet devices
#
# CONFIG_ARCNET is not set

#
# Ethernet (10 or 100Mbit)
#
CONFIG_NET_ETHERNET=y
CONFIG_MII=m
CONFIG_HAPPYMEAL=m
CONFIG_SUNGEM=m
CONFIG_NET_VENDOR_3COM=y
CONFIG_EL1=m
CONFIG_EL2=m
CONFIG_ELPLUS=m
CONFIG_EL16=m
CONFIG_EL3=m
CONFIG_3C515=m
CONFIG_VORTEX=m
CONFIG_TYPHOON=m
CONFIG_LANCE=m
CONFIG_NET_VENDOR_SMC=y
CONFIG_WD80x3=m
CONFIG_ULTRA=m
CONFIG_SMC9194=m
CONFIG_NET_VENDOR_RACAL=y
CONFIG_NI52=m
CONFIG_NI65=m

#
# Tulip family network device support
#
CONFIG_NET_TULIP=y
# CONFIG_DE2104X is not set
CONFIG_TULIP=m
# CONFIG_TULIP_MWI is not set
# CONFIG_TULIP_MMIO is not set
# CONFIG_TULIP_NAPI is not set
# CONFIG_DE4X5 is not set
# CONFIG_WINBOND_840 is not set
# CONFIG_DM9102 is not set
CONFIG_AT1700=m
CONFIG_DEPCA=m
CONFIG_HP100=m
CONFIG_NET_ISA=y
CONFIG_E2100=m
CONFIG_EWRK3=m
CONFIG_EEXPRESS=m
CONFIG_EEXPRESS_PRO=m
CONFIG_HPLAN_PLUS=m
CONFIG_HPLAN=m
CONFIG_LP486E=m
CONFIG_ETH16I=m
CONFIG_NE2000=m
# CONFIG_ZNET is not set
# CONFIG_SEEQ8005 is not set
CONFIG_NET_PCI=y
CONFIG_PCNET32=m
CONFIG_AMD8111_ETH=m
# CONFIG_AMD8111E_NAPI is not set
CONFIG_ADAPTEC_STARFIRE=m
# CONFIG_ADAPTEC_STARFIRE_NAPI is not set
CONFIG_AC3200=m
CONFIG_APRICOT=m
CONFIG_B44=m
# CONFIG_FORCEDETH is not set
CONFIG_CS89x0=m
CONFIG_DGRS=m
# CONFIG_EEPRO100 is not set
CONFIG_E100=m
CONFIG_FEALNX=m
CONFIG_NATSEMI=m
CONFIG_NE2K_PCI=m
CONFIG_8139CP=m
CONFIG_8139TOO=m
CONFIG_8139TOO_PIO=y
# CONFIG_8139TOO_TUNE_TWISTER is not set
CONFIG_8139TOO_8129=y
# CONFIG_8139_OLD_RX_RESET is not set
CONFIG_SIS900=m
CONFIG_EPIC100=m
CONFIG_SUNDANCE=m
# CONFIG_SUNDANCE_MMIO is not set
CONFIG_TLAN=m
CONFIG_VIA_RHINE=m
# CONFIG_VIA_RHINE_MMIO is not set
CONFIG_NET_POCKET=y
CONFIG_ATP=m
CONFIG_DE600=m
CONFIG_DE620=m

#
# Ethernet (1000 Mbit)
#
CONFIG_ACENIC=m
# CONFIG_ACENIC_OMIT_TIGON_I is not set
CONFIG_DL2K=m
CONFIG_E1000=m
CONFIG_E1000_NAPI=y
CONFIG_NS83820=m
CONFIG_HAMACHI=m
CONFIG_YELLOWFIN=m
CONFIG_R8169=m
# CONFIG_R8169_NAPI is not set
# CONFIG_R8169_VLAN is not set
CONFIG_SK98LIN=m
# CONFIG_VIA_VELOCITY is not set
CONFIG_TIGON3=m
# CONFIG_BNX2 is not set

#
# Ethernet (10000 Mbit)
#
# CONFIG_IXGB is not set
# CONFIG_S2IO is not set

#
# Token Ring devices
#
# CONFIG_TR is not set

#
# Wireless LAN (non-hamradio)
#
# CONFIG_NET_RADIO is not set

#
# Wan interfaces
#
# CONFIG_WAN is not set

#
# ATM drivers
#
# CONFIG_ATM_TCP is not set
# CONFIG_ATM_LANAI is not set
# CONFIG_ATM_ENI is not set
# CONFIG_ATM_FIRESTREAM is not set
# CONFIG_ATM_ZATM is not set
# CONFIG_ATM_NICSTAR is not set
# CONFIG_ATM_IDT77252 is not set
# CONFIG_ATM_AMBASSADOR is not set
# CONFIG_ATM_HORIZON is not set
# CONFIG_ATM_IA is not set
# CONFIG_ATM_FORE200E_MAYBE is not set
# CONFIG_ATM_HE is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
CONFIG_PPP=m
CONFIG_PPP_MULTILINK=y
CONFIG_PPP_FILTER=y
CONFIG_PPP_ASYNC=m
CONFIG_PPP_SYNC_TTY=m
CONFIG_PPP_DEFLATE=m
# CONFIG_PPP_BSDCOMP is not set
CONFIG_PPPOE=m
CONFIG_PPPOATM=m
CONFIG_SLIP=m
CONFIG_SLIP_COMPRESSED=y
CONFIG_SLIP_SMART=y
CONFIG_SLIP_MODE_SLIP6=y
CONFIG_NET_FC=y
CONFIG_SHAPER=m
CONFIG_NETCONSOLE=m

#
# ISDN subsystem
#
# CONFIG_ISDN is not set

#
# Telephony Support
#
# CONFIG_PHONE is not set

#
# Input device support
#
CONFIG_INPUT=y

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
# CONFIG_INPUT_JOYDEV is not set
# CONFIG_INPUT_TSDEV is not set
CONFIG_INPUT_EVDEV=m
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_XTKBD is not set
# CONFIG_KEYBOARD_NEWTON is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
CONFIG_MOUSE_SERIAL=m
# CONFIG_MOUSE_INPORT is not set
# CONFIG_MOUSE_LOGIBM is not set
# CONFIG_MOUSE_PC110PAD is not set
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
# CONFIG_INPUT_MISC is not set

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_SERPORT=y
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PCIPS2 is not set
CONFIG_SERIO_LIBPS2=y
# CONFIG_SERIO_RAW is not set
# CONFIG_GAMEPORT is not set

#
# Character devices
#
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
CONFIG_SERIAL_NONSTANDARD=y
# CONFIG_ROCKETPORT is not set
# CONFIG_CYCLADES is not set
# CONFIG_MOXA_SMARTIO is not set
# CONFIG_ISI is not set
# CONFIG_SYNCLINK is not set
# CONFIG_SYNCLINKMP is not set
# CONFIG_N_HDLC is not set
# CONFIG_SPECIALIX is not set
# CONFIG_SX is not set
# CONFIG_STALDRV is not set

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_SERIAL_8250_NR_UARTS=4
# CONFIG_SERIAL_8250_EXTENDED is not set

#
# Non-8250 serial port support
#
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
# CONFIG_SERIAL_JSM is not set
CONFIG_UNIX98_PTYS=y
CONFIG_LEGACY_PTYS=y
CONFIG_LEGACY_PTY_COUNT=256

#
# IPMI
#
# CONFIG_IPMI_HANDLER is not set

#
# Watchdog Cards
#
# CONFIG_WATCHDOG is not set
# CONFIG_HW_RANDOM is not set
CONFIG_NVRAM=m
CONFIG_RTC=y
CONFIG_RTC_HISTOGRAM=y
CONFIG_BLOCKER=y
CONFIG_LPPTEST=y
# CONFIG_DTLK is not set
# CONFIG_R3964 is not set
# CONFIG_APPLICOM is not set
# CONFIG_SONYPI is not set

#
# Ftape, the floppy tape device driver
#
# CONFIG_AGP is not set
# CONFIG_DRM is not set
# CONFIG_MWAVE is not set
# CONFIG_RAW_DRIVER is not set
# CONFIG_HANGCHECK_TIMER is not set

#
# TPM devices
#
# CONFIG_TCG_TPM is not set

#
# I2C support
#
# CONFIG_I2C is not set

#
# Dallas's 1-wire bus
#
# CONFIG_W1 is not set

#
# Misc devices
#
# CONFIG_IBM_ASM is not set

#
# Multimedia devices
#
# CONFIG_VIDEO_DEV is not set

#
# Digital Video Broadcasting Devices
#
# CONFIG_DVB is not set

#
# Graphics support
#
CONFIG_FB=y
CONFIG_FB_CFB_FILLRECT=y
CONFIG_FB_CFB_COPYAREA=y
CONFIG_FB_CFB_IMAGEBLIT=y
CONFIG_FB_SOFT_CURSOR=y
# CONFIG_FB_MACMODES is not set
CONFIG_FB_MODE_HELPERS=y
# CONFIG_FB_TILEBLITTING is not set
CONFIG_FB_CIRRUS=m
# CONFIG_FB_PM2 is not set
# CONFIG_FB_CYBER2000 is not set
# CONFIG_FB_ASILIANT is not set
# CONFIG_FB_IMSTT is not set
CONFIG_FB_VGA16=m
CONFIG_FB_VESA=y
CONFIG_VIDEO_SELECT=y
CONFIG_FB_HGA=m
# CONFIG_FB_HGA_ACCEL is not set
CONFIG_FB_NVIDIA=y
# CONFIG_FB_NVIDIA_I2C is not set
# CONFIG_FB_RIVA is not set
# CONFIG_FB_I810 is not set
# CONFIG_FB_INTEL is not set
# CONFIG_FB_MATROX is not set
# CONFIG_FB_RADEON_OLD is not set
# CONFIG_FB_RADEON is not set
# CONFIG_FB_ATY128 is not set
# CONFIG_FB_ATY is not set
# CONFIG_FB_SAVAGE is not set
# CONFIG_FB_SIS is not set
# CONFIG_FB_NEOMAGIC is not set
# CONFIG_FB_KYRO is not set
# CONFIG_FB_3DFX is not set
# CONFIG_FB_VOODOO1 is not set
# CONFIG_FB_TRIDENT is not set
# CONFIG_FB_GEODE is not set
# CONFIG_FB_S1D13XXX is not set
# CONFIG_FB_VIRTUAL is not set

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
# CONFIG_MDA_CONSOLE is not set
CONFIG_DUMMY_CONSOLE=y
# CONFIG_FRAMEBUFFER_CONSOLE is not set

#
# Logo configuration
#
# CONFIG_LOGO is not set
# CONFIG_BACKLIGHT_LCD_SUPPORT is not set

#
# Sound
#
CONFIG_SOUND=m

#
# Advanced Linux Sound Architecture
#
CONFIG_SND=m
CONFIG_SND_TIMER=m
CONFIG_SND_PCM=m
CONFIG_SND_RAWMIDI=m
CONFIG_SND_SEQUENCER=m
CONFIG_SND_SEQ_DUMMY=m
CONFIG_SND_OSSEMUL=y
CONFIG_SND_MIXER_OSS=m
CONFIG_SND_PCM_OSS=m
CONFIG_SND_SEQUENCER_OSS=y
CONFIG_SND_RTCTIMER=m
# CONFIG_SND_VERBOSE_PRINTK is not set
# CONFIG_SND_DEBUG is not set

#
# Generic devices
#
# CONFIG_SND_DUMMY is not set
# CONFIG_SND_VIRMIDI is not set
# CONFIG_SND_MTPAV is not set
# CONFIG_SND_SERIAL_U16550 is not set
# CONFIG_SND_MPU401 is not set

#
# ISA devices
#
# CONFIG_SND_AD1816A is not set
# CONFIG_SND_AD1848 is not set
# CONFIG_SND_CS4231 is not set
# CONFIG_SND_CS4232 is not set
# CONFIG_SND_CS4236 is not set
# CONFIG_SND_ES968 is not set
# CONFIG_SND_ES1688 is not set
# CONFIG_SND_ES18XX is not set
# CONFIG_SND_GUSCLASSIC is not set
# CONFIG_SND_GUSEXTREME is not set
# CONFIG_SND_GUSMAX is not set
# CONFIG_SND_INTERWAVE is not set
# CONFIG_SND_INTERWAVE_STB is not set
# CONFIG_SND_OPTI92X_AD1848 is not set
# CONFIG_SND_OPTI92X_CS4231 is not set
# CONFIG_SND_OPTI93X is not set
# CONFIG_SND_SB8 is not set
# CONFIG_SND_SB16 is not set
# CONFIG_SND_SBAWE is not set
# CONFIG_SND_WAVEFRONT is not set
# CONFIG_SND_ALS100 is not set
# CONFIG_SND_AZT2320 is not set
# CONFIG_SND_CMI8330 is not set
# CONFIG_SND_DT019X is not set
# CONFIG_SND_OPL3SA2 is not set
# CONFIG_SND_SGALAXY is not set
# CONFIG_SND_SSCAPE is not set

#
# PCI devices
#
CONFIG_SND_AC97_CODEC=m
# CONFIG_SND_ALI5451 is not set
# CONFIG_SND_ATIIXP is not set
# CONFIG_SND_ATIIXP_MODEM is not set
# CONFIG_SND_AU8810 is not set
# CONFIG_SND_AU8820 is not set
# CONFIG_SND_AU8830 is not set
# CONFIG_SND_AZT3328 is not set
# CONFIG_SND_BT87X is not set
CONFIG_SND_CS46XX=m
CONFIG_SND_CS46XX_NEW_DSP=y
# CONFIG_SND_CS4281 is not set
# CONFIG_SND_EMU10K1 is not set
# CONFIG_SND_EMU10K1X is not set
# CONFIG_SND_CA0106 is not set
# CONFIG_SND_KORG1212 is not set
# CONFIG_SND_MIXART is not set
# CONFIG_SND_NM256 is not set
# CONFIG_SND_RME32 is not set
# CONFIG_SND_RME96 is not set
# CONFIG_SND_RME9652 is not set
# CONFIG_SND_HDSP is not set
# CONFIG_SND_TRIDENT is not set
# CONFIG_SND_YMFPCI is not set
# CONFIG_SND_ALS4000 is not set
# CONFIG_SND_CMIPCI is not set
# CONFIG_SND_ENS1370 is not set
# CONFIG_SND_ENS1371 is not set
# CONFIG_SND_ES1938 is not set
# CONFIG_SND_ES1968 is not set
# CONFIG_SND_MAESTRO3 is not set
# CONFIG_SND_FM801 is not set
# CONFIG_SND_ICE1712 is not set
# CONFIG_SND_ICE1724 is not set
# CONFIG_SND_INTEL8X0 is not set
# CONFIG_SND_INTEL8X0M is not set
# CONFIG_SND_SONICVIBES is not set
# CONFIG_SND_VIA82XX is not set
# CONFIG_SND_VIA82XX_MODEM is not set
# CONFIG_SND_VX222 is not set
# CONFIG_SND_HDA_INTEL is not set

#
# USB devices
#
# CONFIG_SND_USB_AUDIO is not set
# CONFIG_SND_USB_USX2Y is not set

#
# Open Sound System
#
CONFIG_SOUND_PRIME=m
# CONFIG_SOUND_BT878 is not set
# CONFIG_SOUND_CMPCI is not set
# CONFIG_SOUND_EMU10K1 is not set
CONFIG_SOUND_FUSION=m
# CONFIG_SOUND_CS4281 is not set
# CONFIG_SOUND_ES1370 is not set
# CONFIG_SOUND_ES1371 is not set
# CONFIG_SOUND_ESSSOLO1 is not set
# CONFIG_SOUND_MAESTRO is not set
# CONFIG_SOUND_MAESTRO3 is not set
# CONFIG_SOUND_ICH is not set
# CONFIG_SOUND_SONICVIBES is not set
# CONFIG_SOUND_TRIDENT is not set
# CONFIG_SOUND_MSNDCLAS is not set
# CONFIG_SOUND_MSNDPIN is not set
# CONFIG_SOUND_VIA82CXXX is not set
# CONFIG_SOUND_OSS is not set
# CONFIG_SOUND_ALI5455 is not set
# CONFIG_SOUND_FORTE is not set
# CONFIG_SOUND_RME96XX is not set
# CONFIG_SOUND_AD1980 is not set

#
# USB support
#
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB=m
# CONFIG_USB_DEBUG is not set

#
# Miscellaneous USB options
#
CONFIG_USB_DEVICEFS=y
# CONFIG_USB_BANDWIDTH is not set
# CONFIG_USB_DYNAMIC_MINORS is not set
# CONFIG_USB_OTG is not set

#
# USB Host Controller Drivers
#
CONFIG_USB_EHCI_HCD=m
# CONFIG_USB_EHCI_SPLIT_ISO is not set
# CONFIG_USB_EHCI_ROOT_HUB_TT is not set
CONFIG_USB_OHCI_HCD=m
# CONFIG_USB_OHCI_BIG_ENDIAN is not set
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
CONFIG_USB_UHCI_HCD=m
# CONFIG_USB_SL811_HCD is not set

#
# USB Device Class drivers
#
# CONFIG_USB_AUDIO is not set
# CONFIG_USB_BLUETOOTH_TTY is not set
# CONFIG_USB_MIDI is not set
# CONFIG_USB_ACM is not set
# CONFIG_USB_PRINTER is not set

#
# NOTE: USB_STORAGE enables SCSI, and 'SCSI disk support' may also be needed; see USB_STORAGE Help for more information
#
# CONFIG_USB_STORAGE is not set

#
# USB Input Devices
#
CONFIG_USB_HID=m
CONFIG_USB_HIDINPUT=y
# CONFIG_HID_FF is not set
# CONFIG_USB_HIDDEV is not set

#
# USB HID Boot Protocol drivers
#
# CONFIG_USB_KBD is not set
# CONFIG_USB_MOUSE is not set
# CONFIG_USB_AIPTEK is not set
# CONFIG_USB_WACOM is not set
# CONFIG_USB_KBTAB is not set
# CONFIG_USB_POWERMATE is not set
# CONFIG_USB_MTOUCH is not set
# CONFIG_USB_EGALAX is not set
# CONFIG_USB_XPAD is not set
# CONFIG_USB_ATI_REMOTE is not set

#
# USB Imaging devices
#
# CONFIG_USB_MDC800 is not set
# CONFIG_USB_MICROTEK is not set

#
# USB Multimedia devices
#
# CONFIG_USB_DABUSB is not set

#
# Video4Linux support is needed for USB Multimedia device support
#

#
# USB Network Adapters
#
# CONFIG_USB_CATC is not set
# CONFIG_USB_KAWETH is not set
# CONFIG_USB_PEGASUS is not set
# CONFIG_USB_RTL8150 is not set
# CONFIG_USB_USBNET is not set
# CONFIG_USB_MON is not set

#
# USB port drivers
#

#
# USB Serial Converter support
#
# CONFIG_USB_SERIAL is not set

#
# USB Miscellaneous drivers
#
# CONFIG_USB_EMI62 is not set
# CONFIG_USB_EMI26 is not set
# CONFIG_USB_AUERSWALD is not set
# CONFIG_USB_RIO500 is not set
# CONFIG_USB_LEGOTOWER is not set
# CONFIG_USB_LCD is not set
# CONFIG_USB_LED is not set
# CONFIG_USB_CYTHERM is not set
# CONFIG_USB_PHIDGETKIT is not set
# CONFIG_USB_PHIDGETSERVO is not set
# CONFIG_USB_IDMOUSE is not set
# CONFIG_USB_SISUSBVGA is not set
# CONFIG_USB_TEST is not set

#
# USB ATM/DSL drivers
#
# CONFIG_USB_ATM is not set
# CONFIG_USB_SPEEDTOUCH is not set

#
# USB Gadget Support
#
# CONFIG_USB_GADGET is not set

#
# MMC/SD Card support
#
# CONFIG_MMC is not set

#
# InfiniBand support
#
# CONFIG_INFINIBAND is not set

#
# File systems
#
CONFIG_EXT2_FS=y
# CONFIG_EXT2_FS_XATTR is not set
CONFIG_EXT3_FS=y
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
# CONFIG_EXT3_FS_SECURITY is not set
CONFIG_JBD=y
# CONFIG_JBD_DEBUG is not set
CONFIG_FS_MBCACHE=y
CONFIG_REISERFS_FS=m
# CONFIG_REISERFS_CHECK is not set
CONFIG_REISERFS_PROC_INFO=y
# CONFIG_REISERFS_FS_XATTR is not set
CONFIG_JFS_FS=m
# CONFIG_JFS_POSIX_ACL is not set
# CONFIG_JFS_SECURITY is not set
CONFIG_JFS_DEBUG=y
# CONFIG_JFS_STATISTICS is not set
CONFIG_FS_POSIX_ACL=y

#
# XFS support
#
# CONFIG_XFS_FS is not set
CONFIG_MINIX_FS=m
CONFIG_ROMFS_FS=m
CONFIG_QUOTA=y
# CONFIG_QFMT_V1 is not set
CONFIG_QFMT_V2=y
CONFIG_QUOTACTL=y
CONFIG_DNOTIFY=y
CONFIG_AUTOFS_FS=m
CONFIG_AUTOFS4_FS=m

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_ZISOFS_FS=y
CONFIG_UDF_FS=m
CONFIG_UDF_NLS=y

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
# CONFIG_NTFS_FS is not set

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_SYSFS=y
# CONFIG_DEVFS_FS is not set
# CONFIG_DEVPTS_FS_XATTR is not set
CONFIG_TMPFS=y
# CONFIG_TMPFS_XATTR is not set
# CONFIG_HUGETLBFS is not set
# CONFIG_HUGETLB_PAGE is not set
CONFIG_RAMFS=y

#
# Miscellaneous filesystems
#
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
CONFIG_CRAMFS=y
# CONFIG_VXFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
CONFIG_SYSV_FS=m
CONFIG_UFS_FS=m
# CONFIG_UFS_FS_WRITE is not set

#
# Network File Systems
#
CONFIG_NFS_FS=m
CONFIG_NFS_V3=y
# CONFIG_NFS_V4 is not set
CONFIG_NFS_DIRECTIO=y
CONFIG_NFSD=m
CONFIG_NFSD_V3=y
# CONFIG_NFSD_V4 is not set
CONFIG_NFSD_TCP=y
CONFIG_LOCKD=m
CONFIG_LOCKD_V4=y
CONFIG_EXPORTFS=m
CONFIG_SUNRPC=m
# CONFIG_RPCSEC_GSS_KRB5 is not set
# CONFIG_RPCSEC_GSS_SPKM3 is not set
CONFIG_SMB_FS=m
# CONFIG_SMB_NLS_DEFAULT is not set
# CONFIG_CIFS is not set
CONFIG_NCP_FS=m
CONFIG_NCPFS_PACKET_SIGNING=y
CONFIG_NCPFS_IOCTL_LOCKING=y
CONFIG_NCPFS_STRONG=y
CONFIG_NCPFS_NFS_NS=y
CONFIG_NCPFS_OS2_NS=y
CONFIG_NCPFS_SMALLDOS=y
CONFIG_NCPFS_NLS=y
CONFIG_NCPFS_EXTRAS=y
CONFIG_CODA_FS=m
# CONFIG_CODA_FS_OLD_API is not set
CONFIG_AFS_FS=m
CONFIG_RXRPC=m

#
# Partition Types
#
CONFIG_PARTITION_ADVANCED=y
# CONFIG_ACORN_PARTITION is not set
CONFIG_OSF_PARTITION=y
# CONFIG_AMIGA_PARTITION is not set
# CONFIG_ATARI_PARTITION is not set
# CONFIG_MAC_PARTITION is not set
CONFIG_MSDOS_PARTITION=y
CONFIG_BSD_DISKLABEL=y
CONFIG_MINIX_SUBPARTITION=y
CONFIG_SOLARIS_X86_PARTITION=y
CONFIG_UNIXWARE_DISKLABEL=y
# CONFIG_LDM_PARTITION is not set
CONFIG_SGI_PARTITION=y
# CONFIG_ULTRIX_PARTITION is not set
CONFIG_SUN_PARTITION=y
# CONFIG_EFI_PARTITION is not set

#
# Native Language Support
#
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-1"
CONFIG_NLS_CODEPAGE_437=m
CONFIG_NLS_CODEPAGE_737=m
CONFIG_NLS_CODEPAGE_775=m
CONFIG_NLS_CODEPAGE_850=m
CONFIG_NLS_CODEPAGE_852=m
CONFIG_NLS_CODEPAGE_855=m
CONFIG_NLS_CODEPAGE_857=m
CONFIG_NLS_CODEPAGE_860=m
CONFIG_NLS_CODEPAGE_861=m
CONFIG_NLS_CODEPAGE_862=m
CONFIG_NLS_CODEPAGE_863=m
CONFIG_NLS_CODEPAGE_864=m
CONFIG_NLS_CODEPAGE_865=m
CONFIG_NLS_CODEPAGE_866=m
CONFIG_NLS_CODEPAGE_869=m
CONFIG_NLS_CODEPAGE_936=m
CONFIG_NLS_CODEPAGE_950=m
CONFIG_NLS_CODEPAGE_932=m
CONFIG_NLS_CODEPAGE_949=m
CONFIG_NLS_CODEPAGE_874=m
CONFIG_NLS_ISO8859_8=m
CONFIG_NLS_CODEPAGE_1250=m
CONFIG_NLS_CODEPAGE_1251=m
# CONFIG_NLS_ASCII is not set
CONFIG_NLS_ISO8859_1=m
CONFIG_NLS_ISO8859_2=m
CONFIG_NLS_ISO8859_3=m
CONFIG_NLS_ISO8859_4=m
CONFIG_NLS_ISO8859_5=m
CONFIG_NLS_ISO8859_6=m
CONFIG_NLS_ISO8859_7=m
CONFIG_NLS_ISO8859_9=m
CONFIG_NLS_ISO8859_13=m
CONFIG_NLS_ISO8859_14=m
CONFIG_NLS_ISO8859_15=m
CONFIG_NLS_KOI8_R=m
CONFIG_NLS_KOI8_U=m
CONFIG_NLS_UTF8=m

#
# Profiling support
#
CONFIG_PROFILING=y
CONFIG_OPROFILE=m

#
# Kernel hacking
#
# CONFIG_PRINTK_TIME is not set
CONFIG_DEBUG_KERNEL=y
CONFIG_MAGIC_SYSRQ=y
CONFIG_LOG_BUF_SHIFT=14
CONFIG_DETECT_SOFTLOCKUP=y
# CONFIG_SCHEDSTATS is not set
# CONFIG_DEBUG_SLAB is not set
CONFIG_DEBUG_PREEMPT=y
# CONFIG_WAKEUP_TIMING is not set
CONFIG_PREEMPT_TRACE=y
# CONFIG_CRITICAL_PREEMPT_TIMING is not set
# CONFIG_CRITICAL_IRQSOFF_TIMING is not set
CONFIG_RT_DEADLOCK_DETECT=y
CONFIG_DEBUG_RT_LOCKING_MODE=y
# CONFIG_DEBUG_KOBJECT is not set
CONFIG_DEBUG_BUGVERBOSE=y
# CONFIG_DEBUG_INFO is not set
# CONFIG_DEBUG_FS is not set
# CONFIG_USE_FRAME_POINTER is not set
CONFIG_EARLY_PRINTK=y
# CONFIG_DEBUG_STACKOVERFLOW is not set
# CONFIG_KPROBES is not set
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_DEBUG_PAGEALLOC is not set
# CONFIG_4KSTACKS is not set
CONFIG_X86_FIND_SMP_CONFIG=y
CONFIG_X86_MPPARSE=y

#
# Security options
#
# CONFIG_KEYS is not set
CONFIG_SECURITY=y
CONFIG_SECURITY_NETWORK=y
CONFIG_SECURITY_CAPABILITIES=y
# CONFIG_SECURITY_ROOTPLUG is not set
# CONFIG_SECURITY_SECLVL is not set
# CONFIG_SECURITY_SELINUX is not set

#
# Cryptographic options
#
CONFIG_CRYPTO=y
CONFIG_CRYPTO_HMAC=y
CONFIG_CRYPTO_NULL=m
CONFIG_CRYPTO_MD4=m
CONFIG_CRYPTO_MD5=m
CONFIG_CRYPTO_SHA1=m
CONFIG_CRYPTO_SHA256=m
CONFIG_CRYPTO_SHA512=m
# CONFIG_CRYPTO_WP512 is not set
# CONFIG_CRYPTO_TGR192 is not set
CONFIG_CRYPTO_DES=m
CONFIG_CRYPTO_BLOWFISH=m
# CONFIG_CRYPTO_TWOFISH is not set
CONFIG_CRYPTO_SERPENT=m
# CONFIG_CRYPTO_AES_586 is not set
CONFIG_CRYPTO_CAST5=m
# CONFIG_CRYPTO_CAST6 is not set
# CONFIG_CRYPTO_TEA is not set
# CONFIG_CRYPTO_ARC4 is not set
# CONFIG_CRYPTO_KHAZAD is not set
# CONFIG_CRYPTO_ANUBIS is not set
CONFIG_CRYPTO_DEFLATE=m
# CONFIG_CRYPTO_MICHAEL_MIC is not set
# CONFIG_CRYPTO_CRC32C is not set
# CONFIG_CRYPTO_TEST is not set

#
# Hardware crypto devices
#
# CONFIG_CRYPTO_DEV_PADLOCK is not set

#
# Library routines
#
CONFIG_CRC_CCITT=m
CONFIG_CRC32=y
CONFIG_LIBCRC32C=m
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=m
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_X86_SMP=y
CONFIG_X86_HT=y
CONFIG_X86_BIOS_REBOOT=y
CONFIG_X86_TRAMPOLINE=y
CONFIG_PC=y

[-- Attachment #3: krlog3.cap --]
[-- Type: text/plain, Size: 59272 bytes --]

Linux version 2.6.12-rc6-RT-V0.7.48-33 (kr@porky.cybersoft.int) (gcc version 3.4.3 20050227 (Red Hat 3.4.3-22.fc3)) #9 SMP Thu Jun 16 06:05:43 CDT 2005
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
 BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 000000001ff9e000 (usable)
 BIOS-e820: 000000001ff9e000 - 0000000020000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
 BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
511MB LOWMEM available.
found SMP MP-table at 000fe710
DMI 2.3 present.
Intel MultiProcessor Specification v1.4
    Virtual Wire compatibility mode.
OEM ID: DELL     Product ID: WS 620       APIC at: 0xFEE00000
Processor #0 6:8 APIC version 17
Processor #1 6:8 APIC version 17
I/O APIC #2 Version 32 at 0xFEC00000.
Enabling APIC mode:  Flat.  Using 1 I/O APICs
Processors: 2
Allocating PCI resources starting at 20000000 (gap: 20000000:dec00000)
Real-Time Preemption Support (c) Ingo Molnar
Built 1 zonelists
Kernel command line: ro root=LABEL=/ console=ttyS0,38400 console=tty0 nmi_watchdog=1 
Initializing CPU#0
PID hash table entries: 2048 (order: 11, 32768 bytes)
Detected 931.119 MHz processor.
Using tsc for high-res timesource
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 513792k/523896k available (2221k kernel code, 9720k reserved, 1210k data, 232k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Security Framework v1.0.0 initialized
Capability LSM initialized
Mount-cache hash table entries: 512
CPU: L1 I cache: 16K, L1 D cache: 16K
CPU: L2 cache: 256K
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... OK.
CPU0: Intel Pentium III (Coppermine) stepping 06
Booting processor 1/1 eip 2000
Initializing CPU#1
CPU: L1 I cache: 16K, L1 D cache: 16K
CPU: L2 cache: 256K
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel Pentium III (Coppermine) stepping 06
Total of 2 processors activated (3715.07 BogoMIPS).
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 pin1=2 pin2=0
checking TSC synchronization across 2 CPUs: passed.
spawn_desched_task(00000000)
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
desched cpu_callback 3/00000000
desched cpu_callback 2/00000000
desched thread 0 started up.
softlockup thread 0 started up.
desched cpu_callback 3/00000001
desched cpu_callback 2/00000001
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
ksoftirqd started up.
softirq RT prio: 24.
Brought up 2 CPUs
desched thread 1 started up.
softlockup thread 1 started up.
checking if image is initramfs... it is
Freeing initrd memory: 295k freed
NET: Registered protocol family 16
PCI: PCI BIOS revision 2.10 entry at 0xfc03e, last bus=4
PCI: Using configuration type 1
mtrr: v2.0 (20020519)
Linux Plug and Play Support v0.97 (c) Adam Belay
SCSI subsystem initialized
PCI: Probing PCI hardware
PCI: Probing PCI hardware (bus 00)
PCI: Transparent bridge - 0000:00:1e.0
PCI: Using IRQ router PIIX/ICH [8086/2410] at 0000:00:1f.0
PCI->APIC IRQ transform: 0000:00:1f.2[D] -> IRQ 19
PCI->APIC IRQ transform: 0000:00:1f.3[B] -> IRQ 17
PCI->APIC IRQ transform: 0000:01:00.0[A] -> IRQ 16
PCI->APIC IRQ transform: 0000:04:04.0[A] -> IRQ 16
PCI->APIC IRQ transform: 0000:04:05.0[A] -> IRQ 17
PCI->APIC IRQ transform: 0000:04:05.1[B] -> IRQ 18
PCI->APIC IRQ transform: 0000:04:0a.0[A] -> IRQ 18
PCI: Failed to allocate mem resource #0:1000@0 for 0000:03:00.0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Initializing Cryptographic API
nvidiafb: nVidia device/chipset 10DE0103
nvidiafb: nVidia Corporation NV10GL [Quadro]
nvidiafb: HW is currently programmed for CRT
nvidiafb: Using CRT on CRTC 0
nvidiafb: MTRR set to ON
nvidiafb: PCI nVidia NV10 framebuffer (64MB @ 0xE8000000)
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Real Time Clock Driver v1.12
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 8 ports, IRQ sharing disabled
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 8192K size 1024 blocksize
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
ICH: IDE controller at PCI slot 0000:00:1f.1
ICH: chipset revision 2
ICH: not 100% native mode: will probe irqs later
    ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:DMA, hdb:pio
    ide1: BM-DMA at 0xffa8-0xffaf, BIOS settings: hdc:DMA, hdd:pio
hda: SAMSUNG CD-R/RW SW-248F, ATAPI CD/DVD-ROM drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
hdc: Lite-On LTN483S 48x Max, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
scsi0 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
        <Adaptec aic7899 Ultra160 SCSI adapter>
        aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs

  Vendor: QUANTUM   Model: ATLAS10K2-TY092L  Rev: DA40
  Type:   Direct-Access                      ANSI SCSI revision: 03
scsi0:A:0:0: Tagged Queuing enabled.  Depth 32
 target0:0:0: Beginning Domain Validation
WIDTH IS 1
(scsi0:A:0): 6.600MB/s transfers (16bit)
(scsi0:A:0): 160.000MB/s transfers (80.000MHz DT, offset 127, 16bit)
 target0:0:0: Ending Domain Validation
scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
        <Adaptec aic7899 Ultra160 SCSI adapter>
        aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs

  Vendor: SEAGATE   Model: SX118273LC        Rev: 6679
  Type:   Direct-Access                      ANSI SCSI revision: 02
scsi1:A:0:0: Tagged Queuing enabled.  Depth 32
 target1:0:0: Beginning Domain Validation
 target1:0:0: Domain Validation skipping write tests
(scsi1:A:0): 20.000MB/s transfers (20.000MHz, offset 15)
 target1:0:0: Ending Domain Validation
SCSI device sda: 17783239 512-byte hdwr sectors (9105 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 17783239 512-byte hdwr sectors (9105 MB)
SCSI device sda: drive cache: write back
 sda: sda1 sda2 sda3
Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
SCSI device sdb: 35566480 512-byte hdwr sectors (18210 MB)
SCSI device sdb: drive cache: write through
SCSI device sdb: 35566480 512-byte hdwr sectors (18210 MB)
SCSI device sdb: drive cache: write through
 sdb: sdb1
Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
Attached scsi generic sg0 at scsi0, channel 0, id 0, lun 0,  type 0
Attached scsi generic sg1 at scsi1, channel 0, id 0, lun 0,  type 0
mice: PS/2 mouse device common for all mice
md: md driver 0.90.1 MAX_MD_DEVS=256, MD_SB_DISKS=27
NET: Registered protocol family 2
IP: routing cache hash table of 256 buckets, 22Kbytes
TCP established hash table entries: 32768 (order: 9, 3145728 bytes)
TCP bind hash table entries: 32768 (order: 9, 2883584 bytes)
TCP: Hash tables configured (established 32768 bind 32768)
NET: Registered protocol family 1
NET: Registered protocol family 17
NET: Registered protocol family 8
NET: Registered protocol family 20
Testing NMI watchdog ... OK.
Starting balanced_irq
*****************************************************************************
*                                                                           *
*  WARNING, the following debugging options are turned on in your .config:  *
*                                                                           *
*        CONFIG_DEBUG_RT_LOCKING_MODE                                       *
*        CONFIG_RT_DEADLOCK_DETECT                                          *
*        CONFIG_DEBUG_PREEMPT                                               *
*                                                                           *
*  they may increase runtime overhead and latencies considerably!           *
*                                                                           *
*****************************************************************************
Freeing unused kernel memory: 232k freed
input: AT Translated Set 2 keyboard on isa0060/serio0
input: ImPS/2 Generic Wheel Mouse on isa0060/serio1
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting.  Commit interval 5 seconds
BUG: soft lockup detected on CPU#1!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 1
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000002 EDX: c1562000
ESI: c1562000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1efce000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111028>] CPU: 1
EIP is at nmi_show_all_regs+0xf8/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00002332 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1efce000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 4, comm:      softirq-timer/0
EIP: 0060:[<c032a2b8>] CPU: 0
EIP is at _raw_spin_lock+0x68/0x90
 EFLAGS: 00000002    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000001 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: c156e000 EDI: 00000002 EBP: c140f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c0327b13>] schedule+0x53/0x140 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#0!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 0
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000001 EDX: c045a000
ESI: c045a000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 016dc000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c032a2b3>] CPU: 1
EIP is at _raw_spin_lock+0x63/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: dff0a000 EDI: 00000002 EBP: c141f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c032007b>] sigd_send+0x2ab/0x2b0 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 0
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00004919 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 016dc000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#1!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 1
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000002 EDX: c1562000
ESI: c1562000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111028>] CPU: 1
EIP is at nmi_show_all_regs+0xf8/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00007417 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 4, comm:      softirq-timer/0
EIP: 0060:[<c032a2ba>] CPU: 0
EIP is at _raw_spin_lock+0x6a/0x90
 EFLAGS: 00000002    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000001 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: c156e000 EDI: 00000002 EBP: c140f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 15715000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c032007b>] sigd_send+0x2ab/0x2b0 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#0!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 0
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000001 EDX: c045a000
ESI: c045a000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1eb81000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c032a2c1>] CPU: 1
EIP is at _raw_spin_lock+0x71/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: dff0a000 EDI: 00000002 EBP: c141f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c032007b>] sigd_send+0x2ab/0x2b0 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111028>] CPU: 0
EIP is at nmi_show_all_regs+0xf8/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00009e9e EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1eb81000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#1!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 1
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000002 EDX: c1562000
ESI: c1562000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 1
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 0000c572 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 4, comm:      softirq-timer/0
EIP: 0060:[<c032a2c1>] CPU: 0
EIP is at _raw_spin_lock+0x71/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: c156e000 EDI: 00000002 EBP: c140f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1eb81000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c032007b>] sigd_send+0x2ab/0x2b0 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#0!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 0
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000001 EDX: c045a000
ESI: c045a000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1eb81000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c032a2c1>] CPU: 1
EIP is at _raw_spin_lock+0x71/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: dff0a000 EDI: 00000002 EBP: c141f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c032007b>] sigd_send+0x2ab/0x2b0 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 0
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 0000ec86 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1eb81000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#1!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 1
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000002 EDX: c1562000
ESI: c1562000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 1
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 0001139a EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 4, comm:      softirq-timer/0
EIP: 0060:[<c032a2ba>] CPU: 0
EIP is at _raw_spin_lock+0x6a/0x90
 EFLAGS: 00000002    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000001 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: c156e000 EDI: 00000002 EBP: c140f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1eb81000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c0327b13>] schedule+0x53/0x140 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#0!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 0
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000001 EDX: c045a000
ESI: c045a000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7812000 CR3: 15715000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c032a2b3>] CPU: 1
EIP is at _raw_spin_lock+0x63/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: dff0a000 EDI: 00000002 EBP: c141f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c032007b>] sigd_send+0x2ab/0x2b0 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111028>] CPU: 0
EIP is at nmi_show_all_regs+0xf8/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00013aae EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7812000 CR3: 15715000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#1!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 1
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000002 EDX: c1562000
ESI: c1562000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1e5fe000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 1
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 000161c2 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1e5fe000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 4, comm:      softirq-timer/0
EIP: 0060:[<c032a2c1>] CPU: 0
EIP is at _raw_spin_lock+0x71/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: c156e000 EDI: 00000002 EBP: c140f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c0327b13>] schedule+0x53/0x140 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#0!

Pid: 3965, comm:           irqbalance
EIP: 0060:[<c0328aa9>] CPU: 0
EIP is at __down+0x1a9/0x430
 EFLAGS: 00000286    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000001 EBX: def975ac ECX: 00000000 EDX: 00000003
ESI: def975e4 EDI: 00000000 EBP: 00000286 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0172741>] sys_fstat64+0x31/0x40 (68)
 [<c0148180>] generic_write_checks+0x1b0/0x300 (20)
 [<c0328d43>] rt_down_write+0x13/0x20 (20)
 [<c01099ed>] sys_mmap2+0x4d/0xb0 (8)
 [<c01099ed>] sys_mmap2+0x4d/0xb0 (4)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (44)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c032a2b3>] CPU: 1
EIP is at _raw_spin_lock+0x63/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: dff0a000 EDI: 00000002 EBP: c141f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 016de000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c032007b>] sigd_send+0x2ab/0x2b0 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 3965, comm:           irqbalance
EIP: 0060:[<c0111028>] CPU: 0
EIP is at nmi_show_all_regs+0xf8/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00018cbe EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c01eba46>] __copy_to_user_ll+0x76/0xc0 (8)
 [<c0105a46>] do_IRQ+0x26/0x40 (36)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (16)
 [<c0328aa9>] __down+0x1a9/0x430 (44)
 [<c0172741>] sys_fstat64+0x31/0x40 (76)
 [<c0148180>] generic_write_checks+0x1b0/0x300 (20)
 [<c0328d43>] rt_down_write+0x13/0x20 (20)
 [<c01099ed>] sys_mmap2+0x4d/0xb0 (8)
 [<c01099ed>] sys_mmap2+0x4d/0xb0 (4)
 [<c010320b>] sysenter_past_esp+0x54/0x75 (44)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#1!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 1
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000002 EDX: c1562000
ESI: c1562000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1e5fe000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 1
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 0001b77e EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1e5fe000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 4, comm:      softirq-timer/0
EIP: 0060:[<c032a2ba>] CPU: 0
EIP is at _raw_spin_lock+0x6a/0x90
 EFLAGS: 00000002    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000001 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: c156e000 EDI: 00000002 EBP: c140f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (36)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#0!

Pid: 3965, comm:           irqbalance
EIP: 0060:[<c0143420>] CPU: 0
EIP is at cpuset_zone_allowed+0x0/0x40
 EFLAGS: 00000202    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000001 EBX: c0380f80 ECX: 00000000 EDX: 00000001
ESI: 00000000 EDI: 000080d2 EBP: c0381da0 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c014b1c2>] __alloc_pages+0x1b2/0x4a0 (4)
 [<c015721e>] do_anonymous_page+0x8e/0x190 (68)
 [<c0165317>] do_truncate+0x57/0x60 (12)
 [<c015738c>] do_no_page+0x6c/0x3e0 (20)
 [<c013b130>] local_irq_restore+0x30/0x50 (32)
 [<c01579c4>] handle_mm_fault+0x184/0x1c0 (32)
 [<c011373a>] do_page_fault+0x1aa/0x5a0 (48)
 [<c0109a28>] sys_mmap2+0x88/0xb0 (116)
 [<c0139f21>] rt_up_write+0x31/0xb0 (20)
 [<c0109a28>] sys_mmap2+0x88/0xb0 (12)
 [<c0109a28>] sys_mmap2+0x88/0xb0 (20)
 [<c0113590>] do_page_fault+0x0/0x5a0 (36)
 [<c0103d5f>] error_code+0x4f/0x54 (8)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c032a2ba>] CPU: 1
EIP is at _raw_spin_lock+0x6a/0x90
 EFLAGS: 00000002    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000001 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: dff0a000 EDI: 00000002 EBP: c141f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1e5fe000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c0327b13>] schedule+0x53/0x140 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 3965, comm:           irqbalance
EIP: 0060:[<c0111028>] CPU: 0
EIP is at nmi_show_all_regs+0xf8/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 0001e205 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (16)
 [<c0143420>] cpuset_zone_allowed+0x0/0x40 (44)
 [<c014b1c2>] __alloc_pages+0x1b2/0x4a0 (12)
 [<c015721e>] do_anonymous_page+0x8e/0x190 (68)
 [<c0165317>] do_truncate+0x57/0x60 (12)
 [<c015738c>] do_no_page+0x6c/0x3e0 (20)
 [<c013b130>] local_irq_restore+0x30/0x50 (32)
 [<c01579c4>] handle_mm_fault+0x184/0x1c0 (32)
 [<c011373a>] do_page_fault+0x1aa/0x5a0 (48)
 [<c0109a28>] sys_mmap2+0x88/0xb0 (116)
 [<c0139f21>] rt_up_write+0x31/0xb0 (20)
 [<c0109a28>] sys_mmap2+0x88/0xb0 (12)
 [<c0109a28>] sys_mmap2+0x88/0xb0 (20)
 [<c0113590>] do_page_fault+0x0/0x5a0 (36)
 [<c0103d5f>] error_code+0x4f/0x54 (8)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#1!

Pid: 4139, comm:                 nifd
EIP: 0073:[<42076090>] CPU: 1
EIP is at 0x42076090
 ESP: 007b:bf8b535c EFLAGS: 00000286    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000020 EBX: bf8b53a7 ECX: 0000003a EDX: 42166e40
ESI: bf8b5393 EDI: 08163f70 EBP: bf8b55b8 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1efce000 CR4: 000006d0
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 4139, comm:                 nifd
EIP: 0060:[<c0111028>] CPU: 1
EIP is at nmi_show_all_regs+0xf8/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00020d03 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1efce000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (16)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 4, comm:      softirq-timer/0
EIP: 0060:[<c032a2c1>] CPU: 0
EIP is at _raw_spin_lock+0x71/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: c156e000 EDI: 00000002 EBP: c140f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (36)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#0!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 0
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000001 EDX: c045a000
ESI: c045a000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f2676e CR3: 15715000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c032a2c1>] CPU: 1
EIP is at _raw_spin_lock+0x71/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: dff0a000 EDI: 00000002 EBP: c141f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7fb6000 CR3: 1efce000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c0327b13>] schedule+0x53/0x140 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 0
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00023825 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f2676e CR3: 15715000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#1!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 1
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000002 EDX: c1562000
ESI: c1562000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 1
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00026325 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 4, comm:      softirq-timer/0
EIP: 0060:[<c032a2c1>] CPU: 0
EIP is at _raw_spin_lock+0x71/0x90
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: c156e000 EDI: 00000002 EBP: c140f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f2676e CR3: 1eb81000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c0327b13>] schedule+0x53/0x140 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

BUG: soft lockup detected on CPU#0!

Pid: 0, comm:              swapper
EIP: 0060:[<c0100d1a>] CPU: 0
EIP is at default_idle+0x2a/0x40
 EFLAGS: 00000246    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c0100cf0 ECX: 00000001 EDX: c045a000
ESI: c045a000 EDI: c0492300 EBP: c0492380 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f2676e CR3: 1eb81000 CR4: 000006d0
 [<c0100dd3>] cpu_idle+0x63/0xe0 (4)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20010003 ]
| 3-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c032a2ba>] CPU: 1
EIP is at _raw_spin_lock+0x6a/0x90
 EFLAGS: 00000002    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000001 EBX: c0448384 ECX: 00000000 EDX: 00000001
ESI: dff0a000 EDI: 00000002 EBP: c141f760 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f1d000 CR3: 1f3b7000 CR4: 000006d0
 [<c012764a>] run_timer_softirq+0x3a/0x3b0 (16)
 [<c0327b01>] schedule+0x41/0x140 (24)
 [<c032007b>] sigd_send+0x2ab/0x2b0 (16)
 [<c012329b>] ksoftirqd+0xeb/0x1b0 (20)
 [<c01231b0>] ksoftirqd+0x0/0x1b0 (28)
 [<c013458d>] kthread+0xbd/0x100 (4)
 [<c01344d0>] kthread+0x0/0x100 (28)
 [<c01011e5>] kernel_thread_helper+0x5/0x10 (16)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)

NMI show regs on CPU#0:

Pid: 0, comm:              swapper
EIP: 0060:[<c0111020>] CPU: 0
EIP is at nmi_show_all_regs+0xf0/0x130
 EFLAGS: 00000046    Not tainted  (2.6.12-rc6-RT-V0.7.48-33)
EAX: 00000000 EBX: c049af20 ECX: 00000000 EDX: 00000000
ESI: 00028982 EDI: 00000000 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f2676e CR3: 1eb81000 CR4: 000006d0
 [<c0143c38>] softlockup_tick+0xc8/0xe0 (24)
 [<c010847c>] timer_interrupt+0x7c/0xa0 (28)
 [<c0143f36>] handle_IRQ_event+0x66/0xf0 (16)
 [<c01440e1>] __do_IRQ+0x101/0x190 (48)
 [<c0105a46>] do_IRQ+0x26/0x40 (44)
 [<c0100cf0>] default_idle+0x0/0x40 (8)
 [<c0103c2a>] common_interrupt+0x1a/0x20 (8)
 [<c0100cf0>] default_idle+0x0/0x40 (4)
 [<c0100d1a>] default_idle+0x2a/0x40 (40)
 [<c0100dd3>] cpu_idle+0x63/0xe0 (12)
 [<c045ca16>] start_kernel+0x1a6/0x260 (36)
 [<c045c390>] unknown_bootoption+0x0/0x210 (20)
---------------------------
| preempt count: 20020004 ]
| 4-level deep critical section nesting:
----------------------------------------
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a269>] .... _raw_spin_lock+0x19/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c032a2cf>] .... _raw_spin_lock+0x7f/0x90
.....[<00000000>] ..   ( <= 0x0)
.. [<c013b424>] .... print_traces+0x14/0x40
.....[<00000000>] ..   ( <= 0x0)


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 11:22     ` K.R. Foley
@ 2005-06-16 17:32       ` Ingo Molnar
  2005-06-16 17:59         ` K.R. Foley
  2005-06-17 19:28         ` William Weston
  0 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-16 17:32 UTC (permalink / raw)
  To: K.R. Foley; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* K.R. Foley <kr@cybsft.com> wrote:

> > could you uncomment the IO_APIC_CACHE define in 
> > arch/i386/kernel/io_apic.c, and could you uncomment line 1109 in 
> > drivers/ide/ide-io.c - does this fix things? (in apic mode)

> Couple of things: 1) I could not find IO_APIC_CACHE anywhere. I could 
> find IOAPIC_CACHE but the define was not commented in io_apic.c. Also 
> the BUG_ON at line 1109 in ide-io.c was not commented out either. So I 
> made the mental leap that you actually meant to comment these out 
> instead of uncomment them??? [...]

yeah, sorry :-|

> [...] That works to get the system booted. Although I am getting many 
> soft lockups now, minutes after the boot. Log attached. [...]

hm, do you get actual lockups, or only the messages about them? I.e.  
does the system work fine if you [the sounds of careful thinking to get 
the word right] disable CONFIG_DETECT_SOFTLOCKUP, or does it lock up 
silently?

> [...] 2) In my infinite wisdom before :-) I failed to attach my config 
> as I should have done before. Also, commenting out

this looks like a sentence worth finishing? :)

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 17:32       ` Ingo Molnar
@ 2005-06-16 17:59         ` K.R. Foley
  2005-06-16 20:37           ` K.R. Foley
  2005-06-16 20:43           ` Ingo Molnar
  2005-06-17 19:28         ` William Weston
  1 sibling, 2 replies; 139+ messages in thread
From: K.R. Foley @ 2005-06-16 17:59 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

Ingo Molnar wrote:
> * K.R. Foley <kr@cybsft.com> wrote:
> 
> 
>>>could you uncomment the IO_APIC_CACHE define in 
>>>arch/i386/kernel/io_apic.c, and could you uncomment line 1109 in 
>>>drivers/ide/ide-io.c - does this fix things? (in apic mode)
> 
> 
>>Couple of things: 1) I could not find IO_APIC_CACHE anywhere. I could 
>>find IOAPIC_CACHE but the define was not commented in io_apic.c. Also 
>>the BUG_ON at line 1109 in ide-io.c was not commented out either. So I 
>>made the mental leap that you actually meant to comment these out 
>>instead of uncomment them??? [...]
> 
> 
> yeah, sorry :-|
> 

OK so there really was no mental leap. It was more like a 
trip,stumble,roll,grasp :-) I actually discovered the real meaning of 
the above after commenting out only one of the above and failed boot. 
Only then did it dawn on me what you were trying for. Hence the last 
line of my email not being finished.

> 
>>[...] That works to get the system booted. Although I am getting many 
>>soft lockups now, minutes after the boot. Log attached. [...]
> 
> 
> hm, do you get actual lockups, or only the messages about them? I.e.  
> does the system work fine if you [the sounds of careful thinking to get 
> the word right] disable CONFIG_DETECT_SOFTLOCKUP, or does it lock up 
> silently?

There doesn't seem to be any actual lockups, just messages. I will try 
disabling the above when I get home this evening. Can't get to the 
system right now.

> 
> 
>>[...] 2) In my infinite wisdom before :-) I failed to attach my config 
>>as I should have done before. Also, commenting out
> 
> 
> this looks like a sentence worth finishing? :)
Actually see my comment above about the "trip,stumble,roll,grasp" The 
line above is the point at which I realized what was going on. :-D

> 
> 	Ingo
> 


-- 
    kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 17:59         ` K.R. Foley
@ 2005-06-16 20:37           ` K.R. Foley
  2005-06-17 11:08             ` Ingo Molnar
  2005-06-16 20:43           ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: K.R. Foley @ 2005-06-16 20:37 UTC (permalink / raw)
  Cc: Ingo Molnar, linux-kernel, Eugeny S. Mints, Daniel Walker

K.R. Foley wrote:
> Ingo Molnar wrote:
> 
>> * K.R. Foley <kr@cybsft.com> wrote:
>>
>>
>>>> could you uncomment the IO_APIC_CACHE define in 
>>>> arch/i386/kernel/io_apic.c, and could you uncomment line 1109 in 
>>>> drivers/ide/ide-io.c - does this fix things? (in apic mode)
>>
>>
>>
>>> Couple of things: 1) I could not find IO_APIC_CACHE anywhere. I could 
>>> find IOAPIC_CACHE but the define was not commented in io_apic.c. Also 
>>> the BUG_ON at line 1109 in ide-io.c was not commented out either. So 
>>> I made the mental leap that you actually meant to comment these out 
>>> instead of uncomment them??? [...]
>>
>>
>>
>> yeah, sorry :-|
>>
> 
> OK so there really was no mental leap. It was more like a 
> trip,stumble,roll,grasp :-) I actually discovered the real meaning of 
> the above after commenting out only one of the above and failed boot. 
> Only then did it dawn on me what you were trying for. Hence the last 
> line of my email not being finished.
> 
>>
>>> [...] That works to get the system booted. Although I am getting many 
>>> soft lockups now, minutes after the boot. Log attached. [...]
>>
>>
>>
>> hm, do you get actual lockups, or only the messages about them? I.e.  
>> does the system work fine if you [the sounds of careful thinking to 
>> get the word right] disable CONFIG_DETECT_SOFTLOCKUP, or does it lock 
>> up silently?
> 

Just had an opportunity to check this. Everything does indeed seem to be 
working OK with this disabled. No lock up messages, no perceived problems.

> 
> There doesn't seem to be any actual lockups, just messages. I will try 
> disabling the above when I get home this evening. Can't get to the 
> system right now.
> 
>>
>>
>>> [...] 2) In my infinite wisdom before :-) I failed to attach my 
>>> config as I should have done before. Also, commenting out
>>
>>
>>
>> this looks like a sentence worth finishing? :)
> 
> Actually see my comment above about the "trip,stumble,roll,grasp" The 
> line above is the point at which I realized what was going on. :-D
> 
>>
>>     Ingo
>>
> 
> 


-- 
    kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 17:59         ` K.R. Foley
  2005-06-16 20:37           ` K.R. Foley
@ 2005-06-16 20:43           ` Ingo Molnar
  2005-06-17  2:06             ` Gene Heskett
                               ` (2 more replies)
  1 sibling, 3 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-16 20:43 UTC (permalink / raw)
  To: K.R. Foley; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* K.R. Foley <kr@cybsft.com> wrote:

> >>[...] That works to get the system booted. Although I am getting many 
> >>soft lockups now, minutes after the boot. Log attached. [...]
> >
> >
> >hm, do you get actual lockups, or only the messages about them? I.e.  
> >does the system work fine if you [the sounds of careful thinking to get 
> >the word right] disable CONFIG_DETECT_SOFTLOCKUP, or does it lock up 
> >silently?
> 
> There doesn't seem to be any actual lockups, just messages. I will try 
> disabling the above when I get home this evening. Can't get to the 
> system right now.

i tweaked the softlockup detector in the last patch a bit (to fix false 
positives under very high loads), might have broken it on SMP.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 20:43           ` Ingo Molnar
@ 2005-06-17  2:06             ` Gene Heskett
  2005-06-17  4:53             ` Gene Heskett
  2005-06-17 11:18             ` Ingo Molnar
  2 siblings, 0 replies; 139+ messages in thread
From: Gene Heskett @ 2005-06-17  2:06 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar, K.R. Foley, Eugeny S. Mints, Daniel Walker

On Thursday 16 June 2005 16:43, Ingo Molnar wrote:
>* K.R. Foley <kr@cybsft.com> wrote:
>> >>[...] That works to get the system booted. Although I am getting
>> >> many soft lockups now, minutes after the boot. Log attached.
>> >> [...]
>> >
>> >hm, do you get actual lockups, or only the messages about them?
>> > I.e. does the system work fine if you [the sounds of careful
>> > thinking to get the word right] disable
>> > CONFIG_DETECT_SOFTLOCKUP, or does it lock up silently?
>>
>> There doesn't seem to be any actual lockups, just messages. I will
>> try disabling the above when I get home this evening. Can't get to
>> the system right now.
>
>i tweaked the softlockup detector in the last patch a bit (to fix
> false positives under very high loads), might have broken it on
> SMP.
>
> Ingo

I noticed that -33 seems to have a measurable lifetime, so I did the 
edits mentioned in this thread and built it.  Running now.  Gotcha's 
if any, reported later.  Preempt Mode=3

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 20:43           ` Ingo Molnar
  2005-06-17  2:06             ` Gene Heskett
@ 2005-06-17  4:53             ` Gene Heskett
  2005-06-17 11:18             ` Ingo Molnar
  2 siblings, 0 replies; 139+ messages in thread
From: Gene Heskett @ 2005-06-17  4:53 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar, K.R. Foley, Eugeny S. Mints, Daniel Walker

On Thursday 16 June 2005 16:43, Ingo Molnar wrote:
>* K.R. Foley <kr@cybsft.com> wrote:
>> >>[...] That works to get the system booted. Although I am getting
>> >> many soft lockups now, minutes after the boot. Log attached.
>> >> [...]
>> >
>> >hm, do you get actual lockups, or only the messages about them?
>> > I.e. does the system work fine if you [the sounds of careful
>> > thinking to get the word right] disable
>> > CONFIG_DETECT_SOFTLOCKUP, or does it lock up silently?
>>
>> There doesn't seem to be any actual lockups, just messages. I will
>> try disabling the above when I get home this evening. Can't get to
>> the system right now.
>
>i tweaked the softlockup detector in the last patch a bit (to fix
> false positives under very high loads), might have broken it on
> SMP.
>
> Ingo

I'm not sure what it is I've got here.  I just tried to restart boinc, 
which hadn't run here in 10 days or so, cause its not housebroken yet 
IMO, and got this in the shell I started it from after a failed 
connection to berkeley attempt, followed by a repeat access:
2005-06-17 00:41:47 [Einstein@Home] Scheduler request to 
http://einstein.phys.uwm.edu/EinsteinAtHome_cgi/cgi succeeded
2005-06-17 00:41:47 [---] request_reschedule_cpus: files downloaded
2005-06-17 00:41:47 [---] schedule_cpus: must schedule
2005-06-17 00:41:47 [---] New work fetch policy: work fetch allowed.
2005-06-17 00:41:47 [---] New CPU scheduler policy: highest debt 
first.
SIGSEGV: segmentation violationStack trace (7 frames):
./boinc[0x807e54e]
[0xffffe420]
./boinc[0x80536e0]
./boinc[0x80725ab]
./boinc[0x80726a8]
/usr/lib/tls/i686/libc.so.6(__libc_start_main+0xe4)[0x4b8b6ad4]
./boinc[0x804ae91]

Exiting...
connect: Operation now in progress
init_poll: get_socket_error(): 111
init_poll: get_socket_error(): 111
already tried both ports, giving up
[1]+  Done                    ./run_client
[root@coyote BOINC]#

Can any sense be made from this?  This is 48-33 with the two items 
mentioned before in this thread disabled.                                                

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 20:37           ` K.R. Foley
@ 2005-06-17 11:08             ` Ingo Molnar
  0 siblings, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-17 11:08 UTC (permalink / raw)
  To: K.R. Foley; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* K.R. Foley <kr@cybsft.com> wrote:

> Just had an opportunity to check this. Everything does indeed seem to 
> be working OK with this disabled. No lock up messages, no perceived 
> problems.

btw., you have this enabled in your config:

   CONFIG_DEBUG_RT_LOCKING_MODE=y

this causes old-style spinlocking to be activated by default. I.e. you 
dont get most of the benefits of PREEMPT_RT. You can reactivate it via:

	echo 1 > /proc/sys/kernel/preempt_locks

but obviously this runtime flag involves some runtime overhead in the 
locking code. This .config option is mainly meant to enable the 
measurement of the locking overhead of PREEMPT_RT, and to debug boot 
problems that might be related to PREEMPT_RT locking.  So you'd almost 
always want to run with DEBUG_RT_LOCKING_MODE turned off.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 20:43           ` Ingo Molnar
  2005-06-17  2:06             ` Gene Heskett
  2005-06-17  4:53             ` Gene Heskett
@ 2005-06-17 11:18             ` Ingo Molnar
  2005-06-17 14:12               ` K.R. Foley
  2005-06-17 15:33               ` K.R. Foley
  2 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-17 11:18 UTC (permalink / raw)
  To: K.R. Foley; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker


* Ingo Molnar <mingo@elte.hu> wrote:

> > There doesn't seem to be any actual lockups, just messages. I will try 
> > disabling the above when I get home this evening. Can't get to the 
> > system right now.
> 
> i tweaked the softlockup detector in the last patch a bit (to fix 
> false positives under very high loads), might have broken it on SMP.

yeah - found a bug that could explain the symptoms on your system.  
Called softlockup_tick() from the global timer interrupt, instead of the 
per-CPU timer interrupt. So on SMP the other CPUs would not see any 
softlockup ticks at all, and would incorrectly report soft lockups.  
This bug is fixed in the -48-36 patch i just uploaded.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-17 11:18             ` Ingo Molnar
@ 2005-06-17 14:12               ` K.R. Foley
  2005-06-17 15:33               ` K.R. Foley
  1 sibling, 0 replies; 139+ messages in thread
From: K.R. Foley @ 2005-06-17 14:12 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

Ingo Molnar wrote:
> * Ingo Molnar <mingo@elte.hu> wrote:
> 
> 
>>>There doesn't seem to be any actual lockups, just messages. I will try 
>>>disabling the above when I get home this evening. Can't get to the 
>>>system right now.
>>
>>i tweaked the softlockup detector in the last patch a bit (to fix 
>>false positives under very high loads), might have broken it on SMP.
> 
> 
> yeah - found a bug that could explain the symptoms on your system.  
> Called softlockup_tick() from the global timer interrupt, instead of the 
> per-CPU timer interrupt. So on SMP the other CPUs would not see any 
> softlockup ticks at all, and would incorrectly report soft lockups.  
> This bug is fixed in the -48-36 patch i just uploaded.
> 
> 	Ingo
> 
Yes I noticed the softlockup_tick() in some stack traces that I
generated with -48-35 last night. Just downloaded and starting to
compile -48-36. Will report back the results. Also will turn of the
CONFIG_DEBUG_RT_LOCKING_MODE mentioned in your previous mail.

thanks.

-- 
   kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-17 11:18             ` Ingo Molnar
  2005-06-17 14:12               ` K.R. Foley
@ 2005-06-17 15:33               ` K.R. Foley
  1 sibling, 0 replies; 139+ messages in thread
From: K.R. Foley @ 2005-06-17 15:33 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel, Eugeny S. Mints, Daniel Walker

Ingo Molnar wrote:
> * Ingo Molnar <mingo@elte.hu> wrote:
> 
> 
>>>There doesn't seem to be any actual lockups, just messages. I will try 
>>>disabling the above when I get home this evening. Can't get to the 
>>>system right now.
>>
>>i tweaked the softlockup detector in the last patch a bit (to fix 
>>false positives under very high loads), might have broken it on SMP.
> 
> 
> yeah - found a bug that could explain the symptoms on your system.  
> Called softlockup_tick() from the global timer interrupt, instead of the 
> per-CPU timer interrupt. So on SMP the other CPUs would not see any 
> softlockup ticks at all, and would incorrectly report soft lockups.  
> This bug is fixed in the -48-36 patch i just uploaded.
> 
> 	Ingo
> 

-48-36 has been up and running for about 45 minutes now and everything
seems much better. I held off because the soft lock ups didn't seem to
manifest themselves right away.

thanks,

-- 
   kr

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-16 17:32       ` Ingo Molnar
  2005-06-16 17:59         ` K.R. Foley
@ 2005-06-17 19:28         ` William Weston
  2005-06-17 21:30           ` William Weston
                             ` (2 more replies)
  1 sibling, 3 replies; 139+ messages in thread
From: William Weston @ 2005-06-17 19:28 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

Ingo,

My Xeon/HT box running -48-33 locked up after being up for three days.
This is better uptime than I've seen on this box since -47-19.

CONFIG_DETECT_SOFTLOCKUP and CONFIG_RT_DEADLOCK_DETECT are enabled.  
CONFIG_DEBUG_RT_LOCKING_MODE is disabled.

All of the HPET options are enabled.  I noticed your comments about HPET 
in the adeos thread.  Should I disable HPET if I don't have any specific 
need for it?

Fortunately, there were some dumps (all ns83820 tx related) left in the 
logs before the machine locked:

Jun 17 03:21:42 manzanita kernel: eth0: tx_timeout: tx_done_idx=50 free_idx=51 cmdsts=08000042
Jun 17 03:21:42 manzanita kernel: BUG: sleeping function called from invalid context softirq-timer/1 (13) at kernel/rt.c:1658
Jun 17 03:21:42 manzanita kernel: in_atomic():0 [20000000], irqs_disabled():536870912
Jun 17 03:21:42 manzanita kernel:  [<c0103eaa>] dump_stack+0x23/0x25 (20)
Jun 17 03:21:42 manzanita kernel:  [<c011b39a>] __might_sleep+0xde/0xf9 (36)
Jun 17 03:21:42 manzanita kernel:  [<c02fdae5>] _spin_lock_irq+0x3b/0x55 (32)
Jun 17 03:21:42 manzanita kernel:  [<df839291>] do_tx_done+0x24/0x1e2 [ns83820] (48)
Jun 17 03:21:42 manzanita kernel:  [<df839d41>] ns83820_tx_timeout+0x64/0xb1 [ns83820] (40)
Jun 17 03:21:42 manzanita kernel:  [<df839e23>] ns83820_tx_watch+0x95/0xb8 [ns83820] (40)
Jun 17 03:21:42 manzanita kernel:  [<c012856d>] run_timer_softirq+0x1e9/0x406 (64)
Jun 17 03:21:42 manzanita kernel:  [<c0124622>] ksoftirqd+0xe9/0x19d (32)
Jun 17 03:21:42 manzanita kernel:  [<c013436b>] kthread+0xab/0xd3 (48)
Jun 17 03:21:44 manzanita kernel:  [<c0101119>] kernel_thread_helper+0x5/0xb (1052196892)
Jun 17 03:21:44 manzanita kernel: ---------------------------
Jun 17 03:21:44 manzanita kernel: | preempt count: 20000001 ]
Jun 17 03:21:44 manzanita kernel: | 1-level deep critical section nesting:
Jun 17 03:21:44 manzanita kernel: ----------------------------------------
Jun 17 03:21:44 manzanita kernel: .. [<c013d513>] .... print_traces+0x1b/0x52
Jun 17 03:21:44 manzanita kernel: .....[<c0103eaa>] ..   ( <= dump_stack+0x23/0x25)
Jun 17 03:21:44 manzanita kernel: 
Jun 17 03:21:44 manzanita kernel: eth0: after: tx_done_idx=51 free_idx=51 cmdsts=00000000

Three additional dumps like this one follow at 03:21:51, 04:02:06, and 
04:06:26 before the machine locked.

I also regularly see high (>200us) wakeup latencies on the Xeon/HT, which
I don't see on the Athlon or non-HT Xeon systems.  Disabling IRQ balancing
doesn't seem to help.  It's been a while since the Xeon/HT box has seen a 
non-debug kernel, but in the past, that hasn't helped latencies by more 
than a few usec.

preemption latency trace v1.1.4 on 2.6.12-rc6-RT-V0.7.48-33-debug
--------------------------------------------------------------------
 latency: 255 us, #29/29, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:2)
    -----------------
    | task: X-3006 (uid:0 nice:0 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
  <idle>-0     0Dnh.    0us : smp_reschedule_interrupt (c0100c8a 0 0)
  <idle>-0     0Dnh.    1us : preempt_schedule_irq (need_resched)
  <idle>-0     0Dnh.    1us : __schedule (preempt_schedule_irq)
  <idle>-0     0Dnh1    2us : sched_clock (__schedule)
  <idle>-0     0Dnh1    2us : _raw_spin_lock_irq (__schedule)
  <idle>-0     0Dnh1    2us : _raw_spin_lock_irqsave (__schedule)
  <idle>-0     0Dnh2    3us : _raw_spin_unlock (__schedule)
  <idle>-0     0Dnh1    3us : preempt_schedule (__schedule)
  <idle>-0     0Dnh1    3us : _raw_spin_lock (__schedule)
  <idle>-0     0Dnh2    4us : find_next_bit (__schedule)
  <idle>-0     0Dnh2    4us : _raw_spin_lock (__schedule)
  <idle>-0     0Dnh3    4us!: find_next_bit (__schedule)
  <idle>-0     0Dnh3  244us : find_next_bit (__schedule)
  <idle>-0     0Dnh3  245us : _raw_spin_unlock (__schedule)
  <idle>-0     0Dnh2  245us : preempt_schedule (__schedule)
  <idle>-0     0Dnh2  246us : find_next_bit (__schedule)
  <idle>-0     0Dnh2  246us : trace_array (__schedule)
  <idle>-0     0Dnh2  248us : trace_array <<...>-3006> (31 78)
  <idle>-0     0Dnh2  249us : trace_array <<...>-3367> (75 78)
  <idle>-0     0Dnh2  250us+: trace_array (__schedule)
   <...>-3006  0Dnh2  252us : __switch_to (__schedule)
   <...>-3006  0Dnh2  253us : __schedule <<idle>-0> (8c 31)
   <...>-3006  0Dnh2  254us : _raw_spin_unlock (__schedule)
   <...>-3006  0Dnh1  254us : trace_stop_sched_switched (__schedule)
   <...>-3006  0Dnh1  254us : trace_stop_sched_switched <<...>-3006> (31 0)
   <...>-3006  0Dnh1  254us : _raw_spin_lock (trace_stop_sched_switched)
   <...>-3006  0Dnh1  255us : trace_stop_sched_switched (__schedule)

preemption latency trace v1.1.4 on 2.6.12-rc6-RT-V0.7.48-33-debug
--------------------------------------------------------------------
 latency: 224 us, #37/37, CPU#1 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:2)
    -----------------
    | task: wmfortune-3144 (uid:500 nice:0 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
  <idle>-0     1Dnh.    0us : smp_reschedule_interrupt (c0100c8a 0 0)
  <idle>-0     1Dnh.    0us : preempt_schedule_irq (need_resched)
  <idle>-0     1Dnh.    1us : __schedule (preempt_schedule_irq)
  <idle>-0     1Dnh1    1us : sched_clock (__schedule)
  <idle>-0     1Dnh1    2us : _raw_spin_lock_irq (__schedule)
  <idle>-0     1Dnh1    2us : _raw_spin_lock_irqsave (__schedule)
  <idle>-0     1Dnh2    3us : pull_rt_tasks (__schedule)
  <idle>-0     1Dnh2    3us : double_lock_balance (pull_rt_tasks)
  <idle>-0     1Dnh2    3us : _raw_spin_trylock (double_lock_balance)
  <idle>-0     1Dnh3    3us : pick_rt_task (pull_rt_tasks)
  <idle>-0     1Dnh3    4us!: find_next_bit (pick_rt_task)
  <idle>-0     1Dnh3  211us : _raw_spin_unlock (pull_rt_tasks)
  <idle>-0     1Dnh2  211us : preempt_schedule (pull_rt_tasks)
  <idle>-0     1Dnh2  212us : find_next_bit (pull_rt_tasks)
  <idle>-0     1Dnh2  212us : find_next_bit (pull_rt_tasks)
  <idle>-0     1Dnh2  212us : _raw_spin_unlock (__schedule)
  <idle>-0     1Dnh1  213us : preempt_schedule (__schedule)
  <idle>-0     1Dnh1  213us : _raw_spin_lock (__schedule)
  <idle>-0     1Dnh2  213us : find_next_bit (__schedule)
  <idle>-0     1Dnh2  213us : _raw_spin_lock (__schedule)
  <idle>-0     1Dnh3  214us : find_next_bit (__schedule)
  <idle>-0     1Dnh3  214us : find_next_bit (__schedule)
  <idle>-0     1Dnh3  215us : _raw_spin_unlock (__schedule)
  <idle>-0     1Dnh2  215us : preempt_schedule (__schedule)
  <idle>-0     1Dnh2  215us : find_next_bit (__schedule)
  <idle>-0     1Dnh2  216us : trace_array (__schedule)
  <idle>-0     1Dnh2  217us : trace_array <<...>-3144> (31 78)
  <idle>-0     1Dnh2  218us : trace_array (__schedule)
   <...>-3144  1Dnh2  220us : __switch_to (__schedule)
   <...>-3144  1Dnh2  221us : __schedule <<idle>-0> (8c 31)
   <...>-3144  1Dnh2  221us : _raw_spin_unlock (__schedule)
   <...>-3144  1Dnh1  222us : trace_stop_sched_switched (__schedule)
   <...>-3144  1Dnh1  222us : trace_stop_sched_switched <<...>-3144> (31 0)
   <...>-3144  1Dnh1  223us : _raw_spin_lock (trace_stop_sched_switched)
   <...>-3144  1Dnh1  224us : trace_stop_sched_switched (__schedule)

My build of -48-36 just completed.  I'll see how it behaves for me and 
keep you posted.


Best Regards,
--William Weston <weston@sysex.net>

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-17 19:28         ` William Weston
@ 2005-06-17 21:30           ` William Weston
  2005-06-18 12:28             ` Ingo Molnar
  2005-06-21 13:10           ` Ingo Molnar
  2005-06-21 13:12           ` [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
  2 siblings, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-17 21:30 UTC (permalink / raw)
  To: William Weston
  Cc: Ingo Molnar, K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: TEXT/PLAIN, Size: 309 bytes --]


Running -48-36 on the Xeon/HT box, I lost keyboard and network after a
couple hours.  Same .config as was used for -48-33 (attached... forgot to
send in previous email).  Xscreensaver was still running with no way to
unlock the console.  Back to -48-33 for the time being.


regards,
--ww  <weston@sysex.net>

[-- Attachment #2: Type: TEXT/PLAIN, Size: 8110 bytes --]

CONFIG_X86=y
CONFIG_MMU=y
CONFIG_UID16=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y
CONFIG_EXPERIMENTAL=y
CONFIG_BROKEN=y
CONFIG_BROKEN_ON_SMP=y
CONFIG_LOCK_KERNEL=y
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_LOCALVERSION="-debug"
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_POSIX_MQUEUE=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_SYSCTL=y
CONFIG_AUDIT=y
CONFIG_AUDITSYSCALL=y
CONFIG_HOTPLUG=y
CONFIG_KOBJECT_UEVENT=y
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SHMEM=y
CONFIG_CC_ALIGN_FUNCTIONS=0
CONFIG_CC_ALIGN_LABELS=0
CONFIG_CC_ALIGN_LOOPS=0
CONFIG_CC_ALIGN_JUMPS=0
CONFIG_BASE_SMALL=0
CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y
CONFIG_MODULE_FORCE_UNLOAD=y
CONFIG_OBSOLETE_MODPARM=y
CONFIG_MODVERSIONS=y
CONFIG_MODULE_SRCVERSION_ALL=y
CONFIG_KMOD=y
CONFIG_STOP_MACHINE=y
CONFIG_X86_PC=y
CONFIG_MPENTIUM4=y
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=7
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_SMP=y
CONFIG_NR_CPUS=2
CONFIG_SCHED_SMT=y
CONFIG_PREEMPT_RT=y
CONFIG_PREEMPT=y
CONFIG_PREEMPT_SOFTIRQS=y
CONFIG_PREEMPT_HARDIRQS=y
CONFIG_PREEMPT_RCU=y
CONFIG_PREEMPT_BKL=y
CONFIG_RWSEM_GENERIC_SPINLOCK=y
CONFIG_ASM_SEMAPHORES=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_TSC=y
CONFIG_X86_MCE=y
CONFIG_X86_MCE_NONFATAL=y
CONFIG_X86_MCE_P4THERMAL=y
CONFIG_MICROCODE=m
CONFIG_X86_MSR=m
CONFIG_X86_CPUID=m
CONFIG_NOHIGHMEM=y
CONFIG_MTRR=y
CONFIG_IRQBALANCE=y
CONFIG_HAVE_DEC_LOCK=y
CONFIG_SECCOMP=y
CONFIG_PM=y
CONFIG_ACPI=y
CONFIG_ACPI_BOOT=y
CONFIG_ACPI_INTERPRETER=y
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_THERMAL=y
CONFIG_ACPI_BLACKLIST_YEAR=0
CONFIG_ACPI_BUS=y
CONFIG_ACPI_EC=y
CONFIG_ACPI_POWER=y
CONFIG_ACPI_PCI=y
CONFIG_ACPI_SYSTEM=y
CONFIG_X86_PM_TIMER=y
CONFIG_APM=y
CONFIG_APM_RTC_IS_GMT=y
CONFIG_PCI=y
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_PCI_LEGACY_PROC=y
CONFIG_PCI_NAMES=y
CONFIG_ISA_DMA_API=y
CONFIG_ISA=y
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_MISC=y
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_PNP=y
CONFIG_PNPBIOS=y
CONFIG_PNPACPI=y
CONFIG_BLK_DEV_FD=y
CONFIG_BLK_DEV_LOOP=y
CONFIG_BLK_DEV_RAM=m
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=4096
CONFIG_INITRAMFS_SOURCE=""
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y
CONFIG_BLK_DEV_IDEDISK=y
CONFIG_IDEDISK_MULTI_MODE=y
CONFIG_BLK_DEV_IDECD=y
CONFIG_IDE_TASK_IOCTL=y
CONFIG_IDE_GENERIC=y
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_SHARE_IRQ=y
CONFIG_BLK_DEV_GENERIC=y
CONFIG_BLK_DEV_IDEDMA_PCI=y
CONFIG_IDEDMA_PCI_AUTO=y
CONFIG_BLK_DEV_PIIX=y
CONFIG_BLK_DEV_IDEDMA=y
CONFIG_IDEDMA_AUTO=y
CONFIG_NET=y
CONFIG_PACKET=y
CONFIG_PACKET_MMAP=y
CONFIG_UNIX=y
CONFIG_NET_KEY=m
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_MROUTE=y
CONFIG_IP_TCPDIAG=y
CONFIG_XFRM=y
CONFIG_BRIDGE=m
CONFIG_VLAN_8021Q=m
CONFIG_LLC=m
CONFIG_LLC2=m
CONFIG_NET_PKTGEN=m
CONFIG_NETDEVICES=y
CONFIG_TUN=m
CONFIG_NET_ETHERNET=y
CONFIG_MII=m
CONFIG_NET_VENDOR_3COM=y
CONFIG_VORTEX=m
CONFIG_NET_TULIP=y
CONFIG_TULIP=m
CONFIG_TULIP_MMIO=y
CONFIG_TULIP_NAPI=y
CONFIG_TULIP_NAPI_HW_MITIGATION=y
CONFIG_DE4X5=m
CONFIG_NET_PCI=y
CONFIG_E100=m
CONFIG_DL2K=m
CONFIG_E1000=m
CONFIG_NS83820=m
CONFIG_INPUT=y
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1280
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=1024
CONFIG_INPUT_EVDEV=y
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
CONFIG_INPUT_MISC=y
CONFIG_INPUT_PCSPKR=m
CONFIG_INPUT_UINPUT=m
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_SERPORT=m
CONFIG_SERIO_PCIPS2=y
CONFIG_SERIO_LIBPS2=y
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_SERIAL_8250_NR_UARTS=2
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_UNIX98_PTYS=y
CONFIG_HW_RANDOM=y
CONFIG_NVRAM=y
CONFIG_RTC=y
CONFIG_BLOCKER=m
CONFIG_AGP=y
CONFIG_AGP_INTEL=y
CONFIG_DRM=y
CONFIG_DRM_I915=y
CONFIG_HPET=y
CONFIG_HPET_RTC_IRQ=y
CONFIG_HPET_MMAP=y
CONFIG_I2C=m
CONFIG_I2C_CHARDEV=m
CONFIG_I2C_ALGOBIT=m
CONFIG_I2C_ALGOPCF=m
CONFIG_I2C_ALGOPCA=m
CONFIG_I2C_I801=m
CONFIG_I2C_PIIX4=m
CONFIG_I2C_ISA=m
CONFIG_I2C_SENSOR=m
CONFIG_SENSORS_LM83=m
CONFIG_SENSORS_LM85=m
CONFIG_SENSORS_LM87=m
CONFIG_SENSORS_LM90=m
CONFIG_SENSORS_EEPROM=m
CONFIG_SENSORS_PCF8574=m
CONFIG_SENSORS_PCF8591=m
CONFIG_SENSORS_RTC8564=m
CONFIG_VIDEO_SELECT=y
CONFIG_VGA_CONSOLE=y
CONFIG_DUMMY_CONSOLE=y
CONFIG_SOUND=m
CONFIG_SND=m
CONFIG_SND_TIMER=m
CONFIG_SND_PCM=m
CONFIG_SND_HWDEP=m
CONFIG_SND_RAWMIDI=m
CONFIG_SND_SEQUENCER=m
CONFIG_SND_SEQ_DUMMY=m
CONFIG_SND_OSSEMUL=y
CONFIG_SND_MIXER_OSS=m
CONFIG_SND_PCM_OSS=m
CONFIG_SND_SEQUENCER_OSS=y
CONFIG_SND_RTCTIMER=m
CONFIG_SND_MPU401_UART=m
CONFIG_SND_DUMMY=m
CONFIG_SND_VIRMIDI=m
CONFIG_SND_SERIAL_U16550=m
CONFIG_SND_MPU401=m
CONFIG_SND_AC97_CODEC=m
CONFIG_SND_EMU10K1=m
CONFIG_SND_INTEL8X0=m
CONFIG_SND_INTEL8X0M=m
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_EXT2_FS=y
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
CONFIG_EXT2_FS_SECURITY=y
CONFIG_EXT3_FS=y
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
CONFIG_EXT3_FS_SECURITY=y
CONFIG_JBD=y
CONFIG_JBD_DEBUG=y
CONFIG_FS_MBCACHE=y
CONFIG_FS_POSIX_ACL=y
CONFIG_ROMFS_FS=m
CONFIG_DNOTIFY=y
CONFIG_AUTOFS4_FS=m
CONFIG_ISO9660_FS=m
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_ZISOFS_FS=m
CONFIG_UDF_FS=m
CONFIG_UDF_NLS=y
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_SYSFS=y
CONFIG_DEVPTS_FS_XATTR=y
CONFIG_DEVPTS_FS_SECURITY=y
CONFIG_TMPFS=y
CONFIG_TMPFS_XATTR=y
CONFIG_TMPFS_SECURITY=y
CONFIG_RAMFS=y
CONFIG_CRAMFS=m
CONFIG_NFS_FS=m
CONFIG_NFS_V3=y
CONFIG_NFSD=m
CONFIG_NFSD_V3=y
CONFIG_LOCKD=m
CONFIG_LOCKD_V4=y
CONFIG_EXPORTFS=m
CONFIG_SUNRPC=m
CONFIG_SMB_FS=m
CONFIG_SMB_NLS_DEFAULT=y
CONFIG_SMB_NLS_REMOTE="cp437"
CONFIG_CIFS=m
CONFIG_CIFS_STATS=y
CONFIG_CIFS_XATTR=y
CONFIG_CIFS_POSIX=y
CONFIG_NCP_FS=m
CONFIG_NCPFS_PACKET_SIGNING=y
CONFIG_NCPFS_IOCTL_LOCKING=y
CONFIG_NCPFS_STRONG=y
CONFIG_NCPFS_NFS_NS=y
CONFIG_NCPFS_OS2_NS=y
CONFIG_NCPFS_SMALLDOS=y
CONFIG_NCPFS_NLS=y
CONFIG_NCPFS_EXTRAS=y
CONFIG_MSDOS_PARTITION=y
CONFIG_NLS=m
CONFIG_NLS_DEFAULT="iso8859-1"
CONFIG_NLS_CODEPAGE_437=m
CONFIG_NLS_CODEPAGE_850=m
CONFIG_NLS_ASCII=m
CONFIG_NLS_ISO8859_1=m
CONFIG_NLS_ISO8859_15=m
CONFIG_NLS_UTF8=m
CONFIG_PROFILING=y
CONFIG_DEBUG_KERNEL=y
CONFIG_MAGIC_SYSRQ=y
CONFIG_LOG_BUF_SHIFT=19
CONFIG_DETECT_SOFTLOCKUP=y
CONFIG_DEBUG_PREEMPT=y
CONFIG_WAKEUP_TIMING=y
CONFIG_PREEMPT_TRACE=y
CONFIG_LATENCY_TIMING=y
CONFIG_LATENCY_TRACE=y
CONFIG_MCOUNT=y
CONFIG_RT_DEADLOCK_DETECT=y
CONFIG_DEBUG_BUGVERBOSE=y
CONFIG_DEBUG_INFO=y
CONFIG_FRAME_POINTER=y
CONFIG_EARLY_PRINTK=y
CONFIG_DEBUG_STACKOVERFLOW=y
CONFIG_X86_FIND_SMP_CONFIG=y
CONFIG_X86_MPPARSE=y
CONFIG_SECURITY=y
CONFIG_SECURITY_NETWORK=y
CONFIG_SECURITY_CAPABILITIES=m
CONFIG_SECURITY_SECLVL=m
CONFIG_SECURITY_SELINUX=y
CONFIG_SECURITY_SELINUX_BOOTPARAM=y
CONFIG_SECURITY_SELINUX_BOOTPARAM_VALUE=0
CONFIG_SECURITY_SELINUX_DISABLE=y
CONFIG_SECURITY_SELINUX_DEVELOP=y
CONFIG_SECURITY_SELINUX_AVC_STATS=y
CONFIG_SECURITY_SELINUX_CHECKREQPROT_VALUE=1
CONFIG_CRYPTO=y
CONFIG_CRYPTO_MD5=y
CONFIG_CRYPTO_SHA1=y
CONFIG_CRYPTO_DES=y
CONFIG_CRYPTO_CRC32C=y
CONFIG_CRC_CCITT=y
CONFIG_CRC32=y
CONFIG_LIBCRC32C=y
CONFIG_ZLIB_INFLATE=m
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_X86_SMP=y
CONFIG_X86_HT=y
CONFIG_X86_BIOS_REBOOT=y
CONFIG_X86_TRAMPOLINE=y
CONFIG_PC=y

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-17 21:30           ` William Weston
@ 2005-06-18 12:28             ` Ingo Molnar
  2005-06-21  1:18               ` William Weston
  2005-06-23  2:05               ` William Weston
  0 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-18 12:28 UTC (permalink / raw)
  To: William Weston
  Cc: William Weston, K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@lysdexia.org> wrote:

> Running -48-36 on the Xeon/HT box, I lost keyboard and network after a 
> couple hours.  Same .config as was used for -48-33 (attached... forgot 
> to send in previous email).  Xscreensaver was still running with no 
> way to unlock the console.  Back to -48-33 for the time being.

does -48-37 work any better?

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-18 12:28             ` Ingo Molnar
@ 2005-06-21  1:18               ` William Weston
  2005-06-23  2:05               ` William Weston
  1 sibling, 0 replies; 139+ messages in thread
From: William Weston @ 2005-06-21  1:18 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

On Sat, 18 Jun 2005, Ingo Molnar wrote:

> * William Weston <weston@lysdexia.org> wrote:
> 
> > Running -48-36 on the Xeon/HT box, I lost keyboard and network after a 
> > couple hours.  Same .config as was used for -48-33 (attached... forgot 
> > to send in previous email).  Xscreensaver was still running with no 
> > way to unlock the console.  Back to -48-33 for the time being.
> 
> does -48-37 work any better?

Up almost three hours with -48-37, and no issues so far.  Thanks, Ingo. 
I'll let this run for a couple of days and then try out the -50-xx series.


--ww <weston@sysex.net>

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-17 19:28         ` William Weston
  2005-06-17 21:30           ` William Weston
@ 2005-06-21 13:10           ` Ingo Molnar
  2005-06-21 19:08             ` William Weston
  2005-06-21 20:17             ` Benjamin LaHaise
  2005-06-21 13:12           ` [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
  2 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-21 13:10 UTC (permalink / raw)
  To: William Weston
  Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker,
	linux-ns83820, nhorman, Jeff Garzik


* William Weston <weston@sysex.net> wrote:

> Fortunately, there were some dumps (all ns83820 tx related) left in 
> the logs before the machine locked:

i'm not sure it's related to the lockup - but there is a generic bug in 
the driver, which in ns83820_tx_timeout() does:

	local_irq_save(flags);
	...
	CALL do_tx_done()

		spin_lock_irq(&dev->tx_lock);
		...
		spin_unlock_irq(&dev->tx_lock); // [1]
	...
	local_irq_restore(flags); // [2]

this leads to interrupts being enabled at [1], while the intention was 
to enable them at [2]. To solve this bug we can do the tx-locking in 
ns83820_tx_timeout(). (local_irq_disable() use in ns83820_tx_timeout() 
was probably SMP-unsafe too, but needs a rare race.)

find the patch below - it's also included in the -50-05 -RT tree i just 
uploaded. Can you confirm that you dont get the warnings in the -50-05 
(and later) -RT kernels?

	Ingo

Index: drivers/net/ns83820.c
===================================================================
--- drivers/net/ns83820.c.orig
+++ drivers/net/ns83820.c
@@ -1013,8 +1013,6 @@ static void do_tx_done(struct net_device
 	struct ns83820 *dev = PRIV(ndev);
 	u32 cmdsts, tx_done_idx, *desc;
 
-	spin_lock_irq(&dev->tx_lock);
-
 	dprintk("do_tx_done(%p)\n", ndev);
 	tx_done_idx = dev->tx_done_idx;
 	desc = dev->tx_descs + (tx_done_idx * DESC_SIZE);
@@ -1070,7 +1068,6 @@ static void do_tx_done(struct net_device
 		netif_start_queue(ndev);
 		netif_wake_queue(ndev);
 	}
-	spin_unlock_irq(&dev->tx_lock);
 }
 
 static void ns83820_cleanup_tx(struct ns83820 *dev)
@@ -1371,7 +1368,9 @@ static void ns83820_do_isr(struct net_de
 	 * work has accumulated
 	 */
 	if ((ISR_TXDESC | ISR_TXIDLE | ISR_TXOK | ISR_TXERR) & isr) {
+		spin_lock_irq(&dev->tx_lock);
 		do_tx_done(ndev);
+		spin_unlock_irq(&dev->tx_lock);
 
 		/* Disable TxOk if there are no outstanding tx packets.
 		 */
@@ -1456,7 +1455,7 @@ static void ns83820_tx_timeout(struct ne
         u32 tx_done_idx, *desc;
 	unsigned long flags;
 
-	local_irq_save(flags);
+	spin_lock_irqsave(&dev->tx_lock, flags);
 
 	tx_done_idx = dev->tx_done_idx;
 	desc = dev->tx_descs + (tx_done_idx * DESC_SIZE);
@@ -1483,7 +1482,7 @@ static void ns83820_tx_timeout(struct ne
 		ndev->name,
 		tx_done_idx, dev->tx_free_idx, le32_to_cpu(desc[DESC_CMDSTS]));
 
-	local_irq_restore(flags);
+	spin_unlock_irqrestore(&dev->tx_lock, flags);
 }
 

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-17 19:28         ` William Weston
  2005-06-17 21:30           ` William Weston
  2005-06-21 13:10           ` Ingo Molnar
@ 2005-06-21 13:12           ` Ingo Molnar
       [not found]             ` <Pine.LNX.4.58.0506211228210.16701@echo.lysdexia.org>
  2 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-21 13:12 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> I also regularly see high (>200us) wakeup latencies on the Xeon/HT, 
> which I don't see on the Athlon or non-HT Xeon systems.  Disabling IRQ 
> balancing doesn't seem to help.  It's been a while since the Xeon/HT 
> box has seen a non-debug kernel, but in the past, that hasn't helped 
> latencies by more than a few usec.

>   <idle>-0     0Dnh2    4us : find_next_bit (__schedule)
>   <idle>-0     0Dnh2    4us : _raw_spin_lock (__schedule)
>   <idle>-0     0Dnh3    4us!: find_next_bit (__schedule)
>   <idle>-0     0Dnh3  244us : find_next_bit (__schedule)
>   <idle>-0     0Dnh3  245us : _raw_spin_unlock (__schedule)

this does seem to be similar to other reports where the cause of such 
latencies was some sort of hardware-level latency. (DMA related delays 
or other, bus-arbitration related delays)

another possibility is that something interesting happened on another 
CPU while this latency occured - to debug this please enable all-CPUs 
tracing:

	echo 1 > /proc/sys/kernel/trace_all_cpus

and send me a new trace.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-21 13:10           ` Ingo Molnar
@ 2005-06-21 19:08             ` William Weston
  2005-06-21 20:17             ` Benjamin LaHaise
  1 sibling, 0 replies; 139+ messages in thread
From: William Weston @ 2005-06-21 19:08 UTC (permalink / raw)
  To: Ingo Molnar
  Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker,
	linux-ns83820, nhorman, Jeff Garzik

On Tue, 21 Jun 2005, Ingo Molnar wrote:

> i'm not sure it's related to the lockup - but there is a generic bug in 
> the driver, which in ns83820_tx_timeout() does:
> 
> 	local_irq_save(flags);
> 	...
> 	CALL do_tx_done()
> 
> 		spin_lock_irq(&dev->tx_lock);
> 		...
> 		spin_unlock_irq(&dev->tx_lock); // [1]
> 	...
> 	local_irq_restore(flags); // [2]
> 
> this leads to interrupts being enabled at [1], while the intention was 
> to enable them at [2]. To solve this bug we can do the tx-locking in 
> ns83820_tx_timeout(). (local_irq_disable() use in ns83820_tx_timeout() 
> was probably SMP-unsafe too, but needs a rare race.)
> 
> find the patch below - it's also included in the -50-05 -RT tree i just 
> uploaded. Can you confirm that you dont get the warnings in the -50-05 
> (and later) -RT kernels?
> 
> 	Ingo

-48-37 still gave the warnings on ns83820_tx_timeout(), but otherwise ran
for a day without any lockups or loss of network or keyboard.  No warnings 
so far with -50-06.  I'll keep you posted.


--ww <weston@sysex.net>


> Index: drivers/net/ns83820.c
> ===================================================================
> --- drivers/net/ns83820.c.orig
> +++ drivers/net/ns83820.c
> @@ -1013,8 +1013,6 @@ static void do_tx_done(struct net_device
>  	struct ns83820 *dev = PRIV(ndev);
>  	u32 cmdsts, tx_done_idx, *desc;
>  
> -	spin_lock_irq(&dev->tx_lock);
> -
>  	dprintk("do_tx_done(%p)\n", ndev);
>  	tx_done_idx = dev->tx_done_idx;
>  	desc = dev->tx_descs + (tx_done_idx * DESC_SIZE);
> @@ -1070,7 +1068,6 @@ static void do_tx_done(struct net_device
>  		netif_start_queue(ndev);
>  		netif_wake_queue(ndev);
>  	}
> -	spin_unlock_irq(&dev->tx_lock);
>  }
>  
>  static void ns83820_cleanup_tx(struct ns83820 *dev)
> @@ -1371,7 +1368,9 @@ static void ns83820_do_isr(struct net_de
>  	 * work has accumulated
>  	 */
>  	if ((ISR_TXDESC | ISR_TXIDLE | ISR_TXOK | ISR_TXERR) & isr) {
> +		spin_lock_irq(&dev->tx_lock);
>  		do_tx_done(ndev);
> +		spin_unlock_irq(&dev->tx_lock);
>  
>  		/* Disable TxOk if there are no outstanding tx packets.
>  		 */
> @@ -1456,7 +1455,7 @@ static void ns83820_tx_timeout(struct ne
>          u32 tx_done_idx, *desc;
>  	unsigned long flags;
>  
> -	local_irq_save(flags);
> +	spin_lock_irqsave(&dev->tx_lock, flags);
>  
>  	tx_done_idx = dev->tx_done_idx;
>  	desc = dev->tx_descs + (tx_done_idx * DESC_SIZE);
> @@ -1483,7 +1482,7 @@ static void ns83820_tx_timeout(struct ne
>  		ndev->name,
>  		tx_done_idx, dev->tx_free_idx, le32_to_cpu(desc[DESC_CMDSTS]));
>  
> -	local_irq_restore(flags);
> +	spin_unlock_irqrestore(&dev->tx_lock, flags);
>  }
>  
> 

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-21 13:10           ` Ingo Molnar
  2005-06-21 19:08             ` William Weston
@ 2005-06-21 20:17             ` Benjamin LaHaise
  2005-06-21 20:37               ` William Weston
  2005-06-22  2:42               ` Gene Heskett
  1 sibling, 2 replies; 139+ messages in thread
From: Benjamin LaHaise @ 2005-06-21 20:17 UTC (permalink / raw)
  To: Ingo Molnar
  Cc: William Weston, K.R. Foley, linux-kernel, Eugeny S. Mints,
	Daniel Walker, linux-ns83820, nhorman, Jeff Garzik

On Tue, Jun 21, 2005 at 03:10:09PM +0200, Ingo Molnar wrote:
> find the patch below - it's also included in the -50-05 -RT tree i just 
> uploaded. Can you confirm that you dont get the warnings in the -50-05 
> (and later) -RT kernels?

Looks good.  Acked-by: Benjamin LaHaise <bcrl@kvack.org>

		-ben

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-21 20:17             ` Benjamin LaHaise
@ 2005-06-21 20:37               ` William Weston
  2005-06-21 20:48                 ` Benjamin LaHaise
  2005-06-22  2:42               ` Gene Heskett
  1 sibling, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-21 20:37 UTC (permalink / raw)
  To: Benjamin LaHaise
  Cc: Ingo Molnar, William Weston, K.R. Foley, linux-kernel,
	Eugeny S. Mints, Daniel Walker, linux-ns83820, nhorman,
	Jeff Garzik

On Tue, 21 Jun 2005, Benjamin LaHaise wrote:

> On Tue, Jun 21, 2005 at 03:10:09PM +0200, Ingo Molnar wrote:
> > find the patch below - it's also included in the -50-05 -RT tree i just 
> > uploaded. Can you confirm that you dont get the warnings in the -50-05 
> > (and later) -RT kernels?
> 
> Looks good.  Acked-by: Benjamin LaHaise <bcrl@kvack.org>
> 
> 		-ben

-50-06 locked up shortly after starting:

	dd if=/dev/urandom of=/dev/null bs=8192

No bug warnings on the ns83820, but I did get these messages (last thing 
that made it syslog):

Jun 21 12:29:37 manzanita kernel: eth0: tx_timeout: tx_done_idx=90 free_idx=95 cmdsts=08000068
Jun 21 12:29:37 manzanita kernel: eth0: after: tx_done_idx=95 free_idx=95 cmdsts=00000000
Jun 21 12:29:51 manzanita kernel: eth0: tx_timeout: tx_done_idx=126 free_idx=3 cmdsts=080000ea
Jun 21 12:29:51 manzanita kernel: eth0: after: tx_done_idx=3 free_idx=3 cmdsts=00000000
Jun 21 12:30:11 manzanita kernel: eth0: tx_timeout: tx_done_idx=17 free_idx=19 cmdsts=08000042
Jun 21 12:30:11 manzanita kernel: eth0: after: tx_done_idx=19 free_idx=19 cmdsts=00000000

Anything to worry about?

--ww

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-21 20:37               ` William Weston
@ 2005-06-21 20:48                 ` Benjamin LaHaise
  0 siblings, 0 replies; 139+ messages in thread
From: Benjamin LaHaise @ 2005-06-21 20:48 UTC (permalink / raw)
  To: William Weston
  Cc: Ingo Molnar, K.R. Foley, linux-kernel, Eugeny S. Mints,
	Daniel Walker, linux-ns83820, nhorman, Jeff Garzik

On Tue, Jun 21, 2005 at 01:37:35PM -0700, William Weston wrote:
> No bug warnings on the ns83820, but I did get these messages (last thing 
> that made it syslog):

Normal use should never be triggering a tx timeout, but it was tested back 
when it was written and shouldn't be causing a hang.  What sort of setup 
is this?  You'll probably need a serial console to catch the dieing gasp 
of the kernel, as it will likely be enlightening.

		-ben

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-21 20:17             ` Benjamin LaHaise
  2005-06-21 20:37               ` William Weston
@ 2005-06-22  2:42               ` Gene Heskett
  2005-06-22  7:40                 ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-22  2:42 UTC (permalink / raw)
  To: linux-kernel
  Cc: Benjamin LaHaise, Ingo Molnar, William Weston, K.R. Foley,
	Eugeny S. Mints, Daniel Walker, linux-ns83820, nhorman,
	Jeff Garzik

On Tuesday 21 June 2005 16:17, Benjamin LaHaise wrote:
>On Tue, Jun 21, 2005 at 03:10:09PM +0200, Ingo Molnar wrote:
>> find the patch below - it's also included in the -50-05 -RT tree i
>> just uploaded. Can you confirm that you dont get the warnings in
>> the -50-05 (and later) -RT kernels?
>
>Looks good.  Acked-by: Benjamin LaHaise <bcrl@kvack.org>
>
>  -ben

FWIW, 50-06 is running clean here with mode 3 & no hardirq threading.  
Uptime is about 9 hours.

Would it do any good to try mode 4 & see if tvtime still runs?  
Previously, I got the impression that was a dma problem & posted some 
of the logs, but I've not noted any fixes for that go by.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22  2:42               ` Gene Heskett
@ 2005-06-22  7:40                 ` Ingo Molnar
  2005-06-22 13:27                   ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-22  7:40 UTC (permalink / raw)
  To: Gene Heskett
  Cc: linux-kernel, Benjamin LaHaise, William Weston, K.R. Foley,
	Eugeny S. Mints, Daniel Walker, linux-ns83820, nhorman,
	Jeff Garzik


* Gene Heskett <gene.heskett@verizon.net> wrote:

> FWIW, 50-06 is running clean here with mode 3 & no hardirq threading.  
> Uptime is about 9 hours.
> 
> Would it do any good to try mode 4 & see if tvtime still runs?  
> Previously, I got the impression that was a dma problem & posted some 
> of the logs, but I've not noted any fixes for that go by.

sure, any extra testing - even if it finds no problems, is just as 
useful. Especially if you have a .config where everything works. That 
way we'll know for sure that any regressions are related to PREEMPT_RT.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
       [not found]             ` <Pine.LNX.4.58.0506211228210.16701@echo.lysdexia.org>
@ 2005-06-22  8:03               ` Ingo Molnar
  2005-06-22  8:24               ` Ingo Molnar
  1 sibling, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-22  8:03 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

>                  _------=> CPU#            
>                 / _-----=> irqs-off        
>                | / _----=> need-resched    
>                || / _---=> hardirq/softirq 
>                ||| / _--=> preempt-depth   
>                |||| /                      
>                |||||     delay             
>    cmd     pid ||||| time  |   caller      
>       \   /    |||||   \   |   /           
[...]
>   wmResh-3189  1....    1us : up_mutex (sock_def_readable)
>   wmResh-3189  1....    2us : __up_mutex (up_mutex)
>   <idle>-0     0Dnh2    2us : _raw_spin_unlock (__schedule)
>   <idle>-0     0Dnh1    2us!: preempt_schedule (__schedule)
>   wmResh-3189  1Dnh.  204us : _raw_spin_lock (__up_mutex)
>   wmResh-3189  1Dnh1  205us : _raw_spin_unlock (__up_mutex)
>   <idle>-0     0Dnh1  205us : _raw_spin_lock (__schedule)
>   wmResh-3189  1....  205us : _read_unlock (unix_stream_sendmsg)

look at the CPU# column, we have trace entries from both CPU#0 and CPU#1 
- and both of them are delayed by 200 usecs! The CPU#0 delay happened in 
the idle thread, between preempt_schedule() in __schedule() and 
_raw_spin_lock in __schedule(). It's a codepath where there's no 
spinning done. The CPU#1 delay happened in the wmResh process, between 
__up_mutex()'s entry and the first _raw_spin_lock() it did. This too is 
a codepath where no spinning is done. (and even if there was spinning, 
the two locks are not the same.)

in other words, since there is no OS-level explanation for the delay, 
this can only be an effect of the hardware/system. (Or it could be a bug 
in the measurement, but the likelyhood of seeing a 200 usec bump in the 
measurement is quite small.)

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
       [not found]             ` <Pine.LNX.4.58.0506211228210.16701@echo.lysdexia.org>
  2005-06-22  8:03               ` Ingo Molnar
@ 2005-06-22  8:24               ` Ingo Molnar
  2005-06-22 10:08                 ` Ingo Molnar
  2005-06-22 21:53                 ` William Weston
  1 sibling, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-22  8:24 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> Attached are two typical traces and the .config from my Xeon/HT box, 
> currently running -50-06 with a normal desktop workload (X, wmaker, 
> ten dockapps, several xterms, and firefox).

the second trace seems to be a cross-CPU wakeup bug. It's not completely 
clear from the trace what happened - but we measured the latency of a 
task (wmcube-3191), where the wakeup happened on CPU#0 and wmcube-3191 
was queued to CPU#1 which was idle at that time. The bug is that it 
wasnt until timestamp 306us that this actually happened - and CPU#1 was 
just idling around in default_idle() for no good reason. CPU#1 should 
have run wmcube-3191 at around timestamp 13us.

I've uploaded the -50-07 kernel which will put some more info into the 
traces - could you try to repeat the measurement and get similar 
latencies? As i guess you already found out that you can always reset 
the measurement to get a new set of traces, via:

	echo 0 > /proc/sys/kernel/preempt_max_latency

(it's not a problem if you send me multiple latency traces, i'll figure 
out which is the most useful one.)

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22  8:24               ` Ingo Molnar
@ 2005-06-22 10:08                 ` Ingo Molnar
  2005-06-22 21:53                 ` William Weston
  1 sibling, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-22 10:08 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* Ingo Molnar <mingo@elte.hu> wrote:

> * William Weston <weston@sysex.net> wrote:
> 
> > Attached are two typical traces and the .config from my Xeon/HT box, 
> > currently running -50-06 with a normal desktop workload (X, wmaker, 
> > ten dockapps, several xterms, and firefox).
> 
> the second trace seems to be a cross-CPU wakeup bug. It's not 
> completely clear from the trace what happened - but we measured the 
> latency of a task (wmcube-3191), where the wakeup happened on CPU#0 
> and wmcube-3191 was queued to CPU#1 which was idle at that time. The 
> bug is that it wasnt until timestamp 306us that this actually happened 
> - and CPU#1 was just idling around in default_idle() for no good 
> reason. CPU#1 should have run wmcube-3191 at around timestamp 13us.

ok, managed to reproduce it on a HT box, and it turned out to be a bug 
in the SMT scheduler: the dependent sleeper logic incorrectly delayed 
high-prio tasks, causing these latencies. I fixed it in the -50-10 
kernel - could you redo your tests with that kernel (or later versions)?

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22  7:40                 ` Ingo Molnar
@ 2005-06-22 13:27                   ` Gene Heskett
  2005-06-22 13:51                     ` Gene Heskett
  2005-06-25  4:41                     ` Ingo Molnar
  0 siblings, 2 replies; 139+ messages in thread
From: Gene Heskett @ 2005-06-22 13:27 UTC (permalink / raw)
  To: linux-kernel
  Cc: Ingo Molnar, Benjamin LaHaise, William Weston, K.R. Foley,
	Eugeny S. Mints, Daniel Walker, linux-ns83820, nhorman,
	Jeff Garzik

[-- Attachment #1: Type: text/plain, Size: 1364 bytes --]

On Wednesday 22 June 2005 03:40, Ingo Molnar wrote:
>* Gene Heskett <gene.heskett@verizon.net> wrote:
>> FWIW, 50-06 is running clean here with mode 3 & no hardirq
>> threading. Uptime is about 9 hours.
>>
>> Would it do any good to try mode 4 & see if tvtime still runs?
>> Previously, I got the impression that was a dma problem & posted
>> some of the logs, but I've not noted any fixes for that go by.
>
>sure, any extra testing - even if it finds no problems, is just as
>useful. Especially if you have a .config where everything works.
> That way we'll know for sure that any regressions are related to
> PREEMPT_RT.
>
> Ingo

I can report that mode 4 is not at all well here.  I turned it on and 
changed the extraversion, built it, and when it booted, it got to 
this line and hung:

Checking to see if this processor honours the WP bit even in 
supervisor mode... OK.

And I had to use the hardware reset to recover & boot to a mode 3 
version of 50-06.

That .config is attached.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

[-- Attachment #2: .config --]
[-- Type: text/plain, Size: 37190 bytes --]

#
# Automatically generated make config: don't edit
# Linux kernel version: 2.6.12-RT-V0.7.50-06-GH
# Wed Jun 22 09:25:57 2005
#
CONFIG_X86=y
CONFIG_MMU=y
CONFIG_UID16=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y

#
# Code maturity level options
#
CONFIG_EXPERIMENTAL=y
# CONFIG_CLEAN_COMPILE is not set
CONFIG_BROKEN=y
CONFIG_BROKEN_ON_SMP=y
CONFIG_LOCK_KERNEL=y
CONFIG_INIT_ENV_ARG_LIMIT=32

#
# General setup
#
CONFIG_LOCALVERSION=""
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
# CONFIG_POSIX_MQUEUE is not set
CONFIG_BSD_PROCESS_ACCT=y
# CONFIG_BSD_PROCESS_ACCT_V3 is not set
CONFIG_SYSCTL=y
# CONFIG_AUDIT is not set
CONFIG_HOTPLUG=y
CONFIG_KOBJECT_UEVENT=y
CONFIG_IKCONFIG=y
# CONFIG_IKCONFIG_PROC is not set
# CONFIG_EMBEDDED is not set
CONFIG_KALLSYMS=y
# CONFIG_KALLSYMS_ALL is not set
# CONFIG_KALLSYMS_EXTRA_PASS is not set
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SHMEM=y
CONFIG_CC_ALIGN_FUNCTIONS=0
CONFIG_CC_ALIGN_LABELS=0
CONFIG_CC_ALIGN_LOOPS=0
CONFIG_CC_ALIGN_JUMPS=0
# CONFIG_TINY_SHMEM is not set
CONFIG_BASE_SMALL=0

#
# Loadable module support
#
CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y
# CONFIG_MODULE_FORCE_UNLOAD is not set
CONFIG_OBSOLETE_MODPARM=y
# CONFIG_MODVERSIONS is not set
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_KMOD=y

#
# Processor type and features
#
CONFIG_X86_PC=y
# CONFIG_X86_ELAN is not set
# CONFIG_X86_VOYAGER is not set
# CONFIG_X86_NUMAQ is not set
# CONFIG_X86_SUMMIT is not set
# CONFIG_X86_BIGSMP is not set
# CONFIG_X86_VISWS is not set
# CONFIG_X86_GENERICARCH is not set
# CONFIG_X86_ES7000 is not set
# CONFIG_M386 is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
# CONFIG_MPENTIUMIII is not set
# CONFIG_MPENTIUMM is not set
# CONFIG_MPENTIUM4 is not set
# CONFIG_MK6 is not set
CONFIG_MK7=y
# CONFIG_MK8 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MEFFICEON is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP2 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MGEODEGX1 is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
CONFIG_X86_GENERIC=y
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=7
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_HPET_TIMER=y
CONFIG_HPET_EMULATE_RTC=y
# CONFIG_SMP is not set
# CONFIG_PREEMPT_NONE is not set
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT_DESKTOP is not set
CONFIG_PREEMPT_RT=y
CONFIG_PREEMPT=y
CONFIG_PREEMPT_SOFTIRQS=y
CONFIG_PREEMPT_HARDIRQS=y
CONFIG_PREEMPT_RCU=y
CONFIG_PREEMPT_BKL=y
CONFIG_RWSEM_GENERIC_SPINLOCK=y
CONFIG_ASM_SEMAPHORES=y
# CONFIG_X86_UP_APIC is not set
CONFIG_X86_TSC=y
# CONFIG_X86_MCE is not set
# CONFIG_TOSHIBA is not set
# CONFIG_I8K is not set
# CONFIG_X86_REBOOTFIXUPS is not set
# CONFIG_MICROCODE is not set
# CONFIG_X86_MSR is not set
CONFIG_X86_CPUID=y

#
# Firmware Drivers
#
# CONFIG_EDD is not set
# CONFIG_NOHIGHMEM is not set
CONFIG_HIGHMEM4G=y
# CONFIG_HIGHMEM64G is not set
CONFIG_HIGHMEM=y
CONFIG_HIGHPTE=y
# CONFIG_MATH_EMULATION is not set
CONFIG_MTRR=y
# CONFIG_EFI is not set
CONFIG_HAVE_DEC_LOCK=y
# CONFIG_REGPARM is not set
CONFIG_SECCOMP=y

#
# Power management options (ACPI, APM)
#
CONFIG_PM=y
# CONFIG_PM_DEBUG is not set
# CONFIG_SOFTWARE_SUSPEND is not set

#
# ACPI (Advanced Configuration and Power Interface) Support
#
CONFIG_ACPI=y
CONFIG_ACPI_BOOT=y
CONFIG_ACPI_INTERPRETER=y
# CONFIG_ACPI_SLEEP is not set
# CONFIG_ACPI_AC is not set
# CONFIG_ACPI_BATTERY is not set
# CONFIG_ACPI_BUTTON is not set
# CONFIG_ACPI_VIDEO is not set
# CONFIG_ACPI_FAN is not set
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_THERMAL=y
# CONFIG_ACPI_ASUS is not set
# CONFIG_ACPI_IBM is not set
# CONFIG_ACPI_TOSHIBA is not set
CONFIG_ACPI_BLACKLIST_YEAR=0
# CONFIG_ACPI_DEBUG is not set
CONFIG_ACPI_BUS=y
CONFIG_ACPI_EC=y
CONFIG_ACPI_POWER=y
CONFIG_ACPI_PCI=y
CONFIG_ACPI_SYSTEM=y
# CONFIG_X86_PM_TIMER is not set
# CONFIG_ACPI_CONTAINER is not set

#
# APM (Advanced Power Management) BIOS Support
#
CONFIG_APM=y
# CONFIG_APM_IGNORE_USER_SUSPEND is not set
# CONFIG_APM_DO_ENABLE is not set
# CONFIG_APM_CPU_IDLE is not set
# CONFIG_APM_DISPLAY_BLANK is not set
CONFIG_APM_RTC_IS_GMT=y
# CONFIG_APM_ALLOW_INTS is not set
CONFIG_APM_REAL_MODE_POWER_OFF=y

#
# CPU Frequency scaling
#
# CONFIG_CPU_FREQ is not set

#
# Bus options (PCI, PCMCIA, EISA, MCA, ISA)
#
CONFIG_PCI=y
# CONFIG_PCI_GOBIOS is not set
# CONFIG_PCI_GOMMCONFIG is not set
# CONFIG_PCI_GODIRECT is not set
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
# CONFIG_PCIEPORTBUS is not set
CONFIG_PCI_LEGACY_PROC=y
CONFIG_PCI_NAMES=y
# CONFIG_PCI_DEBUG is not set
CONFIG_ISA_DMA_API=y
CONFIG_ISA=y
# CONFIG_EISA is not set
# CONFIG_MCA is not set
# CONFIG_SCx200 is not set

#
# PCCARD (PCMCIA/CardBus) support
#
# CONFIG_PCCARD is not set

#
# PCI Hotplug Support
#
# CONFIG_HOTPLUG_PCI is not set

#
# Executable file formats
#
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_AOUT=y
CONFIG_BINFMT_MISC=y

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_FW_LOADER=y
# CONFIG_DEBUG_DRIVER is not set

#
# Memory Technology Devices (MTD)
#
# CONFIG_MTD is not set

#
# Parallel port support
#
# CONFIG_PARPORT is not set

#
# Plug and Play support
#
CONFIG_PNP=y
# CONFIG_PNP_DEBUG is not set

#
# Protocols
#
CONFIG_ISAPNP=y
# CONFIG_PNPBIOS is not set
CONFIG_PNPACPI=y

#
# Block devices
#
CONFIG_BLK_DEV_FD=y
# CONFIG_BLK_DEV_XD is not set
# CONFIG_BLK_CPQ_DA is not set
# CONFIG_BLK_CPQ_CISS_DA is not set
# CONFIG_BLK_DEV_DAC960 is not set
# CONFIG_BLK_DEV_UMEM is not set
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=y
# CONFIG_BLK_DEV_CRYPTOLOOP is not set
# CONFIG_BLK_DEV_NBD is not set
# CONFIG_BLK_DEV_SX8 is not set
# CONFIG_BLK_DEV_UB is not set
# CONFIG_BLK_DEV_RAM is not set
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_INITRAMFS_SOURCE=""
# CONFIG_LBD is not set
# CONFIG_CDROM_PKTCDVD is not set

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_ATA_OVER_ETH is not set

#
# ATA/ATAPI/MFM/RLL support
#
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y

#
# Please see Documentation/ide.txt for help/info on IDE drives
#
# CONFIG_BLK_DEV_IDE_SATA is not set
# CONFIG_BLK_DEV_HD_IDE is not set
CONFIG_BLK_DEV_IDEDISK=y
# CONFIG_IDEDISK_MULTI_MODE is not set
CONFIG_BLK_DEV_IDECD=y
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDEFLOPPY is not set
# CONFIG_BLK_DEV_IDESCSI is not set
# CONFIG_IDE_TASK_IOCTL is not set

#
# IDE chipset support/bugfixes
#
CONFIG_IDE_GENERIC=y
# CONFIG_BLK_DEV_CMD640 is not set
# CONFIG_BLK_DEV_IDEPNP is not set
CONFIG_BLK_DEV_IDEPCI=y
# CONFIG_IDEPCI_SHARE_IRQ is not set
# CONFIG_BLK_DEV_OFFBOARD is not set
# CONFIG_BLK_DEV_GENERIC is not set
# CONFIG_BLK_DEV_OPTI621 is not set
# CONFIG_BLK_DEV_RZ1000 is not set
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_IDEDMA_FORCED is not set
CONFIG_IDEDMA_PCI_AUTO=y
# CONFIG_IDEDMA_ONLYDISK is not set
# CONFIG_BLK_DEV_AEC62XX is not set
# CONFIG_BLK_DEV_ALI15X3 is not set
CONFIG_BLK_DEV_AMD74XX=y
# CONFIG_BLK_DEV_ATIIXP is not set
# CONFIG_BLK_DEV_CMD64X is not set
# CONFIG_BLK_DEV_TRIFLEX is not set
# CONFIG_BLK_DEV_CY82C693 is not set
# CONFIG_BLK_DEV_CS5520 is not set
# CONFIG_BLK_DEV_CS5530 is not set
# CONFIG_BLK_DEV_HPT34X is not set
# CONFIG_BLK_DEV_HPT366 is not set
# CONFIG_BLK_DEV_SC1200 is not set
# CONFIG_BLK_DEV_PIIX is not set
# CONFIG_BLK_DEV_NS87415 is not set
# CONFIG_BLK_DEV_PDC202XX_OLD is not set
# CONFIG_BLK_DEV_PDC202XX_NEW is not set
# CONFIG_BLK_DEV_SVWKS is not set
# CONFIG_BLK_DEV_SIIMAGE is not set
# CONFIG_BLK_DEV_SIS5513 is not set
# CONFIG_BLK_DEV_SLC90E66 is not set
# CONFIG_BLK_DEV_TRM290 is not set
# CONFIG_BLK_DEV_VIA82CXXX is not set
# CONFIG_IDE_ARM is not set
# CONFIG_IDE_CHIPSETS is not set
CONFIG_BLK_DEV_IDEDMA=y
# CONFIG_IDEDMA_IVB is not set
CONFIG_IDEDMA_AUTO=y
# CONFIG_BLK_DEV_HD is not set

#
# SCSI device support
#
CONFIG_SCSI=y
# CONFIG_SCSI_PROC_FS is not set

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=m
# CONFIG_CHR_DEV_ST is not set
# CONFIG_CHR_DEV_OSST is not set
# CONFIG_BLK_DEV_SR is not set
# CONFIG_CHR_DEV_SG is not set

#
# Some SCSI devices (e.g. CD jukebox) support multiple LUNs
#
# CONFIG_SCSI_MULTI_LUN is not set
# CONFIG_SCSI_CONSTANTS is not set
# CONFIG_SCSI_LOGGING is not set

#
# SCSI Transport Attributes
#
# CONFIG_SCSI_SPI_ATTRS is not set
# CONFIG_SCSI_FC_ATTRS is not set
# CONFIG_SCSI_ISCSI_ATTRS is not set

#
# SCSI low-level drivers
#
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
# CONFIG_SCSI_3W_9XXX is not set
# CONFIG_SCSI_7000FASST is not set
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AHA152X is not set
# CONFIG_SCSI_AHA1542 is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC7XXX_OLD is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_SCSI_DPT_I2O is not set
# CONFIG_SCSI_ADVANSYS is not set
# CONFIG_SCSI_IN2000 is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_SCSI_SATA is not set
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_SCSI_CPQFCTS is not set
# CONFIG_SCSI_DMX3191D is not set
# CONFIG_SCSI_DTC3280 is not set
# CONFIG_SCSI_EATA is not set
# CONFIG_SCSI_EATA_PIO is not set
# CONFIG_SCSI_FUTURE_DOMAIN is not set
# CONFIG_SCSI_GDTH is not set
# CONFIG_SCSI_GENERIC_NCR5380 is not set
# CONFIG_SCSI_GENERIC_NCR5380_MMIO is not set
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INITIO is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_NCR53C406A is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_IPR is not set
# CONFIG_SCSI_PAS16 is not set
# CONFIG_SCSI_PCI2000 is not set
# CONFIG_SCSI_PCI2220I is not set
# CONFIG_SCSI_PSI240I is not set
# CONFIG_SCSI_QLOGIC_FAS is not set
# CONFIG_SCSI_QLOGIC_ISP is not set
# CONFIG_SCSI_QLOGIC_FC is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
CONFIG_SCSI_QLA2XXX=y
# CONFIG_SCSI_QLA21XX is not set
# CONFIG_SCSI_QLA22XX is not set
# CONFIG_SCSI_QLA2300 is not set
# CONFIG_SCSI_QLA2322 is not set
# CONFIG_SCSI_QLA6312 is not set
# CONFIG_SCSI_LPFC is not set
# CONFIG_SCSI_SEAGATE is not set
# CONFIG_SCSI_SYM53C416 is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_DC390T is not set
# CONFIG_SCSI_T128 is not set
# CONFIG_SCSI_U14_34F is not set
# CONFIG_SCSI_ULTRASTOR is not set
# CONFIG_SCSI_NSP32 is not set
# CONFIG_SCSI_DEBUG is not set

#
# Old CD-ROM drivers (not SCSI, not IDE)
#
# CONFIG_CD_NO_IDESCSI is not set

#
# Multi-device support (RAID and LVM)
#
# CONFIG_MD is not set

#
# Fusion MPT device support
#
# CONFIG_FUSION is not set

#
# IEEE 1394 (FireWire) support
#
CONFIG_IEEE1394=m

#
# Subsystem Options
#
# CONFIG_IEEE1394_VERBOSEDEBUG is not set
# CONFIG_IEEE1394_OUI_DB is not set
CONFIG_IEEE1394_EXTRA_CONFIG_ROMS=y
CONFIG_IEEE1394_CONFIG_ROM_IP1394=y

#
# Device Drivers
#
# CONFIG_IEEE1394_PCILYNX is not set
CONFIG_IEEE1394_OHCI1394=m

#
# Protocol Drivers
#
CONFIG_IEEE1394_VIDEO1394=m
CONFIG_IEEE1394_SBP2=m
CONFIG_IEEE1394_SBP2_PHYS_DMA=y
# CONFIG_IEEE1394_ETH1394 is not set
CONFIG_IEEE1394_DV1394=m
CONFIG_IEEE1394_RAWIO=m
CONFIG_IEEE1394_CMP=m
CONFIG_IEEE1394_AMDTP=m

#
# I2O device support
#
# CONFIG_I2O is not set

#
# Networking support
#
CONFIG_NET=y

#
# Networking options
#
CONFIG_PACKET=y
CONFIG_PACKET_MMAP=y
CONFIG_UNIX=y
CONFIG_NET_KEY=y
CONFIG_INET=y
# CONFIG_IP_MULTICAST is not set
# CONFIG_IP_ADVANCED_ROUTER is not set
# CONFIG_IP_PNP is not set
# CONFIG_NET_IPIP is not set
# CONFIG_NET_IPGRE is not set
# CONFIG_ARPD is not set
CONFIG_SYN_COOKIES=y
CONFIG_INET_AH=y
CONFIG_INET_ESP=y
CONFIG_INET_IPCOMP=y
CONFIG_INET_TUNNEL=y
CONFIG_IP_TCPDIAG=y
# CONFIG_IP_TCPDIAG_IPV6 is not set
# CONFIG_IPV6 is not set
# CONFIG_NETFILTER is not set
CONFIG_XFRM=y
CONFIG_XFRM_USER=y

#
# SCTP Configuration (EXPERIMENTAL)
#
# CONFIG_IP_SCTP is not set
# CONFIG_ATM is not set
# CONFIG_BRIDGE is not set
# CONFIG_VLAN_8021Q is not set
# CONFIG_DECNET is not set
# CONFIG_LLC2 is not set
# CONFIG_IPX is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_NET_DIVERT is not set
# CONFIG_ECONET is not set
# CONFIG_WAN_ROUTER is not set

#
# QoS and/or fair queueing
#
# CONFIG_NET_SCHED is not set
# CONFIG_NET_CLS_ROUTE is not set

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
# CONFIG_NETPOLL is not set
# CONFIG_NET_POLL_CONTROLLER is not set
# CONFIG_HAMRADIO is not set
# CONFIG_IRDA is not set
# CONFIG_BT is not set
CONFIG_NETDEVICES=y
CONFIG_DUMMY=y
# CONFIG_BONDING is not set
# CONFIG_EQUALIZER is not set
# CONFIG_TUN is not set
# CONFIG_NET_SB1000 is not set

#
# ARCnet devices
#
# CONFIG_ARCNET is not set

#
# Ethernet (10 or 100Mbit)
#
CONFIG_NET_ETHERNET=y
CONFIG_MII=y
# CONFIG_HAPPYMEAL is not set
# CONFIG_SUNGEM is not set
# CONFIG_NET_VENDOR_3COM is not set
# CONFIG_LANCE is not set
# CONFIG_NET_VENDOR_SMC is not set
# CONFIG_NET_VENDOR_RACAL is not set

#
# Tulip family network device support
#
# CONFIG_NET_TULIP is not set
# CONFIG_AT1700 is not set
# CONFIG_DEPCA is not set
# CONFIG_HP100 is not set
# CONFIG_NET_ISA is not set
CONFIG_NET_PCI=y
# CONFIG_PCNET32 is not set
# CONFIG_AMD8111_ETH is not set
# CONFIG_ADAPTEC_STARFIRE is not set
# CONFIG_AC3200 is not set
# CONFIG_APRICOT is not set
# CONFIG_B44 is not set
CONFIG_FORCEDETH=y
# CONFIG_CS89x0 is not set
# CONFIG_DGRS is not set
# CONFIG_EEPRO100 is not set
# CONFIG_E100 is not set
# CONFIG_FEALNX is not set
# CONFIG_NATSEMI is not set
# CONFIG_NE2K_PCI is not set
# CONFIG_8139CP is not set
# CONFIG_8139TOO is not set
# CONFIG_SIS900 is not set
# CONFIG_EPIC100 is not set
# CONFIG_SUNDANCE is not set
# CONFIG_TLAN is not set
# CONFIG_VIA_RHINE is not set
# CONFIG_NET_POCKET is not set

#
# Ethernet (1000 Mbit)
#
# CONFIG_ACENIC is not set
# CONFIG_DL2K is not set
# CONFIG_E1000 is not set
# CONFIG_NS83820 is not set
# CONFIG_HAMACHI is not set
# CONFIG_YELLOWFIN is not set
# CONFIG_R8169 is not set
# CONFIG_SK98LIN is not set
# CONFIG_VIA_VELOCITY is not set
# CONFIG_TIGON3 is not set
# CONFIG_BNX2 is not set

#
# Ethernet (10000 Mbit)
#
# CONFIG_IXGB is not set
# CONFIG_S2IO is not set

#
# Token Ring devices
#
# CONFIG_TR is not set

#
# Wireless LAN (non-hamradio)
#
# CONFIG_NET_RADIO is not set

#
# Wan interfaces
#
# CONFIG_WAN is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_PPP is not set
# CONFIG_SLIP is not set
# CONFIG_NET_FC is not set
# CONFIG_SHAPER is not set
# CONFIG_NETCONSOLE is not set

#
# ISDN subsystem
#
# CONFIG_ISDN is not set

#
# Telephony Support
#
# CONFIG_PHONE is not set

#
# Input device support
#
CONFIG_INPUT=y

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1600
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=1200
# CONFIG_INPUT_JOYDEV is not set
# CONFIG_INPUT_TSDEV is not set
CONFIG_INPUT_EVDEV=y
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_XTKBD is not set
# CONFIG_KEYBOARD_NEWTON is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
# CONFIG_MOUSE_SERIAL is not set
# CONFIG_MOUSE_INPORT is not set
# CONFIG_MOUSE_LOGIBM is not set
# CONFIG_MOUSE_PC110PAD is not set
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
CONFIG_INPUT_MISC=y
CONFIG_INPUT_PCSPKR=y
# CONFIG_INPUT_UINPUT is not set

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
# CONFIG_SERIO_SERPORT is not set
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PCIPS2 is not set
CONFIG_SERIO_LIBPS2=y
# CONFIG_SERIO_RAW is not set
# CONFIG_GAMEPORT is not set

#
# Character devices
#
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
# CONFIG_SERIAL_NONSTANDARD is not set

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
# CONFIG_SERIAL_8250_CONSOLE is not set
CONFIG_SERIAL_8250_ACPI=y
CONFIG_SERIAL_8250_NR_UARTS=2
CONFIG_SERIAL_8250_EXTENDED=y
# CONFIG_SERIAL_8250_MANY_PORTS is not set
CONFIG_SERIAL_8250_SHARE_IRQ=y
# CONFIG_SERIAL_8250_DETECT_IRQ is not set
# CONFIG_SERIAL_8250_MULTIPORT is not set
# CONFIG_SERIAL_8250_RSA is not set

#
# Non-8250 serial port support
#
CONFIG_SERIAL_CORE=y
# CONFIG_SERIAL_JSM is not set
CONFIG_UNIX98_PTYS=y
CONFIG_LEGACY_PTYS=y
CONFIG_LEGACY_PTY_COUNT=256

#
# IPMI
#
CONFIG_IPMI_HANDLER=y
# CONFIG_IPMI_PANIC_EVENT is not set
CONFIG_IPMI_DEVICE_INTERFACE=y
# CONFIG_IPMI_SI is not set
# CONFIG_IPMI_WATCHDOG is not set
# CONFIG_IPMI_POWEROFF is not set

#
# Watchdog Cards
#
# CONFIG_WATCHDOG is not set
CONFIG_HW_RANDOM=y
# CONFIG_NVRAM is not set
CONFIG_RTC=y
# CONFIG_RTC_HISTOGRAM is not set
# CONFIG_BLOCKER is not set
# CONFIG_LPPTEST is not set
# CONFIG_DTLK is not set
# CONFIG_R3964 is not set
# CONFIG_APPLICOM is not set
# CONFIG_SONYPI is not set

#
# Ftape, the floppy tape device driver
#
# CONFIG_FTAPE is not set
CONFIG_AGP=m
# CONFIG_AGP_ALI is not set
# CONFIG_AGP_ATI is not set
# CONFIG_AGP_AMD is not set
# CONFIG_AGP_AMD64 is not set
# CONFIG_AGP_INTEL is not set
CONFIG_AGP_NVIDIA=m
# CONFIG_AGP_SIS is not set
# CONFIG_AGP_SWORKS is not set
# CONFIG_AGP_VIA is not set
# CONFIG_AGP_EFFICEON is not set
CONFIG_DRM=m
# CONFIG_DRM_TDFX is not set
# CONFIG_DRM_GAMMA is not set
# CONFIG_DRM_R128 is not set
CONFIG_DRM_RADEON=m
# CONFIG_DRM_MGA is not set
# CONFIG_DRM_SIS is not set
# CONFIG_MWAVE is not set
# CONFIG_RAW_DRIVER is not set
CONFIG_HPET=y
# CONFIG_HPET_RTC_IRQ is not set
CONFIG_HPET_MMAP=y
# CONFIG_HANGCHECK_TIMER is not set

#
# TPM devices
#
# CONFIG_TCG_TPM is not set

#
# I2C support
#
CONFIG_I2C=m
CONFIG_I2C_CHARDEV=m

#
# I2C Algorithms
#
CONFIG_I2C_ALGOBIT=m
# CONFIG_I2C_ALGOPCF is not set
# CONFIG_I2C_ALGOPCA is not set

#
# I2C Hardware Bus support
#
# CONFIG_I2C_ALI1535 is not set
# CONFIG_I2C_ALI1563 is not set
# CONFIG_I2C_ALI15X3 is not set
# CONFIG_I2C_AMD756 is not set
# CONFIG_I2C_AMD8111 is not set
# CONFIG_I2C_ELEKTOR is not set
# CONFIG_I2C_I801 is not set
# CONFIG_I2C_I810 is not set
# CONFIG_I2C_PIIX4 is not set
CONFIG_I2C_ISA=m
CONFIG_I2C_NFORCE2=m
# CONFIG_I2C_PARPORT_LIGHT is not set
# CONFIG_I2C_PROSAVAGE is not set
# CONFIG_I2C_SAVAGE4 is not set
# CONFIG_SCx200_ACB is not set
# CONFIG_I2C_SIS5595 is not set
# CONFIG_I2C_SIS630 is not set
# CONFIG_I2C_SIS96X is not set
# CONFIG_I2C_STUB is not set
# CONFIG_I2C_VIA is not set
# CONFIG_I2C_VIAPRO is not set
# CONFIG_I2C_VOODOO3 is not set
# CONFIG_I2C_PCA_ISA is not set

#
# Hardware Sensors Chip support
#
CONFIG_I2C_SENSOR=m
# CONFIG_SENSORS_ADM1021 is not set
# CONFIG_SENSORS_ADM1025 is not set
# CONFIG_SENSORS_ADM1026 is not set
# CONFIG_SENSORS_ADM1031 is not set
# CONFIG_SENSORS_ASB100 is not set
# CONFIG_SENSORS_DS1621 is not set
# CONFIG_SENSORS_FSCHER is not set
# CONFIG_SENSORS_FSCPOS is not set
# CONFIG_SENSORS_GL518SM is not set
# CONFIG_SENSORS_GL520SM is not set
# CONFIG_SENSORS_IT87 is not set
# CONFIG_SENSORS_LM63 is not set
# CONFIG_SENSORS_LM75 is not set
# CONFIG_SENSORS_LM77 is not set
# CONFIG_SENSORS_LM78 is not set
# CONFIG_SENSORS_LM80 is not set
# CONFIG_SENSORS_LM83 is not set
# CONFIG_SENSORS_LM85 is not set
# CONFIG_SENSORS_LM87 is not set
# CONFIG_SENSORS_LM90 is not set
# CONFIG_SENSORS_LM92 is not set
# CONFIG_SENSORS_MAX1619 is not set
# CONFIG_SENSORS_PC87360 is not set
# CONFIG_SENSORS_SMSC47B397 is not set
# CONFIG_SENSORS_SIS5595 is not set
# CONFIG_SENSORS_SMSC47M1 is not set
# CONFIG_SENSORS_VIA686A is not set
CONFIG_SENSORS_W83781D=m
# CONFIG_SENSORS_W83L785TS is not set
CONFIG_SENSORS_W83627HF=m

#
# Other I2C Chip support
#
# CONFIG_SENSORS_DS1337 is not set
# CONFIG_SENSORS_EEPROM is not set
# CONFIG_SENSORS_PCF8574 is not set
# CONFIG_SENSORS_PCF8591 is not set
# CONFIG_SENSORS_RTC8564 is not set
# CONFIG_I2C_DEBUG_CORE is not set
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
# CONFIG_I2C_DEBUG_CHIP is not set

#
# Dallas's 1-wire bus
#
# CONFIG_W1 is not set

#
# Misc devices
#
# CONFIG_IBM_ASM is not set

#
# Multimedia devices
#
CONFIG_VIDEO_DEV=m

#
# Video For Linux
#

#
# Video Adapters
#
# CONFIG_VIDEO_BT848 is not set
# CONFIG_VIDEO_PMS is not set
# CONFIG_VIDEO_CPIA is not set
# CONFIG_VIDEO_SAA5246A is not set
# CONFIG_VIDEO_SAA5249 is not set
# CONFIG_TUNER_3036 is not set
# CONFIG_VIDEO_STRADIS is not set
# CONFIG_VIDEO_ZORAN is not set
# CONFIG_VIDEO_ZR36120 is not set
# CONFIG_VIDEO_SAA7134 is not set
# CONFIG_VIDEO_MXB is not set
# CONFIG_VIDEO_DPC is not set
# CONFIG_VIDEO_HEXIUM_ORION is not set
# CONFIG_VIDEO_HEXIUM_GEMINI is not set
CONFIG_VIDEO_CX88=m
CONFIG_VIDEO_CX88_DVB=m
# CONFIG_VIDEO_OVCAMCHIP is not set

#
# Radio Adapters
#
# CONFIG_RADIO_CADET is not set
# CONFIG_RADIO_RTRACK is not set
# CONFIG_RADIO_RTRACK2 is not set
# CONFIG_RADIO_AZTECH is not set
# CONFIG_RADIO_GEMTEK is not set
# CONFIG_RADIO_GEMTEK_PCI is not set
# CONFIG_RADIO_MAXIRADIO is not set
# CONFIG_RADIO_MAESTRO is not set
# CONFIG_RADIO_SF16FMI is not set
# CONFIG_RADIO_SF16FMR2 is not set
# CONFIG_RADIO_TERRATEC is not set
# CONFIG_RADIO_TRUST is not set
# CONFIG_RADIO_TYPHOON is not set
# CONFIG_RADIO_ZOLTRIX is not set

#
# Digital Video Broadcasting Devices
#
CONFIG_DVB=y
CONFIG_DVB_CORE=m

#
# Supported SAA7146 based PCI Adapters
#
# CONFIG_DVB_AV7110 is not set
# CONFIG_DVB_BUDGET is not set
# CONFIG_DVB_BUDGET_CI is not set
# CONFIG_DVB_BUDGET_AV is not set

#
# Supported USB Adapters
#
# CONFIG_DVB_TTUSB_BUDGET is not set
# CONFIG_DVB_TTUSB_DEC is not set
# CONFIG_DVB_DIBUSB is not set
# CONFIG_DVB_CINERGYT2 is not set

#
# Supported FlexCopII (B2C2) Adapters
#
# CONFIG_DVB_B2C2_FLEXCOP is not set
# CONFIG_DVB_B2C2_SKYSTAR is not set

#
# Supported BT878 Adapters
#

#
# Supported DVB Frontends
#

#
# Customise DVB Frontends
#

#
# DVB-S (satellite) frontends
#
# CONFIG_DVB_STV0299 is not set
# CONFIG_DVB_CX24110 is not set
# CONFIG_DVB_TDA8083 is not set
# CONFIG_DVB_TDA80XX is not set
# CONFIG_DVB_MT312 is not set
# CONFIG_DVB_VES1X93 is not set

#
# DVB-T (terrestrial) frontends
#
# CONFIG_DVB_SP8870 is not set
# CONFIG_DVB_SP887X is not set
# CONFIG_DVB_CX22700 is not set
CONFIG_DVB_CX22702=m
# CONFIG_DVB_L64781 is not set
# CONFIG_DVB_TDA1004X is not set
# CONFIG_DVB_NXT6000 is not set
CONFIG_DVB_MT352=m
# CONFIG_DVB_DIB3000MB is not set
# CONFIG_DVB_DIB3000MC is not set

#
# DVB-C (cable) frontends
#
# CONFIG_DVB_ATMEL_AT76C651 is not set
# CONFIG_DVB_VES1820 is not set
# CONFIG_DVB_TDA10021 is not set
# CONFIG_DVB_STV0297 is not set

#
# ATSC (North American/Korean Terresterial DTV) frontends
#
CONFIG_DVB_NXT2002=m
# CONFIG_DVB_OR51211 is not set
CONFIG_DVB_OR51132=m
CONFIG_VIDEO_TUNER=m
CONFIG_VIDEO_BUF=m
CONFIG_VIDEO_BUF_DVB=m
CONFIG_VIDEO_BTCX=m
CONFIG_VIDEO_IR=m
CONFIG_VIDEO_TVEEPROM=m

#
# Graphics support
#
CONFIG_FB=y
CONFIG_FB_CFB_FILLRECT=m
CONFIG_FB_CFB_COPYAREA=m
CONFIG_FB_CFB_IMAGEBLIT=m
CONFIG_FB_SOFT_CURSOR=m
# CONFIG_FB_MACMODES is not set
CONFIG_FB_MODE_HELPERS=y
# CONFIG_FB_TILEBLITTING is not set
# CONFIG_FB_CIRRUS is not set
# CONFIG_FB_PM2 is not set
# CONFIG_FB_CYBER2000 is not set
# CONFIG_FB_ASILIANT is not set
# CONFIG_FB_IMSTT is not set
# CONFIG_FB_VGA16 is not set
# CONFIG_FB_VESA is not set
CONFIG_VIDEO_SELECT=y
# CONFIG_FB_HGA is not set
# CONFIG_FB_NVIDIA is not set
# CONFIG_FB_RIVA is not set
# CONFIG_FB_I810 is not set
# CONFIG_FB_INTEL is not set
# CONFIG_FB_MATROX is not set
# CONFIG_FB_RADEON_OLD is not set
CONFIG_FB_RADEON=m
CONFIG_FB_RADEON_I2C=y
# CONFIG_FB_RADEON_DEBUG is not set
# CONFIG_FB_ATY128 is not set
# CONFIG_FB_ATY is not set
# CONFIG_FB_SAVAGE is not set
# CONFIG_FB_SIS is not set
# CONFIG_FB_NEOMAGIC is not set
# CONFIG_FB_KYRO is not set
# CONFIG_FB_3DFX is not set
# CONFIG_FB_VOODOO1 is not set
# CONFIG_FB_TRIDENT is not set
# CONFIG_FB_PM3 is not set
# CONFIG_FB_GEODE is not set
# CONFIG_FB_S1D13XXX is not set
# CONFIG_FB_VIRTUAL is not set

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
# CONFIG_MDA_CONSOLE is not set
CONFIG_DUMMY_CONSOLE=y
CONFIG_FRAMEBUFFER_CONSOLE=m
CONFIG_FONTS=y
CONFIG_FONT_8x8=y
CONFIG_FONT_8x16=y
CONFIG_FONT_6x11=y
CONFIG_FONT_PEARL_8x8=y
CONFIG_FONT_ACORN_8x8=y
CONFIG_FONT_MINI_4x6=y
CONFIG_FONT_SUN8x16=y
CONFIG_FONT_SUN12x22=y

#
# Logo configuration
#
# CONFIG_LOGO is not set
# CONFIG_BACKLIGHT_LCD_SUPPORT is not set

#
# Sound
#
CONFIG_SOUND=y

#
# Advanced Linux Sound Architecture
#
CONFIG_SND=m
CONFIG_SND_TIMER=m
CONFIG_SND_PCM=m
CONFIG_SND_HWDEP=m
CONFIG_SND_RAWMIDI=m
CONFIG_SND_SEQUENCER=m
# CONFIG_SND_SEQ_DUMMY is not set
CONFIG_SND_OSSEMUL=y
CONFIG_SND_MIXER_OSS=m
CONFIG_SND_PCM_OSS=m
CONFIG_SND_SEQUENCER_OSS=y
CONFIG_SND_RTCTIMER=m
# CONFIG_SND_VERBOSE_PRINTK is not set
# CONFIG_SND_DEBUG is not set

#
# Generic devices
#
CONFIG_SND_MPU401_UART=m
CONFIG_SND_DUMMY=m
CONFIG_SND_VIRMIDI=m
# CONFIG_SND_MTPAV is not set
CONFIG_SND_SERIAL_U16550=m
CONFIG_SND_MPU401=m

#
# ISA devices
#
# CONFIG_SND_AD1816A is not set
# CONFIG_SND_AD1848 is not set
# CONFIG_SND_CS4231 is not set
# CONFIG_SND_CS4232 is not set
# CONFIG_SND_CS4236 is not set
# CONFIG_SND_ES968 is not set
# CONFIG_SND_ES1688 is not set
# CONFIG_SND_ES18XX is not set
# CONFIG_SND_GUSCLASSIC is not set
# CONFIG_SND_GUSEXTREME is not set
# CONFIG_SND_GUSMAX is not set
# CONFIG_SND_INTERWAVE is not set
# CONFIG_SND_INTERWAVE_STB is not set
# CONFIG_SND_OPTI92X_AD1848 is not set
# CONFIG_SND_OPTI92X_CS4231 is not set
# CONFIG_SND_OPTI93X is not set
# CONFIG_SND_SB8 is not set
# CONFIG_SND_SB16 is not set
# CONFIG_SND_SBAWE is not set
# CONFIG_SND_WAVEFRONT is not set
# CONFIG_SND_ALS100 is not set
# CONFIG_SND_AZT2320 is not set
# CONFIG_SND_CMI8330 is not set
# CONFIG_SND_DT019X is not set
# CONFIG_SND_OPL3SA2 is not set
# CONFIG_SND_SGALAXY is not set
# CONFIG_SND_SSCAPE is not set

#
# PCI devices
#
CONFIG_SND_AC97_CODEC=m
# CONFIG_SND_ALI5451 is not set
# CONFIG_SND_ATIIXP is not set
# CONFIG_SND_ATIIXP_MODEM is not set
# CONFIG_SND_AU8810 is not set
# CONFIG_SND_AU8820 is not set
# CONFIG_SND_AU8830 is not set
# CONFIG_SND_AZT3328 is not set
CONFIG_SND_BT87X=m
# CONFIG_SND_BT87X_OVERCLOCK is not set
# CONFIG_SND_CS46XX is not set
# CONFIG_SND_CS4281 is not set
# CONFIG_SND_EMU10K1 is not set
# CONFIG_SND_EMU10K1X is not set
# CONFIG_SND_CA0106 is not set
# CONFIG_SND_KORG1212 is not set
# CONFIG_SND_MIXART is not set
# CONFIG_SND_NM256 is not set
# CONFIG_SND_RME32 is not set
# CONFIG_SND_RME96 is not set
# CONFIG_SND_RME9652 is not set
# CONFIG_SND_HDSP is not set
# CONFIG_SND_TRIDENT is not set
# CONFIG_SND_YMFPCI is not set
# CONFIG_SND_ALS4000 is not set
# CONFIG_SND_CMIPCI is not set
# CONFIG_SND_ENS1370 is not set
# CONFIG_SND_ENS1371 is not set
# CONFIG_SND_ES1938 is not set
# CONFIG_SND_ES1968 is not set
# CONFIG_SND_MAESTRO3 is not set
# CONFIG_SND_FM801 is not set
# CONFIG_SND_ICE1712 is not set
# CONFIG_SND_ICE1724 is not set
CONFIG_SND_INTEL8X0=m
# CONFIG_SND_INTEL8X0M is not set
# CONFIG_SND_SONICVIBES is not set
# CONFIG_SND_VIA82XX is not set
# CONFIG_SND_VIA82XX_MODEM is not set
# CONFIG_SND_VX222 is not set
# CONFIG_SND_HDA_INTEL is not set

#
# USB devices
#
CONFIG_SND_USB_AUDIO=m
CONFIG_SND_USB_USX2Y=m

#
# Open Sound System
#
# CONFIG_SOUND_PRIME is not set

#
# USB support
#
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB=y
# CONFIG_USB_DEBUG is not set

#
# Miscellaneous USB options
#
CONFIG_USB_DEVICEFS=y
# CONFIG_USB_BANDWIDTH is not set
# CONFIG_USB_DYNAMIC_MINORS is not set
# CONFIG_USB_SUSPEND is not set
# CONFIG_USB_OTG is not set

#
# USB Host Controller Drivers
#
CONFIG_USB_EHCI_HCD=y
# CONFIG_USB_EHCI_SPLIT_ISO is not set
# CONFIG_USB_EHCI_ROOT_HUB_TT is not set
CONFIG_USB_OHCI_HCD=y
# CONFIG_USB_OHCI_BIG_ENDIAN is not set
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
# CONFIG_USB_UHCI_HCD is not set
# CONFIG_USB_SL811_HCD is not set

#
# USB Device Class drivers
#
# CONFIG_USB_AUDIO is not set
# CONFIG_USB_BLUETOOTH_TTY is not set
# CONFIG_USB_MIDI is not set
# CONFIG_USB_ACM is not set
CONFIG_USB_PRINTER=y

#
# NOTE: USB_STORAGE enables SCSI, and 'SCSI disk support' may also be needed; see USB_STORAGE Help for more information
#
CONFIG_USB_STORAGE=y
# CONFIG_USB_STORAGE_DEBUG is not set
# CONFIG_USB_STORAGE_DATAFAB is not set
# CONFIG_USB_STORAGE_FREECOM is not set
# CONFIG_USB_STORAGE_ISD200 is not set
# CONFIG_USB_STORAGE_DPCM is not set
# CONFIG_USB_STORAGE_USBAT is not set
# CONFIG_USB_STORAGE_SDDR09 is not set
# CONFIG_USB_STORAGE_SDDR55 is not set
# CONFIG_USB_STORAGE_JUMPSHOT is not set

#
# USB Input Devices
#
CONFIG_USB_HID=y
CONFIG_USB_HIDINPUT=y
# CONFIG_HID_FF is not set
CONFIG_USB_HIDDEV=y
# CONFIG_USB_AIPTEK is not set
# CONFIG_USB_WACOM is not set
# CONFIG_USB_KBTAB is not set
# CONFIG_USB_POWERMATE is not set
# CONFIG_USB_MTOUCH is not set
# CONFIG_USB_EGALAX is not set
# CONFIG_USB_XPAD is not set
# CONFIG_USB_ATI_REMOTE is not set

#
# USB Imaging devices
#
# CONFIG_USB_MDC800 is not set
# CONFIG_USB_MICROTEK is not set

#
# USB Multimedia devices
#
CONFIG_USB_DABUSB=m
# CONFIG_USB_VICAM is not set
# CONFIG_USB_DSBR is not set
# CONFIG_USB_IBMCAM is not set
# CONFIG_USB_KONICAWC is not set
# CONFIG_USB_OV511 is not set
# CONFIG_USB_SE401 is not set
# CONFIG_USB_SN9C102 is not set
# CONFIG_USB_STV680 is not set
# CONFIG_USB_PWC is not set

#
# USB Network Adapters
#
# CONFIG_USB_CATC is not set
# CONFIG_USB_KAWETH is not set
# CONFIG_USB_PEGASUS is not set
# CONFIG_USB_RTL8150 is not set
# CONFIG_USB_USBNET is not set
CONFIG_USB_MON=y

#
# USB port drivers
#

#
# USB Serial Converter support
#
CONFIG_USB_SERIAL=m
# CONFIG_USB_SERIAL_GENERIC is not set
# CONFIG_USB_SERIAL_AIRPRIME is not set
# CONFIG_USB_SERIAL_BELKIN is not set
# CONFIG_USB_SERIAL_WHITEHEAT is not set
# CONFIG_USB_SERIAL_DIGI_ACCELEPORT is not set
# CONFIG_USB_SERIAL_CP2101 is not set
# CONFIG_USB_SERIAL_CYPRESS_M8 is not set
# CONFIG_USB_SERIAL_EMPEG is not set
# CONFIG_USB_SERIAL_FTDI_SIO is not set
# CONFIG_USB_SERIAL_VISOR is not set
# CONFIG_USB_SERIAL_IPAQ is not set
# CONFIG_USB_SERIAL_IR is not set
# CONFIG_USB_SERIAL_EDGEPORT is not set
# CONFIG_USB_SERIAL_EDGEPORT_TI is not set
CONFIG_USB_SERIAL_GARMIN=m
# CONFIG_USB_SERIAL_IPW is not set
# CONFIG_USB_SERIAL_KEYSPAN_PDA is not set
# CONFIG_USB_SERIAL_KEYSPAN is not set
# CONFIG_USB_SERIAL_KLSI is not set
# CONFIG_USB_SERIAL_KOBIL_SCT is not set
# CONFIG_USB_SERIAL_MCT_U232 is not set
CONFIG_USB_SERIAL_PL2303=m
# CONFIG_USB_SERIAL_HP4X is not set
# CONFIG_USB_SERIAL_SAFE is not set
# CONFIG_USB_SERIAL_TI is not set
# CONFIG_USB_SERIAL_CYBERJACK is not set
# CONFIG_USB_SERIAL_XIRCOM is not set
# CONFIG_USB_SERIAL_OMNINET is not set

#
# USB Miscellaneous drivers
#
# CONFIG_USB_EMI62 is not set
# CONFIG_USB_EMI26 is not set
# CONFIG_USB_AUERSWALD is not set
# CONFIG_USB_RIO500 is not set
# CONFIG_USB_LEGOTOWER is not set
# CONFIG_USB_LCD is not set
# CONFIG_USB_LED is not set
# CONFIG_USB_CYTHERM is not set
# CONFIG_USB_PHIDGETKIT is not set
# CONFIG_USB_PHIDGETSERVO is not set
# CONFIG_USB_IDMOUSE is not set
# CONFIG_USB_SISUSBVGA is not set
# CONFIG_USB_TEST is not set

#
# USB ATM/DSL drivers
#

#
# USB Gadget Support
#
# CONFIG_USB_GADGET is not set

#
# MMC/SD Card support
#
# CONFIG_MMC is not set

#
# InfiniBand support
#
# CONFIG_INFINIBAND is not set

#
# File systems
#
CONFIG_EXT2_FS=y
# CONFIG_EXT2_FS_XATTR is not set
CONFIG_EXT3_FS=y
# CONFIG_EXT3_FS_XATTR is not set
CONFIG_JBD=y
# CONFIG_JBD_DEBUG is not set
# CONFIG_REISERFS_FS is not set
# CONFIG_JFS_FS is not set

#
# XFS support
#
# CONFIG_XFS_FS is not set
# CONFIG_MINIX_FS is not set
# CONFIG_ROMFS_FS is not set
# CONFIG_QUOTA is not set
CONFIG_DNOTIFY=y
# CONFIG_AUTOFS_FS is not set
CONFIG_AUTOFS4_FS=y

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_ZISOFS_FS=y
CONFIG_UDF_FS=y
CONFIG_UDF_NLS=y

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=y
CONFIG_MSDOS_FS=y
CONFIG_VFAT_FS=y
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
# CONFIG_NTFS_FS is not set

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_SYSFS=y
# CONFIG_DEVFS_FS is not set
# CONFIG_DEVPTS_FS_XATTR is not set
# CONFIG_TMPFS is not set
# CONFIG_HUGETLBFS is not set
# CONFIG_HUGETLB_PAGE is not set
CONFIG_RAMFS=y

#
# Miscellaneous filesystems
#
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
# CONFIG_CRAMFS is not set
# CONFIG_VXFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
# CONFIG_SYSV_FS is not set
# CONFIG_UFS_FS is not set

#
# Network File Systems
#
CONFIG_NFS_FS=y
CONFIG_NFS_V3=y
# CONFIG_NFS_V4 is not set
# CONFIG_NFS_DIRECTIO is not set
CONFIG_NFSD=y
CONFIG_NFSD_V3=y
# CONFIG_NFSD_V4 is not set
CONFIG_NFSD_TCP=y
CONFIG_LOCKD=y
CONFIG_LOCKD_V4=y
CONFIG_EXPORTFS=y
CONFIG_SUNRPC=y
# CONFIG_RPCSEC_GSS_KRB5 is not set
# CONFIG_RPCSEC_GSS_SPKM3 is not set
CONFIG_SMB_FS=y
# CONFIG_SMB_NLS_DEFAULT is not set
# CONFIG_CIFS is not set
# CONFIG_NCP_FS is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not set

#
# Partition Types
#
CONFIG_PARTITION_ADVANCED=y
# CONFIG_ACORN_PARTITION is not set
# CONFIG_OSF_PARTITION is not set
# CONFIG_AMIGA_PARTITION is not set
# CONFIG_ATARI_PARTITION is not set
# CONFIG_MAC_PARTITION is not set
CONFIG_MSDOS_PARTITION=y
# CONFIG_BSD_DISKLABEL is not set
# CONFIG_MINIX_SUBPARTITION is not set
# CONFIG_SOLARIS_X86_PARTITION is not set
# CONFIG_UNIXWARE_DISKLABEL is not set
# CONFIG_LDM_PARTITION is not set
# CONFIG_SGI_PARTITION is not set
# CONFIG_ULTRIX_PARTITION is not set
# CONFIG_SUN_PARTITION is not set
# CONFIG_EFI_PARTITION is not set

#
# Native Language Support
#
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-1"
CONFIG_NLS_CODEPAGE_437=y
CONFIG_NLS_CODEPAGE_737=m
CONFIG_NLS_CODEPAGE_775=m
CONFIG_NLS_CODEPAGE_850=m
CONFIG_NLS_CODEPAGE_852=m
CONFIG_NLS_CODEPAGE_855=m
CONFIG_NLS_CODEPAGE_857=m
CONFIG_NLS_CODEPAGE_860=m
CONFIG_NLS_CODEPAGE_861=m
CONFIG_NLS_CODEPAGE_862=m
CONFIG_NLS_CODEPAGE_863=m
CONFIG_NLS_CODEPAGE_864=m
CONFIG_NLS_CODEPAGE_865=m
CONFIG_NLS_CODEPAGE_866=m
CONFIG_NLS_CODEPAGE_869=m
CONFIG_NLS_CODEPAGE_936=m
CONFIG_NLS_CODEPAGE_950=m
CONFIG_NLS_CODEPAGE_932=m
CONFIG_NLS_CODEPAGE_949=m
CONFIG_NLS_CODEPAGE_874=m
CONFIG_NLS_ISO8859_8=m
CONFIG_NLS_CODEPAGE_1250=m
CONFIG_NLS_CODEPAGE_1251=m
CONFIG_NLS_ASCII=y
CONFIG_NLS_ISO8859_1=y
CONFIG_NLS_ISO8859_2=m
CONFIG_NLS_ISO8859_3=m
CONFIG_NLS_ISO8859_4=m
CONFIG_NLS_ISO8859_5=m
CONFIG_NLS_ISO8859_6=m
CONFIG_NLS_ISO8859_7=m
CONFIG_NLS_ISO8859_9=m
CONFIG_NLS_ISO8859_13=m
CONFIG_NLS_ISO8859_14=m
CONFIG_NLS_ISO8859_15=y
CONFIG_NLS_KOI8_R=m
CONFIG_NLS_KOI8_U=m
CONFIG_NLS_UTF8=y

#
# Profiling support
#
# CONFIG_PROFILING is not set

#
# Kernel hacking
#
# CONFIG_PRINTK_TIME is not set
CONFIG_DEBUG_KERNEL=y
CONFIG_MAGIC_SYSRQ=y
CONFIG_LOG_BUF_SHIFT=16
# CONFIG_DETECT_SOFTLOCKUP is not set
# CONFIG_SCHEDSTATS is not set
# CONFIG_DEBUG_SLAB is not set
# CONFIG_DEBUG_PREEMPT is not set
# CONFIG_DEBUG_SPINLOCK_SLEEP is not set
# CONFIG_WAKEUP_TIMING is not set
# CONFIG_CRITICAL_PREEMPT_TIMING is not set
# CONFIG_CRITICAL_IRQSOFF_TIMING is not set
# CONFIG_RT_DEADLOCK_DETECT is not set
# CONFIG_DEBUG_RT_LOCKING_MODE is not set
# CONFIG_DEBUG_KOBJECT is not set
# CONFIG_DEBUG_HIGHMEM is not set
CONFIG_DEBUG_BUGVERBOSE=y
# CONFIG_DEBUG_INFO is not set
# CONFIG_DEBUG_FS is not set
# CONFIG_USE_FRAME_POINTER is not set
CONFIG_EARLY_PRINTK=y
CONFIG_DEBUG_STACKOVERFLOW=y
# CONFIG_KPROBES is not set
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_DEBUG_PAGEALLOC is not set
CONFIG_4KSTACKS=y

#
# Security options
#
# CONFIG_KEYS is not set
CONFIG_SECURITY=y
# CONFIG_SECURITY_NETWORK is not set
CONFIG_SECURITY_CAPABILITIES=y
# CONFIG_SECURITY_ROOTPLUG is not set
# CONFIG_SECURITY_SECLVL is not set
# CONFIG_SECURITY_SELINUX is not set

#
# Cryptographic options
#
CONFIG_CRYPTO=y
CONFIG_CRYPTO_HMAC=y
# CONFIG_CRYPTO_NULL is not set
# CONFIG_CRYPTO_MD4 is not set
CONFIG_CRYPTO_MD5=y
CONFIG_CRYPTO_SHA1=y
# CONFIG_CRYPTO_SHA256 is not set
# CONFIG_CRYPTO_SHA512 is not set
# CONFIG_CRYPTO_WP512 is not set
# CONFIG_CRYPTO_TGR192 is not set
CONFIG_CRYPTO_DES=y
# CONFIG_CRYPTO_BLOWFISH is not set
# CONFIG_CRYPTO_TWOFISH is not set
# CONFIG_CRYPTO_SERPENT is not set
# CONFIG_CRYPTO_AES_586 is not set
# CONFIG_CRYPTO_CAST5 is not set
# CONFIG_CRYPTO_CAST6 is not set
# CONFIG_CRYPTO_TEA is not set
# CONFIG_CRYPTO_ARC4 is not set
# CONFIG_CRYPTO_KHAZAD is not set
# CONFIG_CRYPTO_ANUBIS is not set
CONFIG_CRYPTO_DEFLATE=y
# CONFIG_CRYPTO_MICHAEL_MIC is not set
# CONFIG_CRYPTO_CRC32C is not set
# CONFIG_CRYPTO_TEST is not set

#
# Hardware crypto devices
#
# CONFIG_CRYPTO_DEV_PADLOCK is not set

#
# Library routines
#
CONFIG_CRC_CCITT=y
CONFIG_CRC32=y
CONFIG_LIBCRC32C=y
CONFIG_ZLIB_INFLATE=y
CONFIG_ZLIB_DEFLATE=y
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_X86_BIOS_REBOOT=y
CONFIG_PC=y

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22 13:27                   ` Gene Heskett
@ 2005-06-22 13:51                     ` Gene Heskett
  2005-06-22 14:08                       ` Gene Heskett
  2005-06-25  4:41                     ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-22 13:51 UTC (permalink / raw)
  To: linux-kernel
  Cc: Ingo Molnar, Benjamin LaHaise, William Weston, K.R. Foley,
	Eugeny S. Mints, Daniel Walker, linux-ns83820, nhorman,
	Jeff Garzik

On Wednesday 22 June 2005 09:27, Gene Heskett wrote:
>On Wednesday 22 June 2005 03:40, Ingo Molnar wrote:
>>* Gene Heskett <gene.heskett@verizon.net> wrote:
>>> FWIW, 50-06 is running clean here with mode 3 & no hardirq
>>> threading. Uptime is about 9 hours.
>>>
>>> Would it do any good to try mode 4 & see if tvtime still runs?
>>> Previously, I got the impression that was a dma problem & posted
>>> some of the logs, but I've not noted any fixes for that go by.
>>
>>sure, any extra testing - even if it finds no problems, is just as
>>useful. Especially if you have a .config where everything works.
>> That way we'll know for sure that any regressions are related to
>> PREEMPT_RT.
>>
>> Ingo
>
>I can report that mode 4 is not at all well here.  I turned it on
> and changed the extraversion, built it, and when it booted, it got
> to this line and hung:
>
>Checking to see if this processor honours the WP bit even in
>supervisor mode... OK.
>
>And I had to use the hardware reset to recover & boot to a mode 3
>version of 50-06.
>
>That .config is attached.

I can also report that the modules did not get installed, I'd 
forgotten to rename the src tree to match the extraversion, so the 
final cd my script makes to install the modules failed.  I have a new 
version building to dbl-check this.


-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22 13:51                     ` Gene Heskett
@ 2005-06-22 14:08                       ` Gene Heskett
  0 siblings, 0 replies; 139+ messages in thread
From: Gene Heskett @ 2005-06-22 14:08 UTC (permalink / raw)
  To: linux-kernel
  Cc: Ingo Molnar, Benjamin LaHaise, William Weston, K.R. Foley,
	Eugeny S. Mints, Daniel Walker, linux-ns83820, nhorman,
	Jeff Garzik

On Wednesday 22 June 2005 09:51, Gene Heskett wrote:
>On Wednesday 22 June 2005 09:27, Gene Heskett wrote:
>>On Wednesday 22 June 2005 03:40, Ingo Molnar wrote:
>>>* Gene Heskett <gene.heskett@verizon.net> wrote:
>>>> FWIW, 50-06 is running clean here with mode 3 & no hardirq
>>>> threading. Uptime is about 9 hours.
>>>>
>>>> Would it do any good to try mode 4 & see if tvtime still runs?
>>>> Previously, I got the impression that was a dma problem & posted
>>>> some of the logs, but I've not noted any fixes for that go by.
>>>
>>>sure, any extra testing - even if it finds no problems, is just as
>>>useful. Especially if you have a .config where everything works.
>>> That way we'll know for sure that any regressions are related to
>>> PREEMPT_RT.
>>>
>>> Ingo
>>
>>I can report that mode 4 is not at all well here.  I turned it on
>> and changed the extraversion, built it, and when it booted, it got
>> to this line and hung:
>>
>>Checking to see if this processor honours the WP bit even in
>>supervisor mode... OK.
>>
>>And I had to use the hardware reset to recover & boot to a mode 3
>>version of 50-06.
>>
>>That .config is attached.
>
>I can also report that the modules did not get installed, I'd
>forgotten to rename the src tree to match the extraversion, so the
>final cd my script makes to install the modules failed.  I have a
> new version building to dbl-check this.

And that also resulted in the hang at the above lines completion.


-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22  8:24               ` Ingo Molnar
  2005-06-22 10:08                 ` Ingo Molnar
@ 2005-06-22 21:53                 ` William Weston
  2005-06-22 22:00                   ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-22 21:53 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: TEXT/PLAIN, Size: 1351 bytes --]

On Wed, 22 Jun 2005, Ingo Molnar wrote:
>
> the second trace seems to be a cross-CPU wakeup bug. It's not completely 
> clear from the trace what happened - but we measured the latency of a 
> task (wmcube-3191), where the wakeup happened on CPU#0 and wmcube-3191 
> was queued to CPU#1 which was idle at that time. The bug is that it 
> wasnt until timestamp 306us that this actually happened - and CPU#1 was 
> just idling around in default_idle() for no good reason. CPU#1 should 
> have run wmcube-3191 at around timestamp 13us.
> 
> I've uploaded the -50-07 kernel which will put some more info into the 
> traces - could you try to repeat the measurement and get similar 
> latencies? As i guess you already found out that you can always reset 
> the measurement to get a new set of traces, via:
> 
> 	echo 0 > /proc/sys/kernel/preempt_max_latency
> 
> (it's not a problem if you send me multiple latency traces, i'll figure 
> out which is the most useful one.)
> 
> 	Ingo

Hi Ingo,

Latency traces (attached) are looking a little bit better with -50-11.  
The CPU consistently seems to idle for ~200us at a time in the traces.  
Maximum wakeup latency since boot (over an hour ago) is 310us.  With
previous RT kernels, maximums would generally go over 800us.

Should I apply your SMT scheduler latency fix, or is that patch for -mm
only?

--ww

[-- Attachment #2: Type: TEXT/plain, Size: 6360 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-debug
--------------------------------------------------------------------
 latency: 231 us, #88/88, CPU#1 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:2)
    -----------------
    | task: softirq-timer/1-13 (uid:0 nice:-10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
  <idle>-0     1Dnh3    0us : find_next_bit (__trace_start_sched_wakeup)
  <idle>-0     0Dnh1    0us : _raw_spin_unlock (scheduler_tick)
  <idle>-0     1Dnh3    0us : <70617773> (<00726570>)
  <idle>-0     0Dnh.    0us : rebalance_tick (scheduler_tick)
  <idle>-0     1Dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
  <idle>-0     1Dnh3    1us : __trace_start_sched_wakeup <<...>-13> (69 1)
  <idle>-0     0Dnh.    1us : softlockup_tick (smp_apic_timer_interrupt)
  <idle>-0     1Dnh3    1us : _raw_spin_unlock (try_to_wake_up)
  <idle>-0     0Dnh.    1us : irq_exit (apic_timer_interrupt)
  <idle>-0     1Dnh2    1us : resched_task (try_to_wake_up)
  <idle>-0     0Dnh1    1us : do_softirq (irq_exit)
  <idle>-0     0Dnh1    2us : __do_softirq (do_softirq)
  <idle>-0     1Dnh2    2us : try_to_wake_up <<...>-13> (69 8c)
  <idle>-0     0Dnh1    2us : trigger_softirqs (do_softirq)
  <idle>-0     1Dnh2    2us : _raw_spin_unlock_irqrestore (try_to_wake_up)
  <idle>-0     0Dnh1    2us : wakeup_softirqd (trigger_softirqs)
  <idle>-0     1Dnh1    2us : preempt_schedule (try_to_wake_up)
  <idle>-0     1Dnh1    3us : wake_up_process (trigger_softirqs)
  <idle>-0     0Dnh1    3us : wake_up_process (trigger_softirqs)
  <idle>-0     0Dnh1    3us : try_to_wake_up (wake_up_process)
  <idle>-0     1Dnh.    3us : preempt_schedule_irq (need_resched)
  <idle>-0     0Dnh1    3us : _raw_spin_lock (try_to_wake_up)
  <idle>-0     1Dnh.    3us : __schedule (preempt_schedule_irq)
  <idle>-0     1Dnh.    4us : profile_hit (__schedule)
  <idle>-0     0Dnh2    4us : wake_idle (try_to_wake_up)
  <idle>-0     1Dnh1    4us : sched_clock (__schedule)
  <idle>-0     0Dnh2    4us : idle_cpu (wake_idle)
  <idle>-0     1Dnh1    5us : _raw_spin_lock_irq (__schedule)
  <idle>-0     0Dnh2    5us : activate_task (try_to_wake_up)
  <idle>-0     1Dnh1    5us : _raw_spin_lock_irqsave (__schedule)
  <idle>-0     0Dnh2    5us : sched_clock (activate_task)
  <idle>-0     0Dnh2    5us : recalc_task_prio (activate_task)
  <idle>-0     1Dnh2    5us : dependent_sleeper (__schedule)
  <idle>-0     0Dnh2    6us : effective_prio (recalc_task_prio)
  <idle>-0     1Dnh2    6us : _raw_spin_unlock (dependent_sleeper)
  <idle>-0     0Dnh2    6us : activate_task <<...>-4> (69 0)
  <idle>-0     1Dnh1    6us : preempt_schedule (dependent_sleeper)
  <idle>-0     0Dnh2    6us : enqueue_task (activate_task)
  <idle>-0     1Dnh1    6us : _raw_spin_lock (dependent_sleeper)
  <idle>-0     0Dnh2    7us : __trace_start_sched_wakeup (try_to_wake_up)
  <idle>-0     1Dnh1    7us : preempt_schedule (_raw_spin_lock)
  <idle>-0     0Dnh2    7us : _raw_spin_lock (__trace_start_sched_wakeup)
  <idle>-0     0Dnh3    7us : _raw_spin_unlock (try_to_wake_up)
  <idle>-0     0Dnh2    7us : resched_task (try_to_wake_up)
  <idle>-0     0Dnh2    8us : try_to_wake_up <<...>-4> (69 8c)
  <idle>-0     0Dnh2    8us : _raw_spin_unlock_irqrestore (try_to_wake_up)
  <idle>-0     1Dnh2    8us : find_next_bit (dependent_sleeper)
  <idle>-0     0Dnh1    8us : preempt_schedule (try_to_wake_up)
  <idle>-0     1Dnh2    8us : _raw_spin_lock (dependent_sleeper)
  <idle>-0     0Dnh1    8us : wake_up_process (trigger_softirqs)
  <idle>-0     1Dnh3    9us : find_next_bit (dependent_sleeper)
  <idle>-0     0Dnh.    9us : preempt_schedule_irq (need_resched)
  <idle>-0     0Dnh.    9us : __schedule (preempt_schedule_irq)
  <idle>-0     1Dnh3    9us : resched_task (dependent_sleeper)
  <idle>-0     0Dnh.   10us : profile_hit (__schedule)
  <idle>-0     1Dnh3   10us : find_next_bit (dependent_sleeper)
  <idle>-0     0Dnh1   10us : sched_clock (__schedule)
  <idle>-0     1Dnh3   10us : _raw_spin_unlock (dependent_sleeper)
  <idle>-0     0Dnh1   10us : _raw_spin_lock_irq (__schedule)
  <idle>-0     1Dnh2   11us : preempt_schedule (dependent_sleeper)
  <idle>-0     0Dnh1   11us : _raw_spin_lock_irqsave (__schedule)
  <idle>-0     1Dnh2   11us : find_next_bit (dependent_sleeper)
  <idle>-0     0Dnh2   11us : dependent_sleeper (__schedule)
  <idle>-0     0Dnh2   11us : _raw_spin_unlock (dependent_sleeper)
  <idle>-0     1Dnh2   11us : dequeue_task (__schedule)
  <idle>-0     0Dnh1   12us : preempt_schedule (dependent_sleeper)
  <idle>-0     1Dnh2   12us : recalc_task_prio (__schedule)
  <idle>-0     0Dnh1   12us : _raw_spin_lock (dependent_sleeper)
  <idle>-0     1Dnh2   12us : effective_prio (recalc_task_prio)
  <idle>-0     0Dnh2   12us : find_next_bit (dependent_sleeper)
  <idle>-0     1Dnh2   12us : enqueue_task (__schedule)
  <idle>-0     0Dnh2   13us : _raw_spin_lock (dependent_sleeper)
  <idle>-0     1Dnh2   13us : trace_array (__schedule)
  <idle>-0     0Dnh2   13us : preempt_schedule (_raw_spin_lock)
  <idle>-0     1Dnh2   14us : trace_array <<...>-13> (69 6e)
  <idle>-0     1Dnh2   15us : trace_array (__schedule)
   <...>-13    1Dnh2   17us : __switch_to (__schedule)
   <...>-13    1Dnh2   17us : __schedule <<idle>-0> (8c 69)
   <...>-13    1Dnh2   17us : _raw_spin_unlock (__schedule)
   <...>-13    1Dnh1   18us : trace_stop_sched_switched (__schedule)
  <idle>-0     0Dnh3   18us!: find_next_bit (dependent_sleeper)
   <...>-13    1Dnh1  229us : _raw_spin_lock (trace_stop_sched_switched)
   <...>-13    1Dnh2  230us : trace_stop_sched_switched <<...>-13> (69 1)
  <idle>-0     0Dnh3  230us : find_next_bit (dependent_sleeper)
   <...>-13    1Dnh2  230us : _raw_spin_unlock (trace_stop_sched_switched)
  <idle>-0     0Dnh3  231us : _raw_spin_unlock (dependent_sleeper)
   <...>-13    1Dnh1  231us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #3: Type: TEXT/plain, Size: 8168 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-debug
--------------------------------------------------------------------
 latency: 233 us, #121/121, CPU#1 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:2)
    -----------------
    | task: wmcube-2964 (uid:500 nice:10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
       X-2870  0Dnh2    0us : __trace_start_sched_wakeup (try_to_wake_up)
       X-2870  0Dnh2    0us : __trace_start_sched_wakeup <<...>-2964> (36 1)
       X-2870  0Dnh2    0us : _raw_spin_unlock (try_to_wake_up)
       X-2870  0Dnh1    0us : resched_task (try_to_wake_up)
       X-2870  0Dnh1    1us : smp_send_reschedule (try_to_wake_up)
       X-2870  0Dnh1    1us : send_IPI_mask_bitmask (smp_send_reschedule)
       X-2870  0Dnh1    1us : _raw_spin_unlock_irqrestore (try_to_wake_up)
       X-2870  0....    1us : _spin_unlock_irqrestore (sock_def_readable)
softirq--13    1Dnh1    1us : wake_idle (try_to_wake_up)
       X-2870  0....    2us : up_mutex (sock_def_readable)
softirq--13    1Dnh1    2us : idle_cpu (wake_idle)
       X-2870  0....    2us : __up_mutex (up_mutex)
softirq--13    1Dnh1    2us : idle_cpu (wake_idle)
       X-2870  0Dnh.    2us : _raw_spin_lock (__up_mutex)
softirq--13    1Dnh1    2us : find_next_bit (wake_idle)
softirq--13    1Dnh1    3us : idle_cpu (wake_idle)
       X-2870  0Dnh1    3us : _raw_spin_unlock (__up_mutex)
softirq--13    1Dnh1    3us : find_next_bit (wake_idle)
       X-2870  0....    3us : _read_unlock (unix_stream_sendmsg)
softirq--13    1Dnh1    3us : idle_cpu (wake_idle)
       X-2870  0....    3us : up_read_mutex (unix_stream_sendmsg)
softirq--13    1Dnh1    4us : find_next_bit (wake_idle)
       X-2870  0....    4us : up_write_mutex (unix_stream_sendmsg)
softirq--13    1Dnh1    4us : idle_cpu (wake_idle)
       X-2870  0....    4us : __up_mutex (up_write_mutex)
softirq--13    1Dnh1    4us : find_next_bit (wake_idle)
       X-2870  0Dnh.    4us : _raw_spin_lock (__up_mutex)
softirq--13    1Dnh1    5us : activate_task (try_to_wake_up)
       X-2870  0Dnh1    5us : _raw_spin_unlock (__up_mutex)
softirq--13    1Dnh1    5us : sched_clock (activate_task)
softirq--13    1Dnh1    5us : recalc_task_prio (activate_task)
       X-2870  0....    6us : dnotify_parent (do_readv_writev)
softirq--13    1Dnh1    6us : effective_prio (recalc_task_prio)
       X-2870  0....    6us : _spin_lock (dnotify_parent)
softirq--13    1Dnh1    6us : activate_task <<...>-2967> (36 2)
       X-2870  0....    6us : __might_sleep (_spin_lock)
softirq--13    1Dnh1    6us : enqueue_task (activate_task)
       X-2870  0....    6us : irqs_disabled (__might_sleep)
       X-2870  0....    7us : _down_mutex (_spin_lock)
softirq--13    1Dnh1    7us : __trace_start_sched_wakeup (try_to_wake_up)
       X-2870  0....    7us : __down_mutex (_spin_lock)
softirq--13    1Dnh1    7us : _raw_spin_lock (__trace_start_sched_wakeup)
       X-2870  0Dnh.    7us : _raw_spin_lock (__down_mutex)
softirq--13    1Dnh2    8us : _raw_spin_unlock (try_to_wake_up)
       X-2870  0Dnh1    8us : grab_lock (__down_mutex)
softirq--13    1Dnh1    8us : preempt_schedule (try_to_wake_up)
       X-2870  0Dnh1    8us : __down_mutex <X-2870> (36 0)
softirq--13    1Dnh1    8us : resched_task (try_to_wake_up)
       X-2870  0Dnh1    9us : _raw_spin_unlock (__down_mutex)
softirq--13    1Dnh1    9us : try_to_wake_up <<...>-2967> (36 69)
       X-2870  0....    9us : _spin_unlock (do_readv_writev)
softirq--13    1Dnh1    9us : _raw_spin_unlock_irqrestore (try_to_wake_up)
       X-2870  0....    9us : up_mutex (do_readv_writev)
       X-2870  0....   10us : __up_mutex (up_mutex)
softirq--13    1Dnh.   10us : smp_reschedule_interrupt (c0306aaa 0 0)
       X-2870  0Dnh.   10us : _raw_spin_lock (__up_mutex)
softirq--13    1Dnh.   10us : preempt_schedule_irq (need_resched)
       X-2870  0Dnh1   10us : _raw_spin_unlock (__up_mutex)
softirq--13    1Dnh.   11us : __schedule (preempt_schedule_irq)
       X-2870  0Dnh.   11us < (32)
softirq--13    1Dnh.   11us : profile_hit (__schedule)
softirq--13    1Dnh1   11us : sched_clock (__schedule)
softirq--13    1Dnh1   11us : _raw_spin_lock_irq (__schedule)
softirq--13    1Dnh1   12us : _raw_spin_lock_irqsave (__schedule)
       X-2870  0....   12us > sys_gettimeofday (bf8d4b28 00000000 0000007b)
softirq--13    1Dnh2   12us : pull_rt_tasks (__schedule)
       X-2870  0....   12us : sys_gettimeofday (sysenter_past_esp)
       X-2870  0....   13us : timeofday_API_hacks (sys_gettimeofday)
softirq--13    1Dnh2   13us : find_next_bit (pull_rt_tasks)
       X-2870  0....   13us : do_gettimeofday (sys_gettimeofday)
softirq--13    1Dnh2   13us : find_next_bit (pull_rt_tasks)
       X-2870  0....   13us : get_offset_pmtmr (do_gettimeofday)
softirq--13    1Dnh2   13us : dependent_sleeper (__schedule)
softirq--13    1Dnh2   14us : _raw_spin_unlock (dependent_sleeper)
softirq--13    1Dnh1   14us : preempt_schedule (dependent_sleeper)
softirq--13    1Dnh1   14us : _raw_spin_lock (dependent_sleeper)
softirq--13    1Dnh2   15us : find_next_bit (dependent_sleeper)
softirq--13    1Dnh2   15us : _raw_spin_lock (dependent_sleeper)
softirq--13    1Dnh3   15us : find_next_bit (dependent_sleeper)
softirq--13    1Dnh3   16us : find_next_bit (dependent_sleeper)
softirq--13    1Dnh3   16us : _raw_spin_unlock (dependent_sleeper)
       X-2870  0....   16us : copy_to_user (sys_gettimeofday)
softirq--13    1Dnh2   16us : preempt_schedule (dependent_sleeper)
       X-2870  0....   16us : __might_sleep (copy_to_user)
softirq--13    1Dnh2   16us : find_next_bit (dependent_sleeper)
       X-2870  0....   17us : irqs_disabled (__might_sleep)
       X-2870  0....   17us : __might_sleep (copy_to_user)
softirq--13    1Dnh2   17us : trace_array (__schedule)
       X-2870  0....   17us : irqs_disabled (__might_sleep)
       X-2870  0....   17us : __copy_to_user_ll (copy_to_user)
       X-2870  0Dnh.   18us < (0)
softirq--13    1Dnh2   18us : trace_array <<...>-2964> (36 82)
softirq--13    1Dnh2   18us : trace_array <<...>-2967> (36 78)
softirq--13    1Dnh2   19us : trace_array <softirq--13> (69 6e)
softirq--13    1Dnh2   19us!: trace_array (__schedule)
       X-2870  0....  227us > sys_select (00000100 08207260 0000007b)
       X-2870  0....  228us : sys_select (sysenter_past_esp)
       X-2870  0....  228us : select_bits_alloc (sys_select)
       X-2870  0....  228us : __kmalloc (select_bits_alloc)
       X-2870  0....  229us : __might_sleep (__kmalloc)
       X-2870  0....  229us : irqs_disabled (__might_sleep)
       X-2870  0....  229us : __local_save_flags (__kmalloc)
       X-2870  0....  229us : _spin_lock (__kmalloc)
       X-2870  0....  230us : __might_sleep (_spin_lock)
   <...>-2964  1Dnh2  230us : __switch_to (__schedule)
       X-2870  0....  230us : irqs_disabled (__might_sleep)
   <...>-2964  1Dnh2  230us : __schedule <softirq--13> (69 36)
       X-2870  0....  230us : _down_mutex (_spin_lock)
       X-2870  0....  231us : __down_mutex (_spin_lock)
   <...>-2964  1Dnh2  231us : _raw_spin_unlock (__schedule)
       X-2870  0Dnh.  231us : _raw_spin_lock (__down_mutex)
   <...>-2964  1Dnh1  231us : trace_stop_sched_switched (__schedule)
   <...>-2964  1Dnh1  231us : _raw_spin_lock (trace_stop_sched_switched)
       X-2870  0Dnh1  231us : grab_lock (__down_mutex)
   <...>-2964  1Dnh2  232us : trace_stop_sched_switched <<...>-2964> (36 1)
       X-2870  0Dnh1  232us : __down_mutex <X-2870> (36 0)
   <...>-2964  1Dnh2  232us : _raw_spin_unlock (trace_stop_sched_switched)
       X-2870  0Dnh1  232us : _raw_spin_unlock (__down_mutex)
   <...>-2964  1Dnh1  232us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #4: Type: TEXT/plain, Size: 5476 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-debug
--------------------------------------------------------------------
 latency: 223 us, #76/76, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:2)
    -----------------
    | task: wmfortune-2967 (uid:500 nice:0 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
   <...>-3083  1Dnh1    0us : grab_lock (__down_mutex)
softirq--4     0Dnh.    0us : preempt_schedule (__up_mutex)
softirq--4     0Dnh.    0us : irqs_disabled (preempt_schedule)
   <...>-3083  1Dnh1    0us : __down_mutex <<...>-3083> (36 0)
   <...>-3083  1Dnh1    0us : _raw_spin_unlock (__down_mutex)
softirq--4     0Dn..    0us : preempt_schedule (up_mutex)
softirq--4     0Dn..    0us : irqs_disabled (preempt_schedule)
   <...>-3083  1....    0us : __local_save_flags (_spin_lock_irqsave)
softirq--4     0Dnh.    1us : __schedule (preempt_schedule)
   <...>-3083  1....    1us : _spin_unlock_irqrestore (extract_buf)
softirq--4     0Dnh.    1us : profile_hit (__schedule)
   <...>-3083  1....    1us : up_mutex (extract_buf)
   <...>-3083  1....    1us : __up_mutex (up_mutex)
softirq--4     0Dnh1    1us : sched_clock (__schedule)
softirq--4     0Dnh1    2us!: _raw_spin_lock_irq (__schedule)
   <...>-3083  1Dnh.  207us : _raw_spin_lock (__up_mutex)
   <...>-3083  1Dnh1  208us : _raw_spin_unlock (__up_mutex)
softirq--4     0Dnh1  208us : _raw_spin_lock_irqsave (__schedule)
   <...>-3083  1....  208us : sha_transform (extract_buf)
softirq--4     0Dnh2  208us : dependent_sleeper (__schedule)
softirq--4     0Dnh2  209us : _raw_spin_unlock (dependent_sleeper)
softirq--4     0Dnh1  209us : preempt_schedule (dependent_sleeper)
   <...>-3083  1....  209us : __add_entropy_words (extract_buf)
softirq--4     0Dnh1  209us : _raw_spin_lock (dependent_sleeper)
   <...>-3083  1....  209us : _spin_lock_irqsave (__add_entropy_words)
softirq--4     0Dnh2  209us : find_next_bit (dependent_sleeper)
   <...>-3083  1....  210us : __might_sleep (_spin_lock_irqsave)
softirq--4     0Dnh2  210us : _raw_spin_lock (dependent_sleeper)
   <...>-3083  1....  210us : irqs_disabled (__might_sleep)
   <...>-3083  1....  210us : _down_mutex (_spin_lock_irqsave)
softirq--4     0Dnh3  210us : find_next_bit (dependent_sleeper)
   <...>-3083  1....  210us : __down_mutex (_spin_lock_irqsave)
   <...>-3083  1Dnh.  211us : _raw_spin_lock (__down_mutex)
softirq--4     0Dnh3  211us : find_next_bit (dependent_sleeper)
softirq--4     0Dnh3  211us : _raw_spin_unlock (dependent_sleeper)
   <...>-3083  1Dnh1  211us : grab_lock (__down_mutex)
softirq--4     0Dnh2  211us : preempt_schedule (dependent_sleeper)
   <...>-3083  1Dnh1  211us : __down_mutex <<...>-3083> (36 0)
softirq--4     0Dnh2  212us : find_next_bit (dependent_sleeper)
   <...>-3083  1Dnh1  212us : _raw_spin_unlock (__down_mutex)
   <...>-3083  1....  212us : __local_save_flags (_spin_lock_irqsave)
softirq--4     0Dnh2  212us : trace_array (__schedule)
   <...>-3083  1....  212us : _spin_unlock_irqrestore (extract_buf)
   <...>-3083  1....  213us : up_mutex (extract_buf)
   <...>-3083  1....  213us : __up_mutex (up_mutex)
softirq--4     0Dnh2  213us : trace_array <<...>-2967> (34 78)
   <...>-3083  1Dnh.  213us : _raw_spin_lock (__up_mutex)
   <...>-3083  1Dnh1  214us : _raw_spin_unlock (__up_mutex)
   <...>-3083  1....  214us : __add_entropy_words (extract_buf)
softirq--4     0Dnh2  214us : trace_array <softirq--4> (69 6e)
   <...>-3083  1....  214us : _spin_lock_irqsave (__add_entropy_words)
   <...>-3083  1....  214us : __might_sleep (_spin_lock_irqsave)
softirq--4     0Dnh2  215us : trace_array (__schedule)
   <...>-3083  1....  215us : irqs_disabled (__might_sleep)
   <...>-3083  1....  215us : _down_mutex (_spin_lock_irqsave)
   <...>-3083  1....  215us : __down_mutex (_spin_lock_irqsave)
   <...>-3083  1Dnh.  215us : _raw_spin_lock (__down_mutex)
   <...>-3083  1Dnh1  216us : grab_lock (__down_mutex)
   <...>-3083  1Dnh1  216us : __down_mutex <<...>-3083> (36 0)
   <...>-3083  1Dnh1  216us : _raw_spin_unlock (__down_mutex)
   <...>-3083  1....  216us : __local_save_flags (_spin_lock_irqsave)
   <...>-2967  0Dnh2  217us : __switch_to (__schedule)
   <...>-3083  1....  217us : _spin_unlock_irqrestore (extract_buf)
   <...>-3083  1....  217us : up_mutex (extract_buf)
   <...>-2967  0Dnh2  217us : __schedule <softirq--4> (69 34)
   <...>-3083  1....  217us : __up_mutex (up_mutex)
   <...>-2967  0Dnh2  218us : _raw_spin_unlock (__schedule)
   <...>-3083  1Dnh.  218us : _raw_spin_lock (__up_mutex)
   <...>-2967  0Dnh1  218us : trace_stop_sched_switched (__schedule)
   <...>-3083  1Dnh1  218us : _raw_spin_unlock (__up_mutex)
   <...>-2967  0Dnh1  218us : _raw_spin_lock (trace_stop_sched_switched)
   <...>-3083  1....  219us : sha_transform (extract_buf)
   <...>-2967  0Dnh2  219us : trace_stop_sched_switched <<...>-2967> (34 0)
   <...>-2967  0Dnh2  219us : _raw_spin_unlock (trace_stop_sched_switched)
   <...>-2967  0Dnh1  219us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #5: Type: TEXT/plain, Size: 8385 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-debug
--------------------------------------------------------------------
 latency: 237 us, #120/120, CPU#1 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:2)
    -----------------
    | task: wmWeather-2968 (uid:500 nice:10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
softirq--13    1Dnh2    0us : find_next_bit (__trace_start_sched_wakeup)
   <...>-3083  0....    0us : __down_mutex (_spin_lock_irqsave)
   <...>-3083  0Dnh.    0us : _raw_spin_lock (__down_mutex)
softirq--13    1Dnh2    0us : <74666f73> (<2d717269>)
softirq--13    1Dnh2    0us : __trace_start_sched_wakeup (try_to_wake_up)
   <...>-3083  0Dnh1    0us : grab_lock (__down_mutex)
softirq--13    1Dnh2    1us : __trace_start_sched_wakeup <<...>-2968> (34 1)
   <...>-3083  0Dnh1    1us : __down_mutex <<...>-3083> (36 0)
softirq--13    1Dnh2    1us : _raw_spin_unlock (try_to_wake_up)
   <...>-3083  0Dnh1    1us : _raw_spin_unlock (__down_mutex)
softirq--13    1Dnh1    1us : resched_task (try_to_wake_up)
   <...>-3083  0....    1us!: __local_save_flags (_spin_lock_irqsave)
softirq--13    1Dnh1  213us : try_to_wake_up <<...>-2968> (34 69)
softirq--13    1Dnh1  213us : _raw_spin_unlock_irqrestore (try_to_wake_up)
softirq--13    1Dnh.  214us : irqs_disabled (smp_processor_id)
softirq--13    1Dnh.  214us : smp_apic_timer_interrupt (c0306aaa 0 0)
softirq--13    1Dnh.  215us : update_process_times (smp_apic_timer_interrupt)
softirq--13    1Dnh.  215us : account_system_time (update_process_times)
softirq--13    1Dnh.  216us : acct_update_integrals (account_system_time)
softirq--13    1Dnh.  216us : update_mem_hiwater (update_process_times)
softirq--13    1Dnh.  216us : run_local_timers (update_process_times)
softirq--13    1Dnh.  216us : raise_softirq (update_process_times)
   <...>-3083  0....  216us : _spin_unlock_irqrestore (extract_buf)
   <...>-3083  0....  217us : up_mutex (extract_buf)
softirq--13    1Dnh.  217us : scheduler_tick (update_process_times)
   <...>-3083  0....  217us : __up_mutex (up_mutex)
softirq--13    1Dnh.  217us : sched_clock (scheduler_tick)
   <...>-3083  0Dnh.  217us : _raw_spin_lock (__up_mutex)
softirq--13    1Dnh.  218us : _raw_spin_lock (scheduler_tick)
   <...>-3083  0Dnh1  218us : _raw_spin_unlock (__up_mutex)
softirq--13    1Dnh1  218us : __bitmap_weight (scheduler_tick)
   <...>-3083  0....  218us : sha_transform (extract_buf)
softirq--13    1Dnh1  219us : _raw_spin_unlock (scheduler_tick)
softirq--13    1Dnh.  219us : preempt_schedule (scheduler_tick)
softirq--13    1Dnh.  219us : rebalance_tick (scheduler_tick)
   <...>-3083  0....  220us : __add_entropy_words (extract_buf)
softirq--13    1Dnh.  220us : softlockup_tick (smp_apic_timer_interrupt)
   <...>-3083  0....  220us : _spin_lock_irqsave (__add_entropy_words)
softirq--13    1Dnh.  220us : irq_exit (apic_timer_interrupt)
   <...>-3083  0....  220us : __might_sleep (_spin_lock_irqsave)
   <...>-3083  0....  220us : irqs_disabled (__might_sleep)
softirq--13    1Dnh1  221us : do_softirq (irq_exit)
   <...>-3083  0....  221us : _down_mutex (_spin_lock_irqsave)
softirq--13    1Dnh1  221us : __do_softirq (do_softirq)
   <...>-3083  0....  221us : __down_mutex (_spin_lock_irqsave)
softirq--13    1Dnh1  221us : trigger_softirqs (do_softirq)
   <...>-3083  0Dnh.  221us : _raw_spin_lock (__down_mutex)
softirq--13    1Dnh1  222us : wakeup_softirqd (trigger_softirqs)
   <...>-3083  0Dnh1  222us : grab_lock (__down_mutex)
softirq--13    1Dnh.  222us : preempt_schedule_irq (need_resched)
   <...>-3083  0Dnh1  222us : __down_mutex <<...>-3083> (36 0)
softirq--13    1Dnh.  222us : __schedule (preempt_schedule_irq)
   <...>-3083  0Dnh1  223us : _raw_spin_unlock (__down_mutex)
softirq--13    1Dnh.  223us : profile_hit (__schedule)
softirq--13    1Dnh1  223us : sched_clock (__schedule)
   <...>-3083  0....  223us : __local_save_flags (_spin_lock_irqsave)
softirq--13    1Dnh1  223us : _raw_spin_lock_irq (__schedule)
   <...>-3083  0....  224us : _spin_unlock_irqrestore (extract_buf)
   <...>-3083  0....  224us : up_mutex (extract_buf)
softirq--13    1Dnh1  224us : _raw_spin_lock_irqsave (__schedule)
   <...>-3083  0....  224us : __up_mutex (up_mutex)
softirq--13    1Dnh2  224us : dependent_sleeper (__schedule)
   <...>-3083  0Dnh.  224us : _raw_spin_lock (__up_mutex)
softirq--13    1Dnh2  225us : _raw_spin_unlock (dependent_sleeper)
   <...>-3083  0Dnh1  225us : _raw_spin_unlock (__up_mutex)
softirq--13    1Dnh1  225us : preempt_schedule (dependent_sleeper)
   <...>-3083  0....  225us : __add_entropy_words (extract_buf)
softirq--13    1Dnh1  225us : _raw_spin_lock (dependent_sleeper)
   <...>-3083  0....  225us : _spin_lock_irqsave (__add_entropy_words)
softirq--13    1Dnh2  226us : find_next_bit (dependent_sleeper)
   <...>-3083  0....  226us : __might_sleep (_spin_lock_irqsave)
softirq--13    1Dnh2  226us : _raw_spin_lock (dependent_sleeper)
   <...>-3083  0....  226us : irqs_disabled (__might_sleep)
softirq--13    1Dnh3  226us : find_next_bit (dependent_sleeper)
   <...>-3083  0....  226us : _down_mutex (_spin_lock_irqsave)
   <...>-3083  0....  227us : __down_mutex (_spin_lock_irqsave)
   <...>-3083  0Dnh.  227us : _raw_spin_lock (__down_mutex)
softirq--13    1Dnh3  227us : find_next_bit (dependent_sleeper)
   <...>-3083  0Dnh1  227us : grab_lock (__down_mutex)
softirq--13    1Dnh3  227us : _raw_spin_unlock (dependent_sleeper)
   <...>-3083  0Dnh1  228us : __down_mutex <<...>-3083> (36 0)
softirq--13    1Dnh2  228us : preempt_schedule (dependent_sleeper)
   <...>-3083  0Dnh1  228us : _raw_spin_unlock (__down_mutex)
softirq--13    1Dnh2  228us : find_next_bit (dependent_sleeper)
   <...>-3083  0....  228us : __local_save_flags (_spin_lock_irqsave)
softirq--13    1Dnh2  229us : trace_array (__schedule)
   <...>-3083  0....  229us : _spin_unlock_irqrestore (extract_buf)
   <...>-3083  0....  229us : up_mutex (extract_buf)
   <...>-3083  0....  229us : __up_mutex (up_mutex)
softirq--13    1Dnh2  229us : trace_array <<...>-2968> (34 82)
   <...>-3083  0Dnh.  229us : _raw_spin_lock (__up_mutex)
   <...>-3083  0Dnh1  230us : _raw_spin_unlock (__up_mutex)
   <...>-3083  0....  230us : sha_transform (extract_buf)
softirq--13    1Dnh2  230us : trace_array <softirq--13> (69 6e)
softirq--13    1Dnh2  231us : trace_array (__schedule)
   <...>-3083  0....  231us : copy_to_user (extract_entropy_user)
   <...>-3083  0....  232us : __might_sleep (copy_to_user)
   <...>-3083  0....  232us : irqs_disabled (__might_sleep)
   <...>-3083  0....  232us : __might_sleep (copy_to_user)
   <...>-3083  0....  232us : irqs_disabled (__might_sleep)
   <...>-3083  0....  232us : __copy_to_user_ll (copy_to_user)
   <...>-3083  0....  233us : extract_buf (extract_entropy_user)
   <...>-3083  0....  233us : sha_init (extract_buf)
   <...>-3083  0....  234us : sha_transform (extract_buf)
   <...>-2968  1Dnh2  234us : __switch_to (__schedule)
   <...>-2968  1Dnh2  235us : __schedule <softirq--13> (69 34)
   <...>-3083  0....  235us : __add_entropy_words (extract_buf)
   <...>-2968  1Dnh2  235us : _raw_spin_unlock (__schedule)
   <...>-3083  0....  235us : _spin_lock_irqsave (__add_entropy_words)
   <...>-2968  1Dnh1  235us : trace_stop_sched_switched (__schedule)
   <...>-3083  0....  236us : __might_sleep (_spin_lock_irqsave)
   <...>-2968  1Dnh1  236us : _raw_spin_lock (trace_stop_sched_switched)
   <...>-3083  0....  236us : irqs_disabled (__might_sleep)
   <...>-2968  1Dnh2  236us : trace_stop_sched_switched <<...>-2968> (34 1)
   <...>-3083  0....  236us : _down_mutex (_spin_lock_irqsave)
   <...>-2968  1Dnh2  236us : _raw_spin_unlock (trace_stop_sched_switched)
   <...>-3083  0....  237us : __down_mutex (_spin_lock_irqsave)
   <...>-3083  0Dnh.  237us : _raw_spin_lock (__down_mutex)
   <...>-2968  1Dnh1  237us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #6: Type: TEXT/plain, Size: 5120 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-debug
--------------------------------------------------------------------
 latency: 223 us, #70/70, CPU#1 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:2)
    -----------------
    | task: X-2870 (uid:0 nice:0 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
   <...>-3083  0Dnh1    0us : _raw_spin_unlock (__up_mutex)
softirq--13    1Dn..    0us : preempt_schedule (up_mutex)
   <...>-3083  0....    0us : __add_entropy_words (extract_buf)
softirq--13    1Dn..    0us : irqs_disabled (preempt_schedule)
   <...>-3083  0....    0us : _spin_lock_irqsave (__add_entropy_words)
softirq--13    1Dnh.    0us : __schedule (preempt_schedule)
   <...>-3083  0....    0us : __might_sleep (_spin_lock_irqsave)
   <...>-3083  0....    1us!: irqs_disabled (__might_sleep)
softirq--13    1Dnh.  207us : profile_hit (__schedule)
   <...>-3083  0....  207us : _down_mutex (_spin_lock_irqsave)
   <...>-3083  0....  207us : __down_mutex (_spin_lock_irqsave)
softirq--13    1Dnh1  208us : sched_clock (__schedule)
   <...>-3083  0Dnh.  208us : _raw_spin_lock (__down_mutex)
softirq--13    1Dnh1  208us : _raw_spin_lock_irq (__schedule)
softirq--13    1Dnh1  208us : _raw_spin_lock_irqsave (__schedule)
   <...>-3083  0Dnh1  208us : grab_lock (__down_mutex)
softirq--13    1Dnh2  209us : dependent_sleeper (__schedule)
   <...>-3083  0Dnh1  209us : __down_mutex <<...>-3083> (36 0)
softirq--13    1Dnh2  209us : _raw_spin_unlock (dependent_sleeper)
   <...>-3083  0Dnh1  209us : _raw_spin_unlock (__down_mutex)
softirq--13    1Dnh1  209us : preempt_schedule (dependent_sleeper)
   <...>-3083  0....  209us : __local_save_flags (_spin_lock_irqsave)
softirq--13    1Dnh1  210us : _raw_spin_lock (dependent_sleeper)
   <...>-3083  0....  210us : _spin_unlock_irqrestore (extract_buf)
softirq--13    1Dnh2  210us : find_next_bit (dependent_sleeper)
   <...>-3083  0....  210us : up_mutex (extract_buf)
softirq--13    1Dnh2  210us : _raw_spin_lock (dependent_sleeper)
   <...>-3083  0....  210us : __up_mutex (up_mutex)
softirq--13    1Dnh3  211us : find_next_bit (dependent_sleeper)
   <...>-3083  0Dnh.  211us : _raw_spin_lock (__up_mutex)
   <...>-3083  0Dnh1  211us : _raw_spin_unlock (__up_mutex)
softirq--13    1Dnh3  211us : find_next_bit (dependent_sleeper)
softirq--13    1Dnh3  212us : _raw_spin_unlock (dependent_sleeper)
   <...>-3083  0....  212us : sha_transform (extract_buf)
softirq--13    1Dnh2  212us : preempt_schedule (dependent_sleeper)
softirq--13    1Dnh2  212us : find_next_bit (dependent_sleeper)
softirq--13    1Dnh2  213us : trace_array (__schedule)
   <...>-3083  0....  213us : copy_to_user (extract_entropy_user)
   <...>-3083  0....  213us : __might_sleep (copy_to_user)
   <...>-3083  0....  213us : irqs_disabled (__might_sleep)
softirq--13    1Dnh2  213us : trace_array <<...>-2870> (34 78)
   <...>-3083  0....  214us : __might_sleep (copy_to_user)
   <...>-3083  0....  214us : irqs_disabled (__might_sleep)
   <...>-3083  0....  214us : __copy_to_user_ll (copy_to_user)
softirq--13    1Dnh2  214us : trace_array <softirq--13> (69 6e)
   <...>-3083  0....  215us : extract_buf (extract_entropy_user)
   <...>-3083  0....  215us : sha_init (extract_buf)
softirq--13    1Dnh2  215us : trace_array (__schedule)
   <...>-3083  0....  215us : sha_transform (extract_buf)
   <...>-3083  0....  216us : __add_entropy_words (extract_buf)
   <...>-3083  0....  216us : _spin_lock_irqsave (__add_entropy_words)
   <...>-3083  0....  216us : __might_sleep (_spin_lock_irqsave)
   <...>-3083  0....  217us : irqs_disabled (__might_sleep)
   <...>-3083  0....  217us : _down_mutex (_spin_lock_irqsave)
   <...>-2870  1Dnh2  217us : __switch_to (__schedule)
   <...>-3083  0....  217us : __down_mutex (_spin_lock_irqsave)
   <...>-3083  0Dnh.  218us : _raw_spin_lock (__down_mutex)
   <...>-2870  1Dnh2  218us : __schedule <softirq--13> (69 34)
   <...>-2870  1Dnh2  218us : _raw_spin_unlock (__schedule)
   <...>-3083  0Dnh1  218us : grab_lock (__down_mutex)
   <...>-2870  1Dnh1  218us : trace_stop_sched_switched (__schedule)
   <...>-3083  0Dnh1  218us : __down_mutex <<...>-3083> (36 0)
   <...>-2870  1Dnh1  219us : _raw_spin_lock (trace_stop_sched_switched)
   <...>-3083  0Dnh1  219us : _raw_spin_unlock (__down_mutex)
   <...>-2870  1Dnh2  219us : trace_stop_sched_switched <<...>-2870> (34 1)
   <...>-3083  0....  219us : __local_save_flags (_spin_lock_irqsave)
   <...>-2870  1Dnh2  219us : _raw_spin_unlock (trace_stop_sched_switched)
   <...>-3083  0....  219us : _spin_unlock_irqrestore (extract_buf)
   <...>-2870  1Dnh1  220us : trace_stop_sched_switched (__schedule)


vim:ft=help

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22 21:53                 ` William Weston
@ 2005-06-22 22:00                   ` Ingo Molnar
  2005-06-22 23:06                     ` William Weston
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-22 22:00 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> Hi Ingo,
> 
> Latency traces (attached) are looking a little bit better with -50-11.  
> The CPU consistently seems to idle for ~200us at a time in the traces.  
> Maximum wakeup latency since boot (over an hour ago) is 310us.  With 
> previous RT kernels, maximums would generally go over 800us.

these are all the first type of latencies, which seem to be hardware 
related. Could you try to boot the UP kernel, do you see these latencies 
there too? (if yes then please post those too)

> Should I apply your SMT scheduler latency fix, or is that patch for 
> -mm only?

the fix is in current -RT kernels already. As can be seen from the 
latency traces you got, the SMT scheduler is not causing latencies 
anymore.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22 22:00                   ` Ingo Molnar
@ 2005-06-22 23:06                     ` William Weston
  2005-06-23  0:10                       ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-22 23:06 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: TEXT/PLAIN, Size: 509 bytes --]

On Thu, 23 Jun 2005, Ingo Molnar wrote:

> these are all the first type of latencies, which seem to be hardware 
> related. Could you try to boot the UP kernel, do you see these latencies 
> there too? (if yes then please post those too)

On -50-11 UP, the ~200us idle is still showing up in the traces.  This
idle time, however, seems to be at random points within the trace.  Some
of the traces attached are nearly identical except for where the ~200us
jump happens to fall.  Hardware induced latency?

--ww

[-- Attachment #2: Type: TEXT/plain, Size: 2501 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 221 us, #29/29, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: softirq-timer/0-3 (uid:0 nice:-10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
     cc1-4654  0Dnh3    0us : <00316363> (<66747200>)
     cc1-4654  0Dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
     cc1-4654  0Dnh3    0us : __trace_start_sched_wakeup <<...>-3> (69 0)
     cc1-4654  0Dnh2    0us : try_to_wake_up <<...>-3> (69 7b)
     cc1-4654  0Dnh1    0us : preempt_schedule (try_to_wake_up)
     cc1-4654  0Dnh1    0us : wake_up_process (trigger_softirqs)
     cc1-4654  0Dnh.    0us : __schedule (work_resched)
     cc1-4654  0Dnh.    0us : profile_hit (__schedule)
     cc1-4654  0Dnh1    1us : sched_clock (__schedule)
     cc1-4654  0Dnh2    2us : dequeue_task (__schedule)
     cc1-4654  0Dnh2    2us : recalc_task_prio (__schedule)
     cc1-4654  0Dnh2    2us : effective_prio (recalc_task_prio)
     cc1-4654  0Dnh2    2us : enqueue_task (__schedule)
     cc1-4654  0Dnh2    2us : trace_array (__schedule)
     cc1-4654  0Dnh2    3us : trace_array <<...>-3> (69 6e)
     cc1-4654  0Dnh2    3us : trace_array <cc1-4654> (7b 78)
     cc1-4654  0Dnh2    3us : trace_array <<...>-3592> (7d 82)
     cc1-4654  0Dnh2    4us : trace_array <<...>-3588> (7d 82)
     cc1-4654  0Dnh2    4us : trace_array <<...>-3586> (7d 82)
     cc1-4654  0Dnh2    4us : trace_array <<...>-3587> (7d 82)
     cc1-4654  0Dnh2    4us : trace_array <<...>-3589> (7d 82)
     cc1-4654  0Dnh2    5us : trace_array <<...>-3594> (7e 82)
     cc1-4654  0Dnh2    5us : trace_array (__schedule)
   <...>-3     0Dnh2    7us : __switch_to (__schedule)
   <...>-3     0Dnh2    8us : __schedule <cc1-4654> (7b 69)
   <...>-3     0Dnh1    8us!: trace_stop_sched_switched (__schedule)
   <...>-3     0Dnh2  220us : trace_stop_sched_switched <<...>-3> (69 0)
   <...>-3     0Dnh1  221us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #3: Type: TEXT/plain, Size: 2508 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 217 us, #29/29, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: softirq-timer/0-3 (uid:0 nice:-10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
       X-2790  0Dnh3    0us : <2d6d0058> (<616e6962>)
       X-2790  0Dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
       X-2790  0Dnh3    0us : __trace_start_sched_wakeup <<...>-3> (69 0)
       X-2790  0Dnh2    0us : try_to_wake_up <<...>-3> (69 74)
       X-2790  0Dnh1    0us!: preempt_schedule (try_to_wake_up)
       X-2790  0Dnh1  211us : wake_up_process (trigger_softirqs)
       X-2790  0Dnh.  211us : preempt_schedule_irq (need_resched)
       X-2790  0Dnh.  211us : __schedule (preempt_schedule_irq)
       X-2790  0Dnh.  212us : profile_hit (__schedule)
       X-2790  0Dnh1  212us : sched_clock (__schedule)
       X-2790  0Dnh2  212us : dequeue_task (__schedule)
       X-2790  0Dnh2  212us : recalc_task_prio (__schedule)
       X-2790  0Dnh2  212us : effective_prio (recalc_task_prio)
       X-2790  0Dnh2  212us : enqueue_task (__schedule)
       X-2790  0Dnh2  212us : trace_array (__schedule)
       X-2790  0Dnh2  213us : trace_array <<...>-3> (69 6e)
       X-2790  0Dnh2  213us : trace_array <X-2790> (74 78)
       X-2790  0Dnh2  214us : trace_array <<...>-3588> (7d 82)
       X-2790  0Dnh2  214us : trace_array <<...>-3586> (7d 82)
       X-2790  0Dnh2  214us : trace_array <<...>-3587> (7d 82)
       X-2790  0Dnh2  214us : trace_array <<...>-3589> (7d 82)
       X-2790  0Dnh2  214us : trace_array (__schedule)
       X-2790  0Dnh2  215us : trace_array <<...>-6004> (7d 78)
   <...>-3     0Dnh2  216us : __switch_to (__schedule)
   <...>-3     0Dnh2  216us : __schedule <X-2790> (74 69)
   <...>-3     0Dnh1  216us : trace_stop_sched_switched (__schedule)
   <...>-3     0Dnh2  217us : trace_stop_sched_switched <<...>-3> (69 0)
   <...>-3     0Dnh1  217us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #4: Type: TEXT/plain, Size: 2565 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 208 us, #30/30, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: softirq-timer/0-3 (uid:0 nice:-10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
     vlc-8511  0Dnh3    0us : <00636c76> (<6f000000>)
     vlc-8511  0Dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
     vlc-8511  0Dnh3    0us : __trace_start_sched_wakeup <<...>-3> (69 0)
     vlc-8511  0Dnh2    0us : try_to_wake_up <<...>-3> (69 73)
     vlc-8511  0Dnh1    0us!: preempt_schedule (try_to_wake_up)
     vlc-8511  0Dnh1  200us : wake_up_process (trigger_softirqs)
     vlc-8511  0Dnh.  201us : __schedule (work_resched)
     vlc-8511  0Dnh.  201us : profile_hit (__schedule)
     vlc-8511  0Dnh1  201us : sched_clock (__schedule)
     vlc-8511  0Dnh2  201us : dequeue_task (__schedule)
     vlc-8511  0Dnh2  201us : recalc_task_prio (__schedule)
     vlc-8511  0Dnh2  202us : effective_prio (recalc_task_prio)
     vlc-8511  0Dnh2  202us : enqueue_task (__schedule)
     vlc-8511  0Dnh2  202us : trace_array (__schedule)
     vlc-8511  0Dnh2  203us : trace_array <<...>-3> (69 6e)
     vlc-8511  0Dnh2  203us : trace_array <<...>-2790> (73 78)
     vlc-8511  0Dnh2  203us : trace_array <vlc-8511> (73 78)
     vlc-8511  0Dnh2  203us : trace_array <<...>-8766> (7d 78)
     vlc-8511  0Dnh2  203us : trace_array <<...>-3592> (7d 82)
     vlc-8511  0Dnh2  204us : trace_array <<...>-3588> (7d 82)
     vlc-8511  0Dnh2  204us : trace_array <<...>-3587> (7d 82)
     vlc-8511  0Dnh2  204us : trace_array <<...>-3586> (7d 82)
     vlc-8511  0Dnh2  204us : trace_array <<...>-3589> (7d 82)
     vlc-8511  0Dnh2  205us : trace_array (__schedule)
   <...>-3     0Dnh2  206us : __switch_to (__schedule)
   <...>-3     0Dnh2  207us : __schedule <vlc-8511> (73 69)
   <...>-3     0Dnh1  207us : trace_stop_sched_switched (__schedule)
   <...>-3     0Dnh2  208us : trace_stop_sched_switched <<...>-3> (69 0)
   <...>-3     0Dnh1  208us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #5: Type: TEXT/plain, Size: 2681 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 229 us, #32/32, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: IRQ 10-1010 (uid:0 nice:-5 policy:1 rt_prio:41)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
     vlc-8510  0dnh3    0us : <00636c76> (<6f000000>)
     vlc-8510  0dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
     vlc-8510  0dnh3    0us : __trace_start_sched_wakeup <<...>-1010> (3a 0)
     vlc-8510  0dnh2    0us : try_to_wake_up <<...>-1010> (3a 73)
     vlc-8510  0dnh1    0us : preempt_schedule (try_to_wake_up)
     vlc-8510  0dnh1    0us : wake_up_process (redirect_hardirq)
     vlc-8510  0dnh1    0us!: disable_8259A_irq (__do_IRQ)
     vlc-8510  0dnh1  223us : preempt_schedule (__do_IRQ)
     vlc-8510  0dnh.  223us : preempt_schedule (__do_IRQ)
     vlc-8510  0dnh.  223us : local_irq_restore (__do_IRQ)
     vlc-8510  0dnh.  223us : check_soft_flags (local_irq_restore)
     vlc-8510  0Dnh.  223us : preempt_schedule (__do_IRQ)
     vlc-8510  0Dnh.  224us : irq_exit (do_IRQ)
     vlc-8510  0Dnh.  224us : __schedule (work_resched)
     vlc-8510  0Dnh.  224us : profile_hit (__schedule)
     vlc-8510  0Dnh1  224us : sched_clock (__schedule)
     vlc-8510  0Dnh2  224us : trace_array (__schedule)
     vlc-8510  0Dnh2  225us : trace_array <<...>-1010> (3a 3a)
     vlc-8510  0Dnh2  225us : trace_array <vlc-8510> (73 78)
     vlc-8510  0Dnh2  226us : trace_array <<...>-8790> (7c 78)
     vlc-8510  0Dnh2  226us : trace_array <<...>-3592> (7d 82)
     vlc-8510  0Dnh2  226us : trace_array <<...>-3588> (7d 82)
     vlc-8510  0Dnh2  226us : trace_array <<...>-3587> (7d 82)
     vlc-8510  0Dnh2  226us : trace_array <<...>-3586> (7d 82)
     vlc-8510  0Dnh2  226us : trace_array <<...>-3589> (7d 82)
     vlc-8510  0Dnh2  226us : trace_array (__schedule)
   <...>-1010  0Dnh2  228us : __switch_to (__schedule)
   <...>-1010  0Dnh2  228us : __schedule <vlc-8510> (73 3a)
   <...>-1010  0Dnh1  228us : trace_stop_sched_switched (__schedule)
   <...>-1010  0Dnh2  228us : trace_stop_sched_switched <<...>-1010> (3a 0)
   <...>-1010  0Dnh1  229us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #6: Type: TEXT/plain, Size: 2745 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 208 us, #33/33, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: IRQ 10-1010 (uid:0 nice:-5 policy:1 rt_prio:41)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
     vlc-8511  0dnh3    0us : <00636c76> (<6f000000>)
     vlc-8511  0dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
     vlc-8511  0dnh3    0us : __trace_start_sched_wakeup <<...>-1010> (3a 0)
     vlc-8511  0dnh2    0us : try_to_wake_up <<...>-1010> (3a 73)
     vlc-8511  0dnh1    0us : preempt_schedule (try_to_wake_up)
     vlc-8511  0dnh1    0us : wake_up_process (redirect_hardirq)
     vlc-8511  0dnh1    0us : disable_8259A_irq (__do_IRQ)
     vlc-8511  0dnh1    1us : preempt_schedule (__do_IRQ)
     vlc-8511  0dnh.    1us : preempt_schedule (__do_IRQ)
     vlc-8511  0dnh.    1us : local_irq_restore (__do_IRQ)
     vlc-8511  0dnh.    1us : check_soft_flags (local_irq_restore)
     vlc-8511  0Dnh.    2us : preempt_schedule (__do_IRQ)
     vlc-8511  0Dnh.    2us : irq_exit (do_IRQ)
     vlc-8511  0Dnh.    2us : __schedule (work_resched)
     vlc-8511  0Dnh.    2us : profile_hit (__schedule)
     vlc-8511  0Dnh1    2us : sched_clock (__schedule)
     vlc-8511  0Dnh2    2us : trace_array (__schedule)
     vlc-8511  0Dnh2    3us : trace_array <<...>-1010> (3a 3a)
     vlc-8511  0Dnh2    3us : trace_array <<...>-8039> (73 78)
     vlc-8511  0Dnh2    3us : trace_array <vlc-8511> (73 78)
     vlc-8511  0Dnh2    4us : trace_array <<...>-9298> (7b 78)
     vlc-8511  0Dnh2    4us : trace_array <<...>-3588> (7d 82)
     vlc-8511  0Dnh2    4us : trace_array <<...>-3592> (7d 82)
     vlc-8511  0Dnh2    4us : trace_array <<...>-3586> (7d 82)
     vlc-8511  0Dnh2    4us : trace_array <<...>-3587> (7d 82)
     vlc-8511  0Dnh2    4us : trace_array <<...>-3589> (7d 82)
     vlc-8511  0Dnh2    4us!: trace_array (__schedule)
   <...>-1010  0Dnh2  207us : __switch_to (__schedule)
   <...>-1010  0Dnh2  208us : __schedule <vlc-8511> (73 3a)
   <...>-1010  0Dnh1  208us : trace_stop_sched_switched (__schedule)
   <...>-1010  0Dnh2  208us : trace_stop_sched_switched <<...>-1010> (3a 0)
   <...>-1010  0Dnh1  208us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #7: Type: TEXT/plain, Size: 2707 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 231 us, #32/32, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: softirq-timer/0-3 (uid:0 nice:-10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
     tee-10092 0Dnh3    0us!: <00656574> (<6f000000>)
     tee-10092 0Dnh3  222us : __trace_start_sched_wakeup (try_to_wake_up)
     tee-10092 0Dnh3  222us : __trace_start_sched_wakeup <<...>-3> (69 0)
     tee-10092 0Dnh2  222us : try_to_wake_up <<...>-3> (69 73)
     tee-10092 0Dnh1  222us : preempt_schedule (try_to_wake_up)
     tee-10092 0Dnh1  222us : wake_up_process (trigger_softirqs)
     tee-10092 0Dnh.  223us : preempt_schedule_irq (need_resched)
     tee-10092 0Dnh.  223us : __schedule (preempt_schedule_irq)
     tee-10092 0Dnh.  223us : profile_hit (__schedule)
     tee-10092 0Dnh1  224us : sched_clock (__schedule)
     tee-10092 0Dnh2  224us : dequeue_task (__schedule)
     tee-10092 0Dnh2  224us : recalc_task_prio (__schedule)
     tee-10092 0Dnh2  224us : effective_prio (recalc_task_prio)
     tee-10092 0Dnh2  224us : enqueue_task (__schedule)
     tee-10092 0Dnh2  224us : trace_array (__schedule)
     tee-10092 0Dnh2  226us : trace_array <<...>-3> (69 6e)
     tee-10092 0Dnh2  226us : trace_array <tee-10092> (73 78)
     tee-10092 0Dnh2  226us : trace_array <<...>-4794> (73 78)
     tee-10092 0Dnh2  226us : trace_array <<...>-8283> (73 78)
     tee-10092 0Dnh2  227us : trace_array <<...>-4659> (74 78)
     tee-10092 0Dnh2  227us : trace_array <<...>-10089> (7b 78)
     tee-10092 0Dnh2  227us : trace_array <<...>-3592> (7d 82)
     tee-10092 0Dnh2  227us : trace_array <<...>-3588> (7d 82)
     tee-10092 0Dnh2  228us : trace_array <<...>-3586> (7d 82)
     tee-10092 0Dnh2  228us : trace_array <<...>-3587> (7d 82)
     tee-10092 0Dnh2  228us : trace_array (__schedule)
   <...>-3     0Dnh2  230us : __switch_to (__schedule)
   <...>-3     0Dnh2  230us : __schedule <tee-10092> (73 69)
   <...>-3     0Dnh1  230us : trace_stop_sched_switched (__schedule)
   <...>-3     0Dnh2  231us : trace_stop_sched_switched <<...>-3> (69 0)
   <...>-3     0Dnh1  231us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #8: Type: TEXT/plain, Size: 2439 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 208 us, #28/28, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: softirq-timer/0-3 (uid:0 nice:-10 policy:0 rt_prio:0)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
     cc1-11149 0Dnh3    0us : <00316363> (<66747200>)
     cc1-11149 0Dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
     cc1-11149 0Dnh3    0us : __trace_start_sched_wakeup <<...>-3> (69 0)
     cc1-11149 0Dnh2    0us : try_to_wake_up <<...>-3> (69 78)
     cc1-11149 0Dnh1    0us : preempt_schedule (try_to_wake_up)
     cc1-11149 0Dnh1    0us : wake_up_process (trigger_softirqs)
     cc1-11149 0Dnh.    0us : __schedule (work_resched)
     cc1-11149 0Dnh.    1us : profile_hit (__schedule)
     cc1-11149 0Dnh1    1us : sched_clock (__schedule)
     cc1-11149 0Dnh2    1us!: dequeue_task (__schedule)
     cc1-11149 0Dnh2  202us : recalc_task_prio (__schedule)
     cc1-11149 0Dnh2  202us : effective_prio (recalc_task_prio)
     cc1-11149 0Dnh2  202us : enqueue_task (__schedule)
     cc1-11149 0Dnh2  203us : trace_array (__schedule)
     cc1-11149 0Dnh2  204us : trace_array <<...>-3> (69 6e)
     cc1-11149 0Dnh2  204us : trace_array <cc1-11149> (78 78)
     cc1-11149 0Dnh2  204us : trace_array <<...>-3592> (7d 82)
     cc1-11149 0Dnh2  204us : trace_array <<...>-3588> (7d 82)
     cc1-11149 0Dnh2  204us : trace_array <<...>-3587> (7d 82)
     cc1-11149 0Dnh2  205us : trace_array <<...>-3586> (7d 82)
     cc1-11149 0Dnh2  205us : trace_array <<...>-3589> (7d 82)
     cc1-11149 0Dnh2  205us : trace_array (__schedule)
   <...>-3     0Dnh2  207us : __switch_to (__schedule)
   <...>-3     0Dnh2  207us : __schedule <cc1-11149> (78 69)
   <...>-3     0Dnh1  207us : trace_stop_sched_switched (__schedule)
   <...>-3     0Dnh2  208us : trace_stop_sched_switched <<...>-3> (69 0)
   <...>-3     0Dnh1  208us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #9: Type: TEXT/plain, Size: 2692 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 213 us, #32/32, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: IRQ 14-254 (uid:0 nice:-5 policy:1 rt_prio:45)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
softirq--7     0dnh3    0us : <74666f73> (<2d717269>)
softirq--7     0dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
softirq--7     0dnh3    0us : __trace_start_sched_wakeup <<...>-254> (36 0)
softirq--7     0dnh2    0us : try_to_wake_up <<...>-254> (36 3a)
softirq--7     0dnh1    0us : preempt_schedule (try_to_wake_up)
softirq--7     0dnh1    0us : wake_up_process (redirect_hardirq)
softirq--7     0dnh1    0us : disable_8259A_irq (__do_IRQ)
softirq--7     0dnh1    1us : preempt_schedule (__do_IRQ)
softirq--7     0dnh.    1us : preempt_schedule (__do_IRQ)
softirq--7     0dnh.    1us : local_irq_restore (__do_IRQ)
softirq--7     0dnh.    1us : check_soft_flags (local_irq_restore)
softirq--7     0Dnh.    1us : preempt_schedule (__do_IRQ)
softirq--7     0Dnh.    1us!: irq_exit (do_IRQ)
softirq--7     0Dnh.  209us : preempt_schedule_irq (need_resched)
softirq--7     0Dnh.  209us : __schedule (preempt_schedule_irq)
softirq--7     0Dnh.  209us : profile_hit (__schedule)
softirq--7     0Dnh1  209us : sched_clock (__schedule)
softirq--7     0Dnh2  210us : trace_array (__schedule)
softirq--7     0Dnh2  210us : trace_array <<...>-254> (36 36)
softirq--7     0Dnh2  210us : trace_array <softirq--7> (3a 6e)
softirq--7     0Dnh2  211us : trace_array <<...>-11476> (7b 78)
softirq--7     0Dnh2  211us : trace_array <<...>-3588> (7d 82)
softirq--7     0Dnh2  211us : trace_array <<...>-3592> (7d 82)
softirq--7     0Dnh2  211us : trace_array <<...>-3586> (7d 82)
softirq--7     0Dnh2  211us : trace_array <<...>-3587> (7d 82)
softirq--7     0Dnh2  211us : trace_array (__schedule)
   <...>-254   0Dnh2  213us : __switch_to (__schedule)
   <...>-254   0Dnh2  213us : __schedule <softirq--7> (3a 36)
   <...>-254   0Dnh1  213us : trace_stop_sched_switched (__schedule)
   <...>-254   0Dnh2  213us : trace_stop_sched_switched <<...>-254> (36 0)
   <...>-254   0Dnh1  213us : trace_stop_sched_switched (__schedule)


vim:ft=help

[-- Attachment #10: Type: TEXT/plain, Size: 2746 bytes --]

preemption latency trace v1.1.4 on 2.6.12-RT-V0.7.50-11-up-debug
--------------------------------------------------------------------
 latency: 224 us, #33/33, CPU#0 | (M:rt VP:0, KP:1, SP:1 HP:1 #P:1)
    -----------------
    | task: IRQ 10-1010 (uid:0 nice:-5 policy:1 rt_prio:41)
    -----------------

                 _------=> CPU#            
                / _-----=> irqs-off        
               | / _----=> need-resched    
               || / _---=> hardirq/softirq 
               ||| / _--=> preempt-depth   
               |||| /                      
               |||||     delay             
   cmd     pid ||||| time  |   caller      
      \   /    |||||   \   |   /           
     vlc-8039  0dnh3    0us : <00636c76> (<6f000000>)
     vlc-8039  0dnh3    0us : __trace_start_sched_wakeup (try_to_wake_up)
     vlc-8039  0dnh3    0us : __trace_start_sched_wakeup <<...>-1010> (3a 0)
     vlc-8039  0dnh2    0us : try_to_wake_up <<...>-1010> (3a 73)
     vlc-8039  0dnh1    0us : preempt_schedule (try_to_wake_up)
     vlc-8039  0dnh1    0us : wake_up_process (redirect_hardirq)
     vlc-8039  0dnh1    0us : disable_8259A_irq (__do_IRQ)
     vlc-8039  0dnh1    1us : preempt_schedule (__do_IRQ)
     vlc-8039  0dnh.    1us : preempt_schedule (__do_IRQ)
     vlc-8039  0dnh.    1us : local_irq_restore (__do_IRQ)
     vlc-8039  0dnh.    2us : check_soft_flags (local_irq_restore)
     vlc-8039  0Dnh.    2us : preempt_schedule (__do_IRQ)
     vlc-8039  0Dnh.    2us : irq_exit (do_IRQ)
     vlc-8039  0Dnh.    2us : __schedule (work_resched)
     vlc-8039  0Dnh.    2us : profile_hit (__schedule)
     vlc-8039  0Dnh1    2us : sched_clock (__schedule)
     vlc-8039  0Dnh2    3us : trace_array (__schedule)
     vlc-8039  0Dnh2    3us!: trace_array <<...>-1010> (3a 3a)
     vlc-8039  0Dnh2  219us : trace_array <vlc-8039> (73 78)
     vlc-8039  0Dnh2  219us : trace_array <<...>-7919> (74 78)
     vlc-8039  0Dnh2  220us : trace_array <<...>-11600> (7c 78)
     vlc-8039  0Dnh2  220us : trace_array <<...>-3592> (7d 82)
     vlc-8039  0Dnh2  220us : trace_array <<...>-3588> (7d 82)
     vlc-8039  0Dnh2  220us : trace_array <<...>-3586> (7d 82)
     vlc-8039  0Dnh2  220us : trace_array <<...>-3587> (7d 82)
     vlc-8039  0Dnh2  220us : trace_array <<...>-3589> (7d 82)
     vlc-8039  0Dnh2  221us : trace_array (__schedule)
   <...>-1010  0Dnh2  222us : __switch_to (__schedule)
   <...>-1010  0Dnh2  223us : __schedule <vlc-8039> (73 3a)
   <...>-1010  0Dnh1  224us : trace_stop_sched_switched (__schedule)
   <...>-1010  0Dnh2  224us : trace_stop_sched_switched <<...>-1010> (3a 0)
   <...>-1010  0Dnh1  224us : trace_stop_sched_switched (__schedule)


vim:ft=help

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22 23:06                     ` William Weston
@ 2005-06-23  0:10                       ` Ingo Molnar
  2005-06-23 22:11                         ` William Weston
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-23  0:10 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> > these are all the first type of latencies, which seem to be hardware 
> > related. Could you try to boot the UP kernel, do you see these latencies 
> > there too? (if yes then please post those too)
> 
> On -50-11 UP, the ~200us idle is still showing up in the traces.  This 
> idle time, however, seems to be at random points within the trace.  
> Some of the traces attached are nearly identical except for where the 
> ~200us jump happens to fall.  Hardware induced latency?

yes, very likely hardware (or system BIOS, e.g. SMM) induced.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-18 12:28             ` Ingo Molnar
  2005-06-21  1:18               ` William Weston
@ 2005-06-23  2:05               ` William Weston
  2005-06-23  7:56                 ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-23  2:05 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: TEXT/PLAIN, Size: 4229 bytes --]

Hi Ingo,

I just found this oops from last night on my home audio/midi system
(AthlonXP running -48-37).  I was burning a CD at the time, and the scsi
error precedes the oops trace by 46 seconds.  The system is still up and 
fully functional, BTW.

scsi: unknown opcode 0x01
BUG: Unable to handle kernel NULL pointer dereference at virtual address 
00000009
 printing eip:
c044d001
*pde = 00000000
Oops: 0002 [#1]
PREEMPT 
Modules linked in: snd_seq_dummy snd_seq_oss snd_seq_midi it87 eeprom i2c_sensor i2c_isa i2c_viapro i2c_dev i2c_core realtime usbhid ohci1394 ieee1394 uhci_hcd ehci_hcd usbcore snd_emu10k1_synth snd_emux_synth snd_seq_virmidi snd_seq_midi_event snd_seq_midi_emul snd_seq snd_emu10k1 snd_util_mem snd_hwdep snd_mpu401 snd_via82xx snd_mpu401_uart snd_cs46xx gameport snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd soundcore snd_page_alloc
CPU:    0
EIP:    0060:[<c044d001>]    Not tainted VLI
EFLAGS: 00010007   (2.6.12-rc6-RT-V0.7.48-37) 
EIP is at setup_IO_APIC+0x4d1/0x4f0
eax: 00000200   ebx: c04372c0   ecx: 00000009   edx: 00024201
esi: 00000010   edi: df096000   ebp: 00000000   esp: df097f84
ds: 007b   es: 007b   ss: 0068   preempt: 00000002
Process IRQ 16 (pid: 2163, threadinfo=df096000 task=df7e5230)
Stack: c01149db c04372c0 00000010 c013ee34 ffffff10 dfbd58e0 df096000 c04372c0 
       c04372c0 c013eee0 c013ef44 00000873 00000001 df097fbc 00000025 df096000 
       df203e3c c0131265 fffffffc ffffffff ffffffff c01311d0 00000000 00000000 
Call Trace:
 [<c01149db>] end_level_ioapic_irq+0x4b/0xa0 (4)
 [<c013ee34>] do_hardirq+0x94/0x140 (12)
 [<c013eee0>] do_irqd+0x0/0xa0 (24)
 [<c013ef44>] do_irqd+0x64/0xa0 (4)
 [<c0131265>] kthread+0x95/0xd0 (28)
 [<c01311d0>] kthread+0x0/0xd0 (16)
 [<c010138d>] kernel_thread_helper+0x5/0x18 (16)
Code: e6 00 e6 e6 e6 00 e6 e6 e6 00 e6 e6 e6 00 e6 e6 e6 00 e6 e6 e6 00 e6 
e6 e6 00 e6 e6 e6 00 e6 e6 e6 00 e6 e6 e6 00 e6 e6 e6 00 fe <31> 09 00 0c 
00 01 02 2e 00 00 00 55 24 10 00 0c 00 02 02 2e 2e 
 <6>note: IRQ 16[2163] exited with preempt_count 1
BUG: scheduling while atomic: IRQ 16/0x00000001/2163
caller is do_exit+0x211/0x3b0
 [<c030e8d5>] __schedule+0x555/0x710 (8)
 [<c011ee2c>] exit_notify+0x54c/0x8a0 (24)
 [<c0117c19>] wake_up_process+0x19/0x20 (4)
 [<c011f391>] do_exit+0x211/0x3b0 (52)
 [<c010443b>] die+0x16b/0x170 (40)
 [<c01162bd>] do_page_fault+0x34d/0x540 (64)
 [<c0117948>] recalc_task_prio+0x88/0x160 (16)
 [<c030e6e0>] __schedule+0x360/0x710 (36)
 [<c0117bef>] try_to_wake_up+0x11f/0x130 (12)
 [<c0117c19>] wake_up_process+0x19/0x20 (20)
 [<c030ec8f>] preempt_schedule_irq+0x4f/0x70 (48)
 [<c010313c>] need_resched+0x20/0x24 (20)
 [<c0115f70>] do_page_fault+0x0/0x540 (48)
 [<c0103c83>] error_code+0x4f/0x54 (8)
 [<c044d001>] setup_IO_APIC+0x4d1/0x4f0 (44)
 [<c01149db>] end_level_ioapic_irq+0x4b/0xa0 (12)
 [<c013ee34>] do_hardirq+0x94/0x140 (12)
 [<c013eee0>] do_irqd+0x0/0xa0 (24)
 [<c013ef44>] do_irqd+0x64/0xa0 (4)
 [<c0131265>] kthread+0x95/0xd0 (28)
 [<c01311d0>] kthread+0x0/0xd0 (16)
 [<c010138d>] kernel_thread_helper+0x5/0x18 (16)
prev->state: 2 != TASK_RUNNING??
IRQ 16/2163: BUG in __schedule at kernel/sched.c:2968
 [<c030e85c>] __schedule+0x4dc/0x710 (8)
 [<c0117c19>] wake_up_process+0x19/0x20 (28)
 [<c011f391>] do_exit+0x211/0x3b0 (52)
 [<c010443b>] die+0x16b/0x170 (40)
 [<c01162bd>] do_page_fault+0x34d/0x540 (64)
 [<c0117948>] recalc_task_prio+0x88/0x160 (16)
 [<c030e6e0>] __schedule+0x360/0x710 (36)
 [<c0117bef>] try_to_wake_up+0x11f/0x130 (12)
 [<c0117c19>] wake_up_process+0x19/0x20 (20)
 [<c030ec8f>] preempt_schedule_irq+0x4f/0x70 (48)
 [<c010313c>] need_resched+0x20/0x24 (20)
 [<c0115f70>] do_page_fault+0x0/0x540 (48)
 [<c0103c83>] error_code+0x4f/0x54 (8)
 [<c044d001>] setup_IO_APIC+0x4d1/0x4f0 (44)
 [<c01149db>] end_level_ioapic_irq+0x4b/0xa0 (12)
 [<c013ee34>] do_hardirq+0x94/0x140 (12)
 [<c013eee0>] do_irqd+0x0/0xa0 (24)
 [<c013ef44>] do_irqd+0x64/0xa0 (4)
 [<c0131265>] kthread+0x95/0xd0 (28)
 [<c01311d0>] kthread+0x0/0xd0 (16)
 [<c010138d>] kernel_thread_helper+0x5/0x18 (16)

Is this something you've already fixed in the -50-xx series?  My build of
-50-15 just finished, so I'll reboot and hammer on the cd burner with the 
latest, anyway.

--ww

[-- Attachment #2: Type: TEXT/PLAIN, Size: 7943 bytes --]

CONFIG_X86=y
CONFIG_MMU=y
CONFIG_UID16=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y
CONFIG_EXPERIMENTAL=y
CONFIG_BROKEN=y
CONFIG_BROKEN_ON_SMP=y
CONFIG_LOCK_KERNEL=y
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_LOCALVERSION=""
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_POSIX_MQUEUE=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_SYSCTL=y
CONFIG_AUDIT=y
CONFIG_AUDITSYSCALL=y
CONFIG_HOTPLUG=y
CONFIG_KOBJECT_UEVENT=y
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SHMEM=y
CONFIG_CC_ALIGN_FUNCTIONS=0
CONFIG_CC_ALIGN_LABELS=0
CONFIG_CC_ALIGN_LOOPS=0
CONFIG_CC_ALIGN_JUMPS=0
CONFIG_BASE_SMALL=0
CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y
CONFIG_MODULE_FORCE_UNLOAD=y
CONFIG_OBSOLETE_MODPARM=y
CONFIG_MODVERSIONS=y
CONFIG_MODULE_SRCVERSION_ALL=y
CONFIG_KMOD=y
CONFIG_X86_PC=y
CONFIG_MK7=y
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_HPET_TIMER=y
CONFIG_HPET_EMULATE_RTC=y
CONFIG_PREEMPT_RT=y
CONFIG_PREEMPT=y
CONFIG_PREEMPT_SOFTIRQS=y
CONFIG_PREEMPT_HARDIRQS=y
CONFIG_PREEMPT_RCU=y
CONFIG_PREEMPT_BKL=y
CONFIG_RWSEM_GENERIC_SPINLOCK=y
CONFIG_ASM_SEMAPHORES=y
CONFIG_X86_UP_APIC=y
CONFIG_X86_UP_IOAPIC=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_TSC=y
CONFIG_X86_MCE=y
CONFIG_X86_MCE_NONFATAL=y
CONFIG_MICROCODE=m
CONFIG_X86_MSR=m
CONFIG_X86_CPUID=m
CONFIG_NOHIGHMEM=y
CONFIG_MTRR=y
CONFIG_HAVE_DEC_LOCK=y
CONFIG_REGPARM=y
CONFIG_SECCOMP=y
CONFIG_PM=y
CONFIG_ACPI=y
CONFIG_ACPI_BOOT=y
CONFIG_ACPI_INTERPRETER=y
CONFIG_ACPI_SLEEP=y
CONFIG_ACPI_SLEEP_PROC_FS=y
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_THERMAL=y
CONFIG_ACPI_BLACKLIST_YEAR=0
CONFIG_ACPI_DEBUG=y
CONFIG_ACPI_BUS=y
CONFIG_ACPI_EC=y
CONFIG_ACPI_POWER=y
CONFIG_ACPI_PCI=y
CONFIG_ACPI_SYSTEM=y
CONFIG_X86_PM_TIMER=y
CONFIG_APM=y
CONFIG_APM_RTC_IS_GMT=y
CONFIG_APM_REAL_MODE_POWER_OFF=y
CONFIG_PCI=y
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_PCI_LEGACY_PROC=y
CONFIG_PCI_NAMES=y
CONFIG_ISA_DMA_API=y
CONFIG_ISA=y
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_MISC=y
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_PNP=y
CONFIG_ISAPNP=y
CONFIG_PNPACPI=y
CONFIG_BLK_DEV_FD=y
CONFIG_BLK_DEV_LOOP=y
CONFIG_BLK_DEV_RAM=m
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=16384
CONFIG_INITRAMFS_SOURCE=""
CONFIG_CDROM_PKTCDVD=y
CONFIG_CDROM_PKTCDVD_BUFFERS=128
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y
CONFIG_BLK_DEV_IDEDISK=y
CONFIG_IDEDISK_MULTI_MODE=y
CONFIG_BLK_DEV_IDECD=y
CONFIG_IDE_TASK_IOCTL=y
CONFIG_IDE_GENERIC=y
CONFIG_BLK_DEV_IDEPNP=y
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_SHARE_IRQ=y
CONFIG_BLK_DEV_GENERIC=y
CONFIG_BLK_DEV_IDEDMA_PCI=y
CONFIG_IDEDMA_PCI_AUTO=y
CONFIG_BLK_DEV_VIA82CXXX=y
CONFIG_BLK_DEV_IDEDMA=y
CONFIG_IDEDMA_AUTO=y
CONFIG_IEEE1394=m
CONFIG_IEEE1394_OUI_DB=y
CONFIG_IEEE1394_EXTRA_CONFIG_ROMS=y
CONFIG_IEEE1394_CONFIG_ROM_IP1394=y
CONFIG_IEEE1394_OHCI1394=m
CONFIG_IEEE1394_VIDEO1394=m
CONFIG_IEEE1394_ETH1394=m
CONFIG_IEEE1394_DV1394=m
CONFIG_IEEE1394_RAWIO=m
CONFIG_IEEE1394_CMP=m
CONFIG_IEEE1394_AMDTP=m
CONFIG_NET=y
CONFIG_PACKET=y
CONFIG_PACKET_MMAP=y
CONFIG_UNIX=y
CONFIG_NET_KEY=y
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_TCPDIAG=y
CONFIG_XFRM=y
CONFIG_NETDEVICES=y
CONFIG_TUN=y
CONFIG_NET_ETHERNET=y
CONFIG_MII=y
CONFIG_NET_PCI=y
CONFIG_VIA_RHINE=y
CONFIG_VIA_RHINE_MMIO=y
CONFIG_INPUT=y
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1280
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=1024
CONFIG_INPUT_JOYDEV=y
CONFIG_INPUT_EVDEV=y
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
CONFIG_INPUT_JOYSTICK=y
CONFIG_INPUT_MISC=y
CONFIG_INPUT_PCSPKR=y
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_LIBPS2=y
CONFIG_GAMEPORT=m
CONFIG_GAMEPORT_CS461X=m
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_SERIAL_8250_NR_UARTS=2
CONFIG_SERIAL_8250_EXTENDED=y
CONFIG_SERIAL_8250_SHARE_IRQ=y
CONFIG_SERIAL_8250_DETECT_IRQ=y
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_UNIX98_PTYS=y
CONFIG_HW_RANDOM=y
CONFIG_RTC=y
CONFIG_BLOCKER=m
CONFIG_AGP=y
CONFIG_AGP_VIA=y
CONFIG_DRM=y
CONFIG_DRM_RADEON=y
CONFIG_HPET=y
CONFIG_HPET_MMAP=y
CONFIG_I2C=m
CONFIG_I2C_CHARDEV=m
CONFIG_I2C_ISA=m
CONFIG_I2C_VIAPRO=m
CONFIG_I2C_SENSOR=m
CONFIG_SENSORS_IT87=m
CONFIG_SENSORS_EEPROM=m
CONFIG_VIDEO_SELECT=y
CONFIG_VGA_CONSOLE=y
CONFIG_DUMMY_CONSOLE=y
CONFIG_SOUND=m
CONFIG_SND=m
CONFIG_SND_TIMER=m
CONFIG_SND_PCM=m
CONFIG_SND_HWDEP=m
CONFIG_SND_RAWMIDI=m
CONFIG_SND_SEQUENCER=m
CONFIG_SND_SEQ_DUMMY=m
CONFIG_SND_OSSEMUL=y
CONFIG_SND_MIXER_OSS=m
CONFIG_SND_PCM_OSS=m
CONFIG_SND_SEQUENCER_OSS=y
CONFIG_SND_RTCTIMER=m
CONFIG_SND_MPU401_UART=m
CONFIG_SND_DUMMY=m
CONFIG_SND_VIRMIDI=m
CONFIG_SND_SERIAL_U16550=m
CONFIG_SND_MPU401=m
CONFIG_SND_AC97_CODEC=m
CONFIG_SND_CS46XX=m
CONFIG_SND_CS46XX_NEW_DSP=y
CONFIG_SND_EMU10K1=m
CONFIG_SND_CA0106=m
CONFIG_SND_VIA82XX=m
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB=m
CONFIG_USB_DEVICEFS=y
CONFIG_USB_EHCI_HCD=m
CONFIG_USB_EHCI_SPLIT_ISO=y
CONFIG_USB_EHCI_ROOT_HUB_TT=y
CONFIG_USB_UHCI_HCD=m
CONFIG_USB_AUDIO=m
CONFIG_USB_MIDI=m
CONFIG_USB_HID=m
CONFIG_USB_HIDINPUT=y
CONFIG_HID_FF=y
CONFIG_LOGITECH_FF=y
CONFIG_USB_HIDDEV=y
CONFIG_EXT2_FS=y
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
CONFIG_EXT2_FS_SECURITY=y
CONFIG_EXT3_FS=y
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
CONFIG_EXT3_FS_SECURITY=y
CONFIG_JBD=y
CONFIG_JBD_DEBUG=y
CONFIG_FS_MBCACHE=y
CONFIG_FS_POSIX_ACL=y
CONFIG_ROMFS_FS=m
CONFIG_DNOTIFY=y
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_ZISOFS_FS=y
CONFIG_UDF_FS=m
CONFIG_UDF_NLS=y
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_FAT_DEFAULT_IOCHARSET="ascii"
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_SYSFS=y
CONFIG_DEVPTS_FS_XATTR=y
CONFIG_DEVPTS_FS_SECURITY=y
CONFIG_TMPFS=y
CONFIG_TMPFS_XATTR=y
CONFIG_TMPFS_SECURITY=y
CONFIG_HUGETLBFS=y
CONFIG_HUGETLB_PAGE=y
CONFIG_RAMFS=y
CONFIG_HFS_FS=m
CONFIG_HFSPLUS_FS=m
CONFIG_CRAMFS=m
CONFIG_SMB_FS=m
CONFIG_CIFS=m
CONFIG_CIFS_XATTR=y
CONFIG_CIFS_POSIX=y
CONFIG_PARTITION_ADVANCED=y
CONFIG_ATARI_PARTITION=y
CONFIG_MAC_PARTITION=y
CONFIG_MSDOS_PARTITION=y
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="utf8"
CONFIG_NLS_CODEPAGE_437=y
CONFIG_NLS_CODEPAGE_850=y
CONFIG_NLS_CODEPAGE_852=y
CONFIG_NLS_CODEPAGE_1250=y
CONFIG_NLS_ASCII=y
CONFIG_NLS_ISO8859_1=y
CONFIG_NLS_ISO8859_2=y
CONFIG_NLS_ISO8859_15=y
CONFIG_NLS_UTF8=y
CONFIG_PROFILING=y
CONFIG_DEBUG_KERNEL=y
CONFIG_MAGIC_SYSRQ=y
CONFIG_LOG_BUF_SHIFT=18
CONFIG_WAKEUP_TIMING=y
CONFIG_LATENCY_TIMING=y
CONFIG_DEBUG_BUGVERBOSE=y
CONFIG_DEBUG_INFO=y
CONFIG_EARLY_PRINTK=y
CONFIG_X86_FIND_SMP_CONFIG=y
CONFIG_X86_MPPARSE=y
CONFIG_SECURITY=y
CONFIG_SECURITY_NETWORK=y
CONFIG_SECURITY_CAPABILITIES=m
CONFIG_SECURITY_SECLVL=m
CONFIG_SECURITY_SELINUX=y
CONFIG_SECURITY_SELINUX_BOOTPARAM=y
CONFIG_SECURITY_SELINUX_BOOTPARAM_VALUE=1
CONFIG_SECURITY_SELINUX_DEVELOP=y
CONFIG_SECURITY_SELINUX_AVC_STATS=y
CONFIG_SECURITY_SELINUX_CHECKREQPROT_VALUE=1
CONFIG_CRYPTO=y
CONFIG_CRYPTO_MD5=y
CONFIG_CRYPTO_SHA1=y
CONFIG_CRYPTO_DES=y
CONFIG_CRYPTO_CRC32C=y
CONFIG_CRC_CCITT=y
CONFIG_CRC32=y
CONFIG_LIBCRC32C=y
CONFIG_ZLIB_INFLATE=y
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_X86_BIOS_REBOOT=y
CONFIG_PC=y

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-23  2:05               ` William Weston
@ 2005-06-23  7:56                 ` Ingo Molnar
  2005-06-23 13:45                   ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-23  7:56 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> Hi Ingo,
> 
> I just found this oops from last night on my home audio/midi system 
> (AthlonXP running -48-37).  I was burning a CD at the time, and the 
> scsi error precedes the oops trace by 46 seconds.  The system is still 
> up and fully functional, BTW.

Found the bug and it should be fixed in -50-16 and later kernels. I had 
debugging code that called into print_IO_APIC() (when you had an scsi 
interrupt timeout), but that function was an __init call - so the kernel 
called into an already freed code area.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-23  7:56                 ` Ingo Molnar
@ 2005-06-23 13:45                   ` Gene Heskett
  0 siblings, 0 replies; 139+ messages in thread
From: Gene Heskett @ 2005-06-23 13:45 UTC (permalink / raw)
  To: linux-kernel
  Cc: Ingo Molnar, William Weston, K.R. Foley, Eugeny S. Mints, Daniel Walker

On Thursday 23 June 2005 03:56, Ingo Molnar wrote:
>* William Weston <weston@sysex.net> wrote:
>> Hi Ingo,
>>
>> I just found this oops from last night on my home audio/midi
>> system (AthlonXP running -48-37).  I was burning a CD at the time,
>> and the scsi error precedes the oops trace by 46 seconds.  The
>> system is still up and fully functional, BTW.
>
>Found the bug and it should be fixed in -50-16 and later kernels. I
> had debugging code that called into print_IO_APIC() (when you had
> an scsi interrupt timeout), but that function was an __init call -
> so the kernel called into an already freed code area.
>
> Ingo
I just tried to build & boot 50-17 in mode=3, no hardirq's and got the 
same boot failure as mode 4 for 50-06 gave:

On screen:

Checking to see if this processor honours the WP bit even in 
supervisor mode...  OK.

and its stuck, needs a hardware reset to recover.  The next line 
should be the bogomips check/report I believe.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-23  0:10                       ` Ingo Molnar
@ 2005-06-23 22:11                         ` William Weston
  2005-06-24  1:46                           ` William Weston
  0 siblings, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-23 22:11 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

On Thu, 23 Jun 2005, Ingo Molnar wrote:

> yes, very likely hardware (or system BIOS, e.g. SMM) induced.

Running -50-17 on the Xeon/HT box, now with the ICH5 USB controller
disabled in BIOS.

The strangely regular ~200us idle jumps for both CPUs went away.  Now I'm
seeing one CPU at a time disappear (often completely absent) in the 
traces, with a the maximum wakeup generally hitting between 150us and 
300us.  While compiling a kernel and running vlc (which would skip frames 
like mad, even with RR scheduling) I was able to get one trace of 2556us.

There's also BUG warnings for update_out_trace().  I'm not quite sure if 
the trace behavior I'm seeing is related to this bug, but judging by the 
behavior of vlc, I wouldn't bet on it.

Since the 2556us trace is quite large all the info is posted at:

http://sysex.net/testing/2.6.12-RT-V0.7.50-17/xeonht/


--ww

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-23 22:11                         ` William Weston
@ 2005-06-24  1:46                           ` William Weston
  2005-06-24  7:06                             ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-24  1:46 UTC (permalink / raw)
  Cc: Ingo Molnar, K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

On Thu, 23 Jun 2005, William Weston wrote:

> Running -50-17 on the Xeon/HT box, now with the ICH5 USB controller
> disabled in BIOS.
> 
> The strangely regular ~200us idle jumps for both CPUs went away.  Now I'm
> seeing one CPU at a time disappear (often completely absent) in the 
> traces, with a the maximum wakeup generally hitting between 150us and 
> 300us.  While compiling a kernel and running vlc (which would skip frames 
> like mad, even with RR scheduling) I was able to get one trace of 2556us.
> 
> There's also BUG warnings for update_out_trace().  I'm not quite sure if 
> the trace behavior I'm seeing is related to this bug, but judging by the 
> behavior of vlc, I wouldn't bet on it.
> 
> Since the 2556us trace is quite large all the info is posted at:
> 
> http://sysex.net/testing/2.6.12-RT-V0.7.50-17/xeonht/

OK... Running on -50-17 with all RT debug except CONFIG_WAKEUP_TIMING and
CONFIG_LATENCY_TIMING disabled.  Max wakeup latency is 59us now, with a
couple erroneous values of 2533412143us.  VLC performance (streaming from
a multicast UDP source) was great with one instance of burnP6 running.  
Running a second burnP6 along with VLC locks up the box (reproduceable) in
about a minute.  Running two or more instances of burnP6 without VLC does
not result in any odd behavior or noticeably impact GUI performance.  I
rebuilt with CONFIG_DETECT_SOFTLOCKUP enabled, but couldn't catch a trace.

FWIW,  --ww

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-24  1:46                           ` William Weston
@ 2005-06-24  7:06                             ` Ingo Molnar
  2005-06-24 22:31                               ` William Weston
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-24  7:06 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> > http://sysex.net/testing/2.6.12-RT-V0.7.50-17/xeonht/
> 
> OK... Running on -50-17 with all RT debug except CONFIG_WAKEUP_TIMING 
> and CONFIG_LATENCY_TIMING disabled.  Max wakeup latency is 59us now, 
> with a couple erroneous values of 2533412143us.  VLC performance 
> (streaming from a multicast UDP source) was great with one instance of 
> burnP6 running.  Running a second burnP6 along with VLC locks up the 
> box (reproduceable) in about a minute.  Running two or more instances 
> of burnP6 without VLC does not result in any odd behavior or 
> noticeably impact GUI performance.  I rebuilt with 
> CONFIG_DETECT_SOFTLOCKUP enabled, but couldn't catch a trace.

do you have the NMI watchdog enabled? Find below 
serial-logging-earlyprintk-nmi.txt.

	Ingo

to set up serial logging:
-------------------------

install a null modem cable (== serial cable) to one of the serial ports
of the server, connect the cable to another box, run a terminal program
on that other box (e.g. "minicom -m" - do Alt-L to switch on logging
after starting it up) and set up the server's kernel to do serial
logging: enable CONFIG_SERIAL_8250_CONSOLE and
CONFIG_SERIAL_CORE_CONSOLE, recompile & reinstall the kernel, add
"console=ttyS0,38400 console=tty0" to your /etc/grub.conf or
/etc/lilo.conf kernel boot line, reboot the server with the new kernel
command line - and configure minicom to run with that speed (Alt-S).

e.g. my /etc/grub.conf has:

title test-2.6 (test-2.6)
        root (hd0,0)
        kernel /boot/bzImage root=/dev/sda1 console=ttyS0,38400 console=tty0 nmi_watchdog=1 kernel_preempt=1

if everything is set up correctly then you should see kernel messages
showing up in the minicom session when you boot up.

When the messages do not show up then typical errors are mismatch
between the serial port (or speed) and the device names used - if it's
COM2 then use ttyS1, and dont forget to set up the serial speed option
of minicom, etc. You can test the serial connection by doing:

	echo x > /dev/ttyS0

and that should show up in the minicom session on the other box.

to set up early-printk:
-----------------------

occasionally lockups/crashes happen so early in the bootup that nothing
makes it even to the serial log. In that case the 'earlyprintk' feature
is most useful. It is default-enabled on all 2.6 kernels, you only need
to add one more boot parameter to activate it over the serial console:

   earlyprintk=serial,ttyS0,38400

to set up the NMI watchdog:
---------------------------

add nmi_watchdog=1 to your boot parameters and reboot - that should be
all to get it active. If all CPU's NMI count increases in
/proc/interrupts then it's working fine. If the counts do not increase
(or only one CPU increases it) then try nmi_watchdog=2 - this is another
type of NMI that might work better. (Very rarely there are boxes that
dont have reliable NMI counts with 1 and 2 either - but i dont think
your box is one of those.)

once the NMI watchdog is up and running it should catch all hard lockups
and print backtraces to the serial console - even if you are within X
while the lockup happens. You can test hard lockups by running the
attached 'lockupcli' userspace code as root - it turns off interrupts
and goes into an infinite loop => instant lockup. The NMI watchdog
should notice this condition after a couple of seconds and should abort
the task, printing a kernel trace as well. Your box should be back in
working order after that point.

now for the real lockup your box wont be 'fixed' by the NMI watchdog, it
will likely stay locked up, but you should get messages on the serial
console, giving us an idea where the kernel locked up and why. (Very
rarely it happens that not even the NMI watchdog prints anything for a
hard lockup - this is often the sign of hardware problems.)

	Ingo

--- lockupcli.c

main ()
{
        iopl(3);
        for (;;) asm("cli");
}


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-24  7:06                             ` Ingo Molnar
@ 2005-06-24 22:31                               ` William Weston
  2005-06-25  4:14                                 ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-24 22:31 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

On Fri, 24 Jun 2005, Ingo Molnar wrote:

> do you have the NMI watchdog enabled? Find below 
> serial-logging-earlyprintk-nmi.txt.

I had a serial console up, but not NMI watchdog until now.  Here's some 
NMI watchdog traces from both -50-17 and -50-18:

**********************************
*** 2.6.12-RT-V0.7.50-17       ***
**********************************

NMI watchdog detected lockup on CPU#1 (50000/50000)

Pid: 2899, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 1
EIP is at 0x8048392
 ESP: 007b:bfebb440 EFLAGS: 00003082    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: 452a3ff4 ECX: bfebb4ec EDX: 452a3ff4
ESI: bfebb4e4 EDI: bfebb470 EBP: bfebb458 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 139ac000 CR4: 000006d0
NMI show regs on CPU#0:
NMI Watchdog detected LOCKUP on CPU1, eip 08048392, registers:
Modules linked in: eeprom lm85 i2c_sensor i2c_isa i2c_i801 i2c_dev i2c_core realtime microcode snd_intel8x0 snd_ac97_codec snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd soundcore snd_page_alloc ns83820
CPU:    1
EIP:    0073:[<08048392>]    Not tainted VLI
EFLAGS: 00003082   (2.6.12-RT-V0.7.50-17) 
EIP is at 0x8048392
eax: 00000000   ebx: 452a3ff4   ecx: bfebb4ec   edx: 452a3ff4
esi: bfebb4e4   edi: bfebb470   ebp: bfebb458   esp: bfebb440
ds: 007b   es: 007b   ss: 007b   preempt: 00010001
Process lockupcli (pid: 2899, threadinfo=d7060000 task=de5126d0)
console shuts up ...
 
Pid: 0, comm:              swapper
EIP: 0060:[<c0100bc8>] CPU: 0
EIP is at default_idle+0x2a/0x33
 EFLAGS: 00000246    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: c0414000 ECX: c13e72e0 EDX: c0414000
ESI: c0414000 EDI: c0443380 EBP: c0443300 DS: 007b ES: 007b
CR0: 8005003b CR2: 080dcd9c CR3: 1e0e5000 CR4: 000006d0
 [<c0100c7a>] cpu_idle+0x76/0xaf (4)
 [<c0416911>] start_kernel+0x195/0x1fb (36)
 [<c0416338>] unknown_bootoption+0x0/0x1d8 (20)
(           IRQ 4-304  |#0): new 3 us maximum-latency wakeup.
(      gdmgreeter-2858 |#1): new 4 us maximum-latency wakeup.
(               X-2829 |#0): new 10 us maximum-latency wakeup.
( softirq-timer/0-4    |#0): new 11 us maximum-latency wakeup.
BUG: soft lockup detected on CPU#1!
 [<c0140e5e>] softlockup_tick+0xa3/0xb4 (8)
 [<c0111473>] smp_apic_timer_interrupt+0xbd/0xc9 (28)
 [<c01036fc>] apic_timer_interrupt+0x1c/0x24 (24)
 [<c0110bd2>] smp_call_function+0x92/0x11f (44)
 [<c010b550>] mce_checkregs+0x0/0xa3 (36)
 [<c0137040>] up_mutex+0x2b/0x70 (28)
 [<c010b626>] mce_work_fn+0x33/0x6d (12)
 [<c010b550>] mce_checkregs+0x0/0xa3 (4)
 [<c012ec54>] worker_thread+0x1e0/0x289 (20)
 [<c010b5f3>] mce_work_fn+0x0/0x6d (28)
 [<c011936e>] default_wake_function+0x0/0x22 (28)
 [<c011936e>] default_wake_function+0x0/0x22 (32)
 [<c013338a>] kthread+0x7c/0xcd (16)
 [<c012ea74>] worker_thread+0x0/0x289 (20)
 [<c01333b1>] kthread+0xa3/0xcd (4)
 [<c013330e>] kthread+0x0/0xcd (28)
 [<c0101009>] kernel_thread_helper+0x5/0xb (16)
NMI show regs on CPU#1:

Pid: 21, comm:             events/1
EIP: 0060:[<c0111a67>] CPU: 1
EIP is at nmi_show_all_regs+0x8d/0x104
 EFLAGS: 00000046    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: c044b838 ECX: 00000000 EDX: 00000000
ESI: 00028917 EDI: 00000000 EBP: c14bfeb0 DS: 007b ES: 007b
CR0: 8005003b CR2: 451721c0 CR3: 1e0e5000 CR4: 000006d0
 [<c0140e63>] softlockup_tick+0xa8/0xb4 (24)
 [<c0111473>] smp_apic_timer_interrupt+0xbd/0xc9 (28)
 [<c01036fc>] apic_timer_interrupt+0x1c/0x24 (24)
 [<c0110bd2>] smp_call_function+0x92/0x11f (44)
 [<c010b550>] mce_checkregs+0x0/0xa3 (36)
 [<c0137040>] up_mutex+0x2b/0x70 (28)
 [<c010b626>] mce_work_fn+0x33/0x6d (12)
 [<c010b550>] mce_checkregs+0x0/0xa3 (4)
 [<c012ec54>] worker_thread+0x1e0/0x289 (20)
 [<c010b5f3>] mce_work_fn+0x0/0x6d (28)
 [<c011936e>] default_wake_function+0x0/0x22 (28)
 [<c011936e>] default_wake_function+0x0/0x22 (32)
 [<c013338a>] kthread+0x7c/0xcd (16)
 [<c012ea74>] worker_thread+0x0/0x289 (20)
 [<c01333b1>] kthread+0xa3/0xcd (4)
 [<c013330e>] kthread+0x0/0xcd (28)
 [<c0101009>] kernel_thread_helper+0x5/0xb (16)
NMI show regs on CPU#0:

Pid: 2940, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 0
EIP is at 0x8048392
 ESP: 007b:bfa21af0 EFLAGS: 00003086    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: 452a3ff4 ECX: bfa21b9c EDX: 452a3ff4
ESI: bfa21b94 EDI: bfa21b20 EBP: bfa21b08 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 1397d000 CR4: 000006d0
NMI watchdog detected lockup on CPU#0 (50000/50000)

Pid: 2940, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 0
EIP is at 0x8048392
 ESP: 007b:bfa21af0 EFLAGS: 00003086    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: 452a3ff4 ECX: bfa21b9c EDX: 452a3ff4
ESI: bfa21b94 EDI: bfa21b20 EBP: bfa21b08 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 1397d000 CR4: 000006d0
NMI show regs on CPU#1:
NMI Watchdog detected LOCKUP on CPU0, eip 08048392, registers:
Modules linked in: eeprom lm85 i2c_sensor i2c_isa i2c_i801 i2c_dev i2c_core realtime microcode snd_intel8x0 snd_ac97_codec snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd soundcore snd_page_alloc ns83820
CPU:    0
EIP:    0073:[<08048392>]    Not tainted VLI
EFLAGS: 00003086   (2.6.12-RT-V0.7.50-17) 
EIP is at 0x8048392

Pid: 21, comm:             events/1
EIP: 0060:[<c0110bd2>] CPU: 1
eax: 00000000   ebx: 452a3ff4   ecx: bfa21b9c   edx: 452a3ff4
EIP is at smp_call_function+0x92/0x11f
 EFLAGS: 00000297    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: 00000001 ECX: 00000000 EDX: 000c08fb
ESI: 00000001 EDI: c033fbe4 EBP: 00000000 DS: 007b ES: 007b
CR0: 8005003b CR2: 451721c0 CR3: 1e0e5000 CR4: 000006d0
esi: bfa21b94   edi: bfa21b20   ebp: bfa21b08   esp: bfa21af0
 [<c010b550>]ds: 007b   es: 007b   ss: 007b   preempt: 00010001
 mce_checkregs+0x0/0xa3 (28)
Process lockupcli (pid: 2940, threadinfo=d3d62000 task=dec5a650) [<c0137040>]
 up_mutex+0x2b/0x70 (28)
 [<c010b626>]console shuts up ...
  mce_work_fn+0x33/0x6d (12)
 [<c010b550>] mce_checkregs+0x0/0xa3 (4)
 [<c012ec54>] worker_thread+0x1e0/0x289 (20)
 [<c010b5f3>] mce_work_fn+0x0/0x6d (28)
 [<c011936e>] default_wake_function+0x0/0x22 (28)
 [<c011936e>] default_wake_function+0x0/0x22 (32)
 [<c013338a>] kthread+0x7c/0xcd (16)
 [<c012ea74>] worker_thread+0x0/0x289 (20)
 [<c01333b1>] kthread+0xa3/0xcd (4)
 [<c013330e>] kthread+0x0/0xcd (28)
 [<c0101009>] kernel_thread_helper+0x5/0xb (16)
(      watchdog/1-19   |#1): new 46581633 us maximum-latency wakeup.
BUG: soft lockup detected on CPU#0!
 [<c0140e5e>] softlockup_tick+0xa3/0xb4 (8)
 [<c0111473>] smp_apic_timer_interrupt+0xbd/0xc9 (28)
 [<c01036fc>] apic_timer_interrupt+0x1c/0x24 (24)
 [<c02ee5c4>] schedule+0x54/0x13a (44)
 [<c01b6e9c>] kjournald+0x3a2/0x3ab (20)
 [<c013380f>] autoremove_wake_function+0x0/0x4b (40)
 [<c013380f>] autoremove_wake_function+0x0/0x4b (32)
 [<c0102b76>] ret_from_fork+0x6/0x14 (20)
 [<c01b6af0>] commit_timeout+0x0/0x9 (20)
 [<c01b6afa>] kjournald+0x0/0x3ab (16)
 [<c0101009>] kernel_thread_helper+0x5/0xb (16)
NMI show regs on CPU#1:

Pid: 13, comm:      softirq-timer/1
EIP: 0060:[<c02efcf7>] CPU: 1
EIP is at _raw_spin_lock+0x15/0x60
 EFLAGS: 00000046    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000001 EBX: c0408f04 ECX: 00000000 EDX: 00000000
ESI: c1498000 EDI: 00001c80 EBP: c13f87e0 DS: 007b ES: 007b
CR0: 8005003b CR2: 451721c0 CR3: 1e0e5000 CR4: 000006d0
 [<c0127d50>] run_timer_softirq+0x7d/0x392 (12)
 [<c02e007b>] tcpdiag_rcv+0x21/0x176 (40)
 [<c01241af>] ksoftirqd+0xf4/0x189 (20)
 [<c01240bb>] ksoftirqd+0x0/0x189 (40)
 [<c01333b1>] kthread+0xa3/0xcd (4)
 [<c013330e>] kthread+0x0/0xcd (28)
 [<c0101009>] kernel_thread_helper+0x5/0xb (16)
NMI show regs on CPU#0:

Pid: 1274, comm:            kjournald
EIP: 0060:[<c0111a6f>] CPU: 0
EIP is at nmi_show_all_regs+0x95/0x104
 EFLAGS: 00000046    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: c044b838 ECX: 00000000 EDX: 00000000
ESI: 00027d5c EDI: 00000000 EBP: dd6adf1c DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 1e2ef000 CR4: 000006d0
 [<c0140e63>] softlockup_tick+0xa8/0xb4 (24)
 [<c0111473>] smp_apic_timer_interrupt+0xbd/0xc9 (28)
 [<c01036fc>] apic_timer_interrupt+0x1c/0x24 (24)
 [<c02ee5c4>] schedule+0x54/0x13a (44)
 [<c01b6e9c>] kjournald+0x3a2/0x3ab (20)
 [<c013380f>] autoremove_wake_function+0x0/0x4b (40)
 [<c013380f>] autoremove_wake_function+0x0/0x4b (32)
 [<c0102b76>] ret_from_fork+0x6/0x14 (20)
 [<c01b6af0>] commit_timeout+0x0/0x9 (20)
 [<c01b6afa>] kjournald+0x0/0x3ab (16)
 [<c0101009>] kernel_thread_helper+0x5/0xb (16)
NMI watchdog detected lockup on CPU#0 (50000/50000)

Pid: 2941, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 0
EIP is at 0x8048392
 ESP: 007b:bfb44640 EFLAGS: 00003082    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: 452a3ff4 ECX: bfb446ec EDX: 452a3ff4
ESI: bfb446e4 EDI: bfb44670 EBP: bfb44658 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 16741000 CR4: 000006d0
NMI show regs on CPU#1:
NMI Watchdog detected LOCKUP on CPU0, eip 08048392, registers:
Modules linked in: eeprom lm85 i2c_sensor i2c_isa i2c_i801 i2c_dev i2c_core realtime microcode snd_intel8x0 snd_ac97_codec snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd soundcore snd_page_alloc ns83820
CPU:    0
EIP:    0073:[<08048392>]    Not tainted VLI
EFLAGS: 00003082   (2.6.12-RT-V0.7.50-17) 
EIP is at 0x8048392

Pid: 0, comm:              swapper
EIP: 0060:[<c0100bc8>] CPU: 1
eax: 00000000   ebx: 452a3ff4   ecx: bfb446ec   edx: 452a3ff4
esi: bfb446e4   edi: bfb44670   ebp: bfb44658   esp: bfb44640
EIP is at default_idle+0x2a/0x33
 EFLAGS: 00000246    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: def12000 ECX: c13f72e0 EDX: def12000
ESI: def12000 EDI: c0443380 EBP: c0443300 DS: 007b ES: 007b
CR0: 8005003b CR2: 080ddcfc CR3: 1e0e5000 CR4: 000006d0
 [<c0100c7a>]ds: 007b   es: 007b   ss: 007b   preempt: 00010001
 cpu_idle+0x76/0xaf (4)
Process lockupcli (pid: 2941, threadinfo=d3d62000 task=d673e130)
console shuts up ...
 <4>hdb: dma_timer_expiry: dma status == 0x64
hdb: DMA interrupt recovery
hdb: lost interrupt
NMI watchdog detected lockup on CPU#1 (50000/50000)

Pid: 2943, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 1
EIP is at 0x8048392
 ESP: 007b:bfdf1460 EFLAGS: 00003086    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: 452a3ff4 ECX: bfdf150c EDX: 452a3ff4
ESI: bfdf1504 EDI: bfdf1490 EBP: bfdf1478 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 18750000 CR4: 000006d0
NMI show regs on CPU#0:
NMI Watchdog detected LOCKUP on CPU1, eip 08048392, registers:
Modules linked in: eeprom lm85 i2c_sensor i2c_isa i2c_i801 i2c_dev i2c_core realtime microcode snd_intel8x0 snd_ac97_codec snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd soundcore snd_page_alloc ns83820
CPU:    1
EIP:    0073:[<08048392>]    Not tainted VLI
EFLAGS: 00003086   (2.6.12-RT-V0.7.50-17) 
EIP is at 0x8048392

Pid: 0, comm:              swapper
EIP: 0060:[<c0100bc8>] CPU: 0
eax: 00000000   ebx: 452a3ff4   ecx: bfdf150c   edx: 452a3ff4
EIP is at default_idle+0x2a/0x33
 EFLAGS: 00000246    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: c0414000 ECX: c13e72e0 EDX: c0414000
ESI: c0414000 EDI: c0443380 EBP: c0443300 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f7376e CR3: 1e13e000 CR4: 000006d0
 [<c0100c7a>]esi: bfdf1504   edi: bfdf1490   ebp: bfdf1478   esp: bfdf1460
 cpu_idle+0x76/0xaf (4)
ds: 007b   es: 007b   ss: 007b   preempt: 00010001
 [<c0416911>]Process lockupcli (pid: 2943, threadinfo=da2c2000 task=de150230) start_kernel+0x195/0x1fb (36)

 [<c0416338>]console shuts up ...
 unknown_bootoption+0x0/0x1d8 (20)
 <3>BUG: soft lockup detected on CPU#1!
 [<c0140e5e>] softlockup_tick+0xa3/0xb4 (8)
 [<c0111473>] smp_apic_timer_interrupt+0xbd/0xc9 (28)
 [<c01036fc>] apic_timer_interrupt+0x1c/0x24 (24)
 [<c011a0a1>] __cond_resched+0x3f/0x41 (44)
 [<c02eed6c>] cond_resched+0x1c/0x25 (16)
 [<c01509b1>] unmap_vmas+0x13e/0x188 (8)
 [<c0154f2b>] exit_mmap+0x5d/0x118 (48)
 [<c011be29>] mmput+0x2c/0x89 (56)
 [<c0121316>] do_exit+0xcb/0x3dd (16)
 [<c011eba7>] printk+0x17/0x1b (16)
 [<c01049aa>] default_do_nmi+0x0/0x17c (24)
 [<c0111cdc>] nmi_watchdog_tick+0x1fe/0x2a8 (24)
 [<c0104a2a>] default_do_nmi+0x80/0x17c (52)
 [<c015482c>] unmap_vma_list+0x1c/0x28 (24)
 [<c0154bea>] sys_munmap+0x45/0x4e (44)
 [<c0104b77>] do_nmi+0x4e/0x5b (28)
 [<c010388e>] nmi_stack_correct+0x1d/0x22 (20)
NMI show regs on CPU#1:

Pid: 2943, comm:            lockupcli
EIP: 0060:[<c0111a6f>] CPU: 1
EIP is at nmi_show_all_regs+0x95/0x104
 EFLAGS: 00003046    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: c044b838 ECX: 00000000 EDX: 00000000
ESI: 00043196 EDI: 00000000 EBP: da2c3e18 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 00447000 CR4: 000006d0
 [<c0140e63>] softlockup_tick+0xa8/0xb4 (24)
 [<c0111473>] smp_apic_timer_interrupt+0xbd/0xc9 (28)
 [<c01036fc>] apic_timer_interrupt+0x1c/0x24 (24)
 [<c011a0a1>] __cond_resched+0x3f/0x41 (44)
 [<c02eed6c>] cond_resched+0x1c/0x25 (16)
 [<c01509b1>] unmap_vmas+0x13e/0x188 (8)
 [<c0154f2b>] exit_mmap+0x5d/0x118 (48)
 [<c011be29>] mmput+0x2c/0x89 (56)
 [<c0121316>] do_exit+0xcb/0x3dd (16)
 [<c011eba7>] printk+0x17/0x1b (16)
 [<c01049aa>] default_do_nmi+0x0/0x17c (24)
 [<c0111cdc>] nmi_watchdog_tick+0x1fe/0x2a8 (24)
 [<c0104a2a>] default_do_nmi+0x80/0x17c (52)
 [<c015482c>] unmap_vma_list+0x1c/0x28 (24)
 [<c0154bea>] sys_munmap+0x45/0x4e (44)
 [<c0104b77>] do_nmi+0x4e/0x5b (28)
 [<c010388e>] nmi_stack_correct+0x1d/0x22 (20)
NMI show regs on CPU#0:

Pid: 0, comm:              swapper
EIP: 0060:[<c0100bc8>] CPU: 0
EIP is at default_idle+0x2a/0x33
 EFLAGS: 00000246    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: c0414000 ECX: c13e72e0 EDX: c0414000
ESI: c0414000 EDI: c0443380 EBP: c0443300 DS: 007b ES: 007b
CR0: 8005003b CR2: b7f7376e CR3: 1e13e000 CR4: 000006d0
 [<c0100c7a>] cpu_idle+0x76/0xaf (4)
 [<c0416911>] start_kernel+0x195/0x1fb (36)
 [<c0416338>] unknown_bootoption+0x0/0x1d8 (20)

NMI watchdog detected lockup on CPU#0 (50000/50000)

Pid: 2949, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 0
EIP is at 0x8048392
 ESP: 007b:bfdc8f00 EFLAGS: 00003086    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: 452a3ff4 ECX: bfdc8fac EDX: 452a3ff4
ESI: bfdc8fa4 EDI: bfdc8f30 EBP: bfdc8f18 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 13c35000 CR4: 000006d0
NMI show regs on CPU#1:
NMI Watchdog detected LOCKUP on CPU0, eip 08048392, registers:
Modules linked in: eeprom lm85 i2c_sensor i2c_isa i2c_i801 i2c_dev i2c_core realtime microcode snd_intel8x0 snd_ac97_codec snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd soundcore snd_page_alloc ns83820
CPU:    0
EIP:    0073:[<08048392>]    Not tainted VLI
EFLAGS: 00003086   (2.6.12-RT-V0.7.50-17) 
EIP is at 0x8048392
eax: 00000000   ebx: 452a3ff4   ecx: bfdc8fac   edx: 452a3ff4
esi: bfdc8fa4   edi: bfdc8f30   ebp: bfdc8f18   esp: bfdc8f00
ds: 007b   es: 007b   ss: 007b   preempt: 00010001
Process lockupcli (pid: 2949, threadinfo=d3c3c000 task=da2ed290)
console shuts up ...
 
Pid: 0, comm:              swapper
EIP: 0060:[<c0100bc8>] CPU: 1
EIP is at default_idle+0x2a/0x33
 EFLAGS: 00000246    Not tainted  (2.6.12-RT-V0.7.50-17)
EAX: 00000000 EBX: def12000 ECX: c13f72e0 EDX: def12000
ESI: def12000 EDI: c0443380 EBP: c0443300 DS: 007b ES: 007b
CR0: 8005003b CR2: 080f3c04 CR3: 1d9e6000 CR4: 000006d0
 [<c0100c7a>] cpu_idle+0x76/0xaf (4)




**********************************
*** 2.6.12-RT-V0.7.50-18-debug ***
**********************************

NMI watchdog detected lockup on CPU#0 (50000/50000)

Pid: 3264, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 0
EIP is at 0x8048392
 ESP: 007b:bfab1800 EFLAGS: 00003086    Not tainted  (2.6.12-RT-V0.7.50-18-debug)
EAX: 00000000 EBX: 452a3ff4 ECX: bfab18ac EDX: 452a3ff4
ESI: bfab18a4 EDI: bfab1830 EBP: bfab1818 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 1e10d000 CR4: 000006d0
 [<c01010ec>] show_regs+0x14b/0x173 (36)
 [<c0112d6e>] nmi_watchdog_tick+0x17b/0x2a1 (52)
 [<c0104e34>] default_do_nmi+0x7a/0x17a (96)
 [<c0104faa>] do_nmi+0x6f/0x81 (24)
 [<c0103b7a>] nmi_stack_correct+0x1d/0x22 (-323987356)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c0370c2a>] .... _raw_spin_lock+0x1b/0x85
.....[<c0112d34>] ..   ( <= nmi_watchdog_tick+0x141/0x2a1)
.. [<c013effb>] .... print_traces+0x1b/0x52
.....[<c0103de5>] ..   ( <= shoce+0xc2/0xd4)

------------------------------
| showing all locks held by: |  (lockupcli/3264 [ddcf0cc0,  54]):
------------------------------

NMI show regs on CPU#1:


NMI watchdog detected lockup on CPU#0 (50000/50000)

Pid: 3031, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 0
EIP is at 0x8048392
 ESP: 007b:bfdca9e0 EFLAGS: 00003082    Not tainted  (2.6.12-RT-V0.7.50-18-debug)
EAX: 00000000 EBX: 452a3ff4 ECX: bfdcaa8c EDX: 452a3ff4
ESI: bfdcaa84 EDI: bfdcaa10 EBP: bfdca9f8 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 122bd000 CR4: 000006d0
 [<c01010ec>] show_regs+0x14b/0x173 (36)
 [<c0112d6e>] nmi_watchdog_tick+0x17b/0x2a1 (52)
 [<c0104e34>] default_do_nmi+0x7a/0x17a (96)
 [<c0104faa>] do_nmi+0x6f/0x81 (24)
 [<c0103b7a>] nmi_stack_correct+0x1d/0x22 (-308213180)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c0370c2a>] .... _raw_spin_lock+0x1b/0x85
.....[<c0112d34>] ..   ( <= nmi_watchdog_tick+0x141/0x2a1)
.. [<c013effb>] .... print_traces+0x1b/0x52
.....[<103de5>] ..   ( <= show_trace+0xc2/0xd4)

------------------------------
| showing all locks held by: |  (lockupcli/3031 [ddeac660, 118]):
------------------------------

NMI show regs on CPU#1:


NMI watchdog detected lockup on CPU#1 (50000/50000)

Pid: 2937, comm:            lockupcli
EIP: 0073:[<08048392>] CPU: 1
EIP is at 0x8048392
 ESP: 007b:bff205d0 EFLAGS: 00003082    Not tainted  (2.6.12-RT-V0.7.50-18-debug)
EAX: 00000000 EBX: 452a3ff4 ECX: bff2067c EDX: 452a3ff4
ESI: bff20674 EDI: bff20600 EBP: bff205e8 DS: 007b ES: 007b
CR0: 8005003b CR2: 451a5590 CR3: 1382e000 CR4: 000006d0
 [<c01010ec>] show_regs+0x14b/0x173 (36)
 [<c0112d6e>] nmi_watchdog_tick+0x17b/0x2a1 (52)
 [<c0104e34>] default_do_nmi+0x7a/0x17a (96)
 [<c0104faa>] do_nmi+0x6f/0x81 (24)
 [<c0103b7a>] nmi_stack_correct+0x1d/0x22 (-373864908)
---------------------------
| preempt count: 00010002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c0370c2a>] .... _raw_spin_lock+0x1b/0x85
.....[<c0112d34>] ..   ( <= nmi_watchdog_tick+0x141/0x2a1)
.. [<c013effb>] .... print_traces+0x1b/0x52
.....[<c0103de5>] ..   ( <= show_trace+0xc2/0xd4)

------------------------------
| showing all locks held by: |  (lockupcli/2937 [de4ed980,  54]):
------------------------------

NMI show regs on CPU#0:


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-24 22:31                               ` William Weston
@ 2005-06-25  4:14                                 ` Ingo Molnar
  2005-06-27  4:21                                   ` William Weston
  2005-06-27  5:43                                   ` Gene Heskett
  0 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-25  4:14 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> On Fri, 24 Jun 2005, Ingo Molnar wrote:
> 
> > do you have the NMI watchdog enabled? Find below 
> > serial-logging-earlyprintk-nmi.txt.
> 
> I had a serial console up, but not NMI watchdog until now.  Here's 
> some NMI watchdog traces from both -50-17 and -50-18:

all of these traces seem to have lockupcli involved - is that correct?  
lockupcli is just a userspace test-app to artificially trigger a 
hard-lockup (it disables interrupts and goes into an infinite loop). So 
the NMI watchdog triggering on lockupcli would be normal and expected.  
So once this works, it would be nice to reproduce whatever hard lockup 
you are seeing and see whether the NMI watchdog produces any output to 
the serial log. (if such log is supposed to be included in your dmesg 
then it somehow got intermixed with lockupcli logs)

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-22 13:27                   ` Gene Heskett
  2005-06-22 13:51                     ` Gene Heskett
@ 2005-06-25  4:41                     ` Ingo Molnar
  2005-06-25  4:47                       ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-25  4:41 UTC (permalink / raw)
  To: Gene Heskett; +Cc: linux-kernel


* Gene Heskett <gene.heskett@verizon.net> wrote:

> I can report that mode 4 is not at all well here.  I turned it on and 
> changed the extraversion, built it, and when it booted, it got to this 
> line and hung:
> 
> Checking to see if this processor honours the WP bit even in 
> supervisor mode... OK.

ok, could you try the patch below, ontop of whatever tree hung for you?

	Ingo

----
tree ca8b6bbafab35c5c1099c54696c36dc0b8c17cf7
parent 59a49e38711a146dc0bef4837c825b5422335460
author Linus Torvalds <torvalds@ppc970.osdl.org> Sat, 25 Jun 2005 00:39:17 -0700
committer Linus Torvalds <torvalds@ppc970.osdl.org> Sat, 25 Jun 2005 00:39:17 -0700

Add "memory" clobbers to the x86 inline asm of strncmp and friends

They don't actually clobber memory, but gcc doesn't even know they
_read_ memory, so can apparently re-order memory accesses around them.

Which obviously does the wrong thing if the memory access happens to
change the memory that the compare function is accessing..

Verified to fix a strange boot problem by Jens Axboe.

 include/asm-i386/string.h |   32 ++++++++++++++++++++++----------
 1 files changed, 22 insertions(+), 10 deletions(-)

diff --git a/include/asm-i386/string.h b/include/asm-i386/string.h
--- a/include/asm-i386/string.h
+++ b/include/asm-i386/string.h
@@ -116,7 +116,8 @@ __asm__ __volatile__(
 	"orb $1,%%al\n"
 	"3:"
 	:"=a" (__res), "=&S" (d0), "=&D" (d1)
-		     :"1" (cs),"2" (ct));
+	:"1" (cs),"2" (ct)
+	:"memory");
 return __res;
 }
 
@@ -138,8 +139,9 @@ __asm__ __volatile__(
 	"3:\tsbbl %%eax,%%eax\n\t"
 	"orb $1,%%al\n"
 	"4:"
-		     :"=a" (__res), "=&S" (d0), "=&D" (d1), "=&c" (d2)
-		     :"1" (cs),"2" (ct),"3" (count));
+	:"=a" (__res), "=&S" (d0), "=&D" (d1), "=&c" (d2)
+	:"1" (cs),"2" (ct),"3" (count)
+	:"memory");
 return __res;
 }
 
@@ -158,7 +160,9 @@ __asm__ __volatile__(
 	"movl $1,%1\n"
 	"2:\tmovl %1,%0\n\t"
 	"decl %0"
-	:"=a" (__res), "=&S" (d0) : "1" (s),"0" (c));
+	:"=a" (__res), "=&S" (d0)
+	:"1" (s),"0" (c)
+	:"memory");
 return __res;
 }
 
@@ -175,7 +179,9 @@ __asm__ __volatile__(
 	"leal -1(%%esi),%0\n"
 	"2:\ttestb %%al,%%al\n\t"
 	"jne 1b"
-	:"=g" (__res), "=&S" (d0), "=&a" (d1) :"0" (0),"1" (s),"2" (c));
+	:"=g" (__res), "=&S" (d0), "=&a" (d1)
+	:"0" (0),"1" (s),"2" (c)
+	:"memory");
 return __res;
 }
 
@@ -189,7 +195,9 @@ __asm__ __volatile__(
 	"scasb\n\t"
 	"notl %0\n\t"
 	"decl %0"
-	:"=c" (__res), "=&D" (d0) :"1" (s),"a" (0), "0" (0xffffffffu));
+	:"=c" (__res), "=&D" (d0)
+	:"1" (s),"a" (0), "0" (0xffffffffu)
+	:"memory");
 return __res;
 }
 
@@ -333,7 +341,9 @@ __asm__ __volatile__(
 	"je 1f\n\t"
 	"movl $1,%0\n"
 	"1:\tdecl %0"
-	:"=D" (__res), "=&c" (d0) : "a" (c),"0" (cs),"1" (count));
+	:"=D" (__res), "=&c" (d0)
+	:"a" (c),"0" (cs),"1" (count)
+	:"memory");
 return __res;
 }
 
@@ -369,7 +379,7 @@ __asm__ __volatile__(
 	"je 2f\n\t"
 	"stosb\n"
 	"2:"
-	: "=&c" (d0), "=&D" (d1)
+	:"=&c" (d0), "=&D" (d1)
 	:"a" (c), "q" (count), "0" (count/4), "1" ((long) s)
 	:"memory");
 return (s);	
@@ -392,7 +402,8 @@ __asm__ __volatile__(
 	"jne 1b\n"
 	"3:\tsubl %2,%0"
 	:"=a" (__res), "=&d" (d0)
-	:"c" (s),"1" (count));
+	:"c" (s),"1" (count)
+	:"memory");
 return __res;
 }
 /* end of additional stuff */
@@ -473,7 +484,8 @@ static inline void * memscan(void * addr
 		"dec %%edi\n"
 		"1:"
 		: "=D" (addr), "=c" (size)
-		: "0" (addr), "1" (size), "a" (c));
+		: "0" (addr), "1" (size), "a" (c)
+		: "memory");
 	return addr;
 }
 

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-25  4:41                     ` Ingo Molnar
@ 2005-06-25  4:47                       ` Ingo Molnar
  2005-06-25  5:39                         ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-25  4:47 UTC (permalink / raw)
  To: Gene Heskett; +Cc: linux-kernel


* Ingo Molnar <mingo@elte.hu> wrote:

> 
> * Gene Heskett <gene.heskett@verizon.net> wrote:
> 
> > I can report that mode 4 is not at all well here.  I turned it on and 
> > changed the extraversion, built it, and when it booted, it got to this 
> > line and hung:
> > 
> > Checking to see if this processor honours the WP bit even in 
> > supervisor mode... OK.
> 
> ok, could you try the patch below, ontop of whatever tree hung for you?

also included in -V0.7.50-19 and later patches.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-25  4:47                       ` Ingo Molnar
@ 2005-06-25  5:39                         ` Gene Heskett
  2005-06-25  7:26                           ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-25  5:39 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar

On Saturday 25 June 2005 00:47, Ingo Molnar wrote:
>* Ingo Molnar <mingo@elte.hu> wrote:
>> * Gene Heskett <gene.heskett@verizon.net> wrote:
>> > I can report that mode 4 is not at all well here.  I turned it
>> > on and changed the extraversion, built it, and when it booted,
>> > it got to this line and hung:
>> >
>> > Checking to see if this processor honours the WP bit even in
>> > supervisor mode... OK.
>>
>> ok, could you try the patch below, ontop of whatever tree hung for
>> you?
>
>also included in -V0.7.50-19 and later patches.
>
> Ingo

Gahh, and I just built -18 but amanda is running so can't reboot 
anyway.  This is my night to do a graveyard at the tv transmitter so 
it'll be the middle of the day Saturday before I get one eye open 
simultainiously again.  -19 wasn't there 3 or 4 hours ago.

Thanks, I report back when I have done it.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-25  5:39                         ` Gene Heskett
@ 2005-06-25  7:26                           ` Gene Heskett
  2005-06-25  9:12                             ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-25  7:26 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar

On Saturday 25 June 2005 01:39, Gene Heskett wrote:
>On Saturday 25 June 2005 00:47, Ingo Molnar wrote:
>>* Ingo Molnar <mingo@elte.hu> wrote:
>>> * Gene Heskett <gene.heskett@verizon.net> wrote:
>>> > I can report that mode 4 is not at all well here.  I turned it
>>> > on and changed the extraversion, built it, and when it booted,
>>> > it got to this line and hung:
>>> >
>>> > Checking to see if this processor honours the WP bit even in
>>> > supervisor mode... OK.
>>>
>>> ok, could you try the patch below, ontop of whatever tree hung
>>> for you?
>>
>>also included in -V0.7.50-19 and later patches.
>>
>> Ingo
>
>Gahh, and I just built -18 but amanda is running so can't reboot
>anyway.  This is my night to do a graveyard at the tv transmitter so
>it'll be the middle of the day Saturday before I get one eye open
>simultainiously again.  -19 wasn't there 3 or 4 hours ago.
>
>Thanks, I report back when I have done it.

It seems the transmitter only needed a goodnight kiss, so I came back 
& built it.  So far running good, 5 minute uptime, looks good.  More 
reports if I find any gotcha's :)  Seemed to boot marginally faster 
too, but no stopwatch timeings were done.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-25  7:26                           ` Gene Heskett
@ 2005-06-25  9:12                             ` Ingo Molnar
  2005-06-25 13:19                               ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-25  9:12 UTC (permalink / raw)
  To: Gene Heskett; +Cc: linux-kernel


* Gene Heskett <gene.heskett@verizon.net> wrote:

> It seems the transmitter only needed a goodnight kiss, so I came back 
> & built it.  So far running good, 5 minute uptime, looks good.  More 
> reports if I find any gotcha's :) Seemed to boot marginally faster 
> too, but no stopwatch timeings were done.

great. To make sure, these earlier boot failures are gone:

> I just tried to build & boot 50-17 in mode=3, no hardirq's and got the 
> same boot failure as mode 4 for 50-06 gave:

right?

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-25  9:12                             ` Ingo Molnar
@ 2005-06-25 13:19                               ` Gene Heskett
  2005-06-25 14:39                                 ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-25 13:19 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar

On Saturday 25 June 2005 05:12, Ingo Molnar wrote:
>* Gene Heskett <gene.heskett@verizon.net> wrote:
>> It seems the transmitter only needed a goodnight kiss, so I came
>> back & built it.  So far running good, 5 minute uptime, looks
>> good.  More reports if I find any gotcha's :) Seemed to boot
>> marginally faster too, but no stopwatch timeings were done.
>
>great. To make sure, these earlier boot failures are gone:
>> I just tried to build & boot 50-17 in mode=3, no hardirq's and got
>> the same boot failure as mode 4 for 50-06 gave:
>
>right?
>
> Ingo

Yes.  Same mode 3, no hardirq's config.  I have not tried mode=4.  
Here thats been a lockup every time for recent versions.  I just 
checked the log, pretty quiet, nothing out of line.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-25 13:19                               ` Gene Heskett
@ 2005-06-25 14:39                                 ` Gene Heskett
  2005-06-27 19:01                                   ` Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24 Chuck Harding
  0 siblings, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-25 14:39 UTC (permalink / raw)
  To: linux-kernel; +Cc: Ingo Molnar

On Saturday 25 June 2005 09:19, Gene Heskett wrote:
>On Saturday 25 June 2005 05:12, Ingo Molnar wrote:
>>* Gene Heskett <gene.heskett@verizon.net> wrote:
>>> It seems the transmitter only needed a goodnight kiss, so I came
>>> back & built it.  So far running good, 5 minute uptime, looks
>>> good.  More reports if I find any gotcha's :) Seemed to boot
>>> marginally faster too, but no stopwatch timeings were done.
>>
>>great. To make sure, these earlier boot failures are gone:
>>> I just tried to build & boot 50-17 in mode=3, no hardirq's and
>>> got the same boot failure as mode 4 for 50-06 gave:
>>
>>right?
>>
>> Ingo
>
>Yes.  Same mode 3, no hardirq's config.  I have not tried mode=4.
>Here thats been a lockup every time for recent versions.  I just
>checked the log, pretty quiet, nothing out of line.

Now I've tried -22 in mode=4 and its the same hard lockup after this 
line is printed to the screen:

"Checking to see if this processor honours the WP bit even in the 
supervisor mode...  OK"

reset button to recover. -22 in mode=3, no hardirq's now building 
while running -19.

-22, mode=3 no hardirq's is running, but it took kmail a couple of 
minutes to fully init its screen, with a spamd child eating 99% of 
the cpu.  The logs are silent after "loading the r200 code" from 
startx.  But, it seems to be ok now.  More data when available.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-25  4:14                                 ` Ingo Molnar
@ 2005-06-27  4:21                                   ` William Weston
  2005-06-27  8:15                                     ` Ingo Molnar
  2005-06-27  5:43                                   ` Gene Heskett
  1 sibling, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-27  4:21 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

On Sat, 25 Jun 2005, Ingo Molnar wrote:

> > > do you have the NMI watchdog enabled? Find below 
> > > serial-logging-earlyprintk-nmi.txt.
> > 
> > I had a serial console up, but not NMI watchdog until now.  Here's 
> > some NMI watchdog traces from both -50-17 and -50-18:
> 
> all of these traces seem to have lockupcli involved - is that correct?  
> lockupcli is just a userspace test-app to artificially trigger a 
> hard-lockup (it disables interrupts and goes into an infinite loop). So 
> the NMI watchdog triggering on lockupcli would be normal and expected.  
> So once this works, it would be nice to reproduce whatever hard lockup 
> you are seeing and see whether the NMI watchdog produces any output to 
> the serial log. (if such log is supposed to be included in your dmesg 
> then it somehow got intermixed with lockupcli logs)

I still haven't been able to get any NMI watchdog traces with the lockups
induced by VLC and burnP6.  Early printk is enabled on the serial console.
I have noticed, however, that scheduling performance slowly degrades 
during the ~1 minute before locking up.  Once I was able to get a delayed 
SysRq response (~30s) from the serial console after the X console became 
unresponsive.  Is this possibly a scheduler starvation issue that affects 
everything, including the NMI watchdog?  Any more suggestions for catching 
a trace?

--ww

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-25  4:14                                 ` Ingo Molnar
  2005-06-27  4:21                                   ` William Weston
@ 2005-06-27  5:43                                   ` Gene Heskett
  2005-06-27  8:17                                     ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-27  5:43 UTC (permalink / raw)
  To: linux-kernel
  Cc: Ingo Molnar, William Weston, K.R. Foley, Eugeny S. Mints, Daniel Walker

On Saturday 25 June 2005 00:14, Ingo Molnar wrote:
>* William Weston <weston@sysex.net> wrote:
>> On Fri, 24 Jun 2005, Ingo Molnar wrote:
>> > do you have the NMI watchdog enabled? Find below
>> > serial-logging-earlyprintk-nmi.txt.
>>
>> I had a serial console up, but not NMI watchdog until now.  Here's
>> some NMI watchdog traces from both -50-17 and -50-18:
>
>all of these traces seem to have lockupcli involved - is that
> correct? lockupcli is just a userspace test-app to artificially
> trigger a hard-lockup (it disables interrupts and goes into an
> infinite loop). So the NMI watchdog triggering on lockupcli would
> be normal and expected. So once this works, it would be nice to
> reproduce whatever hard lockup you are seeing and see whether the
> NMI watchdog produces any output to the serial log. (if such log is
> supposed to be included in your dmesg then it somehow got
> intermixed with lockupcli logs)
>
> Ingo

In the FWIW category, I booted 50-23 about an hour & a half ago, same 
mode 3, no hardirq's, everything seems to be working fine except for 
kmails total lack of threading causeing composer hangs while a mail 
fetch/spamassassin run is in progress.  But thats not anything new to 
this patchset, its an equal opportunity annoyer.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-27  4:21                                   ` William Weston
@ 2005-06-27  8:15                                     ` Ingo Molnar
  2005-06-28  3:32                                       ` William Weston
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-27  8:15 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> I still haven't been able to get any NMI watchdog traces with the 
> lockups induced by VLC and burnP6.  Early printk is enabled on the 
> serial console. I have noticed, however, that scheduling performance 
> slowly degrades during the ~1 minute before locking up.  Once I was 
> able to get a delayed SysRq response (~30s) from the serial console 
> after the X console became unresponsive.  Is this possibly a scheduler 
> starvation issue that affects everything, including the NMI watchdog?  
> Any more suggestions for catching a trace?

hm. Nothing should starve the NMI watchdog. Only a nasty, complete 
kernel crash or a hardware failure can lock up the box in a way that not 
even the NMI watchdog can get some message out to the console. Just in 
case, could you try the latest patch (-50-24 or later), there were a 
couple of bugs fixed.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-27  5:43                                   ` Gene Heskett
@ 2005-06-27  8:17                                     ` Ingo Molnar
  2005-06-27 17:29                                       ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-27  8:17 UTC (permalink / raw)
  To: Gene Heskett
  Cc: linux-kernel, William Weston, K.R. Foley, Eugeny S. Mints, Daniel Walker


* Gene Heskett <gene.heskett@verizon.net> wrote:

> In the FWIW category, I booted 50-23 about an hour & a half ago, same 
> mode 3, no hardirq's, everything seems to be working fine except for 
> kmails total lack of threading causeing composer hangs while a mail 
> fetch/spamassassin run is in progress.  But thats not anything new to 
> this patchset, its an equal opportunity annoyer.

does the patch below make the kmail starvation go away?

	Ingo

Index: kernel/sched.c
===================================================================
--- kernel/sched.c.orig
+++ kernel/sched.c
@@ -1055,7 +1055,7 @@ static int try_to_wake_up(task_t * p, un
 	/*
 	 * sync wakeups can increase wakeup latencies:
 	 */
-	if (rt_task(p))
+//	if (rt_task(p))
 		sync = 0;
 #endif
 	rq = task_rq_lock(p, &flags);

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-27  8:17                                     ` Ingo Molnar
@ 2005-06-27 17:29                                       ` Gene Heskett
  2005-06-27 19:54                                         ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-27 17:29 UTC (permalink / raw)
  To: linux-kernel
  Cc: Ingo Molnar, William Weston, K.R. Foley, Eugeny S. Mints, Daniel Walker

On Monday 27 June 2005 04:17, Ingo Molnar wrote:
>* Gene Heskett <gene.heskett@verizon.net> wrote:
>> In the FWIW category, I booted 50-23 about an hour & a half ago,
>> same mode 3, no hardirq's, everything seems to be working fine
>> except for kmails total lack of threading causeing composer hangs
>> while a mail fetch/spamassassin run is in progress.  But thats not
>> anything new to this patchset, its an equal opportunity annoyer.
>
>does the patch below make the kmail starvation go away?
>
I put in the comment and its building now.  I rather doubt its going 
to make a huge diff though as its probably the single most repeated 
bitch on the kmail lists, and has been for a long, very long as in 
years, time.  From hints dropped here and there, it might finally be 
fixed with kde-3.5.  But we'll give this a shot nontheless.  I'll add 
more after I reboot to test.

Now rebooted.

I don't think its made a noticable difference, I'm still getting the 
hangs of up to 30 seconds but I'll let it run the rest of the 
afternoon so I get a better feel for it.  It doesn't often miss a 
keystroke, they will eventually be echoed back to the screen.

> Ingo
>
>Index: kernel/sched.c
>===================================================================
>--- kernel/sched.c.orig
>+++ kernel/sched.c
>@@ -1055,7 +1055,7 @@ static int try_to_wake_up(task_t * p, un
>  /*
>   * sync wakeups can increase wakeup latencies:
> 	 */
>-	if (rt_task(p))
>+//	if (rt_task(p))
> 		sync = 0;
> #endif
> 	rq = task_rq_lock(p, &flags);

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-25 14:39                                 ` Gene Heskett
@ 2005-06-27 19:01                                   ` Chuck Harding
  2005-06-27 19:42                                     ` Chuck Harding
  2005-06-27 20:09                                     ` Daniel Walker
  0 siblings, 2 replies; 139+ messages in thread
From: Chuck Harding @ 2005-06-27 19:01 UTC (permalink / raw)
  To: Linux Kernel Discussion List

What can be causing the following message to appear in dmesg and
how can I fix it?

BUG: scheduling with irqs disabled: kapmd/0x00000000/46
caller is schedule_timeout+0x51/0x9e
  [<c02b3bc9>] schedule+0x96/0xf6 (8)
  [<c02b43f7>] schedule_timeout+0x51/0x9e (28)
  [<c01222ed>] process_timeout+0x0/0x5 (32)
  [<c0112063>] apm_mainloop+0x7a/0x96 (24)
  [<c0115e45>] default_wake_function+0x0/0x16 (12)
  [<c0115e45>] default_wake_function+0x0/0x16 (32)
  [<c0111485>] apm_driver_version+0x1c/0x38 (16)
  [<c01126f7>] apm+0x0/0x289 (8)
  [<c01127a6>] apm+0xaf/0x289 (8)
  [<c010133c>] kernel_thread_helper+0x0/0xb (20)
  [<c0101341>] kernel_thread_helper+0x5/0xb (4)

This was also present in earlier final-V0.7.50 version I've tried
(since -00) I don't get hangs but that doesn't look like it should
be happening. Thanks.

-- 
Charles D. (Chuck) Harding <charding@llnl.gov>  Voice: 925-423-8879
Senior Computer Associate         ICCD            Fax: 925-423-6961
Lawrence Livermore National Laboratory      Computation Directorate
Livermore, CA USA  http://www.llnl.gov  GPG Public Key ID: B9EB6601
------------------ http://tinyurl.com/5w5ey -----------------------
-- Unburdened by the rigors of coherent thought. --

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-27 19:01                                   ` Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24 Chuck Harding
@ 2005-06-27 19:42                                     ` Chuck Harding
  2005-06-27 21:08                                       ` Gene Heskett
  2005-06-27 20:09                                     ` Daniel Walker
  1 sibling, 1 reply; 139+ messages in thread
From: Chuck Harding @ 2005-06-27 19:42 UTC (permalink / raw)
  To: Linux Kernel Discussion List

On Mon, 27 Jun 2005, Chuck Harding wrote:

> What can be causing the following message to appear in dmesg and
> how can I fix it?
>
> BUG: scheduling with irqs disabled: kapmd/0x00000000/46
> caller is schedule_timeout+0x51/0x9e
> [<c02b3bc9>] schedule+0x96/0xf6 (8)
> [<c02b43f7>] schedule_timeout+0x51/0x9e (28)
> [<c01222ed>] process_timeout+0x0/0x5 (32)
> [<c0112063>] apm_mainloop+0x7a/0x96 (24)
> [<c0115e45>] default_wake_function+0x0/0x16 (12)
> [<c0115e45>] default_wake_function+0x0/0x16 (32)
> [<c0111485>] apm_driver_version+0x1c/0x38 (16)
> [<c01126f7>] apm+0x0/0x289 (8)
> [<c01127a6>] apm+0xaf/0x289 (8)
> [<c010133c>] kernel_thread_helper+0x0/0xb (20)
> [<c0101341>] kernel_thread_helper+0x5/0xb (4)
>
> This was also present in earlier final-V0.7.50 version I've tried
> (since -00) I don't get hangs but that doesn't look like it should
> be happening. Thanks.
>
another symptom (don't know if it's actually related) is that if I
try to switch to a virtual consol (ctl-alt-chift-F[1..6] the screen
won't change out of graphics mode - it goes black like it's trying
to switch but comes back with the graphical screen which isn't responsive
and hitting alt-F7 restores it to operation. I just rebooted to a kernel
that doesn't have the RT-preempt patch but uses the same .config and
everything for switching between X and virtual terminals works just fine.

-- 
Charles D. (Chuck) Harding <charding@llnl.gov>  Voice: 925-423-8879
Senior Computer Associate         ICCD            Fax: 925-423-6961
Lawrence Livermore National Laboratory      Computation Directorate
Livermore, CA USA  http://www.llnl.gov  GPG Public Key ID: B9EB6601
------------------ http://tinyurl.com/5w5ey -----------------------
-- I'm not fat, just horizontally disproportionate. --

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-27 17:29                                       ` Gene Heskett
@ 2005-06-27 19:54                                         ` Ingo Molnar
  2005-06-27 21:17                                           ` Gene Heskett
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-27 19:54 UTC (permalink / raw)
  To: Gene Heskett
  Cc: linux-kernel, William Weston, K.R. Foley, Eugeny S. Mints, Daniel Walker


* Gene Heskett <gene.heskett@verizon.net> wrote:

> On Monday 27 June 2005 04:17, Ingo Molnar wrote:
> >* Gene Heskett <gene.heskett@verizon.net> wrote:
> >> In the FWIW category, I booted 50-23 about an hour & a half ago,
> >> same mode 3, no hardirq's, everything seems to be working fine
> >> except for kmails total lack of threading causeing composer hangs
> >> while a mail fetch/spamassassin run is in progress.  But thats not
> >> anything new to this patchset, its an equal opportunity annoyer.
> >
> >does the patch below make the kmail starvation go away?

> I put in the comment and its building now.  I rather doubt its going 
> to make a huge diff though as its probably the single most repeated 
> bitch on the kmail lists, and has been for a long, very long as in 
> years, time.  From hints dropped here and there, it might finally be 
> fixed with kde-3.5.  But we'll give this a shot nontheless.  I'll add 
> more after I reboot to test.

ah, ok - so kmail behaves similarly on vanilla kernels too? I thought 
this might be some -RT-specific degradation.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-27 19:01                                   ` Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24 Chuck Harding
  2005-06-27 19:42                                     ` Chuck Harding
@ 2005-06-27 20:09                                     ` Daniel Walker
  2005-06-27 20:28                                       ` Chuck Harding
  2005-06-28  7:53                                       ` Steven Rostedt
  1 sibling, 2 replies; 139+ messages in thread
From: Daniel Walker @ 2005-06-27 20:09 UTC (permalink / raw)
  To: Chuck Harding; +Cc: Linux Kernel Discussion List

On Mon, 2005-06-27 at 12:01 -0700, Chuck Harding wrote:
> What can be causing the following message to appear in dmesg and
> how can I fix it?
> 
> BUG: scheduling with irqs disabled: kapmd/0x00000000/46
> caller is schedule_timeout+0x51/0x9e
>   [<c02b3bc9>] schedule+0x96/0xf6 (8)
>   [<c02b43f7>] schedule_timeout+0x51/0x9e (28)
>   [<c01222ed>] process_timeout+0x0/0x5 (32)
>   [<c0112063>] apm_mainloop+0x7a/0x96 (24)
>   [<c0115e45>] default_wake_function+0x0/0x16 (12)
>   [<c0115e45>] default_wake_function+0x0/0x16 (32)
>   [<c0111485>] apm_driver_version+0x1c/0x38 (16)
>   [<c01126f7>] apm+0x0/0x289 (8)
>   [<c01127a6>] apm+0xaf/0x289 (8)
>   [<c010133c>] kernel_thread_helper+0x0/0xb (20)
>   [<c0101341>] kernel_thread_helper+0x5/0xb (4)
> 
> This was also present in earlier final-V0.7.50 version I've tried
> (since -00) I don't get hangs but that doesn't look like it should
> be happening. Thanks.

If you have PREEMPT_RT enabled, it looks like interrupts are hard
disabled then there is a schedule_timeout() requested. You could try
turning off power management and see if you still have problems.

Daniel 



^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-27 20:09                                     ` Daniel Walker
@ 2005-06-27 20:28                                       ` Chuck Harding
  2005-06-28  0:50                                         ` Daniel Walker
  2005-06-28  7:53                                       ` Steven Rostedt
  1 sibling, 1 reply; 139+ messages in thread
From: Chuck Harding @ 2005-06-27 20:28 UTC (permalink / raw)
  To: Linux Kernel Discussion List

On Mon, 27 Jun 2005, Daniel Walker wrote:

> If you have PREEMPT_RT enabled, it looks like interrupts are hard
> disabled then there is a schedule_timeout() requested. You could try
> turning off power management and see if you still have problems.
>
> Daniel
>

Well, putting apm=off in the kernel command line did the trick. I am
using a desktop system so apm really isn't needed. Time to change my
standard config file..... Thanks.

-- 
Charles D. (Chuck) Harding <charding@llnl.gov>  Voice: 925-423-8879
Senior Computer Associate         ICCD            Fax: 925-423-6961
Lawrence Livermore National Laboratory      Computation Directorate
Livermore, CA USA  http://www.llnl.gov  GPG Public Key ID: B9EB6601
------------------ http://tinyurl.com/5w5ey -----------------------
-- Useless Invention: Rollerblade skates for peglegs. --

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-27 19:42                                     ` Chuck Harding
@ 2005-06-27 21:08                                       ` Gene Heskett
  0 siblings, 0 replies; 139+ messages in thread
From: Gene Heskett @ 2005-06-27 21:08 UTC (permalink / raw)
  To: linux-kernel

On Monday 27 June 2005 15:42, Chuck Harding wrote:
>On Mon, 27 Jun 2005, Chuck Harding wrote:
>> What can be causing the following message to appear in dmesg and
>> how can I fix it?
>>
>> BUG: scheduling with irqs disabled: kapmd/0x00000000/46
>> caller is schedule_timeout+0x51/0x9e
>> [<c02b3bc9>] schedule+0x96/0xf6 (8)
>> [<c02b43f7>] schedule_timeout+0x51/0x9e (28)
>> [<c01222ed>] process_timeout+0x0/0x5 (32)
>> [<c0112063>] apm_mainloop+0x7a/0x96 (24)
>> [<c0115e45>] default_wake_function+0x0/0x16 (12)
>> [<c0115e45>] default_wake_function+0x0/0x16 (32)
>> [<c0111485>] apm_driver_version+0x1c/0x38 (16)
>> [<c01126f7>] apm+0x0/0x289 (8)
>> [<c01127a6>] apm+0xaf/0x289 (8)
>> [<c010133c>] kernel_thread_helper+0x0/0xb (20)
>> [<c0101341>] kernel_thread_helper+0x5/0xb (4)
>>
>> This was also present in earlier final-V0.7.50 version I've tried
>> (since -00) I don't get hangs but that doesn't look like it should
>> be happening. Thanks.
>
>another symptom (don't know if it's actually related) is that if I
>try to switch to a virtual consol (ctl-alt-chift-F[1..6] the screen
>won't change out of graphics mode - it goes black like it's trying
>to switch but comes back with the graphical screen which isn't
> responsive and hitting alt-F7 restores it to operation. I just
> rebooted to a kernel that doesn't have the RT-preempt patch but
> uses the same .config and everything for switching between X and
> virtual terminals works just fine.

Its working ok here, but not with those keystrokes. I just did it 
several times.  Its ctl+alt+Fn here, and always has been.

What I did see on VT#1, where the boinc stuff was being spit out 
before I logged in and did a startx, is that I have less then a 
screenfull of history available, and unlike previous kernels, I'm 
getting a very verbose running trail, almost like an strace output, 
of all the kde/kmail activities going on being output to VT#1.  VT#2 
seems normal and I was able to log into it just fine before hitting 
ctl+alt+F7 to come back to X.  Weird to say the least.

But this brings up the question re how do I enlarge the scrollback 
memory of an init-run-level=3 VT?

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-27 19:54                                         ` Ingo Molnar
@ 2005-06-27 21:17                                           ` Gene Heskett
  2005-06-28  8:28                                             ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Gene Heskett @ 2005-06-27 21:17 UTC (permalink / raw)
  To: linux-kernel
  Cc: Ingo Molnar, William Weston, K.R. Foley, Eugeny S. Mints, Daniel Walker

On Monday 27 June 2005 15:54, Ingo Molnar wrote:
>* Gene Heskett <gene.heskett@verizon.net> wrote:
>> On Monday 27 June 2005 04:17, Ingo Molnar wrote:
>> >* Gene Heskett <gene.heskett@verizon.net> wrote:
>> >> In the FWIW category, I booted 50-23 about an hour & a half
>> >> ago, same mode 3, no hardirq's, everything seems to be working
>> >> fine except for kmails total lack of threading causeing
>> >> composer hangs while a mail fetch/spamassassin run is in
>> >> progress.  But thats not anything new to this patchset, its an
>> >> equal opportunity annoyer.
>> >
>> >does the patch below make the kmail starvation go away?
>>
>> I put in the comment and its building now.  I rather doubt its
>> going to make a huge diff though as its probably the single most
>> repeated bitch on the kmail lists, and has been for a long, very
>> long as in years, time.  From hints dropped here and there, it
>> might finally be fixed with kde-3.5.  But we'll give this a shot
>> nontheless.  I'll add more after I reboot to test.
>
>ah, ok - so kmail behaves similarly on vanilla kernels too? 

Yeaup...

>I 
> thought this might be some -RT-specific degradation.
>
> Ingo

As I just posted in another thread, with this boot I am now getting a 
huge amount of almost strace like detail being output to VT1 from 
kde's/kmails activities.  VT1 being the console I did the startx 
from.  Could this be related to commenting out that line in sched.c?

Sorta new subject next.

Getting all that detail being output to VT1, is there any way I can 
enlarge the VT's scrollback memory buffer?  It's only about 2kb, 
maybe less, less than 2 full screens full.  I'm used to haveing about 
a 10 meg scrollback buffer available for traceing purposes in an x 
console.  I'd appreciate the same length of scrollback for the VT's.

-- 
Cheers, Gene
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
99.35% setiathome rank, not too shabby for a WV hillbilly
Yahoo.com and AOL/TW attorneys please note, additions to the above
message by Gene Heskett are:
Copyright 2005 by Maurice Eugene Heskett, all rights reserved.

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-27 20:28                                       ` Chuck Harding
@ 2005-06-28  0:50                                         ` Daniel Walker
  0 siblings, 0 replies; 139+ messages in thread
From: Daniel Walker @ 2005-06-28  0:50 UTC (permalink / raw)
  To: Chuck Harding; +Cc: Linux Kernel Discussion List, mingo

On Mon, 2005-06-27 at 13:28 -0700, Chuck Harding wrote:
> On Mon, 27 Jun 2005, Daniel Walker wrote:
> 
> > If you have PREEMPT_RT enabled, it looks like interrupts are hard
> > disabled then there is a schedule_timeout() requested. You could try
> > turning off power management and see if you still have problems.
> >
> > Daniel
> >
> 
> Well, putting apm=off in the kernel command line did the trick. I am
> using a desktop system so apm really isn't needed. Time to change my
> standard config file..... Thanks.

Did it solve everything , including the virtual terminal switching, and
the scheduling with irqs disabled ?

Daniel


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-27  8:15                                     ` Ingo Molnar
@ 2005-06-28  3:32                                       ` William Weston
  2005-06-28  8:10                                         ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: William Weston @ 2005-06-28  3:32 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

On Mon, 27 Jun 2005, Ingo Molnar wrote:

> > I still haven't been able to get any NMI watchdog traces with the 
> > lockups induced by VLC and burnP6.  Early printk is enabled on the 
> > serial console. I have noticed, however, that scheduling performance 
> > slowly degrades during the ~1 minute before locking up.  Once I was 
> > able to get a delayed SysRq response (~30s) from the serial console 
> > after the X console became unresponsive.  Is this possibly a scheduler 
> > starvation issue that affects everything, including the NMI watchdog?  
> > Any more suggestions for catching a trace?
> 
> hm. Nothing should starve the NMI watchdog. Only a nasty, complete 
> kernel crash or a hardware failure can lock up the box in a way that not 
> even the NMI watchdog can get some message out to the console. Just in 
> case, could you try the latest patch (-50-24 or later), there were a 
> couple of bugs fixed.

OK.  Running on -50-25 now.  The burnP6 starvation doesn't seem to affect
the whole system, but comes close enough to require the reset button every
time.  I usually, but not always, lose network, X, the keyboard, mouse,
and serial console.  I'm still unable to get any sort of a trace from
these lockups, since it's looking more like a bunch of processes starving 
than a kernel crash or a full lockup.

Once, with VLC (viewing a 5mbit/s mcast/udp stream) and two burnP6
instances running, I was able to fire up top on the serial console and
found out that the IRQ thread for the ns83820 nic was using 99% of one
CPU.

Once, two burnP6 instances made the system unresponsive without running 
VLC.  Everything froze as soon as I fired the second one up.  This may be 
a good one to try to reproduce on an HT machine, since it doesn't require 
VLC and a multicast video stream to make the system unresponsive.

Once, with a normal desktop load and a yum update, this came across on the 
serial console:

cat/2100[CPU#1]: BUG in update_out_trace at kernel/latency.c:587
 [<c01041b3>] dump_stack+0x23/0x30 (20)
 [<c0122e0b>] __WARN_ON+0x6b/0x90 (52)
 [<c0140530>] update_out_trace+0x3d0/0x440 (104)
 [<c0140881>] l_stax2e1/0x310 (72)
 [<c0191eab>] seq_read+0x7b/0x2d0 (60)
 [<c016ecd4>] vfs_read+0xd4/0x140 (36)
 [<c016efb0>] sys_read+0x50/0x80 (44)
 [<c01031c0>] sysenter_past_esp+0x61/0x89 (-8116)
---------------------------
| preempt count: 00000002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c038dd9f>] .... _raw_spin_lock_irqsave+0x1f/0xb0
.....[<c0122dc7>] ..   ( <= __WARN_ON+0x27/0x90)
.. [<c014280d>] .... print_traces+0x1d/0x60
.....[<c01040b2>] ..   ( <= show_trace+0xc2/0xf0)

------------------------------
| showing all locks held by: |  (cat/2100 [deca9320, 117]):
------------------------------

#001:             [d9ac47a4] {(struct semaphore *)(&p->sem)}
... acquired at:  seq_read+0x2b/0x2d0

#002:             [c03fb264] {out_mutex.lock}
... acquired at:  l_start+0x1b/0x310

#003:             [c04d1404] {max_mutex.lock}
... acquired at:  l_start+0x2dc/0x310

CPU0: 000000abfe71626e (000000abfe71654e) ... #3 (000000abfe71654e) 000000abfe7176be
CPU1: 000000abfe6d3f0e (000000abfe6d4efe) ... #41 (000000abfe70fa46) 000000abfe71227e
CPU1 entries: 41
first stamp: 000000abfe71626e
 last stamp: 000000abfe71626e
cat/2101[CPU#1]: BUG in update_out_trace at kernel/latency.c:587
 [<c01041b3>] dump_stack+0x23/0x30 (20)
 [<c0122e0b>] __WARN_ON+0x6b/0x90 (52)
 [<c0140530>] update_out_trace+0x3d0/0x440 (104)
 [<c0140881>] l_start+0x2e1/0x310 (72)
 [<c0191eab>] seq_read+0x7b/0x2d0 (60)
 [<c016ecd4>] vfs_read+0xd4/0x140 (36)
 [<c016efb0>] sys_read+0x50/0x80 (44)
 [<c01031c0>] sysenter_past_esp+0x61/0x89 (-8116)
---------------------------
| preempt count: 00000002 ]
| 2-level deep critical section nesting:
----------------------------------------
.. [<c038dd9f>] .... _raw_spin_lock_irqsave+0x1f/0xb0
.....[<c0122dc7>] ..   ( <= __WARN_ON+0x27/0x90)
.. [<c014280d>] .... print_traces+0x1d/0x60
.....[<c01040b2>] ..   ( <= show_trace+0xc2/0xf0)

------------------------------
| showing all locks held by: |  (cat/2101 [deca9320, 116]):
------------------------------

#001:             [d9ac47a4] {(struct semaphore *)(&p->sem)}
... acquired at:  seq_read+0x2b/0x2d0

#002:             [c04d1404] {max_mutex.lock}
... acquired at:  l_start+0x2dc/0x310

CPU0: 000000abfe71626e (000000abfe71654e) ... #3 (00000071654e) 000000abfe7176be
CPU1: 000000abfe6d3f0e (000000abfe6d4efe) ... #41 (000000abfe70fa46) 000000abfe71227e
CPU1 entries: 41
first stamp: 000000abfe71626e
 last stamp: 000000abfe71626e


Best Regards,
--ww


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-27 20:09                                     ` Daniel Walker
  2005-06-27 20:28                                       ` Chuck Harding
@ 2005-06-28  7:53                                       ` Steven Rostedt
  2005-06-28  8:18                                         ` Ingo Molnar
  2005-06-28 15:54                                         ` Daniel Walker
  1 sibling, 2 replies; 139+ messages in thread
From: Steven Rostedt @ 2005-06-28  7:53 UTC (permalink / raw)
  To: Daniel Walker; +Cc: Chuck Harding, Ingo Molnar, Linux Kernel Discussion List


[Please CC Ingo Molnar on all RT kernel issues]

On Mon, 27 Jun 2005, Daniel Walker wrote:

> On Mon, 2005-06-27 at 12:01 -0700, Chuck Harding wrote:
> > What can be causing the following message to appear in dmesg and
> > how can I fix it?
> >
> > BUG: scheduling with irqs disabled: kapmd/0x00000000/46
> > caller is schedule_timeout+0x51/0x9e
> >   [<c02b3bc9>] schedule+0x96/0xf6 (8)
> >   [<c02b43f7>] schedule_timeout+0x51/0x9e (28)
> >   [<c01222ed>] process_timeout+0x0/0x5 (32)
> >   [<c0112063>] apm_mainloop+0x7a/0x96 (24)
> >   [<c0115e45>] default_wake_function+0x0/0x16 (12)
> >   [<c0115e45>] default_wake_function+0x0/0x16 (32)
> >   [<c0111485>] apm_driver_version+0x1c/0x38 (16)
> >   [<c01126f7>] apm+0x0/0x289 (8)
> >   [<c01127a6>] apm+0xaf/0x289 (8)
> >   [<c010133c>] kernel_thread_helper+0x0/0xb (20)
> >   [<c0101341>] kernel_thread_helper+0x5/0xb (4)
> >
> > This was also present in earlier final-V0.7.50 version I've tried
> > (since -00) I don't get hangs but that doesn't look like it should
> > be happening. Thanks.
>
> If you have PREEMPT_RT enabled, it looks like interrupts are hard
> disabled then there is a schedule_timeout() requested. You could try
> turning off power management and see if you still have problems.
>

Although turning off apm works, this is a fix to the symptom and not a
cure.  Has someone already taken a look at this code? Since
apm_bios_call_simple calls local_save_flags and afterwards
raw_lock_irq_restore is then called.  Shouldn't that have been
raw_local_save_flags?

That apm_bios_call_simple_asm also looks pretty scary!  I haven't yet
figured out how APM_FUNC_VERSION becomes a normal function.

-- Steve


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-28  3:32                                       ` William Weston
@ 2005-06-28  8:10                                         ` Ingo Molnar
  2005-06-28 11:15                                           ` Ingo Molnar
       [not found]                                           ` <Pine.LNX.4.58.0506281745040.10406@echo.lysdexia.org>
  0 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-28  8:10 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

[-- Attachment #1: Type: text/plain, Size: 2688 bytes --]


* William Weston <weston@sysex.net> wrote:

> OK.  Running on -50-25 now.  The burnP6 starvation doesn't seem to 
> affect the whole system, but comes close enough to require the reset 
> button every time.  I usually, but not always, lose network, X, the 
> keyboard, mouse, and serial console.  I'm still unable to get any sort 
> of a trace from these lockups, since it's looking more like a bunch of 
> processes starving than a kernel crash or a full lockup.
> 
> Once, with VLC (viewing a 5mbit/s mcast/udp stream) and two burnP6 
> instances running, I was able to fire up top on the serial console and 
> found out that the IRQ thread for the ns83820 nic was using 99% of one 
> CPU.

aha! that's an important clue. It seems you've got a screaming interrupt 
or some other loop in ns83820 irq handling. Could you do this:

	chrt -o 0 -p `pidof 'IRQ 18'`

(assuming your ns83820 device is still on IRQ18) To check the command 
was effective, enter the following command:

	chrt -o -p `pidof 'IRQ 18'`

and you should see output like:

	pid 748's current scheduling policy: SCHED_OTHER
	pid 748's current scheduling priority: 0

i.e. the thread is not SCHED_FIFO anymore.

this will not fix the ns83820 problem for you, but will make it more 
debuggable - you will still probably lose networking, but keyboard and 
the local console should work fine. You should see a 99% CPU-time 
looping ns83820 IRQ thread when the condition triggers. To debug the 
condition further, could you do something like:

	vmstat 1

what kind of interrupt rate ('in' field) does it report? If it's very 
high then it's a screaming interrupt, if it's low then the IRQ thread is 
looping for some other reason. (but both would be bugs of the -RT 
kernel.)

also, could you try to get a trace of what the IRQ thread is doing. I've 
attached trace-it.c, just run it as root (on a LATENCY_TRACING-enabled 
-RT kernel) to get a finegrained trace of what's going on in the system. 
Whenever the thread-spinning occurs, just run this utility:

	trace-it > trace.txt

and you should get a couple of milliseconds worth of system activity.  
The trace output should look like a really long latency-trace. (The 
latency traces usually compress really well with bzip2 -9, so you can 
attach it to public replies too, if compressed - that way others can 
have a look too.)

> Once, with a normal desktop load and a yum update, this came across on 
> the serial console:
> 
> cat/2100[CPU#1]: BUG in update_out_trace at kernel/latency.c:587

on SMP this could occur if the TSCs of different CPUs are too apart from 
each other. I'll probably put an automatic check for this into the 
/proc/latency_trace code.

	Ingo

[-- Attachment #2: trace-it.c --]
[-- Type: text/plain, Size: 1183 bytes --]


/*
 * Copyright (C) 1999, Ingo Molnar <mingo@redhat.com>
 */

#include <unistd.h>
#include <stdio.h>
#include <stdlib.h>
#include <signal.h>
#include <sys/wait.h>
#include <linux/unistd.h>

int main (int argc, char **argv)
{
	int ret;

	if (getuid() != 0) {
		fprintf(stderr, "needs to run as root.\n");
		exit(1);
	}
	ret = system("cat /proc/sys/kernel/mcount_enabled >/dev/null 2>/dev/null");
	if (ret) {
		fprintf(stderr, "CONFIG_LATENCY_TRACING not enabled?\n");
		exit(1);
	}
	system("echo 1 > /proc/sys/kernel/trace_all_cpus");
	system("echo 1 > /proc/sys/kernel/trace_enabled");
	system("echo 0 > /proc/sys/kernel/trace_freerunning");
	system("echo 0 > /proc/sys/kernel/trace_print_at_crash");
	system("echo 1 > /proc/sys/kernel/trace_user_triggered");
	system("echo 0 > /proc/sys/kernel/trace_verbose");
	system("echo 0 > /proc/sys/kernel/preempt_max_latency");
	system("echo 0 > /proc/sys/kernel/preempt_thresh");
	system("[ -e /proc/sys/kernel/wakeup_timing ] && echo 0 > /proc/sys/kernel/wakeup_timing");
	system("echo 1 > /proc/sys/kernel/mcount_enabled");

	gettimeofday(0, 1);
	usleep(100000);
	gettimeofday(0, 0);

	system("cat /proc/latency_trace");

	return 0;
}



[-- Attachment #3: trace-it --]
[-- Type: application/octet-stream, Size: 6183 bytes --]

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28  7:53                                       ` Steven Rostedt
@ 2005-06-28  8:18                                         ` Ingo Molnar
  2005-06-28  8:34                                           ` Steven Rostedt
  2005-06-28  9:12                                           ` Ingo Molnar
  2005-06-28 15:54                                         ` Daniel Walker
  1 sibling, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-28  8:18 UTC (permalink / raw)
  To: Steven Rostedt; +Cc: Daniel Walker, Chuck Harding, Linux Kernel Discussion List


* Steven Rostedt <rostedt@goodmis.org> wrote:

> Although turning off apm works, this is a fix to the symptom and not a 
> cure.  Has someone already taken a look at this code? Since 
> apm_bios_call_simple calls local_save_flags and afterwards 
> raw_lock_irq_restore is then called.  Shouldn't that have been 
> raw_local_save_flags?

ah, indeed. I fixed this bug and have uploaded the -50-26 patch. Chuck, 
does this fix the APM problems for you?

> That apm_bios_call_simple_asm also looks pretty scary!  I haven't yet 
> figured out how APM_FUNC_VERSION becomes a normal function.

it's all black magic, so when hacking that code i always close my eyes.  
(that's how the bug got introduced)

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-27 21:17                                           ` Gene Heskett
@ 2005-06-28  8:28                                             ` Ingo Molnar
  0 siblings, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-28  8:28 UTC (permalink / raw)
  To: Gene Heskett
  Cc: linux-kernel, William Weston, K.R. Foley, Eugeny S. Mints, Daniel Walker


* Gene Heskett <gene.heskett@verizon.net> wrote:

> >I 
> > thought this might be some -RT-specific degradation.
> >
> > Ingo
> 
> As I just posted in another thread, with this boot I am now getting a 
> huge amount of almost strace like detail being output to VT1 from 
> kde's/kmails activities.  VT1 being the console I did the startx from.  
> Could this be related to commenting out that line in sched.c?

yeah, could be - could you try with it reverted again?

> Getting all that detail being output to VT1, is there any way I can 
> enlarge the VT's scrollback memory buffer?  It's only about 2kb, maybe 
> less, less than 2 full screens full.  I'm used to haveing about a 10 
> meg scrollback buffer available for traceing purposes in an x console.  
> I'd appreciate the same length of scrollback for the VT's.

no idea. In gnome-terminal if you edit the current profile there's a 
scrollback item with # of lines of scrollback you can save.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28  8:18                                         ` Ingo Molnar
@ 2005-06-28  8:34                                           ` Steven Rostedt
  2005-06-28  9:12                                           ` Ingo Molnar
  1 sibling, 0 replies; 139+ messages in thread
From: Steven Rostedt @ 2005-06-28  8:34 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Daniel Walker, Chuck Harding, Linux Kernel Discussion List



On Tue, 28 Jun 2005, Ingo Molnar wrote:

> ah, indeed. I fixed this bug and have uploaded the -50-26 patch. Chuck,
> does this fix the APM problems for you?

The question is where the call to schedule happened. If it was between
the local_save_flags and irq_restore, then I believe the interrupts are
off and the schedule can take place.  But if it was afterwards, then this
is probably the fix since the irqrestore probably didn't restore it.

I guess we need to wait for Chuck to answer this.

-- Steve

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28  8:18                                         ` Ingo Molnar
  2005-06-28  8:34                                           ` Steven Rostedt
@ 2005-06-28  9:12                                           ` Ingo Molnar
  2005-06-28 15:26                                             ` Michal Schmidt
  2005-06-28 22:16                                             ` Chuck Harding
  1 sibling, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-28  9:12 UTC (permalink / raw)
  To: Steven Rostedt; +Cc: Daniel Walker, Chuck Harding, Linux Kernel Discussion List


* Ingo Molnar <mingo@elte.hu> wrote:

> * Steven Rostedt <rostedt@goodmis.org> wrote:
> 
> > Although turning off apm works, this is a fix to the symptom and not a 
> > cure.  Has someone already taken a look at this code? Since 
> > apm_bios_call_simple calls local_save_flags and afterwards 
> > raw_lock_irq_restore is then called.  Shouldn't that have been 
> > raw_local_save_flags?
> 
> ah, indeed. I fixed this bug and have uploaded the -50-26 patch. 
> Chuck, does this fix the APM problems for you?

i've also uploaded -50-27 in which i've improved the irq-flags debugging 
code. They are activated if CONFIG_DEBUG_PREEMPT is enabled, and can 
come in two variants of kernel messages:

 BUG: bad raw irq-flag value 80000000, test/3810!
 BUG: bad soft irq-flag value 00000202, test/3810!

so we should now be able to detect mismatches of irq flags right where 
they occur.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-28  8:10                                         ` Ingo Molnar
@ 2005-06-28 11:15                                           ` Ingo Molnar
       [not found]                                           ` <Pine.LNX.4.58.0506281745040.10406@echo.lysdexia.org>
  1 sibling, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-28 11:15 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* Ingo Molnar <mingo@elte.hu> wrote:

> > Once, with VLC (viewing a 5mbit/s mcast/udp stream) and two burnP6 
> > instances running, I was able to fire up top on the serial console and 
> > found out that the IRQ thread for the ns83820 nic was using 99% of one 
> > CPU.
> 
> aha! that's an important clue. It seems you've got a screaming interrupt 
> or some other loop in ns83820 irq handling. [...]

i just found and fixed a bug in -RT that could cause screaming 
interrupts. Could you try the -50-28 (or any later) kernel, does it fix 
the problem?

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28  9:12                                           ` Ingo Molnar
@ 2005-06-28 15:26                                             ` Michal Schmidt
  2005-06-28 15:31                                               ` Ingo Molnar
  2005-06-28 22:16                                             ` Chuck Harding
  1 sibling, 1 reply; 139+ messages in thread
From: Michal Schmidt @ 2005-06-28 15:26 UTC (permalink / raw)
  To: Ingo Molnar
  Cc: Steven Rostedt, Daniel Walker, Chuck Harding,
	Linux Kernel Discussion List

[-- Attachment #1: Type: text/plain, Size: 212 bytes --]

Ingo Molnar wrote:
> i've also uploaded -50-27 in which i've improved the irq-flags debugging 
> code.

Hi Ingo,
check_raw_flags needs to be exported. The attached one-line patch is 
against -V0.7.50-29.

Michal

[-- Attachment #2: rt-check_raw_flags-export.diff --]
[-- Type: text/plain, Size: 301 bytes --]

--- linux-RT.mich/kernel/rt.c.orig	2005-06-28 17:20:18.000000000 +0200
+++ linux-RT.mich/kernel/rt.c	2005-06-28 17:14:19.000000000 +0200
@@ -2088,6 +2088,7 @@ void check_raw_flags(unsigned long flags
 		}
 	}
 }
+EXPORT_SYMBOL(check_raw_flags);
 
 static void check_soft_flags(unsigned long flags)
 {

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28 15:26                                             ` Michal Schmidt
@ 2005-06-28 15:31                                               ` Ingo Molnar
  2005-06-28 18:50                                                 ` Chuck Harding
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-28 15:31 UTC (permalink / raw)
  To: Michal Schmidt
  Cc: Steven Rostedt, Daniel Walker, Chuck Harding,
	Linux Kernel Discussion List


* Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:

> Ingo Molnar wrote:
> >i've also uploaded -50-27 in which i've improved the irq-flags debugging 
> >code.
> 
> Hi Ingo,
> check_raw_flags needs to be exported. The attached one-line patch is 
> against -V0.7.50-29.

thanks, i've uploaded the -30 patch with your fix included.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28  7:53                                       ` Steven Rostedt
  2005-06-28  8:18                                         ` Ingo Molnar
@ 2005-06-28 15:54                                         ` Daniel Walker
  1 sibling, 0 replies; 139+ messages in thread
From: Daniel Walker @ 2005-06-28 15:54 UTC (permalink / raw)
  To: Steven Rostedt; +Cc: Chuck Harding, Ingo Molnar, Linux Kernel Discussion List



On Tue, 28 Jun 2005, Steven Rostedt wrote:

> 
> [Please CC Ingo Molnar on all RT kernel issues]
> 
> On Mon, 27 Jun 2005, Daniel Walker wrote:
> 
> > On Mon, 2005-06-27 at 12:01 -0700, Chuck Harding wrote:
> > > What can be causing the following message to appear in dmesg and
> > > how can I fix it?
> > >
> > > BUG: scheduling with irqs disabled: kapmd/0x00000000/46
> > > caller is schedule_timeout+0x51/0x9e
> > >   [<c02b3bc9>] schedule+0x96/0xf6 (8)
> > >   [<c02b43f7>] schedule_timeout+0x51/0x9e (28)
> > >   [<c01222ed>] process_timeout+0x0/0x5 (32)
> > >   [<c0112063>] apm_mainloop+0x7a/0x96 (24)
> > >   [<c0115e45>] default_wake_function+0x0/0x16 (12)
> > >   [<c0115e45>] default_wake_function+0x0/0x16 (32)
> > >   [<c0111485>] apm_driver_version+0x1c/0x38 (16)
> > >   [<c01126f7>] apm+0x0/0x289 (8)
> > >   [<c01127a6>] apm+0xaf/0x289 (8)
> > >   [<c010133c>] kernel_thread_helper+0x0/0xb (20)
> > >   [<c0101341>] kernel_thread_helper+0x5/0xb (4)
> > >
> > > This was also present in earlier final-V0.7.50 version I've tried
> > > (since -00) I don't get hangs but that doesn't look like it should
> > > be happening. Thanks.
> >
> > If you have PREEMPT_RT enabled, it looks like interrupts are hard
> > disabled then there is a schedule_timeout() requested. You could try
> > turning off power management and see if you still have problems.
> >
> 
> Although turning off apm works, this is a fix to the symptom and not a
> cure.  Has someone already taken a look at this code? Since
> apm_bios_call_simple calls local_save_flags and afterwards
> raw_lock_irq_restore is then called.  Shouldn't that have been
> raw_local_save_flags?
> 
> That apm_bios_call_simple_asm also looks pretty scary!  I haven't yet
> figured out how APM_FUNC_VERSION becomes a normal function.


I looked at them briefly.. It looks like there is some raw and non-raw
mixed usage .

Daniel


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28 15:31                                               ` Ingo Molnar
@ 2005-06-28 18:50                                                 ` Chuck Harding
  0 siblings, 0 replies; 139+ messages in thread
From: Chuck Harding @ 2005-06-28 18:50 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Linux Kernel Discussion List

On Tue, 28 Jun 2005, Ingo Molnar wrote:

>
> * Michal Schmidt <xschmi00@stud.feec.vutbr.cz> wrote:
>
>> Ingo Molnar wrote:
>>> i've also uploaded -50-27 in which i've improved the irq-flags debugging
>>> code.
>>
>> Hi Ingo,
>> check_raw_flags needs to be exported. The attached one-line patch is
>> against -V0.7.50-29.
>
> thanks, i've uploaded the -30 patch with your fix included.
>
> 	Ingo

It's working fine now - switching back and forth between graphical mode
and text console (which works with or with out the shift key B-)  and no
more flooding of BUG: scheduling with irqsw disabled in dmesg. I did
notice that 50-24 kernal was hard locked up when I came in this morning.
SysRq-B would not reboot it and pinging from another machine said it
was down. I went ahead and booted up another kernel and saw the message
about 50-30 so I built that and that is what I am running on now. I really
like using it because X works much better at rendering the screen and
screen animations are really smooth. (this is on a 2GHz P4 with 1Gb RAM)

-- 
Charles D. (Chuck) Harding <charding@llnl.gov>  Voice: 925-423-8879
Senior Computer Associate         ICCD            Fax: 925-423-6961
Lawrence Livermore National Laboratory      Computation Directorate
Livermore, CA USA  http://www.llnl.gov  GPG Public Key ID: B9EB6601
------------------ http://tinyurl.com/5w5ey -----------------------
-- Oxymoron: Spending Cuts. --

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28  9:12                                           ` Ingo Molnar
  2005-06-28 15:26                                             ` Michal Schmidt
@ 2005-06-28 22:16                                             ` Chuck Harding
  2005-06-29  0:32                                               ` Chuck Harding
  1 sibling, 1 reply; 139+ messages in thread
From: Chuck Harding @ 2005-06-28 22:16 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Linux Kernel Discussion List

On Tue, 28 Jun 2005, Ingo Molnar wrote:

>
> * Ingo Molnar <mingo@elte.hu> wrote:
>
>> * Steven Rostedt <rostedt@goodmis.org> wrote:
>>
>>> Although turning off apm works, this is a fix to the symptom and not a
>>> cure.  Has someone already taken a look at this code? Since
>>> apm_bios_call_simple calls local_save_flags and afterwards
>>> raw_lock_irq_restore is then called.  Shouldn't that have been
>>> raw_local_save_flags?
>>
>> ah, indeed. I fixed this bug and have uploaded the -50-26 patch.
>> Chuck, does this fix the APM problems for you?
>
> i've also uploaded -50-27 in which i've improved the irq-flags debugging
> code. They are activated if CONFIG_DEBUG_PREEMPT is enabled, and can
> come in two variants of kernel messages:
>
> BUG: bad raw irq-flag value 80000000, test/3810!
> BUG: bad soft irq-flag value 00000202, test/3810!
>
> so we should now be able to detect mismatches of irq flags right where
> they occur.
>
> 	Ingo

Ack!! I didn't have that enabled so I am rebuilding again. One thing I've
noticed is that sox seems to be hanging when it is trying to play a .wav
file (for system beeps) and there aren't any error messages about what
might be going on.

-- 
Charles D. (Chuck) Harding <charding@llnl.gov>  Voice: 925-423-8879
Senior Computer Associate         ICCD            Fax: 925-423-6961
Lawrence Livermore National Laboratory      Computation Directorate
Livermore, CA USA  http://www.llnl.gov  GPG Public Key ID: B9EB6601
------------------ http://tinyurl.com/5w5ey -----------------------
-- If I knew what I was doing...I'd be dangerous... --

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24
  2005-06-28 22:16                                             ` Chuck Harding
@ 2005-06-29  0:32                                               ` Chuck Harding
  0 siblings, 0 replies; 139+ messages in thread
From: Chuck Harding @ 2005-06-29  0:32 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Linux Kernel Discussion List

On Tue, 28 Jun 2005, Chuck Harding wrote:

> On Tue, 28 Jun 2005, Ingo Molnar wrote:
>
>> 
>> * Ingo Molnar <mingo@elte.hu> wrote:
>> 
>>> * Steven Rostedt <rostedt@goodmis.org> wrote:
>>> 
>>>> Although turning off apm works, this is a fix to the symptom and not a
>>>> cure.  Has someone already taken a look at this code? Since
>>>> apm_bios_call_simple calls local_save_flags and afterwards
>>>> raw_lock_irq_restore is then called.  Shouldn't that have been
>>>> raw_local_save_flags?
>>> 
>>> ah, indeed. I fixed this bug and have uploaded the -50-26 patch.
>>> Chuck, does this fix the APM problems for you?
>> 
>> i've also uploaded -50-27 in which i've improved the irq-flags debugging
>> code. They are activated if CONFIG_DEBUG_PREEMPT is enabled, and can
>> come in two variants of kernel messages:
>> 
>> BUG: bad raw irq-flag value 80000000, test/3810!
>> BUG: bad soft irq-flag value 00000202, test/3810!
>> 
>> so we should now be able to detect mismatches of irq flags right where
>> they occur.
>>
>> 	Ingo
>
> Ack!! I didn't have that enabled so I am rebuilding again. One thing I've
> noticed is that sox seems to be hanging when it is trying to play a .wav
> file (for system beeps) and there aren't any error messages about what
> might be going on.
>
>

More info - sox is locked up so tight that no kill can stop it. I'm not
seeing any of the BUG messages either even though I enabled 
CONFIG_DEBUG_PREEMPT.

-- 
Charles D. (Chuck) Harding <charding@llnl.gov>  Voice: 925-423-8879
Senior Computer Associate         ICCD            Fax: 925-423-6961
Lawrence Livermore National Laboratory      Computation Directorate
Livermore, CA USA  http://www.llnl.gov  GPG Public Key ID: B9EB6601
------------------ http://tinyurl.com/5w5ey -----------------------
-- LISP: To call a spade a thpade. --

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
       [not found]                                           ` <Pine.LNX.4.58.0506281745040.10406@echo.lysdexia.org>
@ 2005-06-29 12:54                                             ` Ingo Molnar
  2005-06-30  0:29                                               ` William Weston
  0 siblings, 1 reply; 139+ messages in thread
From: Ingo Molnar @ 2005-06-29 12:54 UTC (permalink / raw)
  To: William Weston; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker


* William Weston <weston@sysex.net> wrote:

> I got a trace with VLC and one burnP6 instance running.  The second 
> included trace was started in the background immediately before firing 
> up a second burnP6, but I'm not sure it covers any of the time that 
> the second burnP6 was running.

there doesnt seem to be too much of an interrupt related problem:

   $ grep 'do_IRQ (' trace-it.2.txt
   <...>-18659 0Dnh.  228us : do_IRQ (80480d2 0 0)
   <...>-18659 0Dnh. 1228us : do_IRQ (80480d6 0 0)
   <...>-18659 0Dnh. 2232us : do_IRQ (80480d6 0 0)
   <...>-18659 0Dnh. 3229us : do_IRQ (80480c4 0 0)
   <...>-18659 0Dnh. 4227us : do_IRQ (80480e8 0 0)
   <...>-18659 0Dnh. 5227us : do_IRQ (80480df 0 0)
   <...>-18659 0Dnh. 6226us : do_IRQ (80480e8 0 0)
   <...>-18659 0Dnh. 7226us : do_IRQ (80480df 0 0)
   <...>-18659 0Dnh. 8225us : do_IRQ (80480c4 0 0)
   <...>-18659 0Dnh. 9231us : do_IRQ (80480e3 0 0)
   <...>-18659 0Dnh. 10225us : do_IRQ (80480e8 0 0)

you are getting a timer interrupt (IRQ 0) every 1000 usecs, as expected.

i'd suggest to capture trace-it traces only during a clearly identified 
anomalous event such as an interrupt storm. For latency analysis 
purposes the default latency traces are better.

> > on SMP this could occur if the TSCs of different CPUs are too apart from 
> > each other. I'll probably put an automatic check for this into the 
> > /proc/latency_trace code.
> 
> Yup.  Got another one of these.

was this on a -29 or later kernel? (-29 had a couple of latency.c fixes)

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-29 12:54                                             ` Ingo Molnar
@ 2005-06-30  0:29                                               ` William Weston
  0 siblings, 0 replies; 139+ messages in thread
From: William Weston @ 2005-06-30  0:29 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: K.R. Foley, linux-kernel, Eugeny S. Mints, Daniel Walker

On Wed, 29 Jun 2005, Ingo Molnar wrote:

> > I got a trace with VLC and one burnP6 instance running.  The second 
> > included trace was started in the background immediately before firing 
> > up a second burnP6, but I'm not sure it covers any of the time that 
> > the second burnP6 was running.
> 
> there doesnt seem to be too much of an interrupt related problem:
> 
>    $ grep 'do_IRQ (' trace-it.2.txt
>    <...>-18659 0Dnh.  228us : do_IRQ (80480d2 0 0)
>    <...>-18659 0Dnh. 1228us : do_IRQ (80480d6 0 0)
>    <...>-18659 0Dnh. 2232us : do_IRQ (80480d6 0 0)
>    <...>-18659 0Dnh. 3229us : do_IRQ (80480c4 0 0)
>    <...>-18659 0Dnh. 4227us : do_IRQ (80480e8 0 0)
>    <...>-18659 0Dnh. 5227us : do_IRQ (80480df 0 0)
>    <...>-18659 0Dnh. 6226us : do_IRQ (80480e8 0 0)
>    <...>-18659 0Dnh. 7226us : do_IRQ (80480df 0 0)
>    <...>-18659 0Dnh. 8225us : do_IRQ (80480c4 0 0)
>    <...>-18659 0Dnh. 9231us : do_IRQ (80480e3 0 0)
>    <...>-18659 0Dnh. 10225us : do_IRQ (80480e8 0 0)
> 
> you are getting a timer interrupt (IRQ 0) every 1000 usecs, as expected.
> 
> i'd suggest to capture trace-it traces only during a clearly identified 
> anomalous event such as an interrupt storm. For latency analysis 
> purposes the default latency traces are better.
> 
> > > on SMP this could occur if the TSCs of different CPUs are too apart from 
> > > each other. I'll probably put an automatic check for this into the 
> > > /proc/latency_trace code.
> > 
> > Yup.  Got another one of these.
> 
> was this on a -29 or later kernel? (-29 had a couple of latency.c fixes)

This one was on -50-30.

--ww

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-12  9:29 Zoltan Boszormenyi
@ 2005-06-12 10:39 ` Ingo Molnar
  0 siblings, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-12 10:39 UTC (permalink / raw)
  To: Zoltan Boszormenyi; +Cc: linux-kernel


* Zoltan Boszormenyi <zboszor@freemail.hu> wrote:

> >does -48-13 work any better?
> >
> >	Ingo
> 
> x86-64 needs the attached patch to compile.

(patch MIA)

> Some drivers also fail to compile because of
> SPIN_LOCK_UNLOCKED changes, e.g. softdog and
> four files under net/atm. [...]

i'll fix those up.

> A question, though: why do you comment out the DMPS timer in 
> drivers/char/vt.c? Does it cause any problems? I applied the -RT tree 
> after the multiconsole patch and I had to modify those four chunks 
> manually.

this is a quick hack. The timer code is fully preemptible, but for 
debugging one wants to have a working printk from hardirq contexts too.  
I.e. the mod_timer()/del_timer() would print warnings on PREEMPT_RT. 
We'll need some other approach to solve this cleanly.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
@ 2005-06-12  9:29 Zoltan Boszormenyi
  2005-06-12 10:39 ` Ingo Molnar
  0 siblings, 1 reply; 139+ messages in thread
From: Zoltan Boszormenyi @ 2005-06-12  9:29 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: linux-kernel

[-- Attachment #1: Type: text/plain, Size: 536 bytes --]

> does -48-13 work any better?
> 
> 	Ingo

x86-64 needs the attached patch to compile.
Some drivers also fail to compile because of
SPIN_LOCK_UNLOCKED changes, e.g. softdog and
four files under net/atm. Just take the x86-64 UP
config from FC3's latest errata kernel.
I haven't booted it yet.

A question, though: why do you comment out the
DMPS timer in drivers/char/vt.c?
Does it cause any problems? I applied the -RT tree
after the multiconsole patch and I had to modify
those four chunks manually.

Best regards,
Zoltán Böszörményi


[-- Attachment #2: 01-x86_64-INIT_FILES-fix.patch --]
[-- Type: text/x-patch, Size: 542 bytes --]

--- arch/x86_64/kernel/init_task.c.old	2005-06-12 10:51:21.716609376 +0200
+++ arch/x86_64/kernel/init_task.c	2005-06-12 10:51:33.889758776 +0200
@@ -11,7 +11,7 @@
 #include <asm/desc.h>
 
 static struct fs_struct init_fs = INIT_FS;
-static struct files_struct init_files = INIT_FILES;
+static struct files_struct init_files = INIT_FILES(init_files);
 static struct signal_struct init_signals = INIT_SIGNALS(init_signals);
 static struct sighand_struct init_sighand = INIT_SIGHAND(init_sighand);
 struct mm_struct init_mm = INIT_MM(init_mm);

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 17:29     ` Daniel Walker
@ 2005-06-08 19:24       ` Ingo Molnar
  0 siblings, 0 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-08 19:24 UTC (permalink / raw)
  To: Daniel Walker; +Cc: kus Kusche Klaus, linux-kernel, Thomas Gleixner


* Daniel Walker <dwalker@mvista.com> wrote:

> > Thomas and me already did that - i think Thomas could send a patch for 
> > review?
> 
> Well, making it is one thing, getting Russell to accept it is a whole 
> other issue.. Are you still willing to make the RT patch a sandbox for 
> this?

the patch in essence generalizes the ARM IRQ features and merges them 
into the generic IRQ code - with minimal impact to the current ARM way 
of doing interrupts. The long-term end-result should be more 
architectures using the ARM IRQ handling methods such as irqchip.

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 15:50   ` Ingo Molnar
  2005-06-08 16:23     ` Thomas Gleixner
@ 2005-06-08 17:29     ` Daniel Walker
  2005-06-08 19:24       ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Daniel Walker @ 2005-06-08 17:29 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: kus Kusche Klaus, linux-kernel, Thomas Gleixner



On Wed, 8 Jun 2005, Ingo Molnar wrote:

> 
> * Daniel Walker <dwalker@mvista.com> wrote:
> 
> > > > i have released the -V0.7.48-00 Real-Time Preemption patch, 
> > > [snip]
> > > > be affected that much (besides possible build issues). Non-x86 arches
> > > > wont build. Some regressions might happen, so take care..
> > > 
> > > What arches are likely to work in the near future?
> > > I've seen that "Kconfig.RT" is sourced for i386, x86_64, ppc, 
> > > and mips, but not for arm.
> > > 
> > > arm is one of the platforms we are interested in, any chances?
> > 
> > I can make it work, but Ingo isn't accepting non-generic IRQ arches .. 
> > So it's pretty much on hold until someone bring ARM into the generic 
> > IRQ world.
> 
> Thomas and me already did that - i think Thomas could send a patch for 
> review?


Well, making it is one thing, getting Russell to accept it is a whole
other issue.. Are you still willing to make the RT patch a sandbox for
this?


Daniel


^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 15:50   ` Ingo Molnar
@ 2005-06-08 16:23     ` Thomas Gleixner
  2005-06-08 17:29     ` Daniel Walker
  1 sibling, 0 replies; 139+ messages in thread
From: Thomas Gleixner @ 2005-06-08 16:23 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Daniel Walker, kus Kusche Klaus, linux-kernel

On Wed, 2005-06-08 at 17:50 +0200, Ingo Molnar wrote:
> > So it's pretty much on hold until someone bring ARM into the generic 
> > IRQ world.
> 
> Thomas and me already did that - i think Thomas could send a patch for 
> review?

I have to bring it forward to -rc6. 

tglx



^ permalink raw reply	[flat|nested] 139+ messages in thread

* Re: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 15:49 ` Daniel Walker
@ 2005-06-08 15:50   ` Ingo Molnar
  2005-06-08 16:23     ` Thomas Gleixner
  2005-06-08 17:29     ` Daniel Walker
  0 siblings, 2 replies; 139+ messages in thread
From: Ingo Molnar @ 2005-06-08 15:50 UTC (permalink / raw)
  To: Daniel Walker; +Cc: kus Kusche Klaus, linux-kernel, Thomas Gleixner


* Daniel Walker <dwalker@mvista.com> wrote:

> > > i have released the -V0.7.48-00 Real-Time Preemption patch, 
> > [snip]
> > > be affected that much (besides possible build issues). Non-x86 arches
> > > wont build. Some regressions might happen, so take care..
> > 
> > What arches are likely to work in the near future?
> > I've seen that "Kconfig.RT" is sourced for i386, x86_64, ppc, 
> > and mips, but not for arm.
> > 
> > arm is one of the platforms we are interested in, any chances?
> 
> I can make it work, but Ingo isn't accepting non-generic IRQ arches .. 
> So it's pretty much on hold until someone bring ARM into the generic 
> IRQ world.

Thomas and me already did that - i think Thomas could send a patch for 
review?

	Ingo

^ permalink raw reply	[flat|nested] 139+ messages in thread

* RE: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 14:02 kus Kusche Klaus
  2005-06-08 14:14 ` Thomas Gleixner
@ 2005-06-08 15:49 ` Daniel Walker
  2005-06-08 15:50   ` Ingo Molnar
  1 sibling, 1 reply; 139+ messages in thread
From: Daniel Walker @ 2005-06-08 15:49 UTC (permalink / raw)
  To: kus Kusche Klaus; +Cc: Ingo Molnar, linux-kernel



On Wed, 8 Jun 2005, kus Kusche Klaus wrote:

> > i have released the -V0.7.48-00 Real-Time Preemption patch, 
> [snip]
> > be affected that much (besides possible build issues). Non-x86 arches
> > wont build. Some regressions might happen, so take care..
> 
> What arches are likely to work in the near future?
> I've seen that "Kconfig.RT" is sourced for i386, x86_64, ppc, 
> and mips, but not for arm.
> 
> arm is one of the platforms we are interested in, any chances?

I can make it work, but Ingo isn't accepting non-generic IRQ arches .. So
it's pretty much on hold until someone bring ARM into the generic IRQ
world.

Daniel


^ permalink raw reply	[flat|nested] 139+ messages in thread

* RE: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
  2005-06-08 14:02 kus Kusche Klaus
@ 2005-06-08 14:14 ` Thomas Gleixner
  2005-06-08 15:49 ` Daniel Walker
  1 sibling, 0 replies; 139+ messages in thread
From: Thomas Gleixner @ 2005-06-08 14:14 UTC (permalink / raw)
  To: kus Kusche Klaus; +Cc: Ingo Molnar, Daniel Walker, linux-kernel

On Wed, 2005-06-08 at 16:02 +0200, kus Kusche Klaus wrote:
> > i have released the -V0.7.48-00 Real-Time Preemption patch, 
> [snip]
> > be affected that much (besides possible build issues). Non-x86 arches
> > wont build. Some regressions might happen, so take care..
> 
> What arches are likely to work in the near future?
> I've seen that "Kconfig.RT" is sourced for i386, x86_64, ppc, 
> and mips, but not for arm.
> 
> arm is one of the platforms we are interested in, any chances?

We have a working version for ARM based on a primary patch which
integrates ARM into the generic irq handling

tglx




^ permalink raw reply	[flat|nested] 139+ messages in thread

* RE: [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00
@ 2005-06-08 14:02 kus Kusche Klaus
  2005-06-08 14:14 ` Thomas Gleixner
  2005-06-08 15:49 ` Daniel Walker
  0 siblings, 2 replies; 139+ messages in thread
From: kus Kusche Klaus @ 2005-06-08 14:02 UTC (permalink / raw)
  To: Ingo Molnar; +Cc: Daniel Walker, linux-kernel

> i have released the -V0.7.48-00 Real-Time Preemption patch, 
[snip]
> be affected that much (besides possible build issues). Non-x86 arches
> wont build. Some regressions might happen, so take care..

What arches are likely to work in the near future?
I've seen that "Kconfig.RT" is sourced for i386, x86_64, ppc, 
and mips, but not for arm.

arm is one of the platforms we are interested in, any chances?

-- 
Klaus Kusche                 (Software Development - Control Systems)
KEBA AG             Gewerbepark Urfahr, A-4041 Linz, Austria (Europe)
Tel: +43 / 732 / 7090-3120                 Fax: +43 / 732 / 7090-6301
E-Mail: kus@keba.com                                WWW: www.keba.com

^ permalink raw reply	[flat|nested] 139+ messages in thread

end of thread, other threads:[~2005-06-30  0:31 UTC | newest]

Thread overview: 139+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2005-06-08 11:28 [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
2005-06-08 14:18 ` Michal Schmidt
2005-06-08 14:40   ` Keith Owens
2005-06-08 14:41   ` Paulo Marques
2005-06-08 15:04     ` Michal Schmidt
2005-06-08 15:23       ` Keith Owens
2005-06-08 15:56         ` Paulo Marques
2005-06-08 14:32 ` Michal Schmidt
2005-06-08 15:48 ` K.R. Foley
2005-06-08 16:08   ` K.R. Foley
2005-06-08 16:26     ` K.R. Foley
2005-06-08 17:26   ` K.R. Foley
2005-06-08 19:18     ` Ingo Molnar
2005-06-09 11:39       ` Ingo Molnar
2005-06-10 13:34         ` K.R. Foley
2005-06-09  8:47     ` Serge Noiraud
2005-06-09 11:55       ` Ingo Molnar
2005-06-09 15:12         ` Serge Noiraud
2005-06-09 16:34           ` Daniel Walker
2005-06-13  8:53             ` Serge Noiraud
2005-06-13  9:07               ` Ingo Molnar
2005-06-08 17:51 ` Michal Schmidt
2005-06-09 11:45   ` Ingo Molnar
2005-06-09 12:09     ` Michal Schmidt
2005-06-09 12:13       ` Ingo Molnar
2005-06-09 12:48         ` Michal Schmidt
2005-06-10  8:56         ` Esben Nielsen
2005-06-08 19:58 ` Daniel Walker
2005-06-09 21:24 ` Michal Schmidt
2005-06-09 21:34   ` Michal Schmidt
2005-06-11  7:32   ` Ingo Molnar
2005-06-11  8:10     ` Ingo Molnar
2005-06-11 16:35 ` Peter Zijlstra
2005-06-11 18:48   ` Ingo Molnar
2005-06-11 21:14     ` Peter Zijlstra
2005-06-12  1:40     ` Gene Heskett
2005-06-12  6:49       ` Ingo Molnar
2005-06-12  9:02         ` Gene Heskett
2005-06-12 10:35           ` Ingo Molnar
2005-06-12 13:40             ` Gene Heskett
2005-06-12 13:49               ` Ingo Molnar
2005-06-12 14:23                 ` Gene Heskett
2005-06-13  2:11                 ` Gene Heskett
2005-06-13  6:09                   ` Ingo Molnar
2005-06-13  8:37                     ` Gene Heskett
2005-06-14 18:24 ` K.R. Foley
2005-06-14 18:54   ` Ingo Molnar
2005-06-14 22:45     ` Daniel Walker
2005-06-15  6:12       ` Ingo Molnar
2005-06-15  9:13         ` Esben Nielsen
2005-06-14 20:37 ` Paul E. McKenney
2005-06-16  3:51 ` K.R. Foley
2005-06-16  7:29   ` Ingo Molnar
2005-06-16 11:22     ` K.R. Foley
2005-06-16 17:32       ` Ingo Molnar
2005-06-16 17:59         ` K.R. Foley
2005-06-16 20:37           ` K.R. Foley
2005-06-17 11:08             ` Ingo Molnar
2005-06-16 20:43           ` Ingo Molnar
2005-06-17  2:06             ` Gene Heskett
2005-06-17  4:53             ` Gene Heskett
2005-06-17 11:18             ` Ingo Molnar
2005-06-17 14:12               ` K.R. Foley
2005-06-17 15:33               ` K.R. Foley
2005-06-17 19:28         ` William Weston
2005-06-17 21:30           ` William Weston
2005-06-18 12:28             ` Ingo Molnar
2005-06-21  1:18               ` William Weston
2005-06-23  2:05               ` William Weston
2005-06-23  7:56                 ` Ingo Molnar
2005-06-23 13:45                   ` Gene Heskett
2005-06-21 13:10           ` Ingo Molnar
2005-06-21 19:08             ` William Weston
2005-06-21 20:17             ` Benjamin LaHaise
2005-06-21 20:37               ` William Weston
2005-06-21 20:48                 ` Benjamin LaHaise
2005-06-22  2:42               ` Gene Heskett
2005-06-22  7:40                 ` Ingo Molnar
2005-06-22 13:27                   ` Gene Heskett
2005-06-22 13:51                     ` Gene Heskett
2005-06-22 14:08                       ` Gene Heskett
2005-06-25  4:41                     ` Ingo Molnar
2005-06-25  4:47                       ` Ingo Molnar
2005-06-25  5:39                         ` Gene Heskett
2005-06-25  7:26                           ` Gene Heskett
2005-06-25  9:12                             ` Ingo Molnar
2005-06-25 13:19                               ` Gene Heskett
2005-06-25 14:39                                 ` Gene Heskett
2005-06-27 19:01                                   ` Real-Time Preemption, -RT-2.6.12-final-V0.7.50-24 Chuck Harding
2005-06-27 19:42                                     ` Chuck Harding
2005-06-27 21:08                                       ` Gene Heskett
2005-06-27 20:09                                     ` Daniel Walker
2005-06-27 20:28                                       ` Chuck Harding
2005-06-28  0:50                                         ` Daniel Walker
2005-06-28  7:53                                       ` Steven Rostedt
2005-06-28  8:18                                         ` Ingo Molnar
2005-06-28  8:34                                           ` Steven Rostedt
2005-06-28  9:12                                           ` Ingo Molnar
2005-06-28 15:26                                             ` Michal Schmidt
2005-06-28 15:31                                               ` Ingo Molnar
2005-06-28 18:50                                                 ` Chuck Harding
2005-06-28 22:16                                             ` Chuck Harding
2005-06-29  0:32                                               ` Chuck Harding
2005-06-28 15:54                                         ` Daniel Walker
2005-06-21 13:12           ` [patch] Real-Time Preemption, -RT-2.6.12-rc6-V0.7.48-00 Ingo Molnar
     [not found]             ` <Pine.LNX.4.58.0506211228210.16701@echo.lysdexia.org>
2005-06-22  8:03               ` Ingo Molnar
2005-06-22  8:24               ` Ingo Molnar
2005-06-22 10:08                 ` Ingo Molnar
2005-06-22 21:53                 ` William Weston
2005-06-22 22:00                   ` Ingo Molnar
2005-06-22 23:06                     ` William Weston
2005-06-23  0:10                       ` Ingo Molnar
2005-06-23 22:11                         ` William Weston
2005-06-24  1:46                           ` William Weston
2005-06-24  7:06                             ` Ingo Molnar
2005-06-24 22:31                               ` William Weston
2005-06-25  4:14                                 ` Ingo Molnar
2005-06-27  4:21                                   ` William Weston
2005-06-27  8:15                                     ` Ingo Molnar
2005-06-28  3:32                                       ` William Weston
2005-06-28  8:10                                         ` Ingo Molnar
2005-06-28 11:15                                           ` Ingo Molnar
     [not found]                                           ` <Pine.LNX.4.58.0506281745040.10406@echo.lysdexia.org>
2005-06-29 12:54                                             ` Ingo Molnar
2005-06-30  0:29                                               ` William Weston
2005-06-27  5:43                                   ` Gene Heskett
2005-06-27  8:17                                     ` Ingo Molnar
2005-06-27 17:29                                       ` Gene Heskett
2005-06-27 19:54                                         ` Ingo Molnar
2005-06-27 21:17                                           ` Gene Heskett
2005-06-28  8:28                                             ` Ingo Molnar
2005-06-08 14:02 kus Kusche Klaus
2005-06-08 14:14 ` Thomas Gleixner
2005-06-08 15:49 ` Daniel Walker
2005-06-08 15:50   ` Ingo Molnar
2005-06-08 16:23     ` Thomas Gleixner
2005-06-08 17:29     ` Daniel Walker
2005-06-08 19:24       ` Ingo Molnar
2005-06-12  9:29 Zoltan Boszormenyi
2005-06-12 10:39 ` Ingo Molnar

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).