* fs: avoid softlockups in s_inodes iterators commit
@ 2021-03-16 20:56 David Mozes
2021-03-17 1:28 ` Eric Sandeen
0 siblings, 1 reply; 7+ messages in thread
From: David Mozes @ 2021-03-16 20:56 UTC (permalink / raw)
To: linux-fsdevel; +Cc: sandeen
[-- Attachment #1: Type: text/plain, Size: 2267 bytes --]
Hi,
Per Eric's request, I forward this discussion to the list first.
My first answers are inside
-----Original Message-----
From: Eric Sandeen <sandeen@redhat.com>
Sent: Tuesday, March 16, 2021 10:18 PM
To: David Mozes <david.mozes@silk.us>
Subject: Re: Mail from David.Mozes regarding fs: avoid softlockups in s_inodes iterators commit
On 3/16/21 3:02 PM, David Mozes wrote:
> Hi Eric,
>
> I hope you are all well.
>
> I am writing to you since I think you are interested in this case.
>
This really should go to linux-fsdevel@vger.kernel.org but feel free to cc: me
A few things you'd want to clarify first, though.
What is the testcase?
David> it can be consider as very high load read/write iscsi traffic based on SCST application.
> [122656.730235] sh (27931): drop_caches: 3
When/why are you running drop_caches in the first place?
David > Not sure yet, Will check.
> 5.4.8 vanilla kernel it custom
Is it vanilla, or is it custom? 5.4.8 or 5.4.80?
David> 5.4.80 small custom as I mantion.
> While looking at the code, I suspected on thecond_resched(); in
> /fs/drop_caches.c file. that you moved on commit
> 04646aebd30b99f2cfa0182435a2ec252fcb16d0
>
> I comment out the cond_resched(), and everything is running just fine for ten days.
I moved it; that shouldn't matter. You removed it - that will change behavior.
What happens if you just move it back? i.e. my patch did:
diff --git a/fs/drop_caches.c b/fs/drop_caches.c index d31b6c72b476..dc1a1d5d825b 100644
--- a/fs/drop_caches.c
+++ b/fs/drop_caches.c
@@ -35,11 +35,11 @@ static void drop_pagecache_sb(struct super_block *sb, void *unused)
spin_unlock(&inode->i_lock);
spin_unlock(&sb->s_inode_list_lock);
- cond_resched();
invalidate_mapping_pages(inode->i_mapping, 0, -1);
iput(toput_inode);
toput_inode = inode;
+ cond_resched();
spin_lock(&sb->s_inode_list_lock);
}
spin_unlock(&sb->s_inode_list_lock);
What happens if you don't delete the cond_resched, but move it back up above invalidate_mapping_pages?
David> Will test and update
Thx
David
-Eric
[-- Attachment #2: ATT52578.config --]
[-- Type: application/octet-stream, Size: 94881 bytes --]
#
# Automatically generated file; DO NOT EDIT.
# Linux/x86 4.19.81 Kernel Configuration
#
CONFIG_IP6_NF_MATCH_AH=m
CONFIG_NLS_CODEPAGE_861=m
CONFIG_RING_BUFFER=y
CONFIG_HARDENED_USERCOPY_FALLBACK=y
CONFIG_NF_CONNTRACK_H323=m
CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
CONFIG_IP6_NF_SECURITY=m
CONFIG_VFIO_PCI_MMAP=y
CONFIG_SCSI_DMA=y
CONFIG_NETFILTER_FAMILY_BRIDGE=y
CONFIG_INTEL_IDLE=y
CONFIG_TCP_MD5SIG=y
CONFIG_HID_GT683R=m
CONFIG_MICROCODE=y
CONFIG_IP_SET_HASH_IPMARK=m
CONFIG_TOUCHSCREEN_INEXIO=m
CONFIG_RTLBTCOEXIST=m
CONFIG_NFT_NAT=m
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_INPUT_KEYBOARD=y
CONFIG_SENSORS_ABITUGURU=m
CONFIG_ARCH_SUPPORTS_INT128=y
CONFIG_IP_NF_TARGET_SYNPROXY=m
CONFIG_MEMORY_ISOLATION=y
CONFIG_SLUB_CPU_PARTIAL=y
CONFIG_RFS_ACCEL=y
CONFIG_SERIAL_8250_RT288X=y
CONFIG_IP_NF_TARGET_REDIRECT=m
CONFIG_SERIO_ALTERA_PS2=m
CONFIG_DRM_GMA500=m
CONFIG_ARCH_WANTS_THP_SWAP=y
CONFIG_CRC32=y
CONFIG_I2C_BOARDINFO=y
CONFIG_DMI_SYSFS=y
CONFIG_XEN_PV=y
CONFIG_USB_ALI_M5632=y
CONFIG_DM_SNAPSHOT=y
CONFIG_PNFS_FLEXFILE_LAYOUT=m
CONFIG_X86_MCE=y
CONFIG_SIGNED_PE_FILE_VERIFICATION=y
CONFIG_DRM_NOUVEAU=m
CONFIG_FSCACHE=m
CONFIG_PARPORT_NOT_PC=y
CONFIG_NETFILTER_XT_MATCH_CPU=m
CONFIG_B43_BCMA_PIO=y
CONFIG_MOUSE_ELAN_I2C=m
CONFIG_SENSORS_MAX1668=m
CONFIG_SUNRPC_SWAP=y
CONFIG_FB_TILEBLITTING=y
CONFIG_TCM_QLA2XXX=m
CONFIG_KEY_DH_OPERATIONS=y
CONFIG_IXGBE_DCB=y
CONFIG_CPU_FREQ_GOV_CONSERVATIVE=y
CONFIG_SECCOMP=y
CONFIG_HIGH_RES_TIMERS=y
CONFIG_ARCH_HAS_SET_MEMORY=y
CONFIG_DRM_AMD_DC=y
CONFIG_BLK_DEV_DM=y
CONFIG_RT2800USB_RT3573=y
CONFIG_VLAN_8021Q=m
CONFIG_IP_MULTIPLE_TABLES=y
CONFIG_MTRR_SANITIZER_SPARE_REG_NR_DEFAULT=1
CONFIG_VFIO_PCI_VGA=y
CONFIG_ACPI_BGRT=y
CONFIG_SENSORS_LTC4260=m
CONFIG_CRYPTO_KEYWRAP=m
CONFIG_XEN_DOM0=y
CONFIG_FIRMWARE_MEMMAP=y
CONFIG_SSB_SDIOHOST=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_LEDS_TRIGGER_HEARTBEAT=m
CONFIG_INTEL_PUNIT_IPC=m
CONFIG_ND_PFN=m
CONFIG_SCSI_INITIO=m
CONFIG_XZ_DEC_IA64=y
CONFIG_TOUCHSCREEN_ELAN=m
CONFIG_JOYSTICK_ADI=m
CONFIG_INOTIFY_USER=y
CONFIG_WDAT_WDT=m
CONFIG_SECURITY_NETWORK_XFRM=y
CONFIG_NF_CONNTRACK_NETBIOS_NS=m
CONFIG_HDMI=y
CONFIG_SCSI_DH=y
CONFIG_SCSI_LOGGING=y
CONFIG_BRIDGE_EBT_T_FILTER=m
CONFIG_NETWORK_FILESYSTEMS=y
CONFIG_IRQ_POLL=y
CONFIG_JOYSTICK_IFORCE_232=y
CONFIG_CRYPTO_FIPS=y
CONFIG_KVM_INTEL=m
CONFIG_ASUS_LAPTOP=m
CONFIG_CRYPTO_MD4=m
CONFIG_BCMA_HOST_PCI=y
CONFIG_SATA_AHCI_PLATFORM=m
CONFIG_THERMAL_GOV_BANG_BANG=y
CONFIG_X86_MINIMUM_CPU_FAMILY=64
CONFIG_SCSI_BFA_FC=m
CONFIG_CPU_FREQ_GOV_ONDEMAND=y
CONFIG_KDB_DEFAULT_ENABLE=0x0
CONFIG_SENSORS_LM95245=m
CONFIG_AMD_PHY=m
CONFIG_CHASH=m
CONFIG_GLOB=y
CONFIG_PLX_HERMES=m
CONFIG_CGROUP_DEVICE=y
CONFIG_WL12XX=m
CONFIG_X86_TSC=y
CONFIG_PPP_SYNC_TTY=m
CONFIG_ARCH_SUSPEND_POSSIBLE=y
CONFIG_HID_PLANTRONICS=m
CONFIG_COMPAT_NETLINK_MESSAGES=y
CONFIG_INLINE_WRITE_UNLOCK_IRQ=y
CONFIG_CGROUP_WRITEBACK=y
CONFIG_MAC80211_STA_HASH_MAX_SIZE=0
CONFIG_NLS_MAC_TURKISH=m
CONFIG_IP_VS_NQ=m
CONFIG_INFINIBAND_QEDR=m
CONFIG_SENSORS_LTC4245=m
CONFIG_HAVE_ARCH_MMAP_RND_BITS=y
CONFIG_TCG_TIS_CORE=m
CONFIG_HID_SPEEDLINK=m
CONFIG_HIBERNATION=y
CONFIG_BLK_DEV_NBD=m
CONFIG_PNPACPI=y
CONFIG_USB_SERIAL_NAVMAN=m
CONFIG_CPU_FREQ_GOV_ATTR_SET=y
CONFIG_RMI4_F12=y
CONFIG_JOYSTICK_SPACEORB=m
CONFIG_ACPI_TAD=m
CONFIG_EDAC_I5400=m
CONFIG_TCP_CONG_HTCP=m
CONFIG_EXT4_FS_POSIX_ACL=y
CONFIG_SCSI_DEBUG=m
CONFIG_NET_SWITCHDEV=y
CONFIG_PHYLINK=m
CONFIG_DRM_I915=m
CONFIG_BINFMT_MISC=m
CONFIG_SENSORS_AD7314=m
CONFIG_NETFILTER_XT_MATCH_HELPER=m
CONFIG_SSB_POSSIBLE=y
CONFIG_NFS_V4_2=y
CONFIG_BRIDGE_EBT_T_NAT=m
CONFIG_NF_NAT_SIP=m
CONFIG_SENSORS_W83792D=m
CONFIG_SENSORS_INA3221=m
CONFIG_MMU_NOTIFIER=y
CONFIG_ASYMMETRIC_KEY_TYPE=y
CONFIG_VFIO_VIRQFD=m
CONFIG_VHOST_VSOCK=m
CONFIG_TRANSPARENT_HUGEPAGE_MADVISE=y
CONFIG_DRM_RADEON=m
CONFIG_NETFILTER_XT_MATCH_STATISTIC=m
CONFIG_TERANETICS_PHY=m
CONFIG_NLS_CODEPAGE_855=m
CONFIG_SECURITY_YAMA=y
CONFIG_I2C_ISMT=m
CONFIG_UHID=m
CONFIG_NETCONSOLE_DYNAMIC=y
CONFIG_EDAC_I5100=m
CONFIG_IP_NF_NAT=m
CONFIG_USB_SERIAL_EDGEPORT_TI=m
CONFIG_B43LEGACY_LEDS=y
CONFIG_USB_SERIAL_SAFE=m
CONFIG_BRIDGE_NF_EBTABLES=m
CONFIG_HARDLOCKUP_DETECTOR_PERF=y
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
CONFIG_NET_SCH_FIFO=y
CONFIG_SWPHY=y
CONFIG_THP_SWAP=y
CONFIG_SATA_NV=m
CONFIG_FSNOTIFY=y
CONFIG_ACPI_CONFIGFS=m
CONFIG_CRYPTO_RMD128=m
CONFIG_BLK_DEV_LOOP_MIN_COUNT=0
CONFIG_STP=m
CONFIG_INET6_TUNNEL=m
CONFIG_INTEL_RAPL=m
CONFIG_SCSI_DC395x=m
CONFIG_NF_CONNTRACK_SIP=m
CONFIG_STACK_TRACER=y
CONFIG_DMA_VIRT_OPS=y
CONFIG_HIDRAW=y
CONFIG_NET_SCH_FQ_CODEL=y
CONFIG_WIL6210_ISR_COR=y
CONFIG_SENSORS_ADM1025=m
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_RT2X00_LIB_LEDS=y
CONFIG_ARCH_HAS_FILTER_PGPROT=y
CONFIG_RTL8XXXU_UNTESTED=y
CONFIG_NET_PTP_CLASSIFY=y
CONFIG_UNIX_DIAG=m
CONFIG_IP_VS_SED=m
CONFIG_GENERIC_SMP_IDLE_THREAD=y
CONFIG_MOUSE_CYAPA=m
CONFIG_SQUASHFS_FILE_CACHE=y
CONFIG_ARCH_SUPPORTS_NUMA_BALANCING=y
CONFIG_DM_FLAKEY=m
CONFIG_HAVE_COPY_THREAD_TLS=y
CONFIG_PATA_OPTIDMA=m
CONFIG_DYNAMIC_DEBUG=y
CONFIG_MACVTAP=m
CONFIG_CHELSIO_T4VF=m
CONFIG_HAVE_MEMORY_PRESENT=y
CONFIG_USB_SERIAL_FTDI_SIO=m
CONFIG_BRIDGE_EBT_REDIRECT=m
CONFIG_XEN_COMPAT_XENFS=y
CONFIG_XEN_SCSI_BACKEND=m
CONFIG_PSTORE_COMPRESS_DEFAULT="deflate"
CONFIG_8139CP=m
CONFIG_LDISC_AUTOLOAD=y
CONFIG_SERIAL_8250_RSA=y
CONFIG_FIB_RULES=y
CONFIG_HID_ACRUX_FF=y
CONFIG_CRYPTO_CRCT10DIF=y
CONFIG_W1_SLAVE_DS2408=m
CONFIG_RTC_DRV_MCP795=m
CONFIG_IP_VS_NFCT=y
CONFIG_RT_GROUP_SCHED=y
CONFIG_HID_EMS_FF=m
CONFIG_VLAN_8021Q_GVRP=y
CONFIG_IWLWIFI_DEBUGFS=y
CONFIG_IP_SET_HASH_NETIFACE=m
CONFIG_IP6_NF_MANGLE=m
CONFIG_NET_DSA_TAG_DSA=y
CONFIG_SCSI_CONSTANTS=y
CONFIG_HAVE_IRQ_TIME_ACCOUNTING=y
CONFIG_CFAG12864B=m
CONFIG_NETFILTER_XT_MATCH_REALM=m
CONFIG_MEGARAID_NEWGEN=y
CONFIG_INTEL_TXT=y
CONFIG_HID_GFRM=m
CONFIG_SQUASHFS_XATTR=y
CONFIG_ARCH_HAS_DEVMEM_IS_ALLOWED=y
CONFIG_IP_VS_RR=m
CONFIG_IPV6=y
CONFIG_USB_SERIAL_QUALCOMM=m
CONFIG_HAVE_STACKPROTECTOR=y
CONFIG_INFINIBAND_HFI1=m
CONFIG_CRYPTO_AEAD=y
CONFIG_AUDIT_ARCH=y
CONFIG_COMPAT=y
CONFIG_POWERCAP=y
CONFIG_MAGIC_SYSRQ_SERIAL=y
CONFIG_BQL=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_DEFAULT_TCP_CONG="cubic"
CONFIG_USB_UAS=m
CONFIG_NTB_NETDEV=m
CONFIG_DEVTMPFS=y
CONFIG_NET_CLS_FLOW=m
CONFIG_TIGON3_HWMON=y
CONFIG_SENSORS_MAX8688=m
CONFIG_SENSORS_PC87427=m
CONFIG_PNFS_FILE_LAYOUT=m
CONFIG_QED_SRIOV=y
CONFIG_HSU_DMA=y
CONFIG_NET_IPVTI=m
CONFIG_SCSI_PMCRAID=m
CONFIG_USB_STORAGE_USBAT=m
CONFIG_INFINIBAND_USER_MEM=y
CONFIG_APPLE_GMUX=m
CONFIG_NF_NAT_PROTO_GRE=m
CONFIG_SUNRPC_BACKCHANNEL=y
CONFIG_NLS_ISO8859_7=m
CONFIG_CRYPTO_PCBC=m
CONFIG_IP6_NF_TARGET_REJECT=m
CONFIG_ARCH_MMAP_RND_COMPAT_BITS_MAX=16
CONFIG_UPROBES=y
CONFIG_HID_APPLEIR=m
CONFIG_ASYNC_MEMCPY=m
CONFIG_X86_POWERNOW_K8=m
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_NF_NAT_REDIRECT=y
CONFIG_DCDBAS=m
CONFIG_RTC_DRV_DS1305=m
CONFIG_HOTPLUG_CPU=y
CONFIG_USB_SERIAL_MOS7840=m
CONFIG_INET_DIAG_DESTROY=y
CONFIG_NLS_MAC_CYRILLIC=m
CONFIG_USB_SL811_HCD_ISO=y
CONFIG_PM_SLEEP_DEBUG=y
CONFIG_WLAN=y
CONFIG_NAMESPACES=y
CONFIG_W1_SLAVE_DS2423=m
CONFIG_L2TP_DEBUGFS=m
CONFIG_XEN_512GB=y
CONFIG_HAVE_CMPXCHG_DOUBLE=y
CONFIG_RTC_DRV_ABX80X=m
CONFIG_USB_NET_INT51X1=m
CONFIG_INET6_XFRM_MODE_ROUTEOPTIMIZATION=m
CONFIG_KGDB_SERIAL_CONSOLE=y
CONFIG_PATA_ATP867X=m
CONFIG_SFI=y
CONFIG_HAVE_ARCH_HUGE_VMAP=y
CONFIG_FM10K=m
CONFIG_DW_DMAC_PCI=y
CONFIG_IA32_EMULATION=y
CONFIG_FRAMEBUFFER_CONSOLE_DETECT_PRIMARY=y
CONFIG_BLK_DEV_BSG=y
CONFIG_ENIC=m
CONFIG_SCSI_ISCI=m
CONFIG_SENSORS_MAX6697=m
CONFIG_PATA_SERVERWORKS=m
CONFIG_CONNECTOR=y
CONFIG_NETFILTER_XT_TARGET_RATEEST=m
CONFIG_PCIEAER=y
CONFIG_EPIC100=m
CONFIG_SCTP_COOKIE_HMAC_SHA1=y
CONFIG_BRIDGE_EBT_ARPREPLY=m
CONFIG_BACKLIGHT_APPLE=m
CONFIG_B43LEGACY_DMA_AND_PIO_MODE=y
CONFIG_SENSORS_SIS5595=m
CONFIG_CW1200_WLAN_SDIO=m
CONFIG_DM_MULTIPATH_QL=m
CONFIG_LIBERTAS_USB=m
CONFIG_XFRM_IPCOMP=m
CONFIG_CRYPTO_DRBG_MENU=y
CONFIG_CRYPTO_RNG2=y
CONFIG_UIO_CIF=m
CONFIG_FUSION_FC=m
CONFIG_NETFILTER_NETLINK_QUEUE=m
CONFIG_NET_ACT_CSUM=m
CONFIG_THERMAL_WRITABLE_TRIPS=y
CONFIG_SCSI_MPT3SAS=m
CONFIG_NETWORK_PHY_TIMESTAMPING=y
CONFIG_MSDOS_FS=m
CONFIG_FB_VGA16=m
CONFIG_SCSI_FLASHPOINT=y
CONFIG_NET_CLS_CGROUP=y
CONFIG_TUN=m
CONFIG_IP_VS_FO=m
CONFIG_IIO_KFIFO_BUF=m
CONFIG_ENCLOSURE_SERVICES=m
CONFIG_IPV6_PIMSM_V2=y
CONFIG_ARCH_ENABLE_THP_MIGRATION=y
CONFIG_SENSORS_ADS1015=m
CONFIG_WIZNET_BUS_ANY=y
CONFIG_BNX2=m
CONFIG_LEDS_TRIGGER_DISK=y
CONFIG_CFG80211=m
CONFIG_MACSEC=m
CONFIG_CRYPTO_CHACHA20POLY1305=m
CONFIG_SSB_BLOCKIO=y
CONFIG_CRYPTO_DEV_CHELSIO=m
CONFIG_EQUALIZER=m
CONFIG_IP_SET_HASH_NETNET=m
CONFIG_NLS_CODEPAGE_1250=m
CONFIG_VFIO_PCI_IGD=y
CONFIG_DM_CRYPT=m
CONFIG_REED_SOLOMON_ENC8=y
CONFIG_SERIAL_8250=y
CONFIG_RTC_DRV_ISL12022=m
CONFIG_XEN_GNTDEV=m
CONFIG_SENSORS_W83793=m
CONFIG_B43LEGACY_PIO=y
CONFIG_LZO_DECOMPRESS=y
CONFIG_USB_EHCI_ROOT_HUB_TT=y
CONFIG_IP_VS_PROTO_AH=y
CONFIG_IOMMU_SUPPORT=y
CONFIG_HID_BELKIN=m
CONFIG_ROMFS_BACKED_BY_BLOCK=y
CONFIG_VFIO_IOMMU_TYPE1=m
CONFIG_LEDS_TRIGGER_CAMERA=m
CONFIG_NLS_CODEPAGE_862=m
CONFIG_CRAMFS_BLOCKDEV=y
CONFIG_NFSD=m
CONFIG_SENSORS_TSL2550=m
CONFIG_COMPAT_BINFMT_ELF=y
CONFIG_VFIO_PCI=m
CONFIG_PWM_LPSS=m
CONFIG_X86_DIRECT_GBPAGES=y
CONFIG_PATA_MPIIX=m
CONFIG_USB_SERIAL_OPTION=m
CONFIG_HID_ACRUX=m
CONFIG_RD_LZMA=y
CONFIG_CRYPTO_SALSA20=m
CONFIG_USB=y
CONFIG_PATA_SIL680=m
CONFIG_ACPI_IPMI=m
CONFIG_GENERIC_IRQ_DEBUGFS=y
CONFIG_MMC_SDHCI_PCI=m
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ALIM7101_WDT=m
CONFIG_ACPI_PCI_SLOT=y
CONFIG_MODULES_USE_ELF_RELA=y
CONFIG_BTREE=y
CONFIG_CRYPTO_HMAC=y
CONFIG_WLAN_VENDOR_REALTEK=y
CONFIG_ETHERNET=y
CONFIG_PATA_CMD640_PCI=m
CONFIG_NET_SCH_CODEL=m
CONFIG_FRAMEBUFFER_CONSOLE_ROTATION=y
CONFIG_ATH5K_DEBUG=y
CONFIG_USBIP_VHCI_HC_PORTS=8
CONFIG_SCHED_OMIT_FRAME_POINTER=y
CONFIG_HID_LOGITECH_HIDPP=m
CONFIG_CRYPTO_SHA3=m
CONFIG_BRANCH_PROFILE_NONE=y
CONFIG_SCSI_SCAN_ASYNC=y
CONFIG_CRC_ITU_T=m
CONFIG_NET_DROP_MONITOR=y
CONFIG_HAVE_DMA_CONTIGUOUS=y
CONFIG_DQL=y
CONFIG_VXLAN=m
CONFIG_PINCTRL_BROXTON=m
CONFIG_FRAMEBUFFER_CONSOLE=y
CONFIG_PCIEASPM_PERFORMANCE=y
CONFIG_DM_ZERO=y
CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y
CONFIG_TCP_CONG_LP=m
CONFIG_SONY_FF=y
CONFIG_PINCTRL_BAYTRAIL=y
CONFIG_INPUT_GP2A=m
CONFIG_GAMEPORT_EMU10K1=m
CONFIG_SOCK_CGROUP_DATA=y
CONFIG_WL1251_SPI=m
CONFIG_COREDUMP=y
CONFIG_NET_FOU_IP_TUNNELS=y
CONFIG_USB_NET_GL620A=m
CONFIG_B43_SDIO=y
CONFIG_IP_NF_ARPTABLES=m
CONFIG_USB_SERIAL_GENERIC=y
CONFIG_HID_CHERRY=m
CONFIG_ACCESSIBILITY=y
CONFIG_USE_PERCPU_NUMA_NODE_ID=y
CONFIG_HID_SUNPLUS=m
CONFIG_DRM_VMWGFX_FBCON=y
CONFIG_KSZ884X_PCI=m
CONFIG_HID_PICOLCD=m
CONFIG_BCMA_POSSIBLE=y
CONFIG_NF_LOG_IPV4=m
CONFIG_NET_SCH_SFB=m
CONFIG_FUSION_CTL=m
CONFIG_TULIP=m
CONFIG_CIFS_ACL=y
CONFIG_ZRAM=m
CONFIG_XEN_SELFBALLOONING=y
CONFIG_CRYPTO_CAST5=m
CONFIG_VGA_ARB=y
CONFIG_SENSORS_CORETEMP=m
CONFIG_NET_IPGRE_DEMUX=m
CONFIG_RSI_DEBUGFS=y
CONFIG_NET_POLL_CONTROLLER=y
CONFIG_PRINTK=y
CONFIG_BMC150_ACCEL=m
CONFIG_FORCEDETH=m
CONFIG_TULIP_MMIO=y
CONFIG_ACPI_LPIT=y
CONFIG_FB_SYS_FILLRECT=y
CONFIG_TIMERFD=y
CONFIG_HID_THRUSTMASTER=m
CONFIG_CRYPTO_MCRYPTD=m
CONFIG_SENSORS_MAX16065=m
CONFIG_SENSORS_I5K_AMB=m
CONFIG_DNS_RESOLVER=m
CONFIG_B53_MMAP_DRIVER=m
CONFIG_ITCO_VENDOR_SUPPORT=y
CONFIG_TRACEPOINTS=y
CONFIG_B43_PHY_LP=y
CONFIG_MTD_CFI_I2=y
CONFIG_CRYPTO_AUTHENC=m
CONFIG_AT803X_PHY=m
CONFIG_I6300ESB_WDT=m
CONFIG_W1_MASTER_DS2482=m
CONFIG_JOYSTICK_SIDEWINDER=m
CONFIG_BLK_DEV_SKD=m
CONFIG_NET_EMATCH_STACK=32
CONFIG_CARL9170_LEDS=y
CONFIG_ATL1E=m
CONFIG_USB_STORAGE_ENE_UB6250=m
CONFIG_NLS_MAC_CENTEURO=m
CONFIG_BRCMFMAC_SDIO=y
CONFIG_BOUNCE=y
CONFIG_ARCH_HAS_SYSCALL_WRAPPER=y
CONFIG_RDS_RDMA=m
CONFIG_NUMA_BALANCING=y
CONFIG_I2C_DESIGNWARE_BAYTRAIL=y
CONFIG_THINKPAD_ACPI=m
CONFIG_P54_COMMON=m
CONFIG_COMPAT_32BIT_TIME=y
CONFIG_SHMEM=y
CONFIG_MTD=m
CONFIG_MIGRATION=y
CONFIG_HAVE_ARCH_JUMP_LABEL=y
CONFIG_IWLEGACY_DEBUG=y
CONFIG_BUILD_SALT="n"
CONFIG_MMC_BLOCK_MINORS=8
CONFIG_HID_PRIMAX=m
CONFIG_HAVE_ARCH_PREL32_RELOCATIONS=y
CONFIG_DECOMPRESS_LZMA=y
CONFIG_PCI_IOV=y
CONFIG_WATCHDOG_SYSFS=y
CONFIG_HAVE_KVM_EVENTFD=y
CONFIG_GPIO_VIPERBOARD=m
CONFIG_QED_LL2=y
CONFIG_DEVTMPFS_MOUNT=y
CONFIG_SENSORS_AMC6821=m
CONFIG_USB_IPHETH=m
CONFIG_NLS_CODEPAGE_850=m
CONFIG_DNOTIFY=y
CONFIG_CRYPTO_CTS=m
CONFIG_SUNGEM_PHY=m
CONFIG_EDD=m
CONFIG_JOYSTICK_DB9=m
CONFIG_RTC_DRV_R9701=m
CONFIG_SCSI_UFSHCD=m
CONFIG_INPUT_MOUSEDEV=y
CONFIG_GENERIC_NET_UTILS=y
CONFIG_IPV6_ILA=m
CONFIG_ATA=y
CONFIG_SENSORS_TPS40422=m
CONFIG_CRYPTO_DES=m
CONFIG_ENABLE_MUST_CHECK=y
CONFIG_GPIOLIB_FASTPATH_LIMIT=512
CONFIG_CEPH_LIB=m
CONFIG_ND_BTT=m
CONFIG_NLS_CODEPAGE_437=y
CONFIG_HAVE_ARCH_SOFT_DIRTY=y
CONFIG_HYPERV_KEYBOARD=m
CONFIG_NATSEMI=m
CONFIG_ARCH_PROC_KCORE_TEXT=y
CONFIG_NET_CLS_U32=m
CONFIG_EXPORTFS=y
CONFIG_MTD_UBI_WL_THRESHOLD=4096
CONFIG_MMC_RICOH_MMC=y
CONFIG_HID_SENSOR_HUB=m
CONFIG_TOUCHSCREEN_PENMOUNT=m
CONFIG_IP6_NF_MATCH_MH=m
CONFIG_I2C_SLAVE_EEPROM=m
CONFIG_IP_MROUTE_COMMON=y
CONFIG_NET_INGRESS=y
CONFIG_SCSI_OSD_INITIATOR=m
CONFIG_SCSI_OSD_DPRINT_SENSE=1
CONFIG_MSI_WMI=m
CONFIG_IT87_WDT=m
CONFIG_LRU_CACHE=m
CONFIG_SCSI_CXGB3_ISCSI=m
CONFIG_HAVE_FUNCTION_ERROR_INJECTION=y
CONFIG_SENSORS_MAX1619=m
CONFIG_IPW2200_MONITOR=y
CONFIG_CRYPTO_SHA256_MB=m
CONFIG_OLD_SIGSUSPEND3=y
CONFIG_INFINIBAND_MTHCA_DEBUG=y
CONFIG_SERIO=y
CONFIG_SCHEDSTATS=y
CONFIG_IBMASR=m
CONFIG_INPUT_MOUSE=y
CONFIG_RTLWIFI_PCI=m
CONFIG_INFINIBAND_ISER=m
CONFIG_HOTPLUG_SMT=y
CONFIG_FB_SYS_IMAGEBLIT=y
CONFIG_X86=y
CONFIG_PPS_CLIENT_PARPORT=m
CONFIG_ARCH_HAS_SG_CHAIN=y
CONFIG_SUNRPC_GSS=m
CONFIG_HID_LED=m
CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=y
CONFIG_TYPHOON=m
CONFIG_TIGON3=m
CONFIG_CRYPTO_CAST5_AVX_X86_64=m
CONFIG_SENSORS_LM90=m
CONFIG_NETCONSOLE=m
CONFIG_RTC_INTF_SYSFS=y
CONFIG_MMC_SDHCI_ACPI=m
CONFIG_BCMA_DRIVER_GPIO=y
CONFIG_RTC_DRV_RS5C372=m
CONFIG_QED=m
CONFIG_NET_EMATCH_U32=m
CONFIG_TOUCHSCREEN_TOUCHWIN=m
CONFIG_CPU_FREQ_GOV_COMMON=y
CONFIG_BLK_DEV_INITRD=y
CONFIG_USB_EMI62=m
CONFIG_B43_PHY_N=y
CONFIG_SCSI_IPS=m
CONFIG_ARCH_ENABLE_MEMORY_HOTREMOVE=y
CONFIG_X86_MCE_AMD=y
CONFIG_DM_BUFIO=y
CONFIG_I2C_ALGOPCA=m
CONFIG_LEDS_TRIGGER_TIMER=m
CONFIG_DRM_VIRTIO_GPU=m
CONFIG_RTC_DRV_M48T59=m
CONFIG_RT2800_LIB=m
CONFIG_X86_X2APIC=y
CONFIG_FB_VESA=y
CONFIG_NFS_DEBUG=y
CONFIG_CRYPTO_BLOWFISH_COMMON=m
CONFIG_FUSION_LAN=m
CONFIG_DRM_BOCHS=m
CONFIG_CRYPTO_DRBG_HASH=y
CONFIG_NF_CONNTRACK_SANE=m
CONFIG_CRYPTO_GHASH_CLMUL_NI_INTEL=m
CONFIG_ARCH_CLOCKSOURCE_DATA=y
CONFIG_TOUCHSCREEN_SURFACE3_SPI=m
CONFIG_USB_SERIAL_MOS7720=m
CONFIG_XILLYBUS=m
CONFIG_PREEMPT_NOTIFIERS=y
CONFIG_NET_DSA_TAG_EDSA=y
CONFIG_XEN_PVHVM=y
CONFIG_NF_CT_PROTO_DCCP=y
CONFIG_ZLIB_INFLATE=y
CONFIG_RTC_DRV_V3020=m
CONFIG_SENSORS_SHTC1=m
CONFIG_KVM_ASYNC_PF=y
CONFIG_CRC_T10DIF=y
CONFIG_THERMAL_GOV_FAIR_SHARE=y
CONFIG_ENCRYPTED_KEYS=m
CONFIG_SSB_PCIHOST_POSSIBLE=y
CONFIG_HERMES_PRISM=y
CONFIG_HWMON=y
CONFIG_INTEL_GTT=y
CONFIG_RTC_DRV_PCF85063=m
CONFIG_NET_VENDOR_DLINK=y
CONFIG_CRYPTO_TWOFISH_COMMON=m
CONFIG_AUDITSYSCALL=y
CONFIG_LOGO_LINUX_CLUT224=y
CONFIG_USB_PHY=y
CONFIG_X86_ACPI_CPUFREQ_CPB=y
CONFIG_NLS_ISO8859_2=m
CONFIG_QEDE=m
CONFIG_SENSORS_LM63=m
CONFIG_CRYPTO_CRC32_PCLMUL=m
CONFIG_CLKBLD_I8253=y
CONFIG_RTC_INTF_PROC=y
CONFIG_USB_SERIAL_TI=m
CONFIG_BCMGENET=m
CONFIG_NET_SCH_CBQ=m
CONFIG_PM_CLK=y
CONFIG_ARCH_USE_BUILTIN_BSWAP=y
CONFIG_SENSORS_LTC2990=m
CONFIG_PERF_EVENTS_INTEL_RAPL=m
CONFIG_USB_SERIAL_MOS7715_PARPORT=y
CONFIG_CRYPTO_SERPENT=m
CONFIG_CPU_IDLE_GOV_MENU=y
CONFIG_ARCH_HAS_UBSAN_SANITIZE_ALL=y
CONFIG_SERIAL_8250_LPSS=y
CONFIG_ACPI_FAN=y
CONFIG_MOUSE_PS2_SENTELIC=y
CONFIG_RTC_DRV_RX8010=m
CONFIG_DP83867_PHY=m
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_B44_PCI_AUTOSELECT=y
CONFIG_SENSORS_EMC1403=m
CONFIG_MLXFW=m
CONFIG_RESET_CONTROLLER=y
CONFIG_BNA=m
CONFIG_IP_DCCP_TFRC_LIB=y
CONFIG_OUTPUT_FORMAT="elf64-x86-64"
CONFIG_ACPI=y
CONFIG_SCSI_SYM53C8XX_2=m
CONFIG_SCSI_CXGB4_ISCSI=m
CONFIG_TABLET_USB_PEGASUS=m
CONFIG_SENSORS_SHT15=m
CONFIG_NVRAM=y
CONFIG_LOCKD=m
CONFIG_LEDS_INTEL_SS4200=m
CONFIG_DRM_KMS_FB_HELPER=y
CONFIG_ARCH_MIGHT_HAVE_ACPI_PDC=y
CONFIG_RT2800USB_RT35XX=y
CONFIG_LIBERTAS=m
CONFIG_WLAN_VENDOR_RALINK=y
CONFIG_NTB_PINGPONG=m
CONFIG_CRYPTO_KPP2=y
CONFIG_LATENCYTOP=y
CONFIG_DRM_VMWGFX=m
CONFIG_STE10XP=m
CONFIG_HID_SAITEK=m
CONFIG_CASSINI=m
CONFIG_SCSI_DH_ALUA=m
CONFIG_KEXEC_VERIFY_SIG=y
CONFIG_MTRR=y
CONFIG_LIBFCOE=m
CONFIG_NET_UDP_TUNNEL=m
CONFIG_RPCSEC_GSS_KRB5=m
CONFIG_DEV_PAGEMAP_OPS=y
CONFIG_NLS_MAC_ROMANIAN=m
CONFIG_NET_VENDOR_ADAPTEC=y
CONFIG_CFG80211_REQUIRE_SIGNED_REGDB=y
CONFIG_SENSORS_PCF8591=m
CONFIG_MOUSE_PS2_BYD=y
CONFIG_IPW2200_RADIOTAP=y
CONFIG_SSB_B43_PCI_BRIDGE=y
CONFIG_ACER_WMI=m
CONFIG_USB_AN2720=y
CONFIG_F2FS_STAT_FS=y
CONFIG_SENSORS_UCD9200=m
CONFIG_MIC_COSM=m
CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y
CONFIG_MLX4_DEBUG=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_NETFILTER_XT_MATCH_STRING=m
CONFIG_SSB_DRIVER_PCICORE=y
CONFIG_INPUT_TABLET=y
CONFIG_HID_SENSOR_IIO_TRIGGER=m
CONFIG_MDIO=m
CONFIG_N_HDLC=m
CONFIG_CRYPTO_DRBG_HMAC=y
CONFIG_DRM_BRIDGE=y
CONFIG_HPET_EMULATE_RTC=y
CONFIG_X86_MPPARSE=y
CONFIG_BNXT=m
CONFIG_LOGO=y
CONFIG_NET_VENDOR_SILAN=y
CONFIG_SENSORS_UCD9000=m
CONFIG_KERNEL_XZ=y
CONFIG_DLM=m
CONFIG_SERIAL_ARC=m
CONFIG_DRM_ANALOGIX_ANX78XX=m
CONFIG_NETFILTER_XT_MATCH_BPF=m
CONFIG_TOUCHSCREEN_USB_GOTOP=y
CONFIG_EEEPC_LAPTOP=m
CONFIG_USB_STORAGE=m
CONFIG_NET_VENDOR_BROADCOM=y
CONFIG_GENERIC_CPU_AUTOPROBE=y
CONFIG_STANDALONE=y
CONFIG_CRYPTO_SEED=m
CONFIG_SCHED_MC=y
CONFIG_SCSI_SAS_ATA=y
CONFIG_PCIE_ECRC=y
CONFIG_SECONDARY_TRUSTED_KEYRING=y
CONFIG_DEV_DAX_PMEM=m
CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
CONFIG_GPIO_ICH=m
CONFIG_EFI=y
CONFIG_RATIONAL=y
CONFIG_I2C_MUX=m
CONFIG_NVME_TARGET_LOOP=m
CONFIG_SATA_MV=m
CONFIG_AGP_AMD64=y
CONFIG_WLAN_VENDOR_INTEL=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_DRM_I915_USERPTR=y
CONFIG_SYSTEM_TRUSTED_KEYRING=y
CONFIG_WATCHDOG_CORE=y
CONFIG_USB_SERIAL_SIMPLE=m
CONFIG_GENERIC_EARLY_IOREMAP=y
CONFIG_PCI_XEN=y
CONFIG_PMIC_OPREGION=y
CONFIG_TOUCHSCREEN_EGALAX_SERIAL=m
CONFIG_SENSORS_MAX31790=m
CONFIG_HID_SENSOR_INCLINOMETER_3D=m
CONFIG_SENSORS_FTSTEUTATES=m
CONFIG_TCP_CONG_YEAH=m
CONFIG_SCSI_SYM53C8XX_DMA_ADDRESSING_MODE=1
CONFIG_SCSI_QLA_FC=m
CONFIG_TELCLOCK=m
CONFIG_I40EVF=m
CONFIG_IO_DELAY_TYPE_0XED=1
CONFIG_HAVE_IDE=y
CONFIG_BLOCK=y
CONFIG_IP_VS_LC=m
CONFIG_HID_APPLE=m
CONFIG_CRYPTO_SERPENT_AVX2_X86_64=m
CONFIG_STREAM_PARSER=m
CONFIG_VMXNET3=m
CONFIG_INIT_ENV_ARG_LIMIT=32
CONFIG_IP_NF_ARP_MANGLE=m
CONFIG_P54_LEDS=y
CONFIG_SENSORS_MAX34440=m
CONFIG_SENSORS_G760A=m
CONFIG_RDS=m
CONFIG_PATA_EFAR=m
CONFIG_HOLTEK_FF=y
CONFIG_NOUVEAU_LEGACY_CTX_SUPPORT=y
CONFIG_NET_ACT_IFE=m
CONFIG_ATL2=m
CONFIG_USER_NS=y
CONFIG_ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH=y
CONFIG_CRYPTO_USER=m
CONFIG_NF_CONNTRACK_PPTP=m
CONFIG_CPU_SUP_INTEL=y
CONFIG_TCP_CONG_CDG=m
CONFIG_TMPFS_POSIX_ACL=y
CONFIG_STRICT_KERNEL_RWX=y
CONFIG_SENSORS_ADM9240=m
CONFIG_PROVIDE_OHCI1394_DMA_INIT=y
CONFIG_ACPI_APEI_PCIEAER=y
CONFIG_NETLINK_DIAG=m
CONFIG_BUG=y
CONFIG_KS0108_PORT=0x378
CONFIG_SCSI_AIC7XXX=m
CONFIG_CONTEXT_SWITCH_TRACER=y
CONFIG_MAC80211_HAS_RC=y
CONFIG_KDB_KEYBOARD=y
CONFIG_LOGIWHEELS_FF=y
CONFIG_SENSORS_INA209=m
CONFIG_USB_SL811_HCD=m
CONFIG_OCFS2_FS_O2CB=m
CONFIG_XEN=y
CONFIG_CRYPTO_CAST6=m
CONFIG_IRQ_TIME_ACCOUNTING=y
CONFIG_NET_EMATCH_META=m
CONFIG_SCSI_IPR_DUMP=y
CONFIG_W1_MASTER_DS1WM=m
CONFIG_PANTHERLORD_FF=y
CONFIG_I2C_DIOLAN_U2C=m
CONFIG_ARCH_HAS_MEMBARRIER_SYNC_CORE=y
CONFIG_PM=y
CONFIG_PPS=m
CONFIG_GENERIC_ISA_DMA=y
CONFIG_USB_LCD=m
CONFIG_NET_IFE_SKBPRIO=m
CONFIG_MEMCG=y
CONFIG_SPI=y
CONFIG_SENSORS_DS620=m
CONFIG_HAVE_KVM_CPU_RELAX_INTERCEPT=y
CONFIG_NFT_HASH=m
CONFIG_NF_CONNTRACK_IRC=m
CONFIG_NOUVEAU_DEBUG_DEFAULT=3
CONFIG_PATA_NS87410=m
CONFIG_L2TP_IP=m
CONFIG_NET_FAILOVER=m
CONFIG_PPP_DEFLATE=m
CONFIG_VGA_SWITCHEROO=y
CONFIG_STRIP_ASM_SYMS=y
CONFIG_B53_MDIO_DRIVER=m
CONFIG_IRQ_REMAP=y
CONFIG_TEXTSEARCH_KMP=m
CONFIG_FMC_WRITE_EEPROM=m
CONFIG_W1_SLAVE_SMEM=m
CONFIG_VT=y
CONFIG_USB_NET_NET1080=m
CONFIG_STK3310=m
CONFIG_SENSORS_F71805F=m
CONFIG_SUNRPC_DEBUG=y
CONFIG_NETFILTER_XT_TARGET_CLASSIFY=m
CONFIG_HID_TIVO=m
CONFIG_HID_ICADE=m
CONFIG_PCI_ATS=y
CONFIG_F2FS_FS_SECURITY=y
CONFIG_MACB=m
CONFIG_REGMAP_SPI=y
CONFIG_DMA_ACPI=y
CONFIG_WATCHDOG_HANDLE_BOOT_ENABLED=y
CONFIG_CB710_DEBUG_ASSUMPTIONS=y
CONFIG_SPLIT_PTLOCK_CPUS=4
CONFIG_SBITMAP=y
CONFIG_EDAC_E752X=m
CONFIG_GTP=m
CONFIG_POWER_SUPPLY=y
CONFIG_DM_PERSISTENT_DATA=m
CONFIG_PATA_VIA=m
CONFIG_DAVICOM_PHY=m
CONFIG_SCTP_COOKIE_HMAC_MD5=y
CONFIG_CIFS_XATTR=y
CONFIG_KEXEC_JUMP=y
CONFIG_SENSORS_ADM1275=m
CONFIG_I2C_PCA_PLATFORM=m
CONFIG_NETFILTER_XT_TARGET_NFQUEUE=m
CONFIG_SECURITY_SELINUX_BOOTPARAM=y
CONFIG_ARCH_HAS_UACCESS_FLUSHCACHE=y
CONFIG_HAVE_RCU_TABLE_FREE=y
CONFIG_WEXT_CORE=y
CONFIG_I2C_DESIGNWARE_CORE=m
CONFIG_ACPI_THERMAL_REL=m
CONFIG_NETLABEL=y
CONFIG_NLS=y
CONFIG_IP_SET_HASH_IPPORTNET=m
CONFIG_CDROM_PKTCDVD_BUFFERS=8
CONFIG_SCHED_AUTOGROUP=y
CONFIG_CLS_U32_PERF=y
CONFIG_HWPOISON_INJECT=m
CONFIG_NTB_TOOL=m
CONFIG_RTL8188EE=m
CONFIG_NETFILTER_XT_TARGET_SECMARK=m
CONFIG_HID_MAGICMOUSE=y
CONFIG_MICROSEMI_PHY=m
CONFIG_NFT_COUNTER=m
CONFIG_INET_UDP_DIAG=m
CONFIG_XEN_SAVE_RESTORE=y
CONFIG_TOUCHSCREEN_USB_ETURBO=y
CONFIG_DELL_LAPTOP=m
CONFIG_PPPOE=m
CONFIG_CRYPTO_CRCT10DIF_PCLMUL=m
CONFIG_XFRM_MIGRATE=y
CONFIG_WL1251_SDIO=m
CONFIG_X86_INTEL_PSTATE=y
CONFIG_ZONE_DMA=y
CONFIG_USB_LEGOTOWER=m
CONFIG_NF_NAT_IPV6=m
CONFIG_QLCNIC_HWMON=y
CONFIG_ACPI_I2C_OPREGION=y
CONFIG_ROCKER=m
CONFIG_NETFILTER_XT_MATCH_OWNER=m
CONFIG_X86_PTDUMP_CORE=y
CONFIG_SUN_PARTITION=y
CONFIG_IP_NF_TARGET_ECN=m
CONFIG_PSTORE_DEFLATE_COMPRESS_DEFAULT=y
CONFIG_MD_FAULTY=m
CONFIG_SYN_COOKIES=y
CONFIG_REED_SOLOMON_DEC8=y
CONFIG_IRQ_WORK=y
CONFIG_ATH9K=m
CONFIG_PCI_MSI=y
CONFIG_IP_ADVANCED_ROUTER=y
CONFIG_FB_SYS_COPYAREA=y
CONFIG_X86_64_SMP=y
CONFIG_PATA_CYPRESS=m
CONFIG_CLEANCACHE=y
CONFIG_USB_STORAGE_ALAUDA=m
CONFIG_JOYSTICK_GRIP_MP=m
CONFIG_SPARSEMEM_EXTREME=y
CONFIG_W1_SLAVE_DS2406=m
CONFIG_B44_PCICORE_AUTOSELECT=y
CONFIG_IWLWIFI=m
CONFIG_USB_COMMON=y
CONFIG_SENSORS_ADM1031=m
CONFIG_TASK_XACCT=y
CONFIG_IP_SET_BITMAP_PORT=m
CONFIG_IP6_NF_IPTABLES=m
CONFIG_LZ4_COMPRESS=m
CONFIG_KVM_VFIO=y
CONFIG_USB_HSIC_USB3503=m
CONFIG_X86_PCC_CPUFREQ=m
CONFIG_TOUCHSCREEN_USB_ZYTRONIC=y
CONFIG_FIXED_PHY=y
CONFIG_GPIO_ACPI=y
CONFIG_ARCH_DEFCONFIG="arch/x86/configs/x86_64_defconfig"
CONFIG_ARCH_HAS_SYNC_CORE_BEFORE_USERMODE=y
CONFIG_SENSORS_TMP103=m
CONFIG_NLS_MAC_GAELIC=m
CONFIG_CPU_FREQ_GOV_USERSPACE=y
CONFIG_FTRACE_SYSCALLS=y
CONFIG_LOG_CPU_MAX_BUF_SHIFT=12
CONFIG_NF_DUP_IPV4=m
CONFIG_XEN_PVHVM_SMP=y
CONFIG_BLK_DEV_DM_BUILTIN=y
CONFIG_RPR0521=m
CONFIG_USB_SERIAL_IPW=m
CONFIG_I2C_PIIX4=m
CONFIG_EDAC_I7300=m
CONFIG_INTEL_SOC_DTS_THERMAL=m
CONFIG_PCIEAER_INJECT=m
CONFIG_INET_IPCOMP=m
CONFIG_SENSORS_FSCHMD=m
CONFIG_TASKS_RCU=y
CONFIG_VGA_ARB_MAX_GPUS=16
CONFIG_TOUCHSCREEN_FUJITSU=m
CONFIG_XEN_BLKDEV_BACKEND=m
CONFIG_GENERIC_PINCONF=y
CONFIG_FMC_TRIVIAL=m
CONFIG_XILLYBUS_PCIE=m
CONFIG_EVENT_TRACING=y
CONFIG_MFD_INTEL_LPSS=m
CONFIG_ASYNC_PQ=m
CONFIG_HID_KEYTOUCH=m
CONFIG_HID_CYPRESS=m
CONFIG_N_GSM=m
CONFIG_SG_POOL=y
CONFIG_BRIDGE_EBT_LIMIT=m
CONFIG_SURFACE_PRO3_BUTTON=m
CONFIG_DRM_KMS_HELPER=m
CONFIG_IPW2200_PROMISCUOUS=y
CONFIG_NF_SOCKET_IPV6=m
CONFIG_OCFS2_FS_USERSPACE_CLUSTER=m
CONFIG_W1_SLAVE_DS2433_CRC=y
CONFIG_ATA_OVER_ETH=m
CONFIG_BLK_MQ_PCI=y
CONFIG_USB_NET_PLUSB=m
CONFIG_RTL8192C_COMMON=m
CONFIG_SENSORS_LM95234=m
CONFIG_PREEMPT_VOLUNTARY=y
CONFIG_NLS_ISO8859_1=m
CONFIG_CRYPTO_WORKQUEUE=y
CONFIG_ALX=m
CONFIG_CIFS_FSCACHE=y
CONFIG_R8169=m
CONFIG_ATOMIC64_SELFTEST=y
CONFIG_TCP_CONG_HYBLA=m
CONFIG_PCI_STUB=y
CONFIG_CRYPTO_DRBG_CTR=y
CONFIG_DRM_I2C_NXP_TDA998X=m
CONFIG_MMC_CQHCI=m
CONFIG_HID_KENSINGTON=m
CONFIG_USB_EHCI_HCD=y
CONFIG_MCORE2=y
CONFIG_TEXTSEARCH_BM=m
CONFIG_FS_IOMAP=y
CONFIG_8139TOO=m
CONFIG_NF_CONNTRACK_PROCFS=y
CONFIG_NLS_MAC_INUIT=m
CONFIG_HID_ZYDACRON=m
CONFIG_PPP_MPPE=m
CONFIG_HID_SENSOR_ACCEL_3D=m
CONFIG_DE2104X=m
CONFIG_MEMORY_HOTPLUG=y
CONFIG_VMD=m
CONFIG_USB_NET_SR9700=m
CONFIG_HOTPLUG_PCI_ACPI=y
CONFIG_HID_CMEDIA=m
CONFIG_NETDEVICES=y
CONFIG_NET_KEY=m
CONFIG_HAVE_CONTEXT_TRACKING=y
CONFIG_IP6_NF_TARGET_HL=m
CONFIG_IOSCHED_DEADLINE=y
CONFIG_NETFILTER_CONNCOUNT=m
CONFIG_ARCH_HAS_KCOV=y
CONFIG_CGROUP_FREEZER=y
CONFIG_EVENTFD=y
CONFIG_CRYPTO_DEV_PADLOCK_SHA=m
CONFIG_RTL8192CE=m
CONFIG_VLAN_8021Q_MVRP=y
CONFIG_RTL8821AE=m
CONFIG_FS_POSIX_ACL=y
CONFIG_IPV6_SIT=m
CONFIG_XFRM=y
CONFIG_ATH6KL_DEBUG=y
CONFIG_SENSORS_K8TEMP=m
CONFIG_ASYNC_TX_DMA=y
CONFIG_ARCH_HAS_PMEM_API=y
CONFIG_HAVE_KPROBES_ON_FTRACE=y
CONFIG_IP_SET_HASH_IP=m
CONFIG_MFD_VX855=m
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_IPV6_MULTIPLE_TABLES=y
CONFIG_USB_ANNOUNCE_NEW_DEVICES=y
CONFIG_USB_SERIAL_WHITEHEAT=m
CONFIG_NET_CLS_ROUTE4=m
CONFIG_JUMP_LABEL=y
CONFIG_OVERLAY_FS=m
CONFIG_DRM_RADEON_USERPTR=y
CONFIG_IP_SET_HASH_NETPORT=m
CONFIG_CIFS_ALLOW_INSECURE_LEGACY=y
CONFIG_TCG_INFINEON=m
CONFIG_ATH9K_HTC=m
CONFIG_IP_VS_DH=m
CONFIG_BRCMFMAC_PROTO_MSGBUF=y
CONFIG_RT2800PCI_RT3290=y
CONFIG_IP_NF_TARGET_MASQUERADE=m
CONFIG_AIC79XX_RESET_DELAY_MS=15000
CONFIG_TORTURE_TEST=m
CONFIG_SECURITY_SELINUX_DISABLE=y
CONFIG_HAVE_EBPF_JIT=y
CONFIG_NF_CONNTRACK_BROADCAST=m
CONFIG_ARCH_HAS_KEXEC_PURGATORY=y
CONFIG_CRYPTO_LZ4=m
CONFIG_ECRYPT_FS=m
CONFIG_PROC_PAGE_MONITOR=y
CONFIG_SERIAL_8250_EXTENDED=y
CONFIG_GAMEPORT_FM801=m
CONFIG_RTC_DRV_MAX6916=m
CONFIG_JOYSTICK_MAGELLAN=m
CONFIG_IGB_HWMON=y
CONFIG_DM_CACHE=m
CONFIG_IPMI_DEVICE_INTERFACE=m
CONFIG_BPF=y
CONFIG_NF_NAT_PROTO_DCCP=y
CONFIG_SENSORS_ADM1021=m
CONFIG_DM_DELAY=m
CONFIG_MEMORY_HOTPLUG_DEFAULT_ONLINE=y
CONFIG_X86_CMOV=y
CONFIG_USB_SERIAL_CH341=m
CONFIG_HID_SENSOR_IIO_COMMON=m
CONFIG_USB_FTDI_ELAN=m
CONFIG_ACPI_HOTPLUG_CPU=y
CONFIG_PM_TRACE_RTC=y
CONFIG_RD_LZO=y
CONFIG_IP_SET_HASH_IPPORT=m
CONFIG_KPROBE_EVENTS=y
CONFIG_SENSORS_SHT21=m
CONFIG_USB_IOWARRIOR=m
CONFIG_OPENVSWITCH_GENEVE=m
CONFIG_MLX4_CORE_GEN2=y
CONFIG_USBPCWATCHDOG=m
CONFIG_MODULE_SIG_ALL=y
CONFIG_USB_EZUSB_FX2=m
CONFIG_SCSI_SPI_ATTRS=m
CONFIG_BCMA_DRIVER_GMAC_CMN=y
CONFIG_RTL8XXXU=m
CONFIG_GREENASIA_FF=y
CONFIG_SCSI_HPSA=m
CONFIG_MICROCODE_AMD=y
CONFIG_SENSORS_VIA_CPUTEMP=m
CONFIG_NF_CONNTRACK_SECMARK=y
CONFIG_CHELSIO_T3=m
CONFIG_INSTRUCTION_DECODER=y
CONFIG_CRYPTO_SHA512=m
CONFIG_MWIFIEX_PCIE=m
CONFIG_TRUSTED_KEYS=m
CONFIG_BACKLIGHT_CLASS_DEVICE=y
CONFIG_B43_HWRNG=y
CONFIG_VHOST=m
CONFIG_RT2X00_LIB_USB=m
CONFIG_INPUT_CMA3000_I2C=m
CONFIG_CRYPTO_NULL=y
CONFIG_B43_PHY_G=y
CONFIG_NF_DEFRAG_IPV4=m
CONFIG_USER_RETURN_NOTIFIER=y
CONFIG_INTEL_IOMMU_FLOPPY_WA=y
CONFIG_USB_IDMOUSE=m
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_CRYPTO_CAMELLIA_AESNI_AVX2_X86_64=m
CONFIG_INET_XFRM_MODE_BEET=m
CONFIG_INFINIBAND_IPOIB_DEBUG=y
CONFIG_HID_LCPOWER=m
CONFIG_VIRTIO_CONSOLE=m
CONFIG_MOUSE_ELAN_I2C_SMBUS=y
CONFIG_PERSISTENT_KEYRINGS=y
CONFIG_NET_ACT_CONNMARK=m
CONFIG_PM_DEBUG=y
CONFIG_IPV6_ROUTE_INFO=y
CONFIG_NETFILTER_ADVANCED=y
CONFIG_CRYPTO_DEFLATE=y
CONFIG_GENERIC_STRNLEN_USER=y
CONFIG_USB_APPLEDISPLAY=m
CONFIG_USB_SERIAL_KLSI=m
CONFIG_NETFILTER_XT_MATCH_TCPMSS=m
CONFIG_IGB=m
CONFIG_NETFILTER_XT_MATCH_IPCOMP=m
CONFIG_IPV6_ROUTER_PREF=y
CONFIG_DRM_QXL=m
CONFIG_WLAN_VENDOR_RSI=y
CONFIG_SLIP_COMPRESSED=y
CONFIG_CRYPTO_JITTERENTROPY=y
CONFIG_NTB_INTEL=m
CONFIG_PERF_EVENTS_AMD_POWER=m
CONFIG_ARCH_ENABLE_HUGEPAGE_MIGRATION=y
CONFIG_NETFILTER_XT_MATCH_L2TP=m
CONFIG_DM_SWITCH=m
CONFIG_ROCKETPORT=m
CONFIG_CRYPTO_GCM=y
CONFIG_NE2K_PCI=m
CONFIG_MOUSE_SYNAPTICS_USB=m
CONFIG_NETFILTER_NETLINK_LOG=m
CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_PWM_LPSS_PCI=m
CONFIG_CDROM=m
CONFIG_PINCTRL_CHERRYVIEW=y
CONFIG_NLS_ISO8859_14=m
CONFIG_MAGIC_SYSRQ=y
CONFIG_VOP=m
CONFIG_E100=m
CONFIG_IO_DELAY_0X80=y
CONFIG_X86_PTDUMP=y
CONFIG_DMI=y
CONFIG_IPV6_SIT_6RD=y
CONFIG_PARPORT_SERIAL=m
CONFIG_CRYPTO_KPP=y
CONFIG_PNFS_BLOCK=m
CONFIG_NET_VENDOR_RDC=y
CONFIG_MACHZ_WDT=m
CONFIG_PGTABLE_LEVELS=4
CONFIG_CPUSETS=y
CONFIG_NETFILTER_XT_MATCH_MARK=m
CONFIG_FUNCTION_PROFILER=y
CONFIG_MAC80211_RC_DEFAULT_MINSTREL=y
CONFIG_RMI4_F03_SERIO=m
CONFIG_SPARSE_IRQ=y
CONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP=m
CONFIG_INPUT_IDEAPAD_SLIDEBAR=m
CONFIG_IP_NF_MANGLE=m
CONFIG_TIFM_7XX1=m
CONFIG_RTC_DRV_DS1286=m
CONFIG_FCOE_FNIC=m
CONFIG_INTEL_SMARTCONNECT=y
CONFIG_ATH10K_DEBUGFS=y
CONFIG_TOUCHSCREEN_MCS5000=m
CONFIG_DRM_UDL=m
CONFIG_SECURITYFS=y
CONFIG_LIBERTAS_MESH=y
CONFIG_PCI_HERMES=m
CONFIG_DEFAULT_CFQ=y
CONFIG_RCU_STALL_COMMON=y
CONFIG_PARAVIRT_TIME_ACCOUNTING=y
CONFIG_CPU_SUP_AMD=y
CONFIG_INET6_XFRM_MODE_TUNNEL=m
CONFIG_BRIDGE_EBT_VLAN=m
CONFIG_PCIEPORTBUS=y
CONFIG_SENSORS_F75375S=m
CONFIG_DEBUG_BUGVERBOSE=y
CONFIG_HAVE_IRQ_EXIT_ON_IRQ_STACK=y
CONFIG_IP_NF_FILTER=y
CONFIG_HID_ZEROPLUS=m
CONFIG_DYNAMIC_MEMORY_LAYOUT=y
CONFIG_SATA_SX4=m
CONFIG_NETFILTER_XT_MATCH_LENGTH=m
CONFIG_BRIDGE_EBT_PKTTYPE=m
CONFIG_HID_SENSOR_GYRO_3D=m
CONFIG_MODULES_TREE_LOOKUP=y
CONFIG_FAT_FS=m
CONFIG_FCOE=m
CONFIG_CRYPTO_DEV_QAT_DH895xCCVF=m
CONFIG_MAY_USE_DEVLINK=m
CONFIG_TEXTSEARCH_FSM=m
CONFIG_SENSORS_LM75=m
CONFIG_INFINIBAND_CXGB4=m
CONFIG_LSI_ET1011C_PHY=m
CONFIG_IP6_NF_RAW=m
CONFIG_RTC_DRV_DS1742=m
CONFIG_NVMEM=y
CONFIG_INET_TUNNEL=m
CONFIG_X86_INTERNODE_CACHE_SHIFT=6
CONFIG_CRYPTO_SERPENT_SSE2_X86_64=m
CONFIG_NF_LOG_ARP=m
CONFIG_CRYPTO_DEV_PADLOCK=m
CONFIG_SENSORS_PMBUS=m
CONFIG_NETFILTER_XT_TARGET_NOTRACK=m
CONFIG_EEPROM_93CX6=m
CONFIG_NET_ACT_SKBMOD=m
CONFIG_PINCONF=y
CONFIG_X86_CHECK_BIOS_CORRUPTION=y
CONFIG_MLX4_CORE=m
CONFIG_GENERIC_CLOCKEVENTS=y
CONFIG_ROMFS_FS=m
CONFIG_IOSCHED_CFQ=y
CONFIG_OID_REGISTRY=y
CONFIG_CIFS_UPCALL=y
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_LIB80211=m
CONFIG_MFD_CORE=m
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_DRM_GMA3600=y
CONFIG_X86_PKG_TEMP_THERMAL=m
CONFIG_RAID_ATTRS=m
CONFIG_CONSOLE_TRANSLATIONS=y
CONFIG_PATA_CMD64X=m
CONFIG_ARCH_SUPPORTS_ATOMIC_RMW=y
CONFIG_TCG_CRB=m
CONFIG_RAID6_PQ=m
CONFIG_SBC_FITPC2_WATCHDOG=m
CONFIG_HW_RANDOM_TIMERIOMEM=m
CONFIG_NET_IPGRE=m
CONFIG_LIBERTAS_SDIO=m
CONFIG_CRYPTO_DEV_QAT=m
CONFIG_FUSION=y
CONFIG_SWIOTLB_XEN=y
CONFIG_BRIDGE_EBT_IP6=m
CONFIG_NF_NAT_SNMP_BASIC=m
CONFIG_XEN_SYMS=y
CONFIG_SERIAL_EARLYCON=y
CONFIG_CLS_U32_MARK=y
CONFIG_DEBUG_DEVRES=y
CONFIG_CRYPTO_AKCIPHER=y
CONFIG_SCSI_ACARD=m
CONFIG_LEDS_TRIGGER_BACKLIGHT=m
CONFIG_ACPI_CPU_FREQ_PSS=y
CONFIG_CPU_FREQ=y
CONFIG_USB_OHCI_HCD=y
CONFIG_VIA_RHINE=m
CONFIG_VHOST_RING=m
CONFIG_NR_CPUS_DEFAULT=64
CONFIG_DM_MIRROR=y
CONFIG_CRYPTO_BLOWFISH=m
CONFIG_DUMMY_CONSOLE=y
CONFIG_MLXSW_CORE_HWMON=y
CONFIG_AIC7XXX_DEBUG_MASK=0
CONFIG_SENSORS_LTC3815=m
CONFIG_SCSI_GDTH=m
CONFIG_NLS_ASCII=y
CONFIG_B43=m
CONFIG_JOYSTICK_GRIP=m
CONFIG_TIPC_DIAG=m
CONFIG_NF_REJECT_IPV4=y
CONFIG_RTC_DRV_M41T94=m
CONFIG_RANDOMIZE_MEMORY=y
CONFIG_ARCH_MMAP_RND_BITS_MAX=32
CONFIG_BPF_EVENTS=y
CONFIG_USB_LAN78XX=m
CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE=y
CONFIG_INTEL_MEI_ME=m
CONFIG_INFINIBAND_QIB=m
CONFIG_SATA_SVW=m
CONFIG_TRACE_IRQFLAGS_SUPPORT=y
CONFIG_NFS_V3_ACL=y
CONFIG_NFT_NUMGEN=m
CONFIG_GAMEPORT_L4=m
CONFIG_SENSORS_ADT7462=m
CONFIG_SENSORS_NCT7802=m
CONFIG_CRYPTO_CCM=m
CONFIG_TCP_CONG_ADVANCED=y
CONFIG_NET_CLS_RSVP6=m
CONFIG_MTRR_SANITIZER_ENABLE_DEFAULT=0
CONFIG_USB_NET_CDC_SUBSET=m
CONFIG_KVM_GUEST=y
CONFIG_QFMT_V2=y
CONFIG_INET_DCCP_DIAG=m
CONFIG_TAP=m
CONFIG_NETFILTER_XT_MATCH_CONNMARK=m
CONFIG_ATH9K_HW=m
CONFIG_BLK_CGROUP=y
CONFIG_USB_SERIAL_MCT_U232=m
CONFIG_LEDS_TRIGGERS=y
CONFIG_NET_FOU=m
CONFIG_CRYPTO_RNG=y
CONFIG_MEMCG_SWAP_ENABLED=y
CONFIG_USB_SERIAL_GARMIN=m
CONFIG_RAW_DRIVER=y
CONFIG_XFS_QUOTA=y
CONFIG_JOYSTICK_COBRA=m
CONFIG_ATH10K=m
CONFIG_WINBOND_840=m
CONFIG_SCSI_3W_9XXX=m
CONFIG_ARCH_MMAP_RND_COMPAT_BITS_MIN=8
CONFIG_MVMDIO=m
CONFIG_LOGIG940_FF=y
CONFIG_KVM_MMU_AUDIT=y
CONFIG_RD_GZIP=y
CONFIG_TOUCHSCREEN_USB_E2I=y
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
CONFIG_BCMA_HOST_PCI_POSSIBLE=y
CONFIG_SENSORS_LTC4261=m
CONFIG_USB_SERIAL_KEYSPAN=m
CONFIG_THRUSTMASTER_FF=y
CONFIG_MDIO_BUS=y
CONFIG_TREE_RCU=y
CONFIG_PWM_SYSFS=y
CONFIG_ALLOW_DEV_COREDUMP=y
CONFIG_SWIOTLB=y
CONFIG_USB_STORAGE_CYPRESS_ATACB=m
CONFIG_EXT4_FS_SECURITY=y
CONFIG_GRO_CELLS=y
CONFIG_SCSI_MVUMI=m
CONFIG_NET_TEAM_MODE_ACTIVEBACKUP=m
CONFIG_HAVE_VIRT_CPU_ACCOUNTING_GEN=y
CONFIG_PCI_MSI_IRQ_DOMAIN=y
CONFIG_INFINIBAND_USER_MAD=m
CONFIG_HID_ROCCAT=m
CONFIG_F71808E_WDT=m
CONFIG_INET_XFRM_MODE_TRANSPORT=m
CONFIG_CRYPTO_MD5=y
CONFIG_TRANSPARENT_HUGEPAGE=y
CONFIG_CLOCKSOURCE_VALIDATE_LAST_CYCLE=y
CONFIG_ISCSI_TCP=m
CONFIG_ATA_ACPI=y
CONFIG_NFSD_V3=y
CONFIG_PATA_ALI=m
CONFIG_NET_DSA_MV88E6XXX_GLOBAL2=y
CONFIG_X86_EXTENDED_PLATFORM=y
CONFIG_SECURITY_SELINUX_BOOTPARAM_VALUE=1
CONFIG_MFD_WL1273_CORE=m
CONFIG_RT2800USB_RT53XX=y
CONFIG_ACPI_PROCESSOR=y
CONFIG_ELFCORE=y
CONFIG_HAVE_KVM=y
CONFIG_EDAC_SKX=m
CONFIG_DM_LOG_WRITES=m
CONFIG_BINFMT_ELF=y
CONFIG_RTC_DRV_RX4581=m
CONFIG_NET_CLS_FLOWER=m
CONFIG_SCSI_PROC_FS=y
CONFIG_RMI4_F11=y
CONFIG_I2C_HID=m
CONFIG_MD_RAID456=m
CONFIG_IIO_TRIGGER=y
CONFIG_JOYSTICK_IFORCE_USB=y
CONFIG_SCHED_TRACER=y
CONFIG_CICADA_PHY=m
CONFIG_JOYSTICK_STINGER=m
CONFIG_HAVE_PERF_REGS=y
CONFIG_CIFS_DEBUG=y
CONFIG_USB_SISUSBVGA_CON=y
CONFIG_IP_PIMSM_V1=y
CONFIG_HAVE_KVM_MSI=y
CONFIG_BCACHE=m
CONFIG_INET6_AH=m
CONFIG_KVM_GENERIC_DIRTYLOG_READ_PROTECT=y
CONFIG_SENSORS_MAX197=m
CONFIG_TARGET_CORE=m
CONFIG_HID_XINMO=m
CONFIG_NFS_V4_SECURITY_LABEL=y
CONFIG_USB_SERIAL=y
CONFIG_NET_VENDOR_ALTEON=y
CONFIG_SENSORS_GL518SM=m
CONFIG_USB_MON=y
CONFIG_VGASTATE=m
CONFIG_KEYS=y
CONFIG_XEN_PV_SMP=y
CONFIG_BE2ISCSI=m
CONFIG_INET_XFRM_TUNNEL=m
CONFIG_RTC_DRV_FM3130=m
CONFIG_RMI4_2D_SENSOR=y
CONFIG_ACPI_PROCESSOR_CSTATE=y
CONFIG_XEN_EFI=y
CONFIG_IPMI_POWEROFF=m
CONFIG_NETFILTER_XT_MARK=m
CONFIG_NETFILTER_XTABLES=y
CONFIG_DRM_PANEL_ORIENTATION_QUIRKS=y
CONFIG_IP_VS_LBLC=m
CONFIG_HAVE_KVM_IRQ_BYPASS=y
CONFIG_BLK_DEV_NULL_BLK=m
CONFIG_SOFTLOCKUP_DETECTOR=y
CONFIG_CRYPTO_ECHAINIV=m
CONFIG_HAVE_ARCH_AUDITSYSCALL=y
CONFIG_IPMI_SI=m
CONFIG_USB_STORAGE_DATAFAB=m
CONFIG_TCP_CONG_VEGAS=m
CONFIG_CRYPTO_USER_API_HASH=y
CONFIG_SENSORS_IBMPEX=m
CONFIG_BOOT_PRINTK_DELAY=y
CONFIG_IWLMVM=m
CONFIG_SENSORS_ADM1026=m
CONFIG_PATA_NINJA32=m
CONFIG_SENSORS_ADT7470=m
CONFIG_CRYPTO_DEV_CCP_DD=m
CONFIG_PM_SLEEP_SMP=y
CONFIG_SPI_PXA2XX_PCI=m
CONFIG_X86_16BIT=y
CONFIG_CRYPTO_HW=y
CONFIG_MAC80211_RC_MINSTREL_HT=y
CONFIG_USB_STORAGE_KARMA=m
CONFIG_NTB_PERF=m
CONFIG_TEHUTI=m
CONFIG_SIS900=m
CONFIG_IIO_ST_MAGN_SPI_3AXIS=m
CONFIG_PCSPKR_PLATFORM=y
CONFIG_LEDS_LP3952=m
CONFIG_HAVE_LIVEPATCH=y
CONFIG_MEGARAID_LEGACY=m
CONFIG_CRYPTO_POLY1305_X86_64=m
CONFIG_ATH9K_AHB=y
CONFIG_HID_GREENASIA=m
CONFIG_ORINOCO_USB=m
CONFIG_TOUCHSCREEN_ILI210X=m
CONFIG_XEN_ACPI_PROCESSOR=m
CONFIG_MAGIC_SYSRQ_DEFAULT_ENABLE=0x0
CONFIG_KALLSYMS_ABSOLUTE_PERCPU=y
CONFIG_INTEL_POWERCLAMP=m
CONFIG_BIG_KEYS=y
CONFIG_ACPI_AC=y
CONFIG_ACPI_HOTPLUG_IOAPIC=y
CONFIG_HID_STEELSERIES=m
CONFIG_SPI_MASTER=y
CONFIG_USB_SERIAL_OPTICON=m
CONFIG_RTL8180=m
CONFIG_LWTUNNEL=y
CONFIG_SENSORS_LM87=m
CONFIG_BLK_DEV_THROTTLING=y
CONFIG_VT_HW_CONSOLE_BINDING=y
CONFIG_AIX_PARTITION=y
CONFIG_NET_TEAM_MODE_BROADCAST=m
CONFIG_MPLS=y
CONFIG_CHARGER_SMB347=m
CONFIG_NET_ACT_GACT=m
CONFIG_HID_GYRATION=m
CONFIG_PA12203001=m
CONFIG_USB_WDM=m
CONFIG_PATA_TOSHIBA=m
CONFIG_THERMAL_HWMON=y
CONFIG_TOUCHSCREEN_USB_COMPOSITE=m
CONFIG_USB_SERIAL_KOBIL_SCT=m
CONFIG_GENEVE=m
CONFIG_XZ_DEC_X86=y
CONFIG_VIRT_CPU_ACCOUNTING=y
CONFIG_MLX5_INFINIBAND=m
CONFIG_RMI4_SPI=m
CONFIG_MAC80211_LEDS=y
CONFIG_INPUT_JOYDEV=m
CONFIG_NETFILTER_XT_TARGET_TPROXY=m
CONFIG_HIBERNATE_CALLBACKS=y
CONFIG_IO_STRICT_DEVMEM=y
CONFIG_SERIAL_8250_DW=y
CONFIG_IP_DCCP=m
CONFIG_LIBIPW=m
CONFIG_THERMAL_EMERGENCY_POWEROFF_DELAY_MS=0
CONFIG_CONSOLE_LOGLEVEL_QUIET=4
CONFIG_USB_ACM=m
CONFIG_USB_RTL8150=m
CONFIG_NVME_CORE=y
CONFIG_CRC16=y
CONFIG_DEBUG_SHIRQ=y
CONFIG_USB_NET_AX8817X=m
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_CRYPTO_GF128MUL=y
CONFIG_UPROBE_EVENTS=y
CONFIG_NLS_ISO8859_6=m
CONFIG_NET_CLS=y
CONFIG_PSTORE_DEFLATE_COMPRESS=y
CONFIG_TMPFS=y
CONFIG_RADIX_TREE_MULTIORDER=y
CONFIG_NFT_CT=m
CONFIG_ANON_INODES=y
CONFIG_DM_VERITY_FEC=y
CONFIG_NLS_CODEPAGE_936=m
CONFIG_ET131X=m
CONFIG_WCN36XX=m
CONFIG_FUTEX=y
CONFIG_IP_VS_MH_TAB_INDEX=8
CONFIG_CRYPTO_ANUBIS=m
CONFIG_VIRTIO_PCI=m
CONFIG_TCP_CONG_NV=m
CONFIG_HID_SENSOR_ALS=m
CONFIG_CONSOLE_LOGLEVEL_DEFAULT=7
CONFIG_MWAVE=m
CONFIG_RTL8192SE=m
CONFIG_JOYSTICK_SPACEBALL=m
CONFIG_REGMAP_I2C=y
CONFIG_ARCH_HAS_FAST_MULTIPLIER=y
CONFIG_ATH9K_DEBUGFS=y
CONFIG_NET_VENDOR_REALTEK=y
CONFIG_MFD_SM501_GPIO=y
CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
CONFIG_JOYSTICK_XPAD_FF=y
CONFIG_NETFILTER_XT_TARGET_HL=m
CONFIG_MEGARAID_SAS=m
CONFIG_PATA_HPT3X2N=m
CONFIG_NFSD_V2_ACL=y
CONFIG_PLUGIN_HOSTCC=""
CONFIG_ISL29003=m
CONFIG_CRYPTO_USER_API=y
CONFIG_RTC_HCTOSYS=y
CONFIG_DRM_I915_CAPTURE_ERROR=y
CONFIG_SECURITY_NETWORK=y
CONFIG_FMC_CHARDEV=m
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_INTEL_XWAY_PHY=m
CONFIG_ACPI_CPPC_LIB=y
CONFIG_HUGETLB_PAGE=y
CONFIG_HW_RANDOM_TPM=y
CONFIG_CIFS_WEAK_PW_HASH=y
CONFIG_TOUCHSCREEN_GUNZE=m
CONFIG_SENSORS_LM78=m
CONFIG_NET_VENDOR_EMULEX=y
CONFIG_WIZNET_W5100=m
CONFIG_SENSORS_K10TEMP=m
CONFIG_USB_HID=y
CONFIG_DELL_SMBIOS=m
CONFIG_UBIFS_FS=m
CONFIG_RTL8192CU=m
CONFIG_CRYPTO_TGR192=m
CONFIG_BLK_DEV_RBD=m
CONFIG_VSOCKETS_DIAG=m
CONFIG_USER_STACKTRACE_SUPPORT=y
CONFIG_MEGARAID_MAILBOX=m
CONFIG_NF_TABLES=m
CONFIG_IT8712F_WDT=m
CONFIG_SLUB_DEBUG=y
CONFIG_RTC_DRV_M41T80_WDT=y
CONFIG_WIZNET_W5300=m
CONFIG_BLK_DEV_MD=y
CONFIG_UCS2_STRING=y
CONFIG_MMC_VUB300=m
CONFIG_USB_SERIAL_AIRCABLE=m
CONFIG_IP_SET_BITMAP_IP=m
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_MMC_MTK=m
CONFIG_NET_SCH_INGRESS=m
CONFIG_BCMA=m
CONFIG_DMADEVICES=y
CONFIG_XENFS=m
CONFIG_SCSI_AACRAID=m
CONFIG_ACPI_APEI_MEMORY_FAILURE=y
CONFIG_NF_CONNTRACK_EVENTS=y
CONFIG_MOUSE_PS2_ELANTECH=y
CONFIG_PINCTRL=y
CONFIG_HID_SENSOR_DEVICE_ROTATION=m
CONFIG_IPV6_NDISC_NODETYPE=y
CONFIG_INTEL_VBTN=m
CONFIG_RTC_DRV_MSM6242=m
CONFIG_PCI_LABEL=y
CONFIG_NLS_CODEPAGE_1251=m
CONFIG_EDAC_X38=m
CONFIG_FANOTIFY=y
CONFIG_IP_VS_PROTO_SCTP=y
CONFIG_SP5100_TCO=m
CONFIG_NETFILTER_XT_MATCH_CONNLABEL=m
CONFIG_BLK_DEV_SR_VENDOR=y
CONFIG_SGETMASK_SYSCALL=y
CONFIG_SATA_SIL=m
CONFIG_ALTERA_STAPL=m
CONFIG_USERFAULTFD=y
CONFIG_CGROUP_SCHED=y
CONFIG_QUEUED_RWLOCKS=y
CONFIG_SYSVIPC=y
CONFIG_ARCH_HAS_GIGANTIC_PAGE=y
CONFIG_HAVE_DEBUG_KMEMLEAK=y
CONFIG_JOYSTICK_INTERACT=m
CONFIG_SMSC911X=m
CONFIG_MLX4_INFINIBAND=m
CONFIG_RT2X00=m
CONFIG_NLS_CODEPAGE_863=m
CONFIG_SENSORS_ADT7X10=m
CONFIG_PRINTK_SAFE_LOG_BUF_SHIFT=13
CONFIG_KEYBOARD_GPIO=m
CONFIG_NF_CONNTRACK_FTP=m
CONFIG_CHELSIO_T4=m
CONFIG_MODULES=y
CONFIG_IP_NF_MATCH_ECN=m
CONFIG_EEPROM_LEGACY=m
CONFIG_INFINIBAND_NES=m
CONFIG_PATA_ARTOP=m
CONFIG_CONTEXT_TRACKING=y
CONFIG_HARDLOCKUP_DETECTOR=y
CONFIG_MQ_IOSCHED_DEADLINE=m
CONFIG_USB_HIDDEV=y
CONFIG_IOMMU_IOVA=y
CONFIG_INFINIBAND_IPOIB=m
CONFIG_DUMMY_CONSOLE_COLUMNS=80
CONFIG_SENSORS_APDS990X=m
CONFIG_PATA_WINBOND=m
CONFIG_NFT_MASQ=m
CONFIG_NFT_QUOTA=m
CONFIG_TOUCHSCREEN_AUO_PIXCIR=m
CONFIG_JOLIET=y
CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=y
CONFIG_KPROBES_ON_FTRACE=y
CONFIG_BNX2X=m
CONFIG_AUDIT_WATCH=y
CONFIG_CRYPTO_TEA=m
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_PROC_CHILDREN=y
CONFIG_PDC_ADMA=m
CONFIG_UNIX=y
CONFIG_USB_CATC=m
CONFIG_USB_NET_DRIVERS=y
CONFIG_NO_HZ_COMMON=y
CONFIG_MINIX_FS=m
CONFIG_DRM_MIPI_DSI=y
CONFIG_BRCMSMAC=m
CONFIG_XEN_DEV_EVTCHN=m
CONFIG_HAVE_CLK=y
CONFIG_CRYPTO_HASH2=y
CONFIG_CARL9170=m
CONFIG_CRYPTO_LZ4HC=m
CONFIG_THERMAL_GOV_STEP_WISE=y
CONFIG_DEFAULT_HOSTNAME="(none)"
CONFIG_SRCU=y
CONFIG_NLS_KOI8_R=m
CONFIG_SENSORS_ADT7410=m
CONFIG_IP_SET_HASH_NETPORTNET=m
CONFIG_USB_STORAGE_ISD200=m
CONFIG_CPU_FREQ_GOV_POWERSAVE=y
CONFIG_NFS_FS=m
CONFIG_CRYPTO_TWOFISH_X86_64=m
CONFIG_USB_NET_SMSC95XX=m
CONFIG_CRASH_DUMP=y
CONFIG_MEMBARRIER=y
CONFIG_INFINIBAND_ADDR_TRANS=y
CONFIG_BLK_DEV_IO_TRACE=y
CONFIG_XPS=y
CONFIG_CRYPTO_DEV_QAT_DH895xCC=m
CONFIG_NET_ACT_SKBEDIT=m
CONFIG_INET_ESP=m
CONFIG_SECURITY_SELINUX_DEVELOP=y
CONFIG_SGL_ALLOC=y
CONFIG_HPET_TIMER=y
CONFIG_LZ4_DECOMPRESS=y
CONFIG_NF_TPROXY_IPV6=m
CONFIG_NF_CONNTRACK_ZONES=y
CONFIG_DP83848_PHY=m
CONFIG_EFI_RUNTIME_MAP=y
CONFIG_FONT_SUPPORT=y
CONFIG_ADVISE_SYSCALLS=y
CONFIG_MD=y
CONFIG_CRYPTO_ALGAPI=y
CONFIG_SENSORS_VT8231=m
CONFIG_LP_CONSOLE=y
CONFIG_EDAC_I3200=m
CONFIG_CEPH_FSCACHE=y
CONFIG_INPUT_KXTJ9=m
CONFIG_BSD_PROCESS_ACCT_V3=y
CONFIG_NET_VENDOR_WIZNET=y
CONFIG_SCSI_DMX3191D=m
CONFIG_BRIDGE=m
CONFIG_NETFILTER_XT_MATCH_CGROUP=m
CONFIG_TABLET_USB_GTCO=m
CONFIG_OPT3001=m
CONFIG_SERIAL_8250_MID=y
CONFIG_RD_BZIP2=y
CONFIG_MFD_VIPERBOARD=m
CONFIG_WANT_DEV_COREDUMP=y
CONFIG_INPUT_UINPUT=m
CONFIG_SERIAL_ARC_NR_PORTS=1
CONFIG_NETFILTER_XT_TARGET_CHECKSUM=m
CONFIG_PM_OPP=y
CONFIG_LEDS_TRIGGER_GPIO=m
CONFIG_RTLWIFI_USB=m
CONFIG_TCG_ATMEL=m
CONFIG_X86_INTEL_UMIP=y
CONFIG_KEYBOARD_ATKBD=y
CONFIG_SCSI_QLA_ISCSI=m
CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
CONFIG_X86_PLATFORM_DEVICES=y
CONFIG_IIO_ST_MAGN_I2C_3AXIS=m
CONFIG_LIBNVDIMM=y
CONFIG_NET_IP_TUNNEL=m
CONFIG_INFINIBAND_ADDR_TRANS_CONFIGFS=y
CONFIG_MTD_CFI_I1=y
CONFIG_NF_NAT=m
CONFIG_W1_SLAVE_DS2780=m
CONFIG_MAX_RAW_DEVS=8192
CONFIG_UBIFS_FS_ZLIB=y
CONFIG_W83877F_WDT=m
CONFIG_USB_SERIAL_XIRCOM=m
CONFIG_BLK_DEV_INTEGRITY=y
CONFIG_NET_VENDOR_OKI=y
CONFIG_MOUSE_BCM5974=m
CONFIG_CPU_IDLE=y
CONFIG_WLAN_VENDOR_INTERSIL=y
CONFIG_NTB=m
CONFIG_IP6_NF_MATCH_RPFILTER=m
CONFIG_NFS_COMMON=y
CONFIG_CHR_DEV_SCH=m
CONFIG_FAIR_GROUP_SCHED=y
CONFIG_RT2800USB=m
CONFIG_CRYPTO_HASH=y
CONFIG_HAVE_STACK_VALIDATION=y
CONFIG_EFI_PARTITION=y
CONFIG_PROBE_EVENTS=y
CONFIG_TRACE_CLOCK=y
CONFIG_BCMA_BLOCKIO=y
CONFIG_MODULE_SIG_HASH="sha256"
CONFIG_LOG_BUF_SHIFT=18
CONFIG_PATA_IT8213=m
CONFIG_MEMORY_HOTREMOVE=y
CONFIG_NET_IFE_SKBTCINDEX=m
CONFIG_WLAN_VENDOR_ATH=y
CONFIG_BH1750=m
CONFIG_HZ_1000=y
CONFIG_ACPI_WMI=m
CONFIG_HPET=y
CONFIG_NLS_CODEPAGE_857=m
CONFIG_NETFILTER_XT_TARGET_DSCP=m
CONFIG_EXTRA_FIRMWARE=""
CONFIG_NET_CLS_MATCHALL=m
CONFIG_TCG_TPM=m
CONFIG_NET_VENDOR_8390=y
CONFIG_IPV6_MROUTE=y
CONFIG_XEN_PCIDEV_BACKEND=m
CONFIG_PROC_EVENTS=y
CONFIG_ACPI_VIDEO=m
CONFIG_SENSORS_SHT3x=m
CONFIG_VIRT_TO_BUS=y
CONFIG_VFAT_FS=m
CONFIG_SECURITY_SELINUX_CHECKREQPROT_VALUE=1
CONFIG_ARCH_SUPPORTS_ACPI=y
CONFIG_IIO_ST_GYRO_SPI_3AXIS=m
CONFIG_EDAC_I5000=m
CONFIG_PID_NS=y
CONFIG_MD_RAID1=m
CONFIG_CRYPTO_VMAC=m
CONFIG_SENSORS_ACPI_POWER=m
CONFIG_KEXEC=y
CONFIG_ACPI_CMPC=m
CONFIG_IIO_CONFIGFS=m
CONFIG_CRC32_SLICEBY8=y
CONFIG_SCSI_MPT2SAS=m
CONFIG_HVC_XEN=y
CONFIG_NET_SCH_FQ=m
CONFIG_ROMFS_ON_BLOCK=y
CONFIG_EDAC_AMD64=m
CONFIG_HERMES_CACHE_FW_ON_INIT=y
CONFIG_BLK_DEV_SR=m
CONFIG_CPU_RMAP=y
CONFIG_GENERIC_IRQ_MATRIX_ALLOCATOR=y
CONFIG_BLK_DEV_LOOP=m
CONFIG_IPMI_HANDLER=m
CONFIG_B44=m
CONFIG_SYSV_FS=m
CONFIG_VIRTIO_PCI_LEGACY=y
CONFIG_SENSORS_THMC50=m
CONFIG_ARCH_HIBERNATION_HEADER=y
CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_FENTRY=y
CONFIG_L2TP_ETH=m
CONFIG_PATA_ATIIXP=m
CONFIG_SCSI_QLOGIC_1280=m
CONFIG_DELL_SMO8800=m
CONFIG_HYPERV_UTILS=m
CONFIG_SYNCLINK_GT=m
CONFIG_CFQ_GROUP_IOSCHED=y
CONFIG_NF_NAT_IRC=m
CONFIG_INPUT_MISC=y
CONFIG_SENSORS_SCH5627=m
CONFIG_I2C_AMD756=m
CONFIG_E1000E=m
CONFIG_DNET=m
CONFIG_CRYPTO_CAST6_AVX_X86_64=m
CONFIG_MULTIUSER=y
CONFIG_SUSPEND=y
CONFIG_SUNRPC_XPRT_RDMA=m
CONFIG_CROSS_MEMORY_ATTACH=y
CONFIG_CRYPTO_CBC=y
CONFIG_SENSORS_LM93=m
CONFIG_KS0108_DELAY=2
CONFIG_NETFILTER_XT_TARGET_HMARK=m
CONFIG_INPUT_MMA8450=m
CONFIG_MRP=m
CONFIG_I8253_LOCK=y
CONFIG_SMSC_SCH311X_WDT=m
CONFIG_AIC79XX_CMDS_PER_DEVICE=4
CONFIG_IP6_NF_MATCH_RT=m
CONFIG_SCSI_IPR=m
CONFIG_SQUASHFS_DECOMP_SINGLE=y
CONFIG_SERIAL_8250_RUNTIME_UARTS=32
CONFIG_NS83820=m
CONFIG_CLANG_VERSION=0
CONFIG_KPROBES=y
CONFIG_FS_MBCACHE=m
CONFIG_XEN_HAVE_VPMU=y
CONFIG_MD_MULTIPATH=m
CONFIG_RTC_CLASS=y
CONFIG_DRM_MGAG200=m
CONFIG_CRC7=m
CONFIG_CRYPTO_RNG_DEFAULT=y
CONFIG_SENSORS_LTC4215=m
CONFIG_NET_CLS_TCINDEX=m
CONFIG_KVM_AMD=m
CONFIG_USB_EMI26=m
CONFIG_IP_VS_PROTO_ESP=y
CONFIG_PCNET32=m
CONFIG_MWIFIEX_USB=m
CONFIG_SAMSUNG_Q10=m
CONFIG_TMPFS_XATTR=y
CONFIG_EXT4_USE_FOR_EXT2=y
CONFIG_EDAC_I82975X=m
CONFIG_NET_TEAM=m
CONFIG_TOUCHSCREEN_TSC2007=m
CONFIG_DCA=m
CONFIG_VOP_BUS=m
CONFIG_I2C_I801=m
CONFIG_NETFILTER_FAMILY_ARP=y
CONFIG_BLK_DEV_UMEM=m
CONFIG_BCM_NET_PHYLIB=m
CONFIG_SCSI_SYM53C8XX_DEFAULT_TAGS=16
CONFIG_W1=m
CONFIG_DLM_DEBUG=y
CONFIG_RT2800PCI=m
CONFIG_OPENVSWITCH_GRE=m
CONFIG_RTC_DRV_DS1374=m
CONFIG_MICROCODE_OLD_INTERFACE=y
CONFIG_RTC_DRV_BQ4802=m
CONFIG_PATA_ACPI=m
CONFIG_GENERIC_TRACER=y
CONFIG_CFG80211_USE_KERNEL_REGDB_KEYS=y
CONFIG_NLS_ISO8859_5=m
CONFIG_DRM_VGEM=m
CONFIG_IP_VS_WLC=m
CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_GENERIC_PHY=y
CONFIG_MLXSW_SPECTRUM=m
CONFIG_CPU_ISOLATION=y
CONFIG_NF_NAT_TFTP=m
CONFIG_NETFILTER_XT_MATCH_MULTIPORT=m
CONFIG_NR_CPUS_RANGE_END=512
CONFIG_STACK_VALIDATION=y
CONFIG_NET_SCH_NETEM=m
CONFIG_ACPI_PROCESSOR_AGGREGATOR=m
CONFIG_USB_STORAGE_REALTEK=m
CONFIG_CRYPTO_CAMELLIA=m
CONFIG_RTC_DRV_DS1307=m
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_NFSD_V4=y
CONFIG_TOUCHSCREEN_PROPERTIES=y
CONFIG_PMBUS=m
CONFIG_EFI_MIXED=y
CONFIG_TCP_CONG_ILLINOIS=m
CONFIG_ZEROPLUS_FF=y
CONFIG_NETFILTER_XT_TARGET_REDIRECT=m
CONFIG_CRYPTO_MANAGER2=y
CONFIG_INFINIBAND_QIB_DCA=y
CONFIG_ARCH_HAS_PTE_SPECIAL=y
CONFIG_NET_VENDOR_MYRI=y
CONFIG_KEXEC_FILE=y
CONFIG_DRAGONRISE_FF=y
CONFIG_CLZ_TAB=y
CONFIG_TOUCHSCREEN_USB_3M=y
CONFIG_TOUCHSCREEN_USB_EGALAX=y
CONFIG_BRIDGE_EBT_DNAT=m
CONFIG_GENERIC_PCI_IOMAP=y
CONFIG_NETFILTER_XT_TARGET_LOG=m
CONFIG_X86_INTEL_MEMORY_PROTECTION_KEYS=y
CONFIG_SLUB=y
CONFIG_SENSORS_AD7418=m
CONFIG_NET_SCH_HHF=m
CONFIG_CONFIGFS_FS=y
CONFIG_CRYPTO_TEST=m
CONFIG_MTD_UBI=m
CONFIG_MODULE_SIG_KEY="certs/signing_key.pem"
CONFIG_XZ_DEC_BCJ=y
CONFIG_SLIP=m
CONFIG_PM_SLEEP=y
CONFIG_F2FS_FS_XATTR=y
CONFIG_SENSORS_FAM15H_POWER=m
CONFIG_I2C=y
CONFIG_LEDS_TRIGGER_MTD=y
CONFIG_SCSI_CHELSIO_FCOE=m
CONFIG_EDAC_DECODE_MCE=m
CONFIG_SENSORS_VT1211=m
CONFIG_DEBUG_VM=y
CONFIG_B44_PCI=y
CONFIG_PPP_MULTILINK=y
CONFIG_INFINIBAND_RDMAVT=m
CONFIG_BINFMT_SCRIPT=y
CONFIG_EFI_STUB=y
CONFIG_SATA_PROMISE=m
CONFIG_PARPORT_1284=y
CONFIG_MOUSE_PS2_CYPRESS=y
CONFIG_SENSORS_POWR1220=m
CONFIG_GENERIC_PENDING_IRQ=y
CONFIG_I2C_AMD756_S4882=m
CONFIG_PARPORT_PC=m
CONFIG_NET_TEAM_MODE_LOADBALANCE=m
CONFIG_PPS_CLIENT_GPIO=m
CONFIG_IIO_SW_TRIGGER=m
CONFIG_X86_NEED_RELOCS=y
CONFIG_EARLY_PRINTK_DBGP=y
CONFIG_SCSI_SRP_ATTRS=m
CONFIG_NET_IPGRE_BROADCAST=y
CONFIG_MOUSE_PS2_LOGIPS2PP=y
CONFIG_UFS_FS=m
CONFIG_VM_EVENT_COUNTERS=y
CONFIG_RELAY=y
CONFIG_IWLDVM=m
CONFIG_HAVE_MMIOTRACE_SUPPORT=y
CONFIG_ASUS_NB_WMI=m
CONFIG_RMI4_F30=y
CONFIG_CRYPTO_ECB=y
CONFIG_CRYPTO_SHA512_SSSE3=m
CONFIG_ACPI_SYSTEM_POWER_STATES_SUPPORT=y
CONFIG_WLAN_VENDOR_BROADCOM=y
CONFIG_PM_STD_PARTITION=""
CONFIG_SQUASHFS_LZO=y
CONFIG_FUJITSU_LAPTOP=m
CONFIG_TCM_FILEIO=m
CONFIG_GENERIC_FIND_FIRST_BIT=y
CONFIG_SCSI_STEX=m
CONFIG_I2C_SLAVE=y
CONFIG_NF_CONNTRACK_AMANDA=m
CONFIG_DEBUG_FS=y
CONFIG_RDMA_RXE=m
CONFIG_FEALNX=m
CONFIG_NET_VENDOR_AMD=y
CONFIG_HAVE_KERNEL_LZ4=y
CONFIG_NET_PKTGEN=m
CONFIG_HP_WMI=m
CONFIG_INTEL_ISH_HID=m
CONFIG_USB_SERIAL_EDGEPORT=m
CONFIG_DRM_TTM=m
CONFIG_BASE_FULL=y
CONFIG_FB_CFB_IMAGEBLIT=y
CONFIG_ZLIB_DEFLATE=y
CONFIG_SUNRPC=m
CONFIG_SOLARIS_X86_PARTITION=y
CONFIG_MLXSW_CORE=m
CONFIG_ARCH_DISCARD_MEMBLOCK=y
CONFIG_SCSI_DH_RDAC=m
CONFIG_SENSORS_W83795=m
CONFIG_X86_P4_CLOCKMOD=m
CONFIG_INPUT_ATI_REMOTE2=m
CONFIG_CNIC=m
CONFIG_ACPI_TABLE_UPGRADE=y
CONFIG_RSI_SDIO=m
CONFIG_OSF_PARTITION=y
CONFIG_ARCH_USES_HIGH_VMA_FLAGS=y
CONFIG_NLS_CODEPAGE_864=m
CONFIG_IIO_BUFFER=y
CONFIG_IWL3945=m
CONFIG_IP_VS_LBLCR=m
CONFIG_GPIO_SYSFS=y
CONFIG_HP_WIRELESS=m
CONFIG_USB_YUREX=m
CONFIG_XEN_BACKEND=y
CONFIG_FW_LOADER=y
CONFIG_SECURITY_WRITABLE_HOOKS=y
CONFIG_IIO_SW_DEVICE=m
CONFIG_MODULE_SIG_SHA256=y
CONFIG_IP6_NF_NAT=m
CONFIG_RANDOMIZE_MEMORY_PHYSICAL_PADDING=0xa
CONFIG_SENSORS_ADS7828=m
CONFIG_KALLSYMS=y
CONFIG_COMMON_CLK=y
CONFIG_HOTPLUG_PCI_PCIE=y
CONFIG_PCI=y
CONFIG_RTC_HCTOSYS_DEVICE="rtc0"
CONFIG_CRYPTO_XTS=y
CONFIG_SENSORS_ZL6100=m
CONFIG_PWM=y
CONFIG_NETFILTER_XT_MATCH_RECENT=m
CONFIG_DECOMPRESS_XZ=y
CONFIG_NETFILTER_XT_MATCH_PKTTYPE=m
CONFIG_PCI_QUIRKS=y
CONFIG_INFINIBAND_USNIC=m
CONFIG_MII=m
CONFIG_SIGNALFD=y
CONFIG_NET_CORE=y
CONFIG_MOUSE_PS2_ALPS=y
CONFIG_KEXEC_CORE=y
CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
CONFIG_EXT4_FS=m
CONFIG_MAC80211_DEBUGFS=y
CONFIG_NET_SCH_DRR=m
CONFIG_SENSORS_LTC4151=m
CONFIG_BRIDGE_EBT_802_3=m
CONFIG_MEMORY_BALLOON=y
CONFIG_HAVE_HW_BREAKPOINT=y
CONFIG_KRETPROBES=y
CONFIG_RCU_TORTURE_TEST=m
CONFIG_CRYPTO_SHA1=y
CONFIG_QUOTACTL_COMPAT=y
CONFIG_HID_PENMOUNT=m
CONFIG_IPMI_WATCHDOG=m
CONFIG_JOYSTICK_JOYDUMP=m
CONFIG_INFINIBAND_USER_ACCESS=m
CONFIG_VMWARE_VMCI=m
CONFIG_CHELSIO_T4_DCB=y
CONFIG_USB_ADUTUX=m
CONFIG_KGDB_LOW_LEVEL_TRAP=y
CONFIG_MT7601U=m
CONFIG_ARCH_WANT_GENERAL_HUGETLB=y
CONFIG_SENSORS_SMSC47M192=m
CONFIG_NLS_KOI8_U=m
CONFIG_CRC8=m
CONFIG_SENSORS_SCH5636=m
CONFIG_USB_BELKIN=y
CONFIG_XZ_DEC=y
CONFIG_SATA_PMP=y
CONFIG_IPW2100_MONITOR=y
CONFIG_QLA3XXX=m
CONFIG_DPTF_POWER=m
CONFIG_ATH_COMMON=m
CONFIG_NET_VENDOR_TI=y
CONFIG_LOCKD_V4=y
CONFIG_SENSORS_LTC2945=m
CONFIG_DUMMY=m
CONFIG_W1_SLAVE_DS2431=m
CONFIG_LEDS_LM3530=m
CONFIG_BRIDGE_EBT_MARK_T=m
CONFIG_WATCHDOG=y
CONFIG_SCSI_ADVANSYS=m
CONFIG_HAS_IOMEM=y
CONFIG_HOTPLUG_PCI_ACPI_IBM=m
CONFIG_NF_LOG_IPV6=m
CONFIG_DE4X5=m
CONFIG_CRYPTO_RSA=y
CONFIG_8139TOO_8129=y
CONFIG_SENSORS_LTC4222=m
CONFIG_IP_VS_OVF=m
CONFIG_IIO_TIGHTLOOP_TRIGGER=m
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_ATH6KL_USB=m
CONFIG_FUSION_LOGGING=y
CONFIG_USB_NET_CDC_EEM=m
CONFIG_USB_STORAGE_SDDR09=m
CONFIG_HYPERV_STORAGE=m
CONFIG_IP_NF_MATCH_TTL=m
CONFIG_ASYNC_RAID6_RECOV=m
CONFIG_NET_CLS_IND=y
CONFIG_CRYPTO_ACOMP2=y
CONFIG_PWM_LPSS_PLATFORM=m
CONFIG_SCSI_SYM53C8XX_MAX_TAGS=64
CONFIG_CW1200_WLAN_SPI=m
CONFIG_PCI_MMCONFIG=y
CONFIG_PM_TRACE=y
CONFIG_SCSI_AM53C974=m
CONFIG_NETFILTER_XT_TARGET_TRACE=m
CONFIG_HVC_IRQ=y
CONFIG_ACPI_NFIT=m
CONFIG_CPU_FREQ_DEFAULT_GOV_ONDEMAND=y
CONFIG_PROC_KCORE=y
CONFIG_RTC_DRV_X1205=m
CONFIG_MTD_MAP_BANK_WIDTH_1=y
CONFIG_LPC_ICH=m
CONFIG_NUMA=y
CONFIG_IP6_NF_MATCH_FRAG=m
CONFIG_USB_SERIAL_CYBERJACK=m
CONFIG_NET_SCH_PRIO=m
CONFIG_SCHED_HRTICK=y
CONFIG_SATA_ULI=m
CONFIG_DRM_I915_GVT=y
CONFIG_USB_SERIAL_IUU=m
CONFIG_EPOLL=y
CONFIG_SCSI_AIC79XX=m
CONFIG_NET_IFE=m
CONFIG_CRYPTO_LZO=y
CONFIG_CRYPTO_TWOFISH_AVX_X86_64=m
CONFIG_TCM_USER2=m
CONFIG_BRIDGE_EBT_SNAT=m
CONFIG_SATA_MOBILE_LPM_POLICY=0
CONFIG_SCSI_MVSAS_TASKLET=y
CONFIG_INFINIBAND_OCRDMA=m
CONFIG_SDIO_UART=m
CONFIG_KVM_COMPAT=y
CONFIG_PARTITION_ADVANCED=y
CONFIG_FAILOVER=m
CONFIG_SENSORS_SCH56XX_COMMON=m
CONFIG_NETFILTER_XT_MATCH_DCCP=m
CONFIG_ICPLUS_PHY=m
CONFIG_CGROUP_HUGETLB=y
CONFIG_UNIXWARE_DISKLABEL=y
CONFIG_SCTP_DEFAULT_COOKIE_HMAC_SHA1=y
CONFIG_CRYPTO_CRC32=m
CONFIG_SCSI_ISCSI_ATTRS=m
CONFIG_HAVE_NET_DSA=y
CONFIG_USB_SERIAL_EMPEG=m
CONFIG_NLS_CODEPAGE_852=m
CONFIG_TCG_TIS=m
CONFIG_TOUCHSCREEN_USB_IDEALTEK=y
CONFIG_NETFILTER_XT_MATCH_COMMENT=m
CONFIG_NFS_SWAP=y
CONFIG_I2C_ISCH=m
CONFIG_USB_NET_RNDIS_HOST=m
CONFIG_NET=y
CONFIG_INPUT_EVDEV=y
CONFIG_NET_IFE_SKBMARK=m
CONFIG_NETFILTER_XT_TARGET_TCPMSS=m
CONFIG_B43LEGACY_DMA=y
CONFIG_ACPI_SLEEP=y
CONFIG_NETFILTER_XT_MATCH_DSCP=m
CONFIG_CRYPTO_WP512=m
CONFIG_CFAG12864B_RATE=20
CONFIG_HID_DRAGONRISE=m
CONFIG_X86_ESPFIX64=y
CONFIG_NETFILTER_XT_MATCH_CONNTRACK=m
CONFIG_BLOCK_COMPAT=y
CONFIG_ITCO_WDT=m
CONFIG_NETFILTER_XT_MATCH_RATEEST=m
CONFIG_PINMUX=y
CONFIG_USB_LD=m
CONFIG_BOOTPARAM_HARDLOCKUP_PANIC=y
CONFIG_QUOTA_TREE=y
CONFIG_INPUT_PCSPKR=m
CONFIG_IRQ_DOMAIN_HIERARCHY=y
CONFIG_HVC_XEN_FRONTEND=y
CONFIG_MPILIB=y
CONFIG_USB_NET_CDCETHER=m
CONFIG_PACKET=y
CONFIG_XFRM_ALGO=y
CONFIG_NF_CONNTRACK_TIMESTAMP=y
CONFIG_SCIF=m
CONFIG_RMI4_I2C=m
CONFIG_HAVE_CLK_PREPARE=y
CONFIG_CRYPTO_AKCIPHER2=y
CONFIG_NODES_SHIFT=9
CONFIG_MWIFIEX_SDIO=m
CONFIG_NETFILTER_XT_MATCH_IPRANGE=m
CONFIG_INTEL_IOATDMA=m
CONFIG_NET_CLS_BASIC=m
CONFIG_ASYMMETRIC_PUBLIC_KEY_SUBTYPE=y
CONFIG_I2C_TINY_USB=m
CONFIG_FUSION_SPI=m
CONFIG_FRONTSWAP=y
CONFIG_DUMMY_CONSOLE_ROWS=25
CONFIG_NF_CONNTRACK_TFTP=m
CONFIG_NFS_V3=m
CONFIG_RTC_DRV_MAX6902=m
CONFIG_HAVE_KVM_IRQFD=y
CONFIG_NLS_CODEPAGE_949=m
CONFIG_SENSORS_TMP102=m
CONFIG_NOP_TRACER=y
CONFIG_BACKLIGHT_LCD_SUPPORT=y
CONFIG_LOOPBACK_TARGET=m
CONFIG_ISL29020=m
CONFIG_HID_CORSAIR=m
CONFIG_XEN_XENBUS_FRONTEND=y
CONFIG_INET=y
CONFIG_CRYPTO_PCRYPT=m
CONFIG_IP_ROUTE_VERBOSE=y
CONFIG_XZ_DEC_POWERPC=y
CONFIG_INTEL_PCH_THERMAL=m
CONFIG_VIRTIO_NET=m
CONFIG_TOUCHSCREEN_SIS_I2C=m
CONFIG_NETFILTER_XT_MATCH_ADDRTYPE=m
CONFIG_PREVENT_FIRMWARE_BUILD=y
CONFIG_SERIAL_8250_PNP=y
CONFIG_USB_NET_MCS7830=m
CONFIG_CRYPTO_TWOFISH=m
CONFIG_FREEZER=y
CONFIG_SENSORS_I5500=m
CONFIG_HAVE_HARDLOCKUP_DETECTOR_PERF=y
CONFIG_W1_SLAVE_DS2413=m
CONFIG_ADAPTEC_STARFIRE=m
CONFIG_INPUT_CM109=m
CONFIG_PCI_DOMAINS=y
CONFIG_NFT_QUEUE=m
CONFIG_LCD_PLATFORM=m
CONFIG_SENSORS_IT87=m
CONFIG_LPC_SCH=m
CONFIG_NET_CLS_ACT=y
CONFIG_REED_SOLOMON=m
CONFIG_CIFS_DFS_UPCALL=y
CONFIG_NET_VENDOR_CHELSIO=y
CONFIG_LZ4HC_COMPRESS=m
CONFIG_EFIVAR_FS=y
CONFIG_BRIDGE_EBT_BROUTE=m
CONFIG_USB_NET_SMSC75XX=m
CONFIG_BE2NET=m
CONFIG_PARPORT=m
CONFIG_HAVE_ARCH_VMAP_STACK=y
CONFIG_VORTEX=m
CONFIG_NETFILTER_XT_MATCH_IPVS=m
CONFIG_TIPC_MEDIA_UDP=y
CONFIG_VMWARE_VMCI_VSOCKETS=m
CONFIG_X86_DEBUGCTLMSR=y
CONFIG_HEADERS_CHECK=y
CONFIG_NET_CLS_BPF=m
CONFIG_NET_DSA_TAG_BRCM_PREPEND=y
CONFIG_NFS_V4_1_IMPLEMENTATION_ID_DOMAIN="kernel.org"
CONFIG_IP_SET_MAX=256
CONFIG_HAPPYMEAL=m
CONFIG_HID_WACOM=m
CONFIG_QLCNIC_DCB=y
CONFIG_SCIF_BUS=m
CONFIG_USB_SERIAL_CP210X=m
CONFIG_NET_SCH_SFQ=m
CONFIG_RTC_LIB=y
CONFIG_NVDIMM_DAX=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_NETFILTER_XT_MATCH_POLICY=m
CONFIG_MWL8K=m
CONFIG_KGDB_TESTS=y
CONFIG_HAVE_KPROBES=y
CONFIG_NUMA_BALANCING_DEFAULT_ENABLED=y
CONFIG_IP_ROUTE_CLASSID=y
CONFIG_MOUSE_SYNAPTICS_I2C=m
CONFIG_NETFILTER_XT_TARGET_TEE=m
CONFIG_HPWDT_NMI_DECODING=y
CONFIG_USB_SERIAL_XSENS_MT=m
CONFIG_TOUCHSCREEN_USB_ITM=y
CONFIG_CRYPTO_AES=y
CONFIG_BACKLIGHT_LP855X=m
CONFIG_GPIOLIB=y
CONFIG_SSB=m
CONFIG_ZONE_DEVICE=y
CONFIG_FUTEX_PI=y
CONFIG_BMC150_ACCEL_SPI=m
CONFIG_I2C_STUB=m
CONFIG_DM_BIO_PRISON=m
CONFIG_GENERIC_CPU_VULNERABILITIES=y
CONFIG_NFT_LIMIT=m
CONFIG_HAVE_ARCH_WITHIN_STACK_FRAMES=y
CONFIG_KEYS_COMPAT=y
CONFIG_HID_PID=y
CONFIG_NV_TCO=m
CONFIG_USB_SERIAL_QT2=m
CONFIG_SMSC9420=m
CONFIG_SENSORS_MAX6639=m
CONFIG_IWLWIFI_DEBUG=y
CONFIG_AUTOFS_FS=y
CONFIG_GAMEPORT=m
CONFIG_ISO9660_FS=m
CONFIG_SKY2=m
CONFIG_NETFILTER_XT_NAT=m
CONFIG_RTC_DRV_DS3232=m
CONFIG_XEN_WDT=m
CONFIG_UIO=m
CONFIG_HID_WALTOP=m
CONFIG_HAVE_HARDENED_USERCOPY_ALLOCATOR=y
CONFIG_SCSI_VIRTIO=m
CONFIG_NF_CONNTRACK_MARK=y
CONFIG_HVC_DRIVER=y
CONFIG_BLK_DEV_PCIESSD_MTIP32XX=m
CONFIG_NETFILTER=y
CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=m
CONFIG_MODULE_SIG=y
CONFIG_BRIDGE_EBT_AMONG=m
CONFIG_B53=m
CONFIG_B43_PIO=y
CONFIG_X86_DEV_DMA_OPS=y
CONFIG_B43_BUSES_BCMA_AND_SSB=y
CONFIG_X86_MSR=y
CONFIG_HAVE_ARCH_KASAN=y
CONFIG_NET_VENDOR_SMSC=y
CONFIG_NETFILTER_NETLINK_ACCT=m
CONFIG_NETFILTER_XT_MATCH_CLUSTER=m
CONFIG_USB_KC2190=y
CONFIG_R6040=m
CONFIG_USB_MDC800=m
CONFIG_HWMON_VID=m
CONFIG_SERIO_SERPORT=y
CONFIG_FB_BOOT_VESA_SUPPORT=y
CONFIG_NLS_CODEPAGE_950=m
CONFIG_LEDS_TRIGGER_ONESHOT=m
CONFIG_HAVE_NMI=y
CONFIG_NET_SCH_QFQ=m
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_IXGBEVF=m
CONFIG_TABLET_SERIAL_WACOM4=m
CONFIG_RD_XZ=y
CONFIG_IP_MROUTE=y
CONFIG_INET_XFRM_MODE_TUNNEL=m
CONFIG_X86_SMAP=y
CONFIG_VGA_CONSOLE=y
CONFIG_NF_NAT_NEEDED=y
CONFIG_CRYPTO_ECDH=m
CONFIG_HAVE_DYNAMIC_FTRACE_WITH_REGS=y
CONFIG_NET_ACT_TUNNEL_KEY=m
CONFIG_USB_SERIAL_SAFE_PADDED=y
CONFIG_HID_RMI=m
CONFIG_ATA_VERBOSE_ERROR=y
CONFIG_XEN_BLKDEV_FRONTEND=m
CONFIG_NF_CONNTRACK_SNMP=m
CONFIG_UEFI_CPER_X86=y
CONFIG_USB_SERIAL_BELKIN=m
CONFIG_W1_MASTER_DS2490=m
CONFIG_PRINTK_NMI=y
CONFIG_NLS_MAC_GREEK=m
CONFIG_NET_FLOW_LIMIT=y
CONFIG_XFS_FS=m
CONFIG_SENSORS_DME1737=m
CONFIG_INPUT_KEYSPAN_REMOTE=m
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_X86_MCE_INJECT=m
CONFIG_TOUCHSCREEN_ELO=m
CONFIG_NLS_CODEPAGE_869=m
CONFIG_SENSORS_NCT7904=m
CONFIG_IP6_NF_TARGET_MASQUERADE=m
CONFIG_NFT_REDIR=m
CONFIG_SATA_VIA=m
CONFIG_ACPI_PROCESSOR_IDLE=y
CONFIG_ARCH_WANT_COMPAT_IPC_PARSE_VERSION=y
CONFIG_NO_HZ=y
CONFIG_ARCH_WANT_HUGE_PMD_SHARE=y
CONFIG_POSIX_MQUEUE=y
CONFIG_NOUVEAU_DEBUG=5
CONFIG_NETFILTER_INGRESS=y
CONFIG_TOUCHSCREEN_TOUCHIT213=m
CONFIG_ARCH_WANTS_DYNAMIC_TASK_STRUCT=y
CONFIG_SENSORS_LM83=m
CONFIG_USB_NET_CDC_MBIM=m
CONFIG_PMC_ATOM=y
CONFIG_ACENIC=m
CONFIG_ARCH_MIGHT_HAVE_PC_SERIO=y
CONFIG_PSTORE_RAM=m
CONFIG_LEDS_BLINKM=m
CONFIG_CPU_FREQ_STAT=y
CONFIG_ISCSI_IBFT=m
CONFIG_SPI_PXA2XX=m
CONFIG_TIFM_CORE=m
CONFIG_XEN_PRIVCMD=m
CONFIG_FUSION_SAS=m
CONFIG_GENERIC_STRNCPY_FROM_USER=y
CONFIG_MTD_BLKDEVS=m
CONFIG_BLK_DEV_3W_XXXX_RAID=m
CONFIG_HAVE_RSEQ=y
CONFIG_NET_SCH_MQPRIO=m
CONFIG_NETFILTER_XT_TARGET_NETMAP=m
CONFIG_MLX5_CORE_EN_DCB=y
CONFIG_APDS9802ALS=m
CONFIG_PATA_MARVELL=m
CONFIG_CRYPTO_CAMELLIA_AESNI_AVX_X86_64=m
CONFIG_NETFILTER_XT_MATCH_SCTP=m
CONFIG_SATA_SIL24=m
CONFIG_CRASH_CORE=y
CONFIG_NET_VENDOR_DEC=y
CONFIG_NLS_ISO8859_15=m
CONFIG_HID_SENSOR_MAGNETOMETER_3D=m
CONFIG_TOUCHSCREEN_EETI=m
CONFIG_SENSORS_VIA686A=m
CONFIG_INET6_ESP=m
CONFIG_IP_VS_WRR=m
CONFIG_INTEL_IOMMU_SVM=y
CONFIG_AUTOFS4_FS=y
CONFIG_NET_NSH=m
CONFIG_ATH5K=m
CONFIG_ACPI_BUTTON=y
CONFIG_ILLEGAL_POINTER_VALUE=0xdead000000000000
CONFIG_CRYPTO_DEV_CCP_CRYPTO=m
CONFIG_NETFILTER_XT_SET=m
CONFIG_NLS_MAC_CROATIAN=m
CONFIG_FMC=m
CONFIG_INFINIBAND_IPOIB_DEBUG_DATA=y
CONFIG_TASKSTATS=y
CONFIG_NLS_CODEPAGE_932=m
CONFIG_RT2X00_LIB_MMIO=m
CONFIG_CRYPTO_CRC32C_INTEL=m
CONFIG_NLS_MAC_ICELAND=m
CONFIG_IP6_NF_FILTER=m
CONFIG_DELL_WMI_DESCRIPTOR=m
CONFIG_SYSTEM_DATA_VERIFICATION=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_EFI_ESRT=y
CONFIG_NEED_DMA_MAP_STATE=y
CONFIG_SENSORS_G762=m
CONFIG_IIO=m
CONFIG_GARP=m
CONFIG_RT2500USB=m
CONFIG_MOUSE_PS2_LIFEBOOK=y
CONFIG_SERIO_LIBPS2=y
CONFIG_BLK_DEV_DRBD=m
CONFIG_IP_VS_PROTO_TCP=y
CONFIG_QED_OOO=y
CONFIG_ISCSI_BOOT_SYSFS=m
CONFIG_X86_CPUID=y
CONFIG_CRYPTO_DEV_QAT_C3XXXVF=m
CONFIG_NET_SCH_RED=m
CONFIG_NETFILTER_XT_MATCH_NFACCT=m
CONFIG_NETFILTER_XT_MATCH_CONNBYTES=m
CONFIG_KDB_CONTINUE_CATASTROPHIC=0
CONFIG_USB_PRINTER=m
CONFIG_FONT_8x8=y
CONFIG_SSB_SPROM=y
CONFIG_NET_VENDOR_ATHEROS=y
CONFIG_TRANSPARENT_HUGE_PAGECACHE=y
CONFIG_USB_SERIAL_IR=m
CONFIG_SKGE=m
CONFIG_TCM_PSCSI=m
CONFIG_RELOCATABLE=y
CONFIG_CRYPTO_POLY1305=m
CONFIG_QUEUED_SPINLOCKS=y
CONFIG_XOR_BLOCKS=m
CONFIG_HID_TWINHAN=m
CONFIG_ARCH_HAS_HMM=y
CONFIG_SENSORS_NTC_THERMISTOR=m
CONFIG_NET_VENDOR_SUN=y
CONFIG_DMIID=y
CONFIG_ARCH_HAS_MEM_ENCRYPT=y
CONFIG_PANIC_TIMEOUT=0
CONFIG_ASUS_WMI=m
CONFIG_SENSORS_DS1621=m
CONFIG_MMC_TOSHIBA_PCI=m
CONFIG_QUOTA_NETLINK_INTERFACE=y
CONFIG_INPUT_JOYSTICK=y
CONFIG_NET_ACT_SIMP=m
CONFIG_RT2X00_LIB=m
CONFIG_HID_BATTERY_STRENGTH=y
CONFIG_PM_GENERIC_DOMAINS_SLEEP=y
CONFIG_DM_VERITY=m
CONFIG_NETFILTER_XT_MATCH_ECN=m
CONFIG_ARCH_MIGHT_HAVE_PC_PARPORT=y
CONFIG_ATH9K_PCOEM=y
CONFIG_USB_STORAGE_SDDR55=m
CONFIG_PPDEV=m
CONFIG_CC_HAS_STACKPROTECTOR_NONE=y
CONFIG_IP_NF_TARGET_TTL=m
CONFIG_NF_NAT_MASQUERADE_IPV4=y
CONFIG_LWTUNNEL_BPF=y
CONFIG_CFG80211_DEFAULT_PS=y
CONFIG_GENERIC_IOMAP=y
CONFIG_BUILD_BIN2C=y
CONFIG_USBIP_HOST=m
CONFIG_TOUCHSCREEN_WACOM_W8001=m
CONFIG_RTL8723AE=m
CONFIG_DECOMPRESS_LZ4=y
CONFIG_NETFILTER_NETLINK_OSF=m
CONFIG_XEN_FBDEV_FRONTEND=y
CONFIG_SPARSEMEM_MANUAL=y
CONFIG_DMI_SCAN_MACHINE_NON_EFI_FALLBACK=y
CONFIG_RT2X00_LIB_FIRMWARE=y
CONFIG_DL2K=m
CONFIG_TOUCHSCREEN_MMS114=m
CONFIG_BPF_SYSCALL=y
CONFIG_SMP=y
CONFIG_NET_VENDOR_CADENCE=y
CONFIG_MFD_INTEL_LPSS_ACPI=m
CONFIG_TTY=y
CONFIG_NETFILTER_XT_MATCH_TIME=m
CONFIG_IP_VS=m
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_ZSMALLOC=y
CONFIG_DM_UEVENT=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_MMA7660=m
CONFIG_X86_P6_NOP=y
CONFIG_PNP=y
CONFIG_RTC_DRV_RP5C01=m
CONFIG_NETFILTER_XT_MATCH_MAC=m
CONFIG_I2C_NFORCE2_S4985=m
CONFIG_SENSORS_NCT6775=m
CONFIG_DW_DMAC_CORE=y
CONFIG_NET_ACT_PEDIT=m
CONFIG_NETFILTER_XT_TARGET_NFLOG=m
CONFIG_TOUCHSCREEN_USB_JASTEC=y
CONFIG_GENERIC_ALLOCATOR=y
CONFIG_OPENVSWITCH=m
CONFIG_RTC_DRV_DS1390=m
CONFIG_L2TP=m
CONFIG_TCP_CONG_WESTWOOD=m
CONFIG_RTC_DRV_M41T93=m
CONFIG_KALLSYMS_ALL=y
CONFIG_HID_AUREAL=m
CONFIG_IPMI_SSIF=m
CONFIG_X86_DECODER_SELFTEST=y
CONFIG_SQUASHFS_LZ4=y
CONFIG_LIBCRC32C=m
CONFIG_RSI_USB=m
CONFIG_HAVE_BOOTMEM_INFO_NODE=y
CONFIG_GENERIC_BUG=y
CONFIG_CRYPTO_SHA256=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_JOYSTICK_GUILLEMOT=m
CONFIG_BRIDGE_VLAN_FILTERING=y
CONFIG_WL18XX=m
CONFIG_INET_TCP_DIAG=m
CONFIG_HID_SONY=m
CONFIG_PCI_PASID=y
CONFIG_CRYPTO_BLOWFISH_X86_64=m
CONFIG_HW_CONSOLE=y
CONFIG_MDIO_BITBANG=m
CONFIG_NET_ACT_IPT=m
CONFIG_HAVE_KVM_IRQ_ROUTING=y
CONFIG_LEDS_MLXCPLD=m
CONFIG_DM_DEBUG=y
CONFIG_SCSI_BNX2X_FCOE=m
CONFIG_RAS=y
CONFIG_HYPERV_NET=m
CONFIG_DEVMEM=y
CONFIG_SMSC_PHY=m
CONFIG_HP_ACCEL=m
CONFIG_MOUSE_PS2_FOCALTECH=y
CONFIG_SCSI_BNX2_ISCSI=m
CONFIG_MLX5_CORE=m
CONFIG_NFT_LOG=m
CONFIG_TOUCHSCREEN_MTOUCH=m
CONFIG_BRIDGE_EBT_IP=m
CONFIG_HID_MONTEREY=m
CONFIG_USB_SERIAL_CYPRESS_M8=m
CONFIG_HID_EZKEY=m
CONFIG_PADATA=y
CONFIG_IOSCHED_NOOP=y
CONFIG_THERMAL_GOV_USER_SPACE=y
CONFIG_IPW2200_QOS=y
CONFIG_MDIO_BCM_UNIMAC=m
CONFIG_XEN_TMEM=m
CONFIG_ATH9K_COMMON_DEBUG=y
CONFIG_DM_THIN_PROVISIONING=m
CONFIG_IPMI_DMI_DECODE=y
CONFIG_HAVE_UID16=y
CONFIG_SERIAL_NONSTANDARD=y
CONFIG_RT61PCI=m
CONFIG_COMPAT_OLD_SIGACTION=y
CONFIG_PATA_JMICRON=m
CONFIG_TOUCHSCREEN_TSC_SERIO=m
CONFIG_RTC_NVMEM=y
CONFIG_SCSI_OSD_ULD=m
CONFIG_X86_FEATURE_NAMES=y
CONFIG_JOYSTICK_XPAD_LEDS=y
CONFIG_SENSORS_TC74=m
CONFIG_IPW2100=m
CONFIG_QUOTACTL=y
CONFIG_RTC_DRV_RX8581=m
CONFIG_PARAVIRT=y
CONFIG_CRYPTO_CRYPTD=y
CONFIG_NF_SOCKET_IPV4=m
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_CRYPTO_CHACHA20_X86_64=m
CONFIG_CM32181=m
CONFIG_USBIP_VHCI_HCD=m
CONFIG_DEBUG_KERNEL=y
CONFIG_RTL8192DE=m
CONFIG_ACPI_TOSHIBA=m
CONFIG_GAMEPORT_NS558=m
CONFIG_I2C_VIPERBOARD=m
CONFIG_LOCALVERSION="-KM3"
CONFIG_PATA_IT821X=m
CONFIG_GENERIC_IRQ_EFFECTIVE_AFF_MASK=y
CONFIG_ACERHDF=m
CONFIG_HAVE_PCSPKR_PLATFORM=y
CONFIG_NFS_FSCACHE=y
CONFIG_MAC80211_MESH=y
CONFIG_MMC_WBSD=m
CONFIG_CRYPTO=y
CONFIG_SENSORS_EMC6W201=m
CONFIG_FUNCTION_TRACER=y
CONFIG_USB_TRANCEVIBRATOR=m
CONFIG_SCHED_DEBUG=y
CONFIG_NET_VENDOR_BROCADE=y
CONFIG_DEFAULT_MMAP_MIN_ADDR=65536
CONFIG_SYSTEM_TRUSTED_KEYS=""
CONFIG_A11Y_BRAILLE_CONSOLE=y
CONFIG_PERF_EVENTS_INTEL_UNCORE=m
CONFIG_I2C_SIS96X=m
CONFIG_MMC_TIFM_SD=m
CONFIG_IP_NF_IPTABLES=y
CONFIG_VSOCKETS=m
CONFIG_FB_VIRTUAL=m
CONFIG_DYNAMIC_FTRACE_WITH_REGS=y
CONFIG_PCIE_PTM=y
CONFIG_IWLWIFI_LEDS=y
CONFIG_NET_VENDOR_QLOGIC=y
CONFIG_RUNTIME_TESTING_MENU=y
CONFIG_MPLS_IPTUNNEL=m
CONFIG_USB_XHCI_HCD=y
CONFIG_VIRTIO=m
CONFIG_DEFAULT_CUBIC=y
CONFIG_MFD_SM501=m
CONFIG_HID_SAMSUNG=m
CONFIG_PARMAN=m
CONFIG_IP_SET_LIST_SET=m
CONFIG_TCM_IBLOCK=m
CONFIG_IP_PIMSM_V2=y
CONFIG_CFS_BANDWIDTH=y
CONFIG_XFRM_STATISTICS=y
CONFIG_X86_MCE_THRESHOLD=y
CONFIG_VIA_RHINE_MMIO=y
CONFIG_USB_ISIGHTFW=m
CONFIG_JME=m
CONFIG_DMA_VIRTUAL_CHANNELS=y
CONFIG_SCSI_WD719X=m
CONFIG_GENERIC_MSI_IRQ_DOMAIN=y
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_STRICT_DEVMEM=y
CONFIG_CACHEFILES=m
CONFIG_PATA_OLDPIIX=m
CONFIG_GENERIC_IRQ_SHOW=y
CONFIG_IPV6_OPTIMISTIC_DAD=y
CONFIG_ARCH_HAS_ELF_RANDOMIZE=y
CONFIG_MD_AUTODETECT=y
CONFIG_ASUS_WIRELESS=m
CONFIG_PANIC_ON_OOPS_VALUE=0
CONFIG_JOYSTICK_A3D=m
CONFIG_SENSORS_ATK0110=m
CONFIG_TCP_CONG_HSTCP=m
CONFIG_SCSI_MOD=y
CONFIG_SCSI_SMARTPQI=m
CONFIG_NET_VENDOR_MICREL=y
CONFIG_AUDIT_TREE=y
CONFIG_MPLS_ROUTING=m
CONFIG_F2FS_FS_POSIX_ACL=y
CONFIG_ARCH_HAS_ADD_PAGES=y
CONFIG_JOYSTICK_ZHENHUA=m
CONFIG_USB_SERIAL_SPCP8X5=m
CONFIG_B43_LEDS=y
CONFIG_UBIFS_FS_XATTR=y
CONFIG_P54_USB=m
CONFIG_TOUCHSCREEN_MK712=m
CONFIG_LEDS_CLASS_FLASH=m
CONFIG_USB_NET_HUAWEI_CDC_NCM=m
CONFIG_SCSI_ESAS2R=m
CONFIG_CRYPTO_CRC32C=y
CONFIG_SERIAL_CORE=y
CONFIG_IIO_ST_SENSORS_I2C=m
CONFIG_FUSE_FS=m
CONFIG_BUILDTIME_EXTABLE_SORT=y
CONFIG_UID16=y
CONFIG_DW_DMAC=m
CONFIG_ETHOC=m
CONFIG_ACPI_HED=y
CONFIG_HAVE_DEBUG_STACKOVERFLOW=y
CONFIG_HID_MICROSOFT=m
CONFIG_PCC=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HYPERV_BALLOON=m
CONFIG_SENSORS_LM25066=m
CONFIG_ASSOCIATIVE_ARRAY=y
CONFIG_HSA_AMD=m
CONFIG_AGP_VIA=y
CONFIG_NF_DEFRAG_IPV6=m
CONFIG_MICREL_PHY=m
CONFIG_DRM_LOAD_EDID_FIRMWARE=y
CONFIG_KS0108=m
CONFIG_NFS_V4=m
CONFIG_PPP_FILTER=y
CONFIG_DYNAMIC_FTRACE=y
CONFIG_MAILBOX=y
CONFIG_INPUT_LEDS=y
CONFIG_RCU_NEED_SEGCBLIST=y
CONFIG_INLINE_READ_UNLOCK=y
CONFIG_DEBUG_WX=y
CONFIG_PATA_PDC2027X=m
CONFIG_SENSORS_LTC2978=m
CONFIG_HAS_DMA=y
CONFIG_INTEL_IPS=m
CONFIG_EDAC=y
CONFIG_USB_SERIAL_VISOR=m
CONFIG_BROADCOM_PHY=m
CONFIG_DEBUG_BOOT_PARAMS=y
CONFIG_IO_DELAY_TYPE_NONE=3
CONFIG_SCSI=y
CONFIG_LEDS_TRIGGER_PANIC=y
CONFIG_FB_CFB_FILLRECT=y
CONFIG_RT2800_LIB_MMIO=m
CONFIG_HYPERV=m
CONFIG_FUNCTION_GRAPH_TRACER=y
CONFIG_NF_NAT_PPTP=m
CONFIG_HID_CHICONY=m
CONFIG_NLS_MAC_ROMAN=m
CONFIG_HAVE_ARCH_THREAD_STRUCT_WHITELIST=y
CONFIG_HID=y
CONFIG_HW_RANDOM_AMD=m
CONFIG_CGROUP_NET_PRIO=y
CONFIG_RANDOMIZE_BASE=y
CONFIG_DEVFREQ_GOV_SIMPLE_ONDEMAND=m
CONFIG_SLIP_SMART=y
CONFIG_IXGB=m
CONFIG_NLS_ISO8859_9=m
CONFIG_TOUCHSCREEN_ZFORCE=m
CONFIG_NET_ACT_BPF=m
CONFIG_AMD_IOMMU_V2=m
CONFIG_USB_ARMLINUX=y
CONFIG_I2C_SMBUS=m
CONFIG_IP_VS_PE_SIP=m
CONFIG_JOYSTICK_GF2K=m
CONFIG_RTLWIFI=m
CONFIG_CLKDEV_LOOKUP=y
CONFIG_LEDS_TRIGGER_DEFAULT_ON=m
CONFIG_MXM_WMI=m
CONFIG_FONT_8x16=y
CONFIG_NET_VENDOR_MELLANOX=y
CONFIG_SERIAL_8250_MOXA=m
CONFIG_MAC80211_HWSIM=m
CONFIG_INTEL_MIC_X100_DMA=m
CONFIG_SERIAL_8250_MANY_PORTS=y
CONFIG_VT_CONSOLE_SLEEP=y
CONFIG_LIBFC=m
CONFIG_X86_MCE_INTEL=y
CONFIG_X86_64=y
CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
CONFIG_RTC_DRV_CMOS=y
CONFIG_CRYPTO_USER_API_AEAD=y
CONFIG_PCI_LOCKLESS_CONFIG=y
CONFIG_RTC_DRV_RV3029_HWMON=y
CONFIG_TCP_CONG_BBR=m
CONFIG_TOUCHSCREEN_USB_IRTOUCH=y
CONFIG_PATA_AMD=m
CONFIG_SQUASHFS_FRAGMENT_CACHE_SIZE=3
CONFIG_SENSORS_AD7414=m
CONFIG_TOUCHSCREEN_USB_PANJIT=y
CONFIG_RT2800PCI_RT53XX=y
CONFIG_BONDING=m
CONFIG_MLXSW_SPECTRUM_DCB=y
CONFIG_RTC_DRV_EM3027=m
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_JBD2=m
CONFIG_SENSORS_ASB100=m
CONFIG_PATA_NS87415=m
CONFIG_USBIP_CORE=m
CONFIG_SPARSEMEM_VMEMMAP=y
CONFIG_CRYPTO_CAMELLIA_X86_64=m
CONFIG_IB700_WDT=m
CONFIG_MMC_USHC=m
CONFIG_INET6_IPCOMP=m
CONFIG_QLCNIC=m
CONFIG_MEMCG_KMEM=y
CONFIG_NET_VENDOR_MARVELL=y
CONFIG_PHYLIB=y
CONFIG_IGB_DCA=y
CONFIG_CRYPTO_SHA1_SSSE3=m
CONFIG_IPV6_TUNNEL=m
CONFIG_SENSORS_LM77=m
CONFIG_NET_VENDOR_NVIDIA=y
CONFIG_X86_AMD_FREQ_SENSITIVITY=m
CONFIG_HAVE_GENERIC_GUP=y
CONFIG_NLS_CODEPAGE_874=m
CONFIG_FB_CMDLINE=y
CONFIG_OPTIMIZE_INLINING=y
CONFIG_IRQ_DOMAIN=y
CONFIG_NET_DSA=m
CONFIG_VIRTIO_BALLOON=m
CONFIG_LSM_MMAP_MIN_ADDR=65536
CONFIG_SCSI_ARCMSR=m
CONFIG_PVPANIC=m
CONFIG_PPS_CLIENT_LDISC=m
CONFIG_ARCH_HAS_DEBUG_VIRTUAL=y
CONFIG_NET_TULIP=y
CONFIG_CRYPTO_DEV_SP_CCP=y
CONFIG_BNXT_HWMON=y
CONFIG_IPC_NS=y
CONFIG_CRYPTO_GLUE_HELPER_X86=y
CONFIG_MISC_FILESYSTEMS=y
CONFIG_ARCH_MMAP_RND_BITS_MIN=28
CONFIG_FTRACE=y
CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=m
CONFIG_ATP=m
CONFIG_X86_THERMAL_VECTOR=y
CONFIG_IP_NF_SECURITY=m
CONFIG_IP_NF_RAW=m
CONFIG_IP_NF_ARPFILTER=m
CONFIG_TOUCHSCREEN_USB_ETT_TC45USB=y
CONFIG_COMPAT_32=y
CONFIG_W1_CON=y
CONFIG_NETFILTER_XT_MATCH_SOCKET=m
CONFIG_HYPERV_TSCPAGE=y
CONFIG_PPPOL2TP=m
CONFIG_SYNCLINK=m
CONFIG_CLOCKSOURCE_WATCHDOG=y
CONFIG_HID_TOPSEED=m
CONFIG_B43_PHY_HT=y
CONFIG_DECOMPRESS_BZIP2=y
CONFIG_RT2800PCI_RT33XX=y
CONFIG_CORDIC=m
CONFIG_SENSORS_ADM1029=m
CONFIG_IIO_ST_SENSORS_CORE=m
CONFIG_KSM=y
CONFIG_ARCH_SUPPORTS_UPROBES=y
CONFIG_EXPORTFS_BLOCK_OPS=y
CONFIG_DRM_DP_AUX_CHARDEV=y
CONFIG_NET_VENDOR_STMICRO=y
CONFIG_EDAC_I3000=m
CONFIG_TOPSTAR_LAPTOP=m
CONFIG_AGP_SIS=y
CONFIG_NF_NAT_H323=m
CONFIG_XZ_DEC_SPARC=y
CONFIG_JOYSTICK_TURBOGRAFX=m
CONFIG_ARCH_SPARSEMEM_DEFAULT=y
CONFIG_MLXSW_PCI=m
CONFIG_USB_NET_QMI_WWAN=m
CONFIG_NET_TEAM_MODE_ROUNDROBIN=m
CONFIG_INPUT_CMA3000=m
CONFIG_EDAC_IE31200=m
CONFIG_ALIM1535_WDT=m
CONFIG_INLINE_READ_UNLOCK_IRQ=y
CONFIG_HID_HYPERV_MOUSE=m
CONFIG_GACT_PROB=y
CONFIG_REALTEK_PHY=m
CONFIG_PROC_VMCORE=y
CONFIG_HID_A4TECH=m
CONFIG_RTC_MC146818_LIB=y
CONFIG_NLS_CODEPAGE_860=m
CONFIG_INTEL_MEI_WDT=m
CONFIG_NETFILTER_XT_MATCH_ESP=m
CONFIG_NIU=m
CONFIG_MOUSE_PS2_VMMOUSE=y
CONFIG_IP_NF_TARGET_NETMAP=m
CONFIG_DST_CACHE=y
CONFIG_UNWINDER_ORC=y
CONFIG_NF_REJECT_IPV6=m
CONFIG_RCU_CPU_STALL_TIMEOUT=60
CONFIG_842_COMPRESS=m
CONFIG_SATA_VITESSE=m
CONFIG_NET_DSA_MV88E6XXX=m
CONFIG_CHECKPOINT_RESTORE=y
CONFIG_PRINTER=m
CONFIG_RTC_DRV_ISL1208=m
CONFIG_INT340X_THERMAL=m
CONFIG_CFG80211_DEBUGFS=y
CONFIG_HAVE_ARCH_COMPAT_MMAP_BASES=y
CONFIG_IIO_ST_GYRO_3AXIS=m
CONFIG_IP_ROUTE_MULTIPATH=y
CONFIG_RTC_DRV_PCF2123=m
CONFIG_INTEL_MIC_CARD=m
CONFIG_XEN_NETDEV_FRONTEND=m
CONFIG_INPUT_FF_MEMLESS=m
CONFIG_PARAVIRT_CLOCK=y
CONFIG_SENSORS_W83627HF=m
CONFIG_CHR_DEV_SG=y
CONFIG_IP_SET_HASH_NET=m
CONFIG_SECTION_MISMATCH_WARN_ONLY=y
CONFIG_NET_SCH_DSMARK=m
CONFIG_SSB_DRIVER_PCICORE_POSSIBLE=y
CONFIG_MDIO_DEVICE=y
CONFIG_X86_RESERVE_LOW=64
CONFIG_NFSD_PNFS=y
CONFIG_NEED_SG_DMA_LENGTH=y
CONFIG_POWER_RESET=y
CONFIG_CRYPTO_XCBC=m
CONFIG_NF_NAT_AMANDA=m
CONFIG_IPW2200=m
CONFIG_BRIDGE_EBT_MARK=m
CONFIG_SENSORS_ADT7411=m
CONFIG_IXGBE_DCA=y
CONFIG_IP6_NF_MATCH_IPV6HEADER=m
CONFIG_MACVLAN=m
CONFIG_PATA_PDC_OLD=m
CONFIG_L2TP_V3=y
CONFIG_RTL8723_COMMON=m
CONFIG_CHELSIO_T1_1G=y
CONFIG_BPF_JIT=y
CONFIG_IIO_INTERRUPT_TRIGGER=m
CONFIG_MMCONF_FAM10H=y
CONFIG_SENSORS_INA2XX=m
CONFIG_WLCORE_SDIO=m
CONFIG_CRYPTO_SHA512_MB=m
CONFIG_JOYSTICK_IFORCE=m
CONFIG_PROFILING=y
CONFIG_INTERVAL_TREE=y
CONFIG_IOSF_MBI=y
CONFIG_NET_VENDOR_AMAZON=y
CONFIG_SPARSEMEM=y
CONFIG_INET6_XFRM_MODE_TRANSPORT=m
CONFIG_CRYPTO_ARC4=m
CONFIG_VHOST_NET=m
CONFIG_I2C_NFORCE2=m
CONFIG_USB_SERIAL_DIGI_ACCELEPORT=m
CONFIG_GRACE_PERIOD=m
CONFIG_SLHC=m
CONFIG_NET_VENDOR_TEHUTI=y
CONFIG_QED_RDMA=y
CONFIG_SCSI_UFSHCD_PCI=m
CONFIG_ALTERA_TSE=m
CONFIG_E1000E_HWTS=y
CONFIG_CRYPTO_MANAGER=y
CONFIG_INTEL_MEI_TXE=m
CONFIG_SCSI_IPR_TRACE=y
CONFIG_NET_SCH_HTB=m
CONFIG_EEPROM_AT24=m
CONFIG_UIO_SERCOS3=m
CONFIG_PPP_BSDCOMP=m
CONFIG_SCHED_SMT=y
CONFIG_EDAC_SUPPORT=y
CONFIG_RT_MUTEXES=y
CONFIG_LOCK_SPIN_ON_OWNER=y
CONFIG_WLCORE=m
CONFIG_HID_ORTEK=m
CONFIG_NETFILTER_XT_TARGET_MARK=m
CONFIG_HID_ASUS=m
CONFIG_AR5523=m
CONFIG_ATH10K_CE=y
CONFIG_DRM_I2C_SIL164=m
CONFIG_MD_LINEAR=m
CONFIG_SATA_INIC162X=m
CONFIG_HUGETLBFS=y
CONFIG_CHECK_SIGNATURE=y
CONFIG_SLAB_MERGE_DEFAULT=y
CONFIG_KERNFS=y
CONFIG_X86_INTEL_MPX=y
CONFIG_WL1251=m
CONFIG_I2C_ALGOBIT=m
CONFIG_IPV6_SUBTREES=y
CONFIG_MMC_BLOCK=m
CONFIG_NET_CLS_FW=m
CONFIG_CRYPTO_DEV_CCP=y
CONFIG_KVM=m
CONFIG_PAGE_COUNTER=y
CONFIG_W1_SLAVE_DS2781=m
CONFIG_EXPERT=y
CONFIG_ATL1C=m
CONFIG_DMAR_TABLE=y
CONFIG_MFD_INTEL_LPSS_PCI=m
CONFIG_HW_RANDOM_INTEL=m
CONFIG_NTB_AMD=m
CONFIG_LXT_PHY=m
CONFIG_CFG80211_CRDA_SUPPORT=y
CONFIG_WIRELESS=y
CONFIG_WEXT_PROC=y
CONFIG_BCMA_DRIVER_PCI=y
CONFIG_SQUASHFS=m
CONFIG_EDAC_I7CORE=m
CONFIG_X86_IO_APIC=y
CONFIG_ARCH_HAS_STRICT_KERNEL_RWX=y
CONFIG_DELL_WMI_AIO=m
CONFIG_LOCK_DEBUGGING_SUPPORT=y
CONFIG_NET_SCH_TBF=m
CONFIG_PKCS7_MESSAGE_PARSER=y
CONFIG_USB_NET_CH9200=m
CONFIG_CC_HAS_SANE_STACKPROTECTOR=y
CONFIG_USB_LED_TRIG=y
CONFIG_KGDB=y
CONFIG_SERIO_RAW=m
CONFIG_TASK_IO_ACCOUNTING=y
CONFIG_FAT_DEFAULT_IOCHARSET="ascii"
CONFIG_USBIP_VHCI_NR_HCS=1
CONFIG_ASYNC_XOR=m
CONFIG_NET_CLS_RSVP=m
CONFIG_TIPC=m
CONFIG_MEMORY_HOTPLUG_SPARSE=y
CONFIG_W83977F_WDT=m
CONFIG_MD_RAID0=m
CONFIG_FRAME_WARN=2048
CONFIG_NET_VENDOR_AGERE=y
CONFIG_USB_NET_CDC_NCM=m
CONFIG_HID_GENERIC=y
CONFIG_ARCH_MMAP_RND_BITS=28
CONFIG_X86_VSYSCALL_EMULATION=y
CONFIG_HP_WATCHDOG=m
CONFIG_ARCH_HAS_ZONE_DEVICE=y
CONFIG_BCM87XX_PHY=m
CONFIG_I2C_DESIGNWARE_PCI=m
CONFIG_ASYNC_RAID6_TEST=m
CONFIG_PATA_SCH=m
CONFIG_CRYPTO_DEV_SP_PSP=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_INITRAMFS_SOURCE=""
CONFIG_RTL_CARDS=m
CONFIG_PATA_NETCELL=m
CONFIG_DEBUG_RODATA_TEST=y
CONFIG_DHT11=m
CONFIG_RTC_DRV_DS1374_WDT=y
CONFIG_CGROUPS=y
CONFIG_MMC=m
CONFIG_LZO_COMPRESS=y
CONFIG_DAX=y
CONFIG_VIRTIO_INPUT=m
CONFIG_HAVE_ARCH_MMAP_RND_COMPAT_BITS=y
CONFIG_TOUCHSCREEN_USB_GUNZE=y
CONFIG_CRYPTO_SEQIV=y
CONFIG_ACPI_SPCR_TABLE=y
CONFIG_BRCMFMAC=m
CONFIG_HID_LOGITECH=m
CONFIG_USB_SERIAL_CONSOLE=y
CONFIG_DM_LOG_USERSPACE=m
CONFIG_JOYSTICK_GAMECON=m
CONFIG_CRYPTO_USER_API_RNG=y
CONFIG_SCSI_ENCLOSURE=m
CONFIG_HAVE_GCC_PLUGINS=y
CONFIG_STACKTRACE=y
CONFIG_SENSORS_LM92=m
CONFIG_EXTCON=y
CONFIG_CHELSIO_LIB=m
CONFIG_SCSI_SAS_LIBSAS=m
CONFIG_ISCSI_TARGET=m
CONFIG_HAVE_ACPI_APEI=y
CONFIG_OPROFILE_NMI_TIMER=y
CONFIG_TOSHIBA_HAPS=m
CONFIG_NETFILTER_XT_TARGET_IDLETIMER=m
CONFIG_VFIO_PCI_INTX=y
CONFIG_UIO_AEC=m
CONFIG_SCSI_PM8001=m
CONFIG_USB_NET_RNDIS_WLAN=m
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_IFB=m
CONFIG_IIO_ST_ACCEL_3AXIS=m
CONFIG_LEDS_LP3944=m
CONFIG_USB_SEVSEG=m
CONFIG_IPV6_VTI=m
CONFIG_CRYPTO_DRBG=y
CONFIG_RTC_DRV_PCF8563=m
CONFIG_PPTP=m
CONFIG_SENSORS_SMSC47M1=m
CONFIG_ISCSI_IBFT_FIND=y
CONFIG_KGDB_KDB=y
CONFIG_DCB=y
CONFIG_PCIPCWATCHDOG=m
CONFIG_CGROUP_CPUACCT=y
CONFIG_USB_SERIAL_OTI6858=m
CONFIG_HAS_IOPORT_MAP=y
CONFIG_X86_CMPXCHG64=y
CONFIG_NLMON=m
CONFIG_ATH10K_PCI=m
CONFIG_NET_VENDOR_VIA=y
CONFIG_UBIFS_FS_SECURITY=y
CONFIG_ISA_DMA_API=y
CONFIG_HZ=1000
CONFIG_SERIAL_8250_SHARE_IRQ=y
CONFIG_NET_ACT_VLAN=m
CONFIG_IXGBE_HWMON=y
CONFIG_USB_RTL8152=m
CONFIG_NEED_MULTIPLE_NODES=y
CONFIG_I2C_HELPER_AUTO=y
CONFIG_NETFILTER_XT_MATCH_U32=m
CONFIG_SQUASHFS_ZLIB=y
CONFIG_AGP_INTEL=y
CONFIG_INLINE_SPIN_UNLOCK_IRQ=y
CONFIG_NLS_ISO8859_4=m
CONFIG_FB_BACKLIGHT=y
CONFIG_RTC_DRV_RX8025=m
CONFIG_SERIAL_8250_NR_UARTS=32
CONFIG_ARCH_HAS_STRICT_MODULE_RWX=y
CONFIG_TCP_CONG_DCTCP=m
CONFIG_NET_EMATCH_IPSET=m
CONFIG_CC_IS_GCC=y
CONFIG_INFINIBAND_SRPT=m
CONFIG_CRYPTO_RMD160=m
CONFIG_ACPI_CUSTOM_METHOD=m
CONFIG_BCM7XXX_PHY=m
CONFIG_PATA_HPT366=m
CONFIG_NET_EGRESS=y
CONFIG_XEN_AUTO_XLATE=y
CONFIG_RMI4_CORE=m
CONFIG_NET_VENDOR_ARC=y
CONFIG_SCHED_MC_PRIO=y
CONFIG_IP_SET_HASH_MAC=m
CONFIG_CRYPTO_ENGINE=m
CONFIG_INET_AH=m
CONFIG_SENSORS_ATXP1=m
CONFIG_HID_LENOVO=m
CONFIG_HAVE_USER_RETURN_NOTIFIER=y
CONFIG_MTD_UBI_BEB_LIMIT=20
CONFIG_DEFAULT_IOSCHED="cfq"
CONFIG_DRM_I2C_CH7006=m
CONFIG_TABLET_USB_KBTAB=m
CONFIG_UDF_FS=m
CONFIG_RTC_DRV_DS1343=m
CONFIG_IPV6_MIP6=y
CONFIG_MARVELL_PHY=m
CONFIG_HAVE_PERF_USER_STACK_DUMP=y
CONFIG_ACPI_EC_DEBUGFS=m
CONFIG_CGROUP_PERF=y
CONFIG_NLATTR=y
CONFIG_HOTPLUG_PCI=y
CONFIG_ZD1211RW=m
CONFIG_TCP_CONG_CUBIC=y
CONFIG_CEPH_FS=m
CONFIG_SCSI_NETLINK=y
CONFIG_NR_CPUS=64
CONFIG_IXGBE=m
CONFIG_SUSPEND_FREEZER=y
CONFIG_HAVE_EXIT_THREAD=y
CONFIG_IIO_BUFFER_CB=m
CONFIG_MMC_SDHCI=m
CONFIG_B43_SSB=y
CONFIG_NETFILTER_XT_CONNMARK=m
CONFIG_ENA_ETHERNET=m
CONFIG_NR_CPUS_RANGE_BEGIN=2
CONFIG_IIO_ST_ACCEL_SPI_3AXIS=m
CONFIG_LEDS_LT3593=m
CONFIG_NO_HZ_FULL=y
CONFIG_LOGITECH_FF=y
CONFIG_IPV6_FOU_TUNNEL=m
CONFIG_HID_KYE=m
CONFIG_MOUSE_PS2_TRACKPOINT=y
CONFIG_CRYPTO_CHACHA20=m
CONFIG_HID_GEMBIRD=m
CONFIG_MOUSE_VSXXXAA=m
CONFIG_IP_MROUTE_MULTIPLE_TABLES=y
CONFIG_NFT_COMPAT=m
CONFIG_DRM_NOUVEAU_BACKLIGHT=y
CONFIG_SOFT_WATCHDOG=m
CONFIG_SYSFS=y
CONFIG_IP_SET_BITMAP_IPMAC=m
CONFIG_ISCSI_TARGET_CXGB4=m
CONFIG_USB_DEFAULT_PERSIST=y
CONFIG_LIB80211_CRYPT_WEP=m
CONFIG_DELL_WMI=m
CONFIG_SENSORS_W83791D=m
CONFIG_INPUT_TOUCHSCREEN=y
CONFIG_RT2800USB_UNKNOWN=y
CONFIG_EDAC_LEGACY_SYSFS=y
CONFIG_DRM_PANEL_BRIDGE=y
CONFIG_I2C_VIAPRO=m
CONFIG_FB_HYPERV=m
CONFIG_NF_CONNTRACK_LABELS=y
CONFIG_IP_NF_MATCH_AH=m
CONFIG_INFINIBAND_SRP=m
CONFIG_CARL9170_WPC=y
CONFIG_TCP_CONG_VENO=m
CONFIG_INFINIBAND=m
CONFIG_ASN1=y
CONFIG_NF_LOG_COMMON=m
CONFIG_I2C_PARPORT_LIGHT=m
CONFIG_NETFILTER_XT_MATCH_LIMIT=m
CONFIG_CRYPTO_AES_NI_INTEL=y
CONFIG_CRYPTO_DEV_VIRTIO=m
CONFIG_ULI526X=m
CONFIG_NET_KEY_MIGRATE=y
CONFIG_I2C_SIMTEC=m
CONFIG_NTB_TRANSPORT=m
CONFIG_DEFAULT_IO_DELAY_TYPE=0
CONFIG_XZ_DEC_ARM=y
CONFIG_NLS_CODEPAGE_775=m
CONFIG_MOUSE_SERIAL=m
CONFIG_CRYPTO_HASH_INFO=y
CONFIG_FB_SYS_FOPS=y
CONFIG_JOYSTICK_ANALOG=m
CONFIG_BLK_SCSI_REQUEST=y
CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
CONFIG_NETFILTER_XT_MATCH_DEVGROUP=m
CONFIG_ACPI_BATTERY=y
CONFIG_FUJITSU_TABLET=m
CONFIG_PM_DEVFREQ=y
CONFIG_FB=y
CONFIG_TRACING=y
CONFIG_BLK_MQ_VIRTIO=y
CONFIG_IP_NF_MATCH_RPFILTER=m
CONFIG_NLS_CODEPAGE_865=m
CONFIG_I2C_COMPAT=y
CONFIG_DRM_SCHED=m
CONFIG_WLAN_VENDOR_ZYDAS=y
CONFIG_INET_SCTP_DIAG=m
CONFIG_NFSD_V3_ACL=y
CONFIG_SPARSEMEM_VMEMMAP_ENABLE=y
CONFIG_HID_ELO=m
CONFIG_NET_ACT_NAT=m
CONFIG_FTRACE_MCOUNT_RECORD=y
CONFIG_CC_HAS_ASM_GOTO=y
CONFIG_VIRTUALIZATION=y
CONFIG_ND_CLAIM=y
CONFIG_MSDOS_PARTITION=y
CONFIG_RTC_I2C_AND_SPI=y
CONFIG_VIRT_CPU_ACCOUNTING_GEN=y
CONFIG_MYRI10GE_DCA=y
CONFIG_TOUCHSCREEN_USB_NEXIO=y
CONFIG_BOOTPARAM_HARDLOCKUP_PANIC_VALUE=1
CONFIG_RT2800USB_RT33XX=y
CONFIG_PINCTRL_INTEL=m
CONFIG_SENSORS_TMP421=m
CONFIG_SUNGEM=m
CONFIG_HAVE_OPROFILE=y
CONFIG_X86_INTEL_LPSS=y
CONFIG_LEDS_CLEVO_MAIL=m
CONFIG_IP_SET=m
CONFIG_THERMAL=y
CONFIG_SYNC_FILE=y
CONFIG_TOUCHSCREEN_TOUCHRIGHT=m
CONFIG_AMD8111_ETH=m
CONFIG_XEN_ACPI=y
CONFIG_AMD_IOMMU=y
CONFIG_I2C_AMD8111=m
CONFIG_INPUT_POWERMATE=m
CONFIG_NET_FC=y
CONFIG_ACPI_WATCHDOG=y
CONFIG_BRCMUTIL=m
CONFIG_VETH=m
CONFIG_RTC_DRV_PCF8583=m
CONFIG_MLX5_CORE_EN=y
CONFIG_NET_VENDOR_3COM=y
CONFIG_HID_PETALYNX=m
CONFIG_AMD_NUMA=y
CONFIG_STACKPROTECTOR=y
CONFIG_IRQ_BYPASS_MANAGER=m
CONFIG_TLAN=m
CONFIG_INTEL_MIC_BUS=m
CONFIG_ARCH_ENABLE_SPLIT_PMD_PTLOCK=y
CONFIG_NET_DSA_TAG_BRCM=y
CONFIG_SENSORS_W83L786NG=m
CONFIG_NET_ACT_MIRRED=m
CONFIG_HAVE_ARCH_KGDB=y
CONFIG_VGACON_SOFT_SCROLLBACK_SIZE=64
CONFIG_ARCH_USE_QUEUED_SPINLOCKS=y
CONFIG_INPUT_APANEL=m
CONFIG_NF_TPROXY_IPV4=m
CONFIG_B43_PCICORE_AUTOSELECT=y
CONFIG_BLK_DEBUG_FS=y
CONFIG_QLCNIC_SRIOV=y
CONFIG_MYRI10GE=m
CONFIG_X86_PM_TIMER=y
CONFIG_USB_VL600=m
CONFIG_B43LEGACY_HWRNG=y
CONFIG_HAVE_RCU_TABLE_INVALIDATE=y
CONFIG_ATH9K_BTCOEX_SUPPORT=y
CONFIG_RT2X00_LIB_PCI=m
CONFIG_SCSI_MVSAS=m
CONFIG_CPU_FREQ_GOV_SCHEDUTIL=y
CONFIG_NET_VENDOR_INTEL=y
CONFIG_USB_WUSB_CBAF=m
CONFIG_RPS=y
CONFIG_PACKET_DIAG=m
CONFIG_USB_NET_ZAURUS=m
CONFIG_SERIAL_8250_EXAR=y
CONFIG_INET6_XFRM_TUNNEL=m
CONFIG_DRM_AST=m
CONFIG_DM_MULTIPATH_ST=m
CONFIG_NET_TEAM_MODE_RANDOM=m
CONFIG_SENSORS_LM95241=m
CONFIG_PROC_PID_CPUSET=y
CONFIG_REALTEK_AUTOPM=y
CONFIG_USB_NET_AX88179_178A=m
CONFIG_PM_GENERIC_DOMAINS=y
CONFIG_INPUT_ATLAS_BTNS=m
CONFIG_IPV6_FOU=m
CONFIG_TOUCHSCREEN_USB_DMC_TSC10=y
CONFIG_MTD_MAP_BANK_WIDTH_2=y
CONFIG_NFT_REJECT=m
CONFIG_NVME_TARGET_RDMA=m
CONFIG_WDTPCI=m
CONFIG_USB_SERIAL_DEBUG=m
CONFIG_SENSORS_MAX16064=m
CONFIG_IP_SET_HASH_IPPORTIP=m
CONFIG_MLX4_EN=m
CONFIG_TABLET_USB_ACECAD=m
CONFIG_HYPERVISOR_GUEST=y
CONFIG_SENSORS_LM70=m
CONFIG_NET_EMATCH_NBYTE=m
CONFIG_SENSORS_BH1770=m
CONFIG_NORTEL_HERMES=m
CONFIG_SIS190=m
CONFIG_TCG_NSC=m
CONFIG_ZISOFS=y
CONFIG_WLAN_VENDOR_MEDIATEK=y
CONFIG_CUSE=m
CONFIG_IP_MULTICAST=y
CONFIG_DM_CACHE_SMQ=m
CONFIG_CRYPTO_RMD256=m
CONFIG_W83627HF_WDT=m
CONFIG_SQUASHFS_XZ=y
CONFIG_USB_NET_CX82310_ETH=m
CONFIG_GENERIC_CMOS_UPDATE=y
CONFIG_NET_VENDOR_CISCO=y
CONFIG_EEPROM_MAX6875=m
CONFIG_ACPI_ALS=m
CONFIG_DRM_CIRRUS_QEMU=m
CONFIG_MOUSE_APPLETOUCH=m
CONFIG_HID_LOGITECH_DJ=m
CONFIG_DEFAULT_SECURITY="selinux"
CONFIG_CRYPTO_DH=y
CONFIG_FUNCTION_ERROR_INJECTION=y
CONFIG_TICK_ONESHOT=y
CONFIG_XEN_PCIDEV_FRONTEND=m
CONFIG_HID_BETOP_FF=m
CONFIG_NF_NAT_PROTO_UDPLITE=y
CONFIG_USB_SERIAL_SIERRAWIRELESS=m
CONFIG_CRYPTO_CTR=y
CONFIG_COMPAT_FOR_U64_ALIGNMENT=y
CONFIG_MTRR_SANITIZER=y
CONFIG_SCSI_HPTIOP=m
CONFIG_NATIONAL_PHY=m
CONFIG_B43LEGACY_PCICORE_AUTOSELECT=y
CONFIG_USB_SERIAL_KEYSPAN_PDA=m
CONFIG_WIRELESS_EXT=y
CONFIG_RTC_DRV_RS5C348=m
CONFIG_HW_RANDOM=y
CONFIG_B43_PCI_AUTOSELECT=y
CONFIG_MUTEX_SPIN_ON_OWNER=y
CONFIG_IO_DELAY_TYPE_0X80=0
CONFIG_X86_SPEEDSTEP_LIB=m
CONFIG_IE6XX_WDT=m
CONFIG_SYS_HYPERVISOR=y
CONFIG_TOUCHSCREEN_WACOM_I2C=m
CONFIG_VIRTIO_VSOCKETS_COMMON=m
CONFIG_DRM_AMD_DC_DCN1_0=y
CONFIG_AMIGA_PARTITION=y
CONFIG_EARLY_PRINTK=y
CONFIG_CGROUP_NET_CLASSID=y
CONFIG_MEMCG_SWAP=y
CONFIG_SENSORS_ADS7871=m
CONFIG_NETFILTER_SYNPROXY=m
CONFIG_FS_DAX=y
CONFIG_NLS_CODEPAGE_737=m
CONFIG_NF_NAT_IPV4=m
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HW_RANDOM_VIA=m
CONFIG_SUNDANCE=m
CONFIG_SENSORS_W83781D=m
CONFIG_I2C_DESIGNWARE_PLATFORM=m
CONFIG_HAVE_CMPXCHG_LOCAL=y
CONFIG_NVDIMM_PFN=y
CONFIG_AF_KCM=m
CONFIG_SSB_DRIVER_GPIO=y
CONFIG_EEEPC_WMI=m
CONFIG_TREE_SRCU=y
CONFIG_CRYPTO_NULL2=y
CONFIG_ACPI_THERMAL=y
CONFIG_RT2X00_LIB_CRYPTO=y
CONFIG_SCSI_DH_HP_SW=m
CONFIG_IP_SCTP=m
CONFIG_INPUT_SOC_BUTTON_ARRAY=m
CONFIG_P54_PCI=m
CONFIG_ARCH_HAS_ACPI_TABLE_UPGRADE=y
CONFIG_FSCACHE_OBJECT_LIST=y
CONFIG_SERIAL_8250_DMA=y
CONFIG_BASE_SMALL=0
CONFIG_IWLEGACY_DEBUGFS=y
CONFIG_XEN_GRANT_DEV_ALLOC=m
CONFIG_CRYPTO_BLKCIPHER2=y
CONFIG_SCSI_SAS_ATTRS=m
CONFIG_SECURITY_SELINUX_AVC_STATS=y
CONFIG_RTL8187=m
CONFIG_X86_PMEM_LEGACY_DEVICE=y
CONFIG_CRYPTO_AES_X86_64=y
CONFIG_B43LEGACY_PCI_AUTOSELECT=y
CONFIG_DM_RAID=m
CONFIG_COMPACTION=y
CONFIG_ARCH_HAS_UACCESS_MCSAFE=y
CONFIG_SCSI_MPT3SAS_MAX_SGE=128
CONFIG_QLGE=m
CONFIG_ALIENWARE_WMI=m
CONFIG_NF_DUP_IPV6=m
CONFIG_RTL8723BE=m
CONFIG_Z3FOLD=y
CONFIG_RTC_DRV_DS2404=m
CONFIG_THINKPAD_ACPI_HOTKEY_POLL=y
CONFIG_DRM_AMDGPU=m
CONFIG_RTC_DRV_DS1553=m
CONFIG_CRYPTO_KHAZAD=m
CONFIG_PROC_FS=y
CONFIG_MMC_CB710=m
CONFIG_MTD_BLOCK=m
CONFIG_ACPI_HOTPLUG_MEMORY=y
CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y
CONFIG_WEXT_PRIV=y
CONFIG_THINKPAD_ACPI_VIDEO=y
CONFIG_VIRTIO_MMIO=m
CONFIG_NET_VENDOR_ROCKER=y
CONFIG_SCSI_LOWLEVEL=y
CONFIG_INTEL_SOC_DTS_IOSF_CORE=m
CONFIG_INPUT_GPIO_ROTARY_ENCODER=m
CONFIG_IP_VS_PROTO_AH_ESP=y
CONFIG_IP_DCCP_CCID3=y
CONFIG_MEMFD_CREATE=y
CONFIG_DMA_DIRECT_OPS=y
CONFIG_IRQ_FORCED_THREADING=y
CONFIG_NILFS2_FS=m
CONFIG_ATH9K_PCI=y
CONFIG_EDAC_ATOMIC_SCRUB=y
CONFIG_DRM_VM=y
CONFIG_NLS_ISO8859_3=m
CONFIG_RSI_91X=m
CONFIG_XEN_SYS_HYPERVISOR=y
CONFIG_CRYPTO_CMAC=m
CONFIG_MAX30100=m
CONFIG_HID_PANTHERLORD=m
CONFIG_DRM_FBDEV_EMULATION=y
CONFIG_TEST_KSTRTOX=y
CONFIG_IIO_ST_GYRO_I2C_3AXIS=m
CONFIG_NET_SCH_TEQL=m
CONFIG_SENSORS_MCP3021=m
CONFIG_XEN_NETDEV_BACKEND=m
CONFIG_SCSI_SNIC=m
CONFIG_KXCJK1013=m
CONFIG_IWLEGACY=m
CONFIG_SCSI_INIA100=m
CONFIG_IP_VS_SH=m
CONFIG_XEN_BALLOON=y
CONFIG_CRYPTO_SERPENT_AVX_X86_64=m
CONFIG_USB_PEGASUS=m
CONFIG_IIO_ST_MAGN_3AXIS=m
CONFIG_USB_TMC=m
CONFIG_INPUT_E3X0_BUTTON=m
CONFIG_DEBUG_STACKOVERFLOW=y
CONFIG_BLK_DEV_FD=m
CONFIG_BLK_MQ_RDMA=y
CONFIG_SENSORS_MAX20751=m
CONFIG_DEV_DAX=m
CONFIG_NET_VENDOR_NATSEMI=y
CONFIG_BLK_DEV_BSGLIB=y
CONFIG_ATH5K_PCI=y
CONFIG_AQUANTIA_PHY=m
CONFIG_TABLET_USB_HANWANG=m
CONFIG_ATH9K_COMMON=m
CONFIG_IKCONFIG=y
CONFIG_CRYPTO_DEV_QAT_C62XVF=m
CONFIG_USB_SERIAL_QCAUX=m
CONFIG_NFSD_BLOCKLAYOUT=y
CONFIG_SATA_ACARD_AHCI=m
CONFIG_GENERIC_IRQ_MIGRATION=y
CONFIG_NET_VENDOR_NETRONOME=y
CONFIG_DEBUG_LIST=y
CONFIG_NFS_USE_KERNEL_DNS=y
CONFIG_SENSORS_MAX31722=m
CONFIG_SENSORS_IBMAEM=m
CONFIG_DMA_ENGINE_RAID=y
CONFIG_INTEL_MIC_HOST=m
CONFIG_ARCH_HAS_FORTIFY_SOURCE=y
CONFIG_GCC_VERSION=40407
CONFIG_SYSCTL=y
CONFIG_CRYPTO_DES3_EDE_X86_64=m
CONFIG_TOSHIBA_WMI=m
CONFIG_842_DECOMPRESS=m
CONFIG_ARCH_HAS_GCOV_PROFILE_ALL=y
CONFIG_BRIDGE_IGMP_SNOOPING=y
CONFIG_IP_NF_TARGET_CLUSTERIP=m
CONFIG_W1_SLAVE_THERM=m
CONFIG_JOYSTICK_TWIDJOY=m
CONFIG_PHYS_ADDR_T_64BIT=y
CONFIG_THREAD_INFO_IN_TASK=y
CONFIG_NOZOMI=m
CONFIG_MLX4_EN_DCB=y
CONFIG_CRYPTO_842=m
CONFIG_NETFILTER_XT_TARGET_AUDIT=m
CONFIG_TOUCHSCREEN_PIXCIR=m
CONFIG_HAVE_C_RECORDMCOUNT=y
CONFIG_GENERIC_MSI_IRQ=y
CONFIG_SENSORS_ADCXX=m
CONFIG_SENSORS_DELL_SMM=m
CONFIG_INFINIBAND_I40IW=m
CONFIG_HID_THINGM=m
CONFIG_USB_NET_KALMIA=m
CONFIG_ATH6KL_SDIO=m
CONFIG_USB_NET_DM9601=m
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_SSB_PCIHOST=y
CONFIG_IIO_ST_ACCEL_I2C_3AXIS=m
CONFIG_LDM_PARTITION=y
CONFIG_CIFS=m
CONFIG_DRM_FBDEV_OVERALLOC=100
CONFIG_XFRM_USER=y
CONFIG_TCP_CONG_BIC=m
CONFIG_TASK_DELAY_ACCT=y
CONFIG_SCSI_DH_EMC=m
CONFIG_NET_NS=y
CONFIG_SENSORS_TMP401=m
CONFIG_SENSORS_ADT7475=m
CONFIG_HAVE_PERF_EVENTS=y
CONFIG_B53_SRAB_DRIVER=m
CONFIG_CRYPTO_DEV_QAT_C62X=m
CONFIG_SENSORS_LIS3_I2C=m
CONFIG_RT2800PCI_RT35XX=y
CONFIG_BTT=y
CONFIG_ATA_SFF=y
CONFIG_JOYSTICK_WALKERA0701=m
CONFIG_CRYPTO_LRW=y
CONFIG_RTC_DRV_DS1685_FAMILY=m
CONFIG_IWLWIFI_OPMODE_MODULAR=y
CONFIG_NET_EMATCH_CMP=m
CONFIG_MLXSW_SWITCHX2=m
CONFIG_PPP_ASYNC=m
CONFIG_MD_RAID10=m
CONFIG_NFSD_SCSILAYOUT=y
CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
CONFIG_NO_BOOTMEM=y
CONFIG_SSB_SDIOHOST_POSSIBLE=y
CONFIG_SENSORS_APPLESMC=m
CONFIG_NLS_CODEPAGE_866=m
CONFIG_SENSORS_ABITUGURU3=m
CONFIG_CRAMFS=m
CONFIG_SKGE_GENESIS=y
CONFIG_PINCTRL_SUNRISEPOINT=m
CONFIG_LEDS_TRIGGER_TRANSIENT=m
CONFIG_CYCLADES=m
CONFIG_STMMAC_ETH=m
CONFIG_CHELSIO_T1=m
CONFIG_NFSD_V4_SECURITY_LABEL=y
CONFIG_CEPH_FS_POSIX_ACL=y
CONFIG_BLK_DEV_PMEM=m
CONFIG_AUDIT=y
CONFIG_INTEL_IOMMU=y
CONFIG_THERMAL_DEFAULT_GOV_STEP_WISE=y
CONFIG_DM_MULTIPATH=m
CONFIG_CRYPTO_USER_API_SKCIPHER=y
CONFIG_SCSI_3W_SAS=m
CONFIG_BPF_JIT_ALWAYS_ON=y
CONFIG_SENSORS_LM80=m
CONFIG_CMA_AREAS=7
CONFIG_PCI_HYPERV=m
CONFIG_PCIEASPM=y
CONFIG_PM_ADVANCED_DEBUG=y
CONFIG_INTEL_IDMA64=m
CONFIG_ATA_PIIX=y
CONFIG_ARM_GIC_MAX_NR=1
CONFIG_B43LEGACY=m
CONFIG_HID_MULTITOUCH=m
CONFIG_FB_DEFERRED_IO=y
CONFIG_SATA_AHCI=y
CONFIG_SLAB_FREELIST_RANDOM=y
CONFIG_SECURITY=y
CONFIG_SENSORS_ASC7621=m
CONFIG_OPTPROBES=y
CONFIG_NETXEN_NIC=m
CONFIG_BNX2X_SRIOV=y
CONFIG_ACPI_NUMA=y
CONFIG_HID_ELECOM=m
CONFIG_KVM_MMIO=y
CONFIG_USB_EHCI_TT_NEWSCHED=y
CONFIG_FAT_DEFAULT_CODEPAGE=437
CONFIG_TCM_FC=m
CONFIG_IPV6_MROUTE_MULTIPLE_TABLES=y
CONFIG_BLK_DEV=y
CONFIG_SERIO_I8042=y
CONFIG_MAC80211_RC_DEFAULT="minstrel_ht"
CONFIG_RTL8187_LEDS=y
CONFIG_NFS_ACL_SUPPORT=m
CONFIG_RT2800USB_RT55XX=y
CONFIG_W1_SLAVE_DS2433=m
CONFIG_ATL1=m
CONFIG_USB_SERIAL_OMNINET=m
CONFIG_BRIDGE_NETFILTER=m
CONFIG_TCP_CONG_SCALABLE=m
CONFIG_PATA_TRIFLEX=m
CONFIG_JOYSTICK_TMDC=m
CONFIG_IOMMU_API=y
CONFIG_TRACING_SUPPORT=y
CONFIG_UNIX98_PTYS=y
CONFIG_CDROM_PKTCDVD=m
CONFIG_VFIO=m
CONFIG_NETFILTER_XT_TARGET_CONNMARK=m
CONFIG_MINIX_SUBPARTITION=y
CONFIG_NET_RX_BUSY_POLL=y
CONFIG_SENSORS_SMSC47B397=m
CONFIG_CRYPTO_MICHAEL_MIC=m
CONFIG_CRYPTO_ANSI_CPRNG=m
CONFIG_SECURITY_SELINUX=y
CONFIG_ZONE_DMA32=y
CONFIG_NET_SCHED=y
CONFIG_NETFILTER_XT_TARGET_CONNSECMARK=m
CONFIG_NVME_RDMA=m
CONFIG_DRM_PANEL=y
CONFIG_PRINTK_TIME=y
CONFIG_SERIAL_JSM=m
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
CONFIG_SECCOMP_FILTER=y
CONFIG_PATA_HPT37X=m
CONFIG_UIO_PCI_GENERIC=m
CONFIG_PPP=m
CONFIG_NETFILTER_XT_MATCH_QUOTA=m
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
CONFIG_NET_SCH_PIE=m
CONFIG_TOUCHSCREEN_ATMEL_MXT=m
CONFIG_HAVE_KERNEL_LZO=y
CONFIG_ASYNC_CORE=m
CONFIG_INTEL_PMC_CORE=y
CONFIG_NET_SCH_MULTIQ=m
CONFIG_INET_DIAG=m
CONFIG_CRYPTO_GHASH=y
CONFIG_SYNCLINKMP=m
CONFIG_PSTORE=y
CONFIG_OVERLAY_FS_REDIRECT_ALWAYS_FOLLOW=y
CONFIG_HAVE_SCHED_AVG_IRQ=y
CONFIG_SCSI_LPFC=m
CONFIG_NF_NAT_FTP=m
CONFIG_MAC80211_RC_MINSTREL=y
CONFIG_CRYPTO_RMD320=m
CONFIG_IIO_CONSUMERS_PER_TRIGGER=2
CONFIG_NF_CT_PROTO_UDPLITE=y
CONFIG_IKCONFIG_PROC=y
CONFIG_IO_DELAY_TYPE_UDELAY=2
CONFIG_IP6_NF_TARGET_SYNPROXY=m
CONFIG_HANGCHECK_TIMER=m
CONFIG_JOYSTICK_WARRIOR=m
CONFIG_SENSORS_W83627EHF=m
CONFIG_ELF_CORE=y
CONFIG_DEV_COREDUMP=y
CONFIG_SENSORS_LM73=m
CONFIG_VIA_VELOCITY=m
CONFIG_SENSORS_PC87360=m
CONFIG_TEXTSEARCH=y
CONFIG_DRM_AMDGPU_USERPTR=y
CONFIG_ACPI_DOCK=y
CONFIG_XEN_HAVE_PVMMU=y
CONFIG_INFINIBAND_ON_DEMAND_PAGING=y
CONFIG_USB_SUPPORT=y
CONFIG_NVME_TARGET=m
CONFIG_I2C_SCMI=m
CONFIG_I2C_VIA=m
CONFIG_INPUT_POLLDEV=m
CONFIG_CRYPTO_DEV_QAT_C3XXX=m
CONFIG_MODIFY_LDT_SYSCALL=y
CONFIG_SENSORS_ADC128D818=m
CONFIG_RTC_DRV_BQ32K=m
CONFIG_WLAN_VENDOR_ST=y
CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS=y
CONFIG_VIA_WDT=m
CONFIG_BLK_DEV_NVME=y
CONFIG_BRCMFMAC_PROTO_BCDC=y
CONFIG_TOUCHSCREEN_USB_EASYTOUCH=y
CONFIG_NET_VENDOR_SIS=y
CONFIG_F2FS_FS=m
CONFIG_TOUCHSCREEN_EDT_FT5X06=m
CONFIG_SENSORS_LIS3LV02D=m
CONFIG_WIZNET_W5100_SPI=m
CONFIG_MMIOTRACE=y
CONFIG_PAGE_POOL=y
CONFIG_TOUCHSCREEN_ST1232=m
CONFIG_SCSI_FC_ATTRS=m
CONFIG_VT_CONSOLE=y
CONFIG_EDAC_SBRIDGE=m
CONFIG_HID_UCLOGIC=m
CONFIG_HW_RANDOM_VIRTIO=m
CONFIG_ACPI_APEI=y
CONFIG_CFG80211_WEXT_EXPORT=y
CONFIG_SCHED_INFO=y
CONFIG_MQ_IOSCHED_KYBER=m
CONFIG_IP_VS_FTP=m
CONFIG_FANOTIFY_ACCESS_PERMISSIONS=y
CONFIG_VMWARE_PVSCSI=m
CONFIG_CFG80211_WEXT=y
CONFIG_VIRTIO_VSOCKETS=m
CONFIG_WLAN_VENDOR_MARVELL=y
CONFIG_SMARTJOYPLUS_FF=y
CONFIG_I2C_PARPORT=m
CONFIG_NETFILTER_XT_MATCH_PHYSDEV=m
CONFIG_NOP_USB_XCEIV=m
CONFIG_BRCMFMAC_PCIE=y
CONFIG_CC_OPTIMIZE_FOR_PERFORMANCE=y
CONFIG_BLK_DEV_RAM=m
CONFIG_ARCH_MMAP_RND_COMPAT_BITS=8
CONFIG_SENSORS_HDAPS=m
CONFIG_NETFILTER_XT_MATCH_STATE=m
CONFIG_TOUCHSCREEN_RM_TS=m
CONFIG_NET_DSA_BCM_SF2=m
CONFIG_LOGIRUMBLEPAD2_FF=y
CONFIG_BSD_DISKLABEL=y
CONFIG_RTC_DRV_M48T35=m
CONFIG_CRYPTO_CAST_COMMON=m
CONFIG_IIO_TRIGGERED_BUFFER=m
CONFIG_XEN_PVH=y
CONFIG_RTC_DRV_PCF2127=m
CONFIG_USB_STORAGE_FREECOM=m
CONFIG_SCSI_BUSLOGIC=m
CONFIG_BRIDGE_EBT_LOG=m
CONFIG_MICROCHIP_PHY=m
CONFIG_OPENVSWITCH_VXLAN=m
CONFIG_NET_SCH_GRED=m
CONFIG_PCI_DIRECT=y
CONFIG_MMC_VIA_SDMMC=m
CONFIG_DRM=m
CONFIG_FUSION_MAX_SGE=40
CONFIG_DOUBLEFAULT=y
CONFIG_INET6_XFRM_MODE_BEET=m
CONFIG_IWL4965=m
CONFIG_PCIE_DPC=y
CONFIG_POSIX_MQUEUE_SYSCTL=y
CONFIG_RTC_DRV_MAX6900=m
CONFIG_XILINX_GMII2RGMII=m
CONFIG_UNUSED_SYMBOLS=y
CONFIG_SENSORS_MAX1111=m
CONFIG_CRYPTO_DEV_PADLOCK_AES=m
CONFIG_SAMSUNG_LAPTOP=m
CONFIG_USB_USS720=m
CONFIG_FB_CFB_COPYAREA=y
CONFIG_FB_EFI=y
CONFIG_USB_SISUSBVGA=m
CONFIG_I40E=m
CONFIG_BRIDGE_EBT_STP=m
CONFIG_HAVE_KVM_IRQCHIP=y
CONFIG_RT73USB=m
CONFIG_USB_ULPI_BUS=m
CONFIG_DE2104X_DSL=0
CONFIG_BRIDGE_EBT_ARP=m
CONFIG_BALLOON_COMPACTION=y
CONFIG_BMC150_ACCEL_I2C=m
CONFIG_IP6_NF_MATCH_EUI64=m
CONFIG_BINARY_PRINTF=y
CONFIG_MWIFIEX=m
CONFIG_HP_ILO=m
CONFIG_USB_STORAGE_JUMPSHOT=m
CONFIG_SENSORS_MAX6642=m
CONFIG_NET_SCH_PLUG=m
CONFIG_HARDLOCKUP_CHECK_TIMESTAMP=y
CONFIG_TRACER_MAX_TRACE=y
CONFIG_SGI_PARTITION=y
CONFIG_INPUT_SPARSEKMAP=m
CONFIG_CRYPTO_TWOFISH_X86_64_3WAY=m
CONFIG_AIC7XXX_CMDS_PER_DEVICE=4
CONFIG_SYSFS_SYSCALL=y
CONFIG_RTL8192EE=m
CONFIG_RTC_DRV_DS1685=y
CONFIG_CW1200=m
CONFIG_SYSVIPC_SYSCTL=y
CONFIG_NVME_FABRICS=m
CONFIG_WLAN_VENDOR_TI=y
CONFIG_HID_NTRIG=y
CONFIG_IP_VS_IPV6=y
CONFIG_X86_64_ACPI_NUMA=y
CONFIG_DMA_SHARED_BUFFER=y
CONFIG_VHOST_SCSI=m
CONFIG_CIFS_POSIX=y
CONFIG_PATA_RDC=m
CONFIG_USB_EPSON2888=y
CONFIG_SENSORS_W83L785TS=m
CONFIG_W1_SLAVE_DS28E04=m
CONFIG_DECOMPRESS_GZIP=y
CONFIG_RT2X00_LIB_DEBUGFS=y
CONFIG_NLS_MAC_CELTIC=m
CONFIG_VIRTIO_MENU=y
CONFIG_XFRM_SUB_POLICY=y
CONFIG_VIRTIO_BLK=m
CONFIG_DECOMPRESS_LZO=y
CONFIG_USB_SERIAL_ARK3116=m
CONFIG_64BIT=y
CONFIG_QUOTA=y
CONFIG_EARLY_PRINTK_EFI=y
CONFIG_DM9102=m
CONFIG_SENSORS_LINEAGE=m
CONFIG_SCSI_MPT2SAS_MAX_SGE=128
CONFIG_ZBUD=y
CONFIG_MMC_SDHCI_PLTFM=m
CONFIG_I2C_CHARDEV=m
CONFIG_RCU_NOCB_CPU=y
CONFIG_LLC=m
CONFIG_FMC_FAKEDEV=m
CONFIG_ARCH_USE_QUEUED_RWLOCKS=y
CONFIG_SC92031=m
CONFIG_ARCH_HAS_PKEYS=y
CONFIG_INTEL_HID_EVENT=m
CONFIG_NETWORK_SECMARK=y
CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
CONFIG_CRYPTO_SIMD=y
CONFIG_HID_HOLTEK=m
CONFIG_ARCH_RANDOM=y
CONFIG_SERIAL_8250_PCI=y
CONFIG_LIB80211_CRYPT_CCMP=m
CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
CONFIG_RTC_DRV_DS1672=m
CONFIG_INTEL_MEI=m
CONFIG_USB_SERIAL_SSU100=m
CONFIG_MOUSE_PS2_SYNAPTICS=y
CONFIG_ATA_BMDMA=y
CONFIG_XZ_DEC_ARMTHUMB=y
CONFIG_B43_BCMA=y
CONFIG_MEMORY_FAILURE=y
CONFIG_NFS_V4_1=y
CONFIG_ARCH_USE_CMPXCHG_LOCKREF=y
CONFIG_REGMAP=y
CONFIG_NLS_UTF8=m
CONFIG_PCIE_PME=y
CONFIG_JOYSTICK_XPAD=m
CONFIG_HARDENED_USERCOPY=y
CONFIG_INFINIBAND_ISERT=m
CONFIG_DRM_AMD_ACP=y
CONFIG_HAVE_MOD_ARCH_SPECIFIC=y
CONFIG_FB_NOTIFY=y
CONFIG_INPUT_YEALINK=m
CONFIG_FW_CFG_SYSFS=m
CONFIG_SENSORS_NCT6683=m
CONFIG_RTC_DRV_M41T80=m
CONFIG_STRICT_MODULE_RWX=y
CONFIG_XEN_SCSI_FRONTEND=m
CONFIG_USB_USBNET=m
CONFIG_NET_DEVLINK=m
CONFIG_CPU_SUP_CENTAUR=y
CONFIG_CB710_CORE=m
CONFIG_USB_SERIAL_PL2303=m
CONFIG_NET_ACT_POLICE=m
CONFIG_AIC79XX_DEBUG_MASK=0
CONFIG_UEFI_CPER=y
CONFIG_NODES_SPAN_OTHER_NODES=y
CONFIG_HAVE_INTEL_TXT=y
CONFIG_SYSCTL_EXCEPTION_TRACE=y
CONFIG_SYSVIPC_COMPAT=y
CONFIG_INPUT_XEN_KBDDEV_FRONTEND=m
CONFIG_FHANDLE=y
CONFIG_USB_MICROTEK=m
CONFIG_PANASONIC_LAPTOP=m
CONFIG_HID_SMARTJOYPLUS=m
CONFIG_ATA_GENERIC=m
CONFIG_TOUCHSCREEN_GOODIX=m
CONFIG_NEW_LEDS=y
CONFIG_SWAP=y
CONFIG_CRC64=m
CONFIG_B53_SPI_DRIVER=m
CONFIG_MICROCODE_INTEL=y
CONFIG_MOUSE_ELAN_I2C_I2C=y
CONFIG_RTC_DRV_DS1511=m
CONFIG_USB_NET_CDC_SUBSET_ENABLE=m
CONFIG_IP_FIB_TRIE_STATS=y
CONFIG_CRYPTO_SHA256_SSSE3=m
CONFIG_NET_SCH_HFSC=m
CONFIG_RTC_DRV_RV3029C2=m
CONFIG_WIL6210=m
CONFIG_MAC80211=m
CONFIG_UBIFS_ATIME_SUPPORT=y
CONFIG_TOUCHSCREEN_USB_GENERAL_TOUCH=y
CONFIG_MEGARAID_MM=m
CONFIG_ARCH_USES_PG_UNCACHED=y
CONFIG_CRC_CCITT=y
CONFIG_GPIOLIB_IRQCHIP=y
CONFIG_IGBVF=m
CONFIG_BLK_DEV_SD=y
CONFIG_NET_NCSI=y
CONFIG_PHYSICAL_ALIGN=0x1000000
CONFIG_ACPI_LEGACY_TABLES_LOOKUP=y
CONFIG_NETFILTER_NETLINK=m
CONFIG_VITESSE_PHY=m
CONFIG_MODULE_UNLOAD=y
CONFIG_KEXEC_BZIMAGE_VERIFY_SIG=y
CONFIG_FSCACHE_STATS=y
CONFIG_INFINIBAND_MTHCA=m
CONFIG_SENSORS_MAX6650=m
CONFIG_HAVE_ACPI_APEI_NMI=y
CONFIG_ARCH_WANT_OLD_COMPAT_IPC=y
CONFIG_RT2500PCI=m
CONFIG_CMA=y
CONFIG_RWSEM_SPIN_ON_OWNER=y
CONFIG_SENSORS_LM85=m
CONFIG_TRACER_SNAPSHOT=y
CONFIG_INFINIBAND_IPOIB_CM=y
CONFIG_HAVE_RELIABLE_STACKTRACE=y
CONFIG_BITREVERSE=y
CONFIG_DEVPORT=y
CONFIG_DRM_I915_COMPRESS_ERROR=y
CONFIG_IOSCHED_BFQ=m
CONFIG_MACB_USE_HWSTAMP=y
CONFIG_INTEL_RST=m
CONFIG_X509_CERTIFICATE_PARSER=y
CONFIG_BLK_DEV_RAM_SIZE=16384
CONFIG_USB_SERIAL_WWAN=m
CONFIG_MAC_PARTITION=y
CONFIG_CONSOLE_POLL=y
CONFIG_EARLY_PRINTK_USB=y
CONFIG_HID_ALPS=m
CONFIG_XFS_POSIX_ACL=y
CONFIG_ND_BLK=m
CONFIG_INT3406_THERMAL=m
CONFIG_NVM=y
CONFIG_BRCMFMAC_USB=y
CONFIG_TOUCHSCREEN_DYNAPRO=m
CONFIG_NLS_ISO8859_13=m
CONFIG_PCI_PRI=y
CONFIG_BLK_DEV_SX8=m
CONFIG_CRYPTO_BLKCIPHER=y
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_X86_PAT=y
CONFIG_USB_STORAGE_ONETOUCH=m
CONFIG_NLS_ISO8859_8=m
CONFIG_RT2400PCI=m
CONFIG_NF_CONNTRACK=m
CONFIG_RTC_DRV_PCF8523=m
CONFIG_ARCH_HAS_REFCOUNT=y
CONFIG_EFI_RUNTIME_WRAPPERS=y
CONFIG_LCD_CLASS_DEVICE=m
CONFIG_ARCH_DMA_ADDR_T_64BIT=y
CONFIG_FILE_LOCKING=y
CONFIG_PATA_HPT3X3=m
CONFIG_RTC_DRV_STK17TA8=m
CONFIG_RMI4_F03=y
CONFIG_TOUCHSCREEN_USB_ELO=y
CONFIG_USB_CHAOSKEY=m
CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
CONFIG_FS_DAX_PMD=y
CONFIG_KARMA_PARTITION=y
CONFIG_NETPOLL=y
CONFIG_ZSWAP=y
CONFIG_SENSORS_F71882FG=m
CONFIG_ACPI_APEI_GHES=y
CONFIG_SENSORS_ADT7310=m
CONFIG_AIO=y
CONFIG_SERIO_ARC_PS2=m
CONFIG_NET_MPLS_GSO=m
CONFIG_LEGACY_VSYSCALL_EMULATE=y
CONFIG_RTC_DRV_DS1347=m
CONFIG_BLK_DEV_DAC960=m
CONFIG_CLKEVT_I8253=y
CONFIG_RING_BUFFER_BENCHMARK=m
CONFIG_NET_EMATCH=y
CONFIG_PERF_EVENTS=y
CONFIG_GENERIC_TIME_VSYSCALL=y
CONFIG_IP_NF_TARGET_REJECT=y
CONFIG_NET_SCH_CHOKE=m
CONFIG_LEDS_CLASS=y
CONFIG_IP6_NF_MATCH_HL=m
CONFIG_PERF_EVENTS_INTEL_CSTATE=m
CONFIG_KALLSYMS_BASE_RELATIVE=y
CONFIG_IP_VS_TAB_BITS=12
CONFIG_IP6_NF_MATCH_OPTS=m
CONFIG_SCSI_SAS_HOST_SMP=y
CONFIG_RTC_INTF_DEV=y
CONFIG_MTD_MAP_BANK_WIDTH_4=y
CONFIG_IIO_ST_SENSORS_SPI=m
CONFIG_DCACHE_WORD_ACCESS=y
CONFIG_INFINIBAND_CXGB3=m
CONFIG_USB_SERIAL_SYMBOL=m
CONFIG_PSTORE_COMPRESS=y
CONFIG_HERMES=m
CONFIG_NETFILTER_XT_MATCH_OSF=m
CONFIG_MLX_PLATFORM=m
CONFIG_SATA_QSTOR=m
CONFIG_WILINK_PLATFORM_DATA=y
CONFIG_PATA_SIS=m
CONFIG_MESSAGE_LOGLEVEL_DEFAULT=4
CONFIG_AMD_NB=y
CONFIG_LIB80211_CRYPT_TKIP=m
CONFIG_LOCKUP_DETECTOR=y
CONFIG_QSEMI_PHY=m
CONFIG_IP_VS_PROTO_UDP=y
CONFIG_NLS_DEFAULT="utf8"
CONFIG_ACPI_CONTAINER=y
CONFIG_UTS_NS=y
CONFIG_NF_CT_PROTO_GRE=m
CONFIG_WMI_BMOF=m
CONFIG_DAX_DRIVER=y
CONFIG_NF_CT_NETLINK=m
CONFIG_AUXDISPLAY=y
CONFIG_NET_EMATCH_TEXT=m
CONFIG_DMA_ENGINE=y
CONFIG_X86_ACPI_CPUFREQ=m
CONFIG_HID_WIIMOTE=m
CONFIG_DEFAULT_SECURITY_SELINUX=y
CONFIG_RDS_TCP=m
CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE_PUD=y
CONFIG_CGROUP_PIDS=y
CONFIG_CRYPTO_AEAD2=y
CONFIG_CRYPTO_FCRYPT=m
CONFIG_NF_NAT_MASQUERADE_IPV6=y
CONFIG_XEN_DEBUG_FS=y
CONFIG_TOSHIBA_BT_RFKILL=m
CONFIG_MOUSE_PS2=y
CONFIG_NET_IPIP=m
CONFIG_IP_VS_SH_TAB_BITS=8
CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC_VALUE=0
CONFIG_USB_SERIAL_IPAQ=m
CONFIG_NETFILTER_XT_MATCH_HL=m
CONFIG_CRYPTO_ALGAPI2=y
CONFIG_SATA_SIS=m
CONFIG_PHYSICAL_START=0x1000000
CONFIG_NETFILTER_XT_TARGET_LED=m
CONFIG_WEXT_SPY=y
CONFIG_UBIFS_FS_LZO=y
CONFIG_ACPI_SBS=m
CONFIG_GENERIC_IRQ_RESERVATION_MODE=y
CONFIG_HAVE_MEMBLOCK=y
CONFIG_TOUCHSCREEN_SILEAD=m
CONFIG_X86_PMEM_LEGACY=y
CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_INPUT=y
CONFIG_PATA_OPTI=m
CONFIG_PROC_SYSCTL=y
CONFIG_ATH6KL=m
CONFIG_HAVE_PERF_EVENTS_NMI=y
CONFIG_NETFILTER_XT_TARGET_CT=m
CONFIG_RD_LZ4=y
CONFIG_MMU=y
CONFIG_OCFS2_FS=m
CONFIG_USB_KAWETH=m
CONFIG_USB_SIERRA_NET=m
CONFIG_AIC7XXX_RESET_DELAY_MS=15000
CONFIG_VMWARE_BALLOON=m
CONFIG_BRIDGE_EBT_NFLOG=m
CONFIG_TABLET_USB_AIPTEK=m
CONFIG_BNXT_SRIOV=y
CONFIG_VGACON_SOFT_SCROLLBACK=y
CONFIG_AGP=y
CONFIG_IWLWIFI_PCIE_RTPM=y
CONFIG_INLINE_WRITE_UNLOCK=y
CONFIG_ZPOOL=y
CONFIG_SENSORS_GL520SM=m
CONFIG_E1000=m
CONFIG_SCSI_SYM53C8XX_MMIO=y
^ permalink raw reply [flat|nested] 7+ messages in thread* Re: fs: avoid softlockups in s_inodes iterators commit
2021-03-16 20:56 fs: avoid softlockups in s_inodes iterators commit David Mozes
@ 2021-03-17 1:28 ` Eric Sandeen
2021-03-17 16:40 ` David Mozes
0 siblings, 1 reply; 7+ messages in thread
From: Eric Sandeen @ 2021-03-17 1:28 UTC (permalink / raw)
To: David Mozes, linux-fsdevel; +Cc: sandeen
On 3/16/21 3:56 PM, David Mozes wrote:
> Hi,
> Per Eric's request, I forward this discussion to the list first.
> My first answers are inside
ok, but you stripped out all of the other useful information like backtraces,
stack corruption, etc. You need to provide the evidence of the actual failure
for the list to see. Also ..
> -----Original Message-----
> From: Eric Sandeen <sandeen@redhat.com>
> Sent: Tuesday, March 16, 2021 10:18 PM
> To: David Mozes <david.mozes@silk.us>
> Subject: Re: Mail from David.Mozes regarding fs: avoid softlockups in s_inodes iterators commit
>
> On 3/16/21 3:02 PM, David Mozes wrote:
>> Hi Eric,
>>
...
> David > Not sure yet, Will check.
>> 5.4.8 vanilla kernel it custom
>
> Is it vanilla, or is it custom? 5.4.8 or 5.4.80?
>
> David> 5.4.80 small custom as I mantion.
what is a "small custom?" Can you reproduce it on an unmodified upstream kernel?
-Eric
^ permalink raw reply [flat|nested] 7+ messages in thread
* RE: fs: avoid softlockups in s_inodes iterators commit
2021-03-17 1:28 ` Eric Sandeen
@ 2021-03-17 16:40 ` David Mozes
2021-03-17 16:45 ` David Mozes
0 siblings, 1 reply; 7+ messages in thread
From: David Mozes @ 2021-03-17 16:40 UTC (permalink / raw)
To: Eric Sandeen, linux-fsdevel; +Cc: sandeen
Sure Eric,
Send details again
I run a very high load traffic (Iscsi storage-related IO load )on GCP.
After one day of running, my kernel has been stack with two typical cases involving page fault.
1) Soft lockup, as described in the first typical case,
2) Panic as described in the second case.
First typical case: (the soft lockup happens on several CPUs):
Feb 21 07:38:52 c-node02 kernel: [242408.563170] ? flush_tlb_func_common.constprop.10+0x250/0x250
Feb 21 07:38:52 c-node02 kernel: [242408.563171] on_each_cpu_mask+0x23/0x60
Feb 21 07:38:52 c-node02 kernel: [242408.563173] ? x86_configure_nx+0x40/0x40
Feb 21 07:38:52 c-node02 kernel: [242408.563174] on_each_cpu_cond_mask+0xa0/0xd0
Feb 21 07:38:52 c-node02 kernel: [242408.563175] ? flush_tlb_func_common.constprop.10+0x250/0x250
Feb 21 07:38:52 c-node02 kernel: [242408.563177] flush_tlb_mm_range+0xbc/0xf0
Feb 21 07:38:52 c-node02 kernel: [242408.563179] ptep_clear_flush+0x40/0x50
Feb 21 07:38:52 c-node02 kernel: [242408.563180] try_to_unmap_one+0x2ae/0xae0
Feb 21 07:38:52 c-node02 kernel: [242408.563184] ? mutex_lock+0xe/0x30
Feb 21 07:38:52 c-node02 kernel: [242408.563186] rmap_walk_anon+0x13a/0x2c0
Feb 21 07:38:52 c-node02 kernel: [242408.563188] try_to_unmap+0x9c/0xf0
Feb 21 07:38:52 c-node02 kernel: [242408.563190] ? page_remove_rmap+0x330/0x330
Feb 21 07:38:52 c-node02 kernel: [242408.563192] ? page_not_mapped+0x20/0x20
Feb 21 07:38:52 c-node02 kernel: [242408.563193] ? page_get_anon_vma+0x80/0x80
Feb 21 07:38:52 c-node02 kernel: [242408.563195] ? invalid_mkclean_vma+0x20/0x20
Feb 21 07:38:52 c-node02 kernel: [242408.563196] migrate_pages+0x3cd/0xc80
Feb 21 07:38:52 c-node02 kernel: [242408.563197] ? do_pages_stat+0x180/0x180
Feb 21 07:38:52 c-node02 kernel: [242408.563198] migrate_misplaced_page+0x15e/0x270
Feb 21 07:38:52 c-node02 kernel: [242408.563200] __handle_mm_fault+0xd80/0x12f0
Feb 21 07:38:52 c-node02 kernel: [242408.563202] handle_mm_fault+0xc2/0x1f0
Feb 21 07:38:52 c-node02 kernel: [242408.563204] __do_page_fault+0x23e/0x4f0
Feb 21 07:38:52 c-node02 kernel: [242408.563206] do_page_fault+0x30/0x110
Feb 21 07:38:52 c-node02 kernel: [242408.563207] page_fault+0x3e/0x50
Feb 21 07:38:52 c-node02 kernel: [242408.563209] RIP: 0033:0x7f27fffb9e73
Feb 21 07:38:52 c-node02 kernel: [242408.563211] Code: 89 6d e8 48 89 fb 4c 89 75 f0 4c 89 7d f8 49 89 f6 4c 89 65 e0 48 81 ec c0 06 00 00 4c 8b 3d 3c a1 34 00 49 89 d5 64 41 8b 07 <89> 85 dc fa ff ff 8b 87 c0 00 00 00 85 c0 0f 85 b9 01 00 00 c7 87
Feb 21 07:38:52 c-node02 kernel: [242408.563211] RSP: 002b:00007f12a37fda10 EFLAGS: 00010202
Feb 21 07:38:52 c-node02 kernel: [242408.563213] RAX: 0000000000000000 RBX: 00007f12a37fe0e0 RCX: 0000000000000000
Feb 21 07:38:52 c-node02 kernel: [242408.563214] RDX: 00007f12a37fe200 RSI: 00000000017a9453 RDI: 00007f12a37fe0e0
Feb 21 07:38:52 c-node02 kernel: [242408.563214] RBP: 00007f12a37fe0d0 R08: 0000000000000000 R09: 00000000017c7550
Feb 21 07:38:52 c-node02 kernel: [242408.563215] R10: 0000000000000000 R11: 00000000000003f8 R12: 00000000017a9453
Feb 21 07:38:52 c-node02 kernel: [242408.563216] R13: 00007f12a37fe200 R14: 00000000017a9453 R15: fffffffffffffe90
Feb 21 07:38:52 c-node02 kernel: [242408.604094] watchdog: BUG: soft lockup - CPU#45 stuck for 22s! [km_target_creat:49068]
Feb 21 07:38:52 c-node02 kernel: [242408.604095] Modules linked in: iscsi_scst(OE) crc32c_intel(O) scst_local(OE) netconsole(O) scst_user(OE) scst(OE) drbd(O) lru_cache(O) loop(O) 8021q(O) mrp(O) garp(O) nfsd(O) nfs_acl(O) auth_rpcgss(O) lockd(O) sunrpc(O) grace(O) xt_MASQUERADE(O) xt_nat(O) xt_state(O) iptable_nat(O) xt_addrtype(O) xt_conntrack(O) nf_nat(O) nf_conntrack(O) nf_defrag_ipv4(O) nf_defrag_ipv6(O) libcrc32c(O) br_netfilter(O) bridge(O) stp(O) llc(O) overlay(O) be2iscsi(O) iscsi_boot_sysfs(O) bnx2i(O) cnic(O) uio(O) cxgb4i(O) cxgb4(O) cxgb3i(O) libcxgbi(O) cxgb3(O) mdio(O) libcxgb(O) ib_iser(OE) iscsi_tcp(O) libiscsi_tcp(O) libiscsi(O) scsi_transport_iscsi(O) dm_multipath(O) rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_fpga_tools(OE) mlx5_ib(OE) ib_uverbs(OE) mlx5_core(OE) mdev(OE) mlxfw(OE) ptp(O) pps_core(O) mlx4_ib(OE) ib_core(OE) mlx4_core(OE) mlx_compat(OE) fuse(O) binfmt_misc(O) pvpanic(O) pcspkr(O) virtio_rng(O) virtio_net(O) net_failover(O) failover(O) i2
:
Second typical case PANIC:
From the cosule:
[123080.813877] kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
[ 0.000000] Linux version 5.4.80-KM8 (david.mozes@kbuilder64-tc8-test1) (gcc version 8.3.1 20190311 (Red Hat 8.3.1-3) (GCC)) #14 SMP Mon Jan 11 16:21:21 IST 2021
Mon Jan 11 16:21:21 IST 2021
[ 0.000000] Command line: ro root=LABEL=/ rd_NO_LUKS KEYBOARDTYPE=pc KEYTABLE=us LANG=en_US.UTF-8 rd_NO_MD SYSFONT=latarcyrheb-sun16 nompath append="nmi_watchdog=2"
From the vmcore-dmesg:
[121271.606463] ll header: 00000000: 42 01 0a ad 0c 02 42 01 0a ad 0c 01 08 00
[122656.730235] sh (27931): drop_caches: 3
[123080.813877] kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
[123080.813887] sched: RT throttling activated
[123080.821706] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: serial8250_console_write+0x26e/0x270
After I comment out
After I comment out the cond_resched(), everything looks more stable.
I Will try another run as Eric sagest with the:
cond_resched()
before the:
Invalidtated_mapping_pages
See and report regarding the behavior.
I think we have a very stressful environment on GCP for testing that
Thx
David
-----Original Message-----
From: Eric Sandeen <sandeen@sandeen.net>
Sent: Wednesday, March 17, 2021 3:28 AM
To: David Mozes <david.mozes@silk.us>; linux-fsdevel@vger.kernel.org
Cc: sandeen@redhat.com
Subject: Re: fs: avoid softlockups in s_inodes iterators commit
On 3/16/21 3:56 PM, David Mozes wrote:
> Hi,
> Per Eric's request, I forward this discussion to the list first.
> My first answers are inside
ok, but you stripped out all of the other useful information like backtraces, stack corruption, etc. You need to provide the evidence of the actual failure for the list to see. Also ..
> -----Original Message-----
> From: Eric Sandeen <sandeen@redhat.com>
> Sent: Tuesday, March 16, 2021 10:18 PM
> To: David Mozes <david.mozes@silk.us>
> Subject: Re: Mail from David.Mozes regarding fs: avoid softlockups in
> s_inodes iterators commit
>
> On 3/16/21 3:02 PM, David Mozes wrote:
>> Hi Eric,
>>
...
> David > Not sure yet, Will check.
>> 5.4.8 vanilla kernel it custom
>
> Is it vanilla, or is it custom? 5.4.8 or 5.4.80?
>
> David> 5.4.80 small custom as I mantion.
what is a "small custom?" Can you reproduce it on an unmodified upstream kernel?
-Eric
^ permalink raw reply [flat|nested] 7+ messages in thread
* RE: fs: avoid softlockups in s_inodes iterators commit
2021-03-17 16:40 ` David Mozes
@ 2021-03-17 16:45 ` David Mozes
2021-03-17 19:58 ` Eric Sandeen
0 siblings, 1 reply; 7+ messages in thread
From: David Mozes @ 2021-03-17 16:45 UTC (permalink / raw)
To: David Mozes, Eric Sandeen, linux-fsdevel; +Cc: sandeen
Send gin the stack of the first case on different run
panic on 25.2.2021
whatchg on server 4. the pmc was server w\2
Feb 23 05:46:06 c-node04 kernel: [125259.990332] watchdog: BUG: soft lockup - CPU#41 stuck for 22s! [kuic_msg_domain:15790]
Feb 23 05:46:06 c-node04 kernel: [125259.990333] Modules linked in: iscsi_scst(OE) crc32c_intel(O) scst_local(OE) scst_user(OE) scst(OE) drbd(O) lru_cache(O) 8021q(O) mrp(O) garp(O) netconsole(O) nfsd(O) nfs_acl(O) auth_rpcgss(O) lockd(O) sunrpc(O) grace(O) xt_MASQUERADE(O) xt_nat(O) xt_state(O) iptable_nat(O) xt_addrtype(O) xt_conntrack(O) nf_nat(O) nf_conntrack(O) nf_defrag_ipv4(O) nf_defrag_ipv6(O) libcrc32c(O) br_netfilter(O) bridge(O) stp(O) llc(O) overlay(O) be2iscsi(O) iscsi_boot_sysfs(O) bnx2i(O) cnic(O) uio(O) cxgb4i(O) cxgb4(O) cxgb3i(O) libcxgbi(O) cxgb3(O) mdio(O) libcxgb(O) ib_iser(OE) iscsi_tcp(O) libiscsi_tcp(O) libiscsi(O) scsi_transport_iscsi(O) dm_multipath(O) rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_fpga_tools(OE) mlx5_ib(OE) ib_uverbs(OE) mlx5_core(OE) mdev(OE) mlxfw(OE) ptp(O) pps_core(O) mlx4_ib(OE) ib_core(OE) mlx4_core(OE) mlx_compat(OE) fuse(O) binfmt_misc(O) pvpanic(O) pcspkr(O) virtio_rng(O) virtio_net(O) net_failover(O) failover(O) i2c_piix4(
Feb 23 05:46:06 c-node04 kernel: O) ext4(OE)
Feb 23 05:46:06 c-node04 kernel: [125259.990368] jbd2(OE) mbcache(OE) virtio_scsi(OE) virtio_pci(OE) virtio_ring(OE) virtio(OE) [last unloaded: scst_local]
Feb 23 05:46:06 c-node04 kernel: [125259.990373] CPU: 41 PID: 15790 Comm: kuic_msg_domain Kdump: loaded Tainted: G W OEL 5.4.80-KM8 #14
Feb 23 05:46:06 c-node04 kernel: [125259.990374] Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Feb 23 05:46:06 c-node04 kernel: [125259.990378] RIP: 0010:smp_call_function_many+0x1e5/0x250
Feb 23 05:46:06 c-node04 kernel: [125259.990380] Code: c7 e8 bf 3d 75 00 3b 05 1d 13 1d 01 0f 83 b0 fe ff ff 48 63 d0 48 8b 0b 48 03 0c d5 20 99 18 a8 8b 51 18 83 e2 01 74 0a f3 90 <8b> 51 18 83 e2 01 75 f6 eb c8 48 8b 34 24 48 c7 c2 e0 9e 33 a8 89
Feb 23 05:46:06 c-node04 kernel: [125259.990381] RSP: 0000:ffff8f90bfbfbaa0 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
Feb 23 05:46:06 c-node04 kernel: [125259.990382] RAX: 0000000000000005 RBX: ffff8f72c7aab540 RCX: ffff8f72c75703a0
Feb 23 05:46:06 c-node04 kernel: [125259.990383] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff8f72c7aab548
Feb 23 05:46:06 c-node04 kernel: [125259.990384] RBP: ffff8f72c7aab548 R08: 0000000000000001 R09: ffff8f72c7aab550
Feb 23 05:46:06 c-node04 kernel: [125259.990385] R10: ffff8f72c7aab548 R11: 0000000000000001 R12: ffffffffa706efa0
Feb 23 05:46:06 c-node04 kernel: [125259.990385] R13: ffff8f72c7aa9e00 R14: 0000000000000001 R15: 0000000000000060
Feb 23 05:46:06 c-node04 kernel: [125259.990386] FS: 00007f261aa6d700(0000) GS:ffff8f72c7a80000(0000) knlGS:0000000000000000
Feb 23 05:46:06 c-node04 kernel: [125259.990387] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 23 05:46:06 c-node04 kernel: [125259.990388] CR2: 00007f26281ff918 CR3: 0000003b9bc97005 CR4: 00000000003606e0
Feb 23 05:46:06 c-node04 kernel: [125259.990392] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 23 05:46:06 c-node04 kernel: [125259.990393] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Feb 23 05:46:06 c-node04 kernel: [125259.990393] Call Trace:
Feb 23 05:46:06 c-node04 kernel: [125259.990399] ? flush_tlb_func_common.constprop.10+0x250/0x250
Feb 23 05:46:06 c-node04 kernel: [125259.990400] on_each_cpu_mask+0x23/0x60
Feb 23 05:46:06 c-node04 kernel: [125259.990399] ? flush_tlb_func_common.constprop.10+0x250/0x250
Feb 23 05:46:06 c-node04 kernel: [125259.990400] on_each_cpu_mask+0x23/0x60
Feb 23 05:46:06 c-node04 kernel: [125259.990402] ? x86_configure_nx+0x40/0x40
Feb 23 05:46:06 c-node04 kernel: [125259.990403] on_each_cpu_cond_mask+0xa0/0xd0
Feb 23 05:46:06 c-node04 kernel: [125259.990404] ? flush_tlb_func_common.constprop.10+0x250/0x250
Feb 23 05:46:06 c-node04 kernel: [125259.990406] flush_tlb_mm_range+0xbc/0xf0
Feb 23 05:46:06 c-node04 kernel: [125259.990409] ptep_clear_flush+0x40/0x50
Feb 23 05:46:06 c-node04 kernel: [125259.990411] try_to_unmap_one+0x2ae/0xae0
Feb 23 05:46:06 c-node04 kernel: [125259.990413] rmap_walk_anon+0x13a/0x2c0
Feb 23 05:46:06 c-node04 kernel: [125259.990415] try_to_unmap+0x9c/0xf0
Feb 23 05:46:06 c-node04 kernel: [125259.990417] ? page_remove_rmap+0x330/0x330
Feb 23 05:46:06 c-node04 kernel: [125259.990418] ? page_not_mapped+0x20/0x20
Feb 23 05:46:06 c-node04 kernel: [125259.990420] ? page_get_anon_vma+0x80/0x80
Feb 23 05:46:06 c-node04 kernel: [125259.990421] ? invalid_mkclean_vma+0x20/0x20
Feb 23 05:46:06 c-node04 kernel: [125259.990423] migrate_pages+0x3cd/0xc80
Feb 23 05:46:06 c-node04 kernel: [125259.990425] ? do_pages_stat+0x180/0x180
Feb 23 05:46:06 c-node04 kernel: [125259.990427] migrate_misplaced_page+0x15e/0x270
Feb 23 05:46:06 c-node04 kernel: [125259.990429] __handle_mm_fault+0xd80/0x12f0
Feb 23 05:46:06 c-node04 kernel: [125259.990432] handle_mm_fault+0xc2/0x1f0
Feb 23 05:46:06 c-node04 kernel: [125259.990433] __do_page_fault+0x23e/0x4f0
Feb 23 05:46:06 c-node04 kernel: [125259.990435] do_page_fault+0x30/0x110
Feb 23 05:46:06 c-node04 kernel: [125259.990436] page_fault+0x3e/0x50
Feb 23 05:46:06 c-node04 kernel: [125259.990438] RIP: 0033:0x7f267d43b470
Feb 23 05:46:06 c-node04 kernel: [125259.990439] Code: 00 b8 83 00 00 00 e9 37 fb ff ff 8b 43 10 83 e0 7f 83 f8 12 74 b5 83 f8 11 0f 85 89 fc ff ff e9 e4 fe ff ff 66 0f 1f 44 00 00 <8b> 77 10 49 89 f8 89 f0 89 f7 83 e7 7f 83 e0 7c 75 31 64 44 8b 0c
Feb 23 05:46:06 c-node04 kernel: [125259.990440] RSP: 002b:00007f261aa6c9f8 EFLAGS: 00010202
Feb 23 05:46:06 c-node04 kernel: [125259.990441] RAX: 000000001e16f5c0 RBX: 00007f26281ff8e0 RCX: 000000001e16f5c0
Feb 23 05:46:06 c-node04 kernel: [125259.990442] RDX: 00007f261aa6ca90 RSI: 00000000000017a0 RDI: 00007f26281ff908
Feb 23 05:46:06 c-node04 kernel: [125259.990443] RBP: 00007f261aa6ca30 R08: 000000000000000b R09: 0000000000000011
Feb 23 05:46:06 c-node04 kernel: [125259.990443] R10: 000000001e16f6dc R11: 000000001e16f5c0 R12: 0000000010cafa1
-----Original Message-----
From: David Mozes <david.mozes@silk.us>
Sent: Wednesday, March 17, 2021 6:40 PM
To: Eric Sandeen <sandeen@sandeen.net>; linux-fsdevel@vger.kernel.org
Cc: sandeen@redhat.com
Subject: RE: fs: avoid softlockups in s_inodes iterators commit
Sure Eric,
Send details again
I run a very high load traffic (Iscsi storage-related IO load )on GCP.
After one day of running, my kernel has been stack with two typical cases involving page fault.
1) Soft lockup, as described in the first typical case,
2) Panic as described in the second case.
First typical case: (the soft lockup happens on several CPUs):
Feb 21 07:38:52 c-node02 kernel: [242408.563170] ? flush_tlb_func_common.constprop.10+0x250/0x250
Feb 21 07:38:52 c-node02 kernel: [242408.563171] on_each_cpu_mask+0x23/0x60 Feb 21 07:38:52 c-node02 kernel: [242408.563173] ? x86_configure_nx+0x40/0x40 Feb 21 07:38:52 c-node02 kernel: [242408.563174] on_each_cpu_cond_mask+0xa0/0xd0 Feb 21 07:38:52 c-node02 kernel: [242408.563175] ? flush_tlb_func_common.constprop.10+0x250/0x250
Feb 21 07:38:52 c-node02 kernel: [242408.563177] flush_tlb_mm_range+0xbc/0xf0 Feb 21 07:38:52 c-node02 kernel: [242408.563179] ptep_clear_flush+0x40/0x50 Feb 21 07:38:52 c-node02 kernel: [242408.563180] try_to_unmap_one+0x2ae/0xae0 Feb 21 07:38:52 c-node02 kernel: [242408.563184] ? mutex_lock+0xe/0x30 Feb 21 07:38:52 c-node02 kernel: [242408.563186] rmap_walk_anon+0x13a/0x2c0 Feb 21 07:38:52 c-node02 kernel: [242408.563188] try_to_unmap+0x9c/0xf0 Feb 21 07:38:52 c-node02 kernel: [242408.563190] ? page_remove_rmap+0x330/0x330 Feb 21 07:38:52 c-node02 kernel: [242408.563192] ? page_not_mapped+0x20/0x20 Feb 21 07:38:52 c-node02 kernel: [242408.563193] ? page_get_anon_vma+0x80/0x80 Feb 21 07:38:52 c-node02 kernel: [242408.563195] ? invalid_mkclean_vma+0x20/0x20 Feb 21 07:38:52 c-node02 kernel: [242408.563196] migrate_pages+0x3cd/0xc80 Feb 21 07:38:52 c-node02 kernel: [242408.563197] ? do_pages_stat+0x180/0x180 Feb 21 07:38:52 c-node02 kernel: [242408.563198] migrate_misplaced_page+0x15e/0x270
Feb 21 07:38:52 c-node02 kernel: [242408.563200] __handle_mm_fault+0xd80/0x12f0 Feb 21 07:38:52 c-node02 kernel: [242408.563202] handle_mm_fault+0xc2/0x1f0 Feb 21 07:38:52 c-node02 kernel: [242408.563204] __do_page_fault+0x23e/0x4f0 Feb 21 07:38:52 c-node02 kernel: [242408.563206] do_page_fault+0x30/0x110 Feb 21 07:38:52 c-node02 kernel: [242408.563207] page_fault+0x3e/0x50 Feb 21 07:38:52 c-node02 kernel: [242408.563209] RIP: 0033:0x7f27fffb9e73 Feb 21 07:38:52 c-node02 kernel: [242408.563211] Code: 89 6d e8 48 89 fb 4c 89 75 f0 4c 89 7d f8 49 89 f6 4c 89 65 e0 48 81 ec c0 06 00 00 4c 8b 3d 3c a1 34 00 49 89 d5 64 41 8b 07 <89> 85 dc fa ff ff 8b 87 c0 00 00 00 85 c0 0f 85 b9 01 00 00 c7 87 Feb 21 07:38:52 c-node02 kernel: [242408.563211] RSP: 002b:00007f12a37fda10 EFLAGS: 00010202 Feb 21 07:38:52 c-node02 kernel: [242408.563213] RAX: 0000000000000000 RBX: 00007f12a37fe0e0 RCX: 0000000000000000 Feb 21 07:38:52 c-node02 kernel: [242408.563214] RDX: 00007f12a37fe200 RSI: 00000000017a9453 RDI: 00007f12a37fe0e0 Feb 21 07:38:52 c-node02 kernel: [242408.563214] RBP: 00007f12a37fe0d0 R08: 0000000000000000 R09: 00000000017c7550 Feb 21 07:38:52 c-node02 kernel: [242408.563215] R10: 0000000000000000 R11: 00000000000003f8 R12: 00000000017a9453 Feb 21 07:38:52 c-node02 kernel: [242408.563216] R13: 00007f12a37fe200 R14: 00000000017a9453 R15: fffffffffffffe90 Feb 21 07:38:52 c-node02 kernel: [242408.604094] watchdog: BUG: soft lockup - CPU#45 stuck for 22s! [km_target_creat:49068] Feb 21 07:38:52 c-node02 kernel: [242408.604095] Modules linked in: iscsi_scst(OE) crc32c_intel(O) scst_local(OE) netconsole(O) scst_user(OE) scst(OE) drbd(O) lru_cache(O) loop(O) 8021q(O) mrp(O) garp(O) nfsd(O) nfs_acl(O) auth_rpcgss(O) lockd(O) sunrpc(O) grace(O) xt_MASQUERADE(O) xt_nat(O) xt_state(O) iptable_nat(O) xt_addrtype(O) xt_conntrack(O) nf_nat(O) nf_conntrack(O) nf_defrag_ipv4(O) nf_defrag_ipv6(O) libcrc32c(O) br_netfilter(O) bridge(O) stp(O) llc(O) overlay(O) be2iscsi(O) iscsi_boot_sysfs(O) bnx2i(O) cnic(O) uio(O) cxgb4i(O) cxgb4(O) cxgb3i(O) libcxgbi(O) cxgb3(O) mdio(O) libcxgb(O) ib_iser(OE) iscsi_tcp(O) libiscsi_tcp(O) libiscsi(O) scsi_transport_iscsi(O) dm_multipath(O) rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_fpga_tools(OE) mlx5_ib(OE) ib_uverbs(OE) mlx5_core(OE) mdev(OE) mlxfw(OE) ptp(O) pps_core(O) mlx4_ib(OE) ib_core(OE) mlx4_core(OE) mlx_compat(OE) fuse(O) binfmt_misc(O) pvpanic(O) pcspkr(O) virtio_rng(O) virtio_net(O) net_failover(O) failover(O) i2
:
Second typical case PANIC:
From the cosule:
[123080.813877] kernel tried to execute NX-protected page - exploit attempt? (uid: 0)
[ 0.000000] Linux version 5.4.80-KM8 (david.mozes@kbuilder64-tc8-test1) (gcc version 8.3.1 20190311 (Red Hat 8.3.1-3) (GCC)) #14 SMP Mon Jan 11 16:21:21 IST 2021
Mon Jan 11 16:21:21 IST 2021
[ 0.000000] Command line: ro root=LABEL=/ rd_NO_LUKS KEYBOARDTYPE=pc KEYTABLE=us LANG=en_US.UTF-8 rd_NO_MD SYSFONT=latarcyrheb-sun16 nompath append="nmi_watchdog=2"
From the vmcore-dmesg:
[121271.606463] ll header: 00000000: 42 01 0a ad 0c 02 42 01 0a ad 0c 01 08 00 [122656.730235] sh (27931): drop_caches: 3 [123080.813877] kernel tried to execute NX-protected page - exploit attempt? (uid: 0) [123080.813887] sched: RT throttling activated [123080.821706] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: serial8250_console_write+0x26e/0x270
After I comment out
After I comment out the cond_resched(), everything looks more stable.
I Will try another run as Eric sagest with the:
cond_resched()
before the:
Invalidtated_mapping_pages
See and report regarding the behavior.
I think we have a very stressful environment on GCP for testing that Thx David
-----Original Message-----
From: Eric Sandeen <sandeen@sandeen.net>
Sent: Wednesday, March 17, 2021 3:28 AM
To: David Mozes <david.mozes@silk.us>; linux-fsdevel@vger.kernel.org
Cc: sandeen@redhat.com
Subject: Re: fs: avoid softlockups in s_inodes iterators commit
On 3/16/21 3:56 PM, David Mozes wrote:
> Hi,
> Per Eric's request, I forward this discussion to the list first.
> My first answers are inside
ok, but you stripped out all of the other useful information like backtraces, stack corruption, etc. You need to provide the evidence of the actual failure for the list to see. Also ..
> -----Original Message-----
> From: Eric Sandeen <sandeen@redhat.com>
> Sent: Tuesday, March 16, 2021 10:18 PM
> To: David Mozes <david.mozes@silk.us>
> Subject: Re: Mail from David.Mozes regarding fs: avoid softlockups in
> s_inodes iterators commit
>
> On 3/16/21 3:02 PM, David Mozes wrote:
>> Hi Eric,
>>
...
> David > Not sure yet, Will check.
>> 5.4.8 vanilla kernel it custom
>
> Is it vanilla, or is it custom? 5.4.8 or 5.4.80?
>
> David> 5.4.80 small custom as I mantion.
what is a "small custom?" Can you reproduce it on an unmodified upstream kernel?
-Eric
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: fs: avoid softlockups in s_inodes iterators commit
2021-03-17 16:45 ` David Mozes
@ 2021-03-17 19:58 ` Eric Sandeen
2021-03-21 11:47 ` David Mozes
0 siblings, 1 reply; 7+ messages in thread
From: Eric Sandeen @ 2021-03-17 19:58 UTC (permalink / raw)
To: David Mozes, Eric Sandeen, linux-fsdevel
On 3/17/21 11:45 AM, David Mozes wrote:
> Send gin the stack of the first case on different run
>
> panic on 25.2.2021
> whatchg on server 4. the pmc was server w\2
> Feb 23 05:46:06 c-node04 kernel: [125259.990332] watchdog: BUG: soft lockup - CPU#41 stuck for 22s! [kuic_msg_domain:15790]
> Feb 23 05:46:06 c-node04 kernel: [125259.990333] Modules linked in: iscsi_scst(OE) crc32c_intel(O) scst_local(OE) scst_user(OE) scst(OE) drbd(O) lru_cache(O) 8021q(O) mrp(O) garp(O) netconsole(O) nfsd(O) nfs_acl(O) auth_rpcgss(O) lockd(O) sunrpc(O) grace(O) xt_MASQUERADE(O) xt_nat(O) xt_state(O) iptable_nat(O) xt_addrtype(O) xt_conntrack(O) nf_nat(O) nf_conntrack(O) nf_defrag_ipv4(O) nf_defrag_ipv6(O) libcrc32c(O) br_netfilter(O) bridge(O) stp(O) llc(O) overlay(O) be2iscsi(O) iscsi_boot_sysfs(O) bnx2i(O) cnic(O) uio(O) cxgb4i(O) cxgb4(O) cxgb3i(O) libcxgbi(O) cxgb3(O) mdio(O) libcxgb(O) ib_iser(OE) iscsi_tcp(O) libiscsi_tcp(O) libiscsi(O) scsi_transport_iscsi(O) dm_multipath(O) rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_fpga_tools(OE) mlx5_ib(OE) ib_uverbs(OE) mlx5_core(OE) mdev(OE) mlxfw(OE) ptp(O) pps_core(O) mlx4_ib(OE) ib_core(OE) mlx4_core(OE) mlx_compat(OE) fuse(O) binfmt_misc(O) pvpanic(O) pcspkr(O) virtio_rng(O) virtio_net(O) net_failover(O) failover(O) i2c_piix4(
> Feb 23 05:46:06 c-node04 kernel: O) ext4(OE)
> Feb 23 05:46:06 c-node04 kernel: [125259.990368] jbd2(OE) mbcache(OE) virtio_scsi(OE) virtio_pci(OE) virtio_ring(OE) virtio(OE) [last unloaded: scst_local]
ok, you still haven't said what your "light custom" changes to this kernel are, and all of your modules are out of tree (O) and/or unsigned (E) so I would suggest first trying to reproduce this on something a lot less messy and closer to upstream.
-Eric
^ permalink raw reply [flat|nested] 7+ messages in thread
* RE: fs: avoid softlockups in s_inodes iterators commit
2021-03-17 19:58 ` Eric Sandeen
@ 2021-03-21 11:47 ` David Mozes
2021-03-21 23:04 ` Eric Sandeen
0 siblings, 1 reply; 7+ messages in thread
From: David Mozes @ 2021-03-21 11:47 UTC (permalink / raw)
To: Eric Sandeen, Eric Sandeen, linux-fsdevel
Our light custom is enabled us to load a very high load IO on the VM/kernel.
In case I remove them, we will not be able to generate such a high load on the Kernel.
Eric, after I moved the cond_resched to the place you asked for
See below:
--- a/fs/drop_caches.c
+++ b/fs/drop_caches.c
@@ -35,11 +35,11 @@ static void drop_pagecache_sb(struct super_block *sb, void *unused)
spin_unlock(&inode->i_lock);
spin_unlock(&sb->s_inode_list_lock);
+ cond_resched();
invalidate_mapping_pages(inode->i_mapping, 0, -1);
iput(toput_inode);
toput_inode = inode;
We got stuck again after one and a half-day of running under the heavy load:
What we saw on the node is:
From the system log:
You can see that the system stuck around 0ne hour till we reboot it
Mar 20 10:08:02 c-node04 kernel: [26251.637328] sh (48738): drop_caches: 3
Mar 20 10:08:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:08:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:09:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:10:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:11:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:12:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:13:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:14:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:15:47 c-node04 rsyslogd: -- MARK --
Mar 20 10:16:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:17:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:18:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:19:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:20:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:21:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:22:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:23:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:24:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:25:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:26:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:27:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:28:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:29:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:30:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:31:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:32:48 c-node04 rsyslogd: -- MARK --
Mar 20 10:33:49 c-node04 rsyslogd: -- MARK --
Mar 20 10:34:49 c-node04 rsyslogd: -- MARK --
Mar 20 10:35:49 c-node04 rsyslogd: -- MARK --
Mar 20 10:36:49 c-node04 rsyslogd: -- MARK --
Mar 20 10:37:49 c-node04 rsyslogd: -- MARK --
Mar 20 10:38:49 c-node04 rsyslogd: -- MARK --
Mar 20 10:39:49 c-node04 rsyslogd: -- MARK --
Mar 20 10:40:49 c-node04 rsyslogd: -- MARK –
Mar 20 10:45:49 c-node04 rsyslogd: -- MARK --
Mar 20 10:46:49 c-node04 rsyslogd: -- MARK --
Mar 20 11:44:49 c-node04 kernel: imklog 5.8.10, log source = /proc/kmsg started.
Mar 20 11:44:49 c-node04 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="11153" x-info="http://www.rsyslog.com"] start
Mar 20 11:44:49 c-node04 kernel: [ 0.000000] Linux version 5.4.80-KM8 (david.mozes@kbuilder64-tc8) (gcc version 8.3.1 20190311 (R
From the GCP console log we saw that the VM is 100% cpu while we stuck
several times we got the folwing warning
Mar 20 11:53:29 c-node04 kernel:
Mar 20 11:53:29 c-node04 kernel: [ 569.106644] virtio_scsi(OE) virtio_pci(OE) virtio_ring(OE) virtio(OE) [last unloaded: scst_local]
Mar 20 11:53:29 c-node04 kernel: [ 569.106649] CPU: 42 PID: 39649 Comm: kal_scsi_tgt_cr Kdump: loaded Tainted: G OE 5.4.80-KM8 #20
Mar 20 11:53:29 c-node04 kernel: [ 569.106650] Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Mar 20 11:53:29 c-node04 kernel: [ 569.106652] RIP: 0010:usercopy_warn+0x7d/0xa0
Mar 20 11:53:29 c-node04 kernel: [ 569.106653] Code: 0e af 41 51 48 c7 c0 51 bd 0d af 49 89 f1 48 0f 45 c2 48 89 f9 4d 89 d8 4c 89 d2 48 c7 c7 c8 ff 0e af 48 89 c6 e8 8c 5e df ff <0f> 0b 48 83 c4 18 c3 48 c7 c6 9f f9 0f af 49 89 f1 49 89 f3 eb 96
Mar 20 11:53:29 c-node04 kernel: [ 569.106654] RSP: 0018:ffff9dbb7845bda0 EFLAGS: 00010286
Mar 20 11:53:29 c-node04 kernel: [ 569.106654] RAX: 0000000000000000 RBX: ffff9dca3ee24b88 RCX: 0000000000000006
Mar 20 11:53:29 c-node04 kernel: [ 569.106655] RDX: 0000000000000007 RSI: 0000000000000096 RDI: ffff9dca47ad74a0
Mar 20 11:53:29 c-node04 kernel: [ 569.106655] RBP: 0000000000000238 R08: 00000000000008ed R09: 0000000000000002
Mar 20 11:53:29 c-node04 kernel: [ 569.106655] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000001
Mar 20 11:53:29 c-node04 kernel: [ 569.106656] R13: ffff9dca3ee24dc0 R14: 0000000000000238 R15: ffff9dca3ee24b88
Mar 20 11:53:29 c-node04 kernel: [ 569.106657] FS: 00007fa42daf0700(0000) GS:ffff9dca47ac0000(0000) knlGS:0000000000000000
Mar 20 11:53:29 c-node04 kernel: [ 569.106657] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 20 11:53:29 c-node04 kernel: [ 569.106658] CR2: 00007fabfd7d2000 CR3: 0000003bbda9a001 CR4: 00000000003606e0
Mar 20 11:53:29 c-node04 kernel: [ 569.106661] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 20 11:53:29 c-node04 kernel: [ 569.106661] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Mar 20 11:53:29 c-node04 kernel: [ 569.106662] Call Trace:
Mar 20 11:53:29 c-node04 kernel: [ 569.106669] __check_object_size+0x162/0x173
Mar 20 11:53:29 c-node04 kernel: [ 569.106676] dev_user_reply_get_cmd.isra.17+0x198/0x420 [scst_user]
Mar 20 11:53:29 c-node04 kernel: [ 569.106679] dev_user_ioctl+0x317/0x71a [scst_user]
Mar 20 11:53:29 c-node04 kernel: [ 569.106683] ? ep_poll+0x88/0x460
Mar 20 11:53:29 c-node04 kernel: [ 569.106688] do_vfs_ioctl+0xa2/0x600
Mar 20 11:53:29 c-node04 kernel: [ 569.106691] ? finish_wait+0x80/0x80
Mar 20 11:53:29 c-node04 kernel: [ 569.106692] ksys_ioctl+0x60/0x90
Mar 20 11:53:29 c-node04 kernel: [ 569.106693] __x64_sys_ioctl+0x16/0x20
Mar 20 11:53:29 c-node04 kernel: [ 569.106698] do_syscall_64+0x55/0x1a0
Mar 20 11:53:29 c-node04 kernel: [ 569.106703] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Mar 20 11:53:29 c-node04 kernel: [ 569.106706] RIP: 0033:0x7fac04913b77
Mar 20 11:53:29 c-node04 kernel: [ 569.106707] Code: 90 90 90 48 8b 05 51 d4 2a 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 90 90 90 90 90 90 90 90 90 90 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 21 d4 2a 00 31 d2 48 29 c2 64
Mar 20 11:53:29 c-node04 kernel: [ 569.106708] RSP: 002b:00007fa42dae9788 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Mar 20 11:53:29 c-node04 kernel: [ 569.106709] RAX: ffffffffffffffda RBX: 00007fa46c127140 RCX: 00007fac04913b77
The bottom line the system is looking more stable without the:
cond_resched()
will try to run without this commad that happens every hour. ( a lagitimc Linux command)
echo 3 > /proc/sys/vm/drop_caches
Thx
David
-----Original Message-----
From: Eric Sandeen <sandeen@redhat.com>
Sent: Wednesday, March 17, 2021 9:59 PM
To: David Mozes <david.mozes@silk.us>; Eric Sandeen <sandeen@sandeen.net>; linux-fsdevel@vger.kernel.org
Subject: Re: fs: avoid softlockups in s_inodes iterators commit
On 3/17/21 11:45 AM, David Mozes wrote:
> Send gin the stack of the first case on different run
>
> panic on 25.2.2021
> whatchg on server 4. the pmc was server w\2
> Feb 23 05:46:06 c-node04 kernel: [125259.990332] watchdog: BUG: soft lockup - CPU#41 stuck for 22s! [kuic_msg_domain:15790]
> Feb 23 05:46:06 c-node04 kernel: [125259.990333] Modules linked in: iscsi_scst(OE) crc32c_intel(O) scst_local(OE) scst_user(OE) scst(OE) drbd(O) lru_cache(O) 8021q(O) mrp(O) garp(O) netconsole(O) nfsd(O) nfs_acl(O) auth_rpcgss(O) lockd(O) sunrpc(O) grace(O) xt_MASQUERADE(O) xt_nat(O) xt_state(O) iptable_nat(O) xt_addrtype(O) xt_conntrack(O) nf_nat(O) nf_conntrack(O) nf_defrag_ipv4(O) nf_defrag_ipv6(O) libcrc32c(O) br_netfilter(O) bridge(O) stp(O) llc(O) overlay(O) be2iscsi(O) iscsi_boot_sysfs(O) bnx2i(O) cnic(O) uio(O) cxgb4i(O) cxgb4(O) cxgb3i(O) libcxgbi(O) cxgb3(O) mdio(O) libcxgb(O) ib_iser(OE) iscsi_tcp(O) libiscsi_tcp(O) libiscsi(O) scsi_transport_iscsi(O) dm_multipath(O) rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_fpga_tools(OE) mlx5_ib(OE) ib_uverbs(OE) mlx5_core(OE) mdev(OE) mlxfw(OE) ptp(O) pps_core(O) mlx4_ib(OE) ib_core(OE) mlx4_core(OE) mlx_compat(OE) fuse(O) binfmt_misc(O) pvpanic(O) pcspkr(O) virtio_rng(O) virtio_net(O) net_failover(O) failover(O) i2c_piix4(
> Feb 23 05:46:06 c-node04 kernel: O) ext4(OE)
> Feb 23 05:46:06 c-node04 kernel: [125259.990368] jbd2(OE) mbcache(OE) virtio_scsi(OE) virtio_pci(OE) virtio_ring(OE) virtio(OE) [last unloaded: scst_local]
ok, you still haven't said what your "light custom" changes to this kernel are, and all of your modules are out of tree (O) and/or unsigned (E) so I would suggest first trying to reproduce this on something a lot less messy and closer to upstream.
-Eric
^ permalink raw reply [flat|nested] 7+ messages in thread* Re: fs: avoid softlockups in s_inodes iterators commit
2021-03-21 11:47 ` David Mozes
@ 2021-03-21 23:04 ` Eric Sandeen
0 siblings, 0 replies; 7+ messages in thread
From: Eric Sandeen @ 2021-03-21 23:04 UTC (permalink / raw)
To: David Mozes, Eric Sandeen, linux-fsdevel
On 3/21/21 6:47 AM, David Mozes wrote:
>
> Our light custom is enabled us to load a very high load IO on the VM/kernel.
If you can't explain what this change is, I'm afraid the default assumption will be
that your <unspecified> changes have contributed to the problem.
> In case I remove them, we will not be able to generate such a high load on the Kernel.
>
> Eric, after I moved the cond_resched to the place you asked for
> See below:
>
> --- a/fs/drop_caches.c
> +++ b/fs/drop_caches.c
> @@ -35,11 +35,11 @@ static void drop_pagecache_sb(struct super_block *sb, void *unused)
> spin_unlock(&inode->i_lock);
> spin_unlock(&sb->s_inode_list_lock);
>
> + cond_resched();
> invalidate_mapping_pages(inode->i_mapping, 0, -1);
> iput(toput_inode);
> toput_inode = inode;
>
> We got stuck again after one and a half-day of running under the heavy load:
> What we saw on the node is:
<a different backtrace than before with the actual warning omitted>
Ok, then the change you flagged from my commit is not the root cause of your problem.
At this point, I can only presume that your "light custom" is the root cause.
If you can't reproduce the problem on a stock kernel, then I don't think we can proceed
further.
-Eric
^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2021-03-21 23:05 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-03-16 20:56 fs: avoid softlockups in s_inodes iterators commit David Mozes
2021-03-17 1:28 ` Eric Sandeen
2021-03-17 16:40 ` David Mozes
2021-03-17 16:45 ` David Mozes
2021-03-17 19:58 ` Eric Sandeen
2021-03-21 11:47 ` David Mozes
2021-03-21 23:04 ` Eric Sandeen
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.