All of lore.kernel.org
 help / color / mirror / Atom feed
* [LTP] LTP's filecaps test gives false positive results
@ 2010-03-02 10:11 Iranna D Ankad
  2010-03-02 15:21 ` Serge E. Hallyn
  2010-03-02 16:39 ` Garrett Cooper
  0 siblings, 2 replies; 13+ messages in thread
From: Iranna D Ankad @ 2010-03-02 10:11 UTC (permalink / raw)
  To: ltp-list; +Cc: Rishikesh K Rajak, Serge E Hallyn


[-- Attachment #1.1: Type: text/plain, Size: 11871 bytes --]

Hello ..
When I am trying to run LTP's filecaps test, it does not actually run the 
test, but ltp-pan report test PASSED.
This is happening in the latest LTP (ltp-full-20100228), including couple 
of past LTP releases (ex. November, December releases)

---------------------------------------------------------------------------------------------------------------------------------------------------
mx3950:/opt/ltp # ./runltp -f filecaps
INFO: creating /opt/ltp/results directory
If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.
 
LSB_VERSION="core-2.0-noarch:core-3.2-noarch:core-4.0-noarch:core-2.0-x86_64:core-3.2-x86_64:core-4.0-x86_64"
SUSE Linux Enterprise Server 11 (x86_64)
VERSION = 11
PATCHLEVEL = 1
Linux mx3950 2.6.32.8-default #1 SMP Fri Feb 26 18:45:10 EST 2010 x86_64 
x86_64 x86_64 GNU/Linux
 
Gnu C                  gcc (SUSE Linux) 4.3.4 [gcc-4_3-branch revision 
152973]
Gnu make               3.81
util-linux             ng 2.16)
mount                  ng 2.16 (with libblkid and selinux support)
modutils               3.11.1
e2fsprogs              1.41.9
PPP                    2.4.5
Linux C Library        2.11.1
Dynamic linker (ldd)   2.11.1
Procps                 3.2.7
Net-tools              1.60
iproute2              iproute2-ss090324
Kbd                    1.14.1
Sh-utils               6.12
Modules Loaded         radeon ttm drm_kms_helper drm i2c_algo_bit ipv6 
microcode fuse loop dm_mod rtc_cmos ses i2c_piix4 rtc_core sr_mod 
usb_storage rtc_lib acpi_memhotplug sg pcspkr serio_raw joydev enclosure 
button i2c_core cdrom usbhid hid ohci_hcd ehci_hcd sd_mod ssb crc_t10dif 
mmc_core usbcore pcmcia pcmcia_core edd ext3 mbcache jbd fan processor 
ata_generic thermal thermal_sys hwmon

free reports:
             total       used       free     shared    buffers     cached
Mem:      33019056    2530968   30488088          0     108020    1218628
-/+ buffers/cache:    1204320   31814736
Swap:     20964816          0   20964816

/proc/cpuinfo
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 15
model           : 6
model name      : Intel(R) Xeon(TM) CPU 3.16GHz
stepping        : 8
cpu MHz         : 3169.236
cache size      : 8192 KB
physical id     : 0
siblings        : 4
core id         : 0
cpu cores       : 2
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 6
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx 
lm constant_tsc pebs bts pni dtes64 monitor ds_cpl vmx est tm2 cid cx16 
xtpr pdcm lahf_lm tpr_shadow vnmi
bogomips        : 6338.47
clflush size    : 64
cache_alignment : 128
address sizes   : 40 bits physical, 48 bits virtual
power management:

processor       : 1
vendor_id       : GenuineIntel
cpu family      : 15
model           : 6
model name      : Intel(R) Xeon(TM) CPU 3.16GHz
stepping        : 8
cpu MHz         : 3169.236
cache size      : 8192 KB
physical id     : 0
siblings        : 4
core id         : 0
cpu cores       : 2
apicid          : 1
initial apicid  : 1
fpu             : yes
fpu_exception   : yes
cpuid level     : 6
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx 
lm constant_tsc pebs bts pni dtes64 monitor ds_cpl vmx est tm2 cid cx16 
xtpr pdcm lahf_lm tpr_shadow vnmi
bogomips        : 6339.10
clflush size    : 64
cache_alignment : 128
address sizes   : 40 bits physical, 48 bits virtual
power management:

processor       : 2
vendor_id       : GenuineIntel
cpu family      : 15
model           : 6
model name      : Intel(R) Xeon(TM) CPU 3.16GHz
stepping        : 8
cpu MHz         : 3169.236
cache size      : 8192 KB
physical id     : 0
siblings        : 4
core id         : 1
cpu cores       : 2
apicid          : 2
initial apicid  : 2
fpu             : yes
fpu_exception   : yes
cpuid level     : 6
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx 
lm constant_tsc pebs bts pni dtes64 monitor ds_cpl vmx est tm2 cid cx16 
xtpr pdcm lahf_lm tpr_shadow vnmi
bogomips        : 6339.19
clflush size    : 64
cache_alignment : 128
address sizes   : 40 bits physical, 48 bits virtual
power management:

processor       : 3
vendor_id       : GenuineIntel
cpu family      : 15
model           : 6
model name      : Intel(R) Xeon(TM) CPU 3.16GHz
stepping        : 8
cpu MHz         : 3169.236
cache size      : 8192 KB
physical id     : 0
siblings        : 4
core id         : 1
cpu cores       : 2
apicid          : 3
initial apicid  : 3
fpu             : yes
fpu_exception   : yes
cpuid level     : 6
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx 
lm constant_tsc pebs bts pni dtes64 monitor ds_cpl vmx est tm2 cid cx16 
xtpr pdcm lahf_lm tpr_shadow vnmi
bogomips        : 6339.16
clflush size    : 64
cache_alignment : 128
address sizes   : 40 bits physical, 48 bits virtual
power management:

processor       : 4
vendor_id       : GenuineIntel
cpu family      : 15
model           : 6
model name      : Intel(R) Xeon(TM) CPU 3.16GHz
stepping        : 8
cpu MHz         : 3169.236
cache size      : 8192 KB
physical id     : 1
siblings        : 4
core id         : 0
cpu cores       : 2
apicid          : 4
initial apicid  : 4
fpu             : yes
fpu_exception   : yes
cpuid level     : 6
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx 
lm constant_tsc pebs bts pni dtes64 monitor ds_cpl vmx est tm2 cid cx16 
xtpr pdcm lahf_lm tpr_shadow vnmi
bogomips        : 6339.29
clflush size    : 64
cache_alignment : 128
address sizes   : 40 bits physical, 48 bits virtual
power management:

processor       : 5
vendor_id       : GenuineIntel
cpu family      : 15
model           : 6
model name      : Intel(R) Xeon(TM) CPU 3.16GHz
stepping        : 8
cpu MHz         : 3169.236
cache size      : 8192 KB
physical id     : 1
siblings        : 4
core id         : 0
cpu cores       : 2
apicid          : 5
initial apicid  : 5
fpu             : yes
fpu_exception   : yes
cpuid level     : 6
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx 
lm constant_tsc pebs bts pni dtes64 monitor ds_cpl vmx est tm2 cid cx16 
xtpr pdcm lahf_lm tpr_shadow vnmi
bogomips        : 6339.25
clflush size    : 64
cache_alignment : 128
address sizes   : 40 bits physical, 48 bits virtual
power management:

processor       : 6
vendor_id       : GenuineIntel
cpu family      : 15
model           : 6
model name      : Intel(R) Xeon(TM) CPU 3.16GHz
stepping        : 8
cpu MHz         : 3169.236
cache size      : 8192 KB
physical id     : 1
siblings        : 4
core id         : 1
cpu cores       : 2
apicid          : 6
initial apicid  : 6
fpu             : yes
fpu_exception   : yes
cpuid level     : 6
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx 
lm constant_tsc pebs bts pni dtes64 monitor ds_cpl vmx est tm2 cid cx16 
xtpr pdcm lahf_lm tpr_shadow vnmi
bogomips        : 6339.28
clflush size    : 64
cache_alignment : 128
address sizes   : 40 bits physical, 48 bits virtual
power management:

processor       : 7
vendor_id       : GenuineIntel
cpu family      : 15
model           : 6
model name      : Intel(R) Xeon(TM) CPU 3.16GHz
stepping        : 8
cpu MHz         : 3169.236
cache size      : 8192 KB
physical id     : 1
siblings        : 4
core id         : 1
cpu cores       : 2
apicid          : 7
initial apicid  : 7
fpu             : yes
fpu_exception   : yes
cpuid level     : 6
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx 
lm constant_tsc pebs bts pni dtes64 monitor ds_cpl vmx est tm2 cid cx16 
xtpr pdcm lahf_lm tpr_shadow vnmi
bogomips        : 6339.29
clflush size    : 64
cache_alignment : 128
address sizes   : 40 bits physical, 48 bits virtual
power management:

remove test cases which require the block device.
You can specify it with option -b
COMMAND:    /opt/ltp/bin/ltp-pan  -e -S   -a 12064     -n 12064  -p  -f 
/tmp/ltp-P00GfUUqLS/alltests -l 
/opt/ltp/results/LTP_RUN_ON-2010_Mar_02-04h_14m_57s.log  -C 
/opt/ltp/output/LTP_RUN_ON-2010_Mar_02-04h_14m_57s.failed
LOG File: /opt/ltp/results/LTP_RUN_ON-2010_Mar_02-04h_14m_57s.log
FAILED COMMAND File: 
/opt/ltp/output/LTP_RUN_ON-2010_Mar_02-04h_14m_57s.failed
Running tests.......
<<<test_start>>>
tag=Filecaps stime=1267521297
cmdline="filecapstest.sh"
contacts=""
analysis=exit
<<<test_output>>>
incrementing stop
Filecaps 0 CONF : System doesn't support execution of the test
setcap not installed. Please install libcap-2.11 or newer from
ftp://ftp.kernel.org/pub/linux/libs/security/linux-privs/libcap2
<<<execution_status>>>
initiation_status="ok"
duration=0 termination_type=exited termination_id=0 corefile=no
cutime=0 cstime=0
<<<test_end>>>
INFO: ltp-pan reported all tests PASS
LTP Version: LTP-20100131
 
       ###############################################################"
 
            Done executing testcases."
            LTP Version:  LTP-20100131
       ###############################################################"
 
mx3950:/opt/ltp #

---------------------------------------------------------------------------------------------------------------------------------------------------

LTP reports setcap is installed, but actually, my system has setcap 
installed, along with all required libcap related rpms.

mx3950:/opt/ltp # setc
setcap      setconsole  setctsid 
mx3950:/opt/ltp #

mx3950:/opt/ltp # rpm -qa | grep cap
libcap1-1.10-6.10
libcap2-2.11-2.15
libcap-progs-2.11-2.15
libpcap0-0.9.8-50.4.32
libcap2-32bit-2.11-2.15
libcap1-32bit-1.10-6.10
mx3950:/opt/ltp # 
---------------------------------------------------------------------------------------------------------------------------------------------------


Here is the false positive log, which shows test PASSED, without actually 
running the test.

---------------------------------------------------------------------------------------------------------------------------------------------------

mx3950:/opt/ltp # cat results/LTP_RUN_ON-2010_Mar_02-04h_14m_57s.log 
Test Start Time: Tue Mar  2 04:14:57 2010
-----------------------------------------
Testcase                       Result     Exit Value
--------                       ------     ----------
Filecaps                       PASS       0 

-----------------------------------------------
Total Tests: 1
Total Failures: 0
Kernel Version: 2.6.32.8-default
Machine Architecture: x86_64
Hostname: mx3950

mx3950:/opt/ltp # 
---------------------------------------------------------------------------------------------------------------------------------------------------

Thanks!
-Iranna D Ankad
----------------------------------------------------------------------------------------------------
Linux-Technology Center, IBM India Software Labs
Manyata Embassy Park, BENGALURU - 560045,
Ph: +91-080-28055007   Extn: 55007
----------------------------------------------------------------------------------------------------
"If you don't have patience to test the software, the software will test 
your patience !!"

[-- Attachment #1.2: Type: text/html, Size: 30985 bytes --]

[-- Attachment #2: Type: text/plain, Size: 345 bytes --]

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev

[-- Attachment #3: Type: text/plain, Size: 155 bytes --]

_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list

^ permalink raw reply	[flat|nested] 13+ messages in thread

end of thread, other threads:[~2010-03-18 19:13 UTC | newest]

Thread overview: 13+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2010-03-02 10:11 [LTP] LTP's filecaps test gives false positive results Iranna D Ankad
2010-03-02 15:21 ` Serge E. Hallyn
2010-03-02 16:25   ` Garrett Cooper
2010-03-02 17:35     ` Serge E. Hallyn
2010-03-02 18:25       ` Garrett Cooper
2010-03-03  5:56         ` Rishikesh K Rajak
2010-03-03  9:14           ` Garrett Cooper
2010-03-03  9:23             ` Rishikesh K Rajak
2010-03-03 16:00             ` Serge E. Hallyn
2010-03-18  9:25             ` Rishikesh K Rajak
2010-03-18 14:55               ` Serge E. Hallyn
2010-03-18 19:13                 ` Garrett Cooper
2010-03-02 16:39 ` Garrett Cooper

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.