Re: [OT] 2.6 not 3.0 - (WAS Re: [PATCH-RFC] 4 of 4 - New problem logging macros, SCSI RAIDdevice)

[Andreas Boman <aboman@nerdfest.org>]

[-- Attachment #1.1: Type: text/plain, Size: 3952 bytes --]

On Thu, 2002-10-03 at 17:05, Dave Jones wrote:
<SNIP>
>  > > We still need some work for low memory boxes (where low isn't
>  > > necessarily all that low). On my 128MB laptop I can lock up the box
>  > > for a minute or two at a time by doing two things at the same time,
>  > > like a bk pull, and switching desktops.
>  > 
>  > Specific version info and all the usual how-to-reproduce info
>  > would help here.  Things have changed a _lot_ in the past
>  > week or two.
> That was 2.5.39 + bk from just before .40 hit the streets.
> I'll pull something current in a tick, and give that a shot.
> 
>  > Comparisons with 2.4 are useful.  Simple "here's how to
>  > reproduce" instructions are 100% golden ;)
Usually its difficult with theese 'feeling' issues though...

> theres usually not too much going on on the laptop.
> It runs enlightenment + gnome 1.4. A few gnome-terminals,
> and thats about it. After bitkeeper had sucked down a few
> changesets and started its "lets grind the disk for a while"
> consistency thing, interactive feel is approaching nil.
> Trying to focus a different window takes about 5 seconds minimum.
> Switching desktops takes 30 seconds minimum.
> 
> My completely unscientific guess here is that bitkeeper is
> whoring all the I/O bandwidth, and we're trying to swap at
> the same time, which is getting starved.
> I'll try and reproduce after some sleep with vmstat running
> if this will be of use.
> 
<SNIP>
>  
>  > It should be immune to our traditional catastrophic failure
>  > scenarios, and that's something which we want to keep.  There are
>  > some ten- or twenty-percent regressions in some areas, but at this
>  > time that's a reasonable price to pay for not locking up, not having
>  > five-minute comas, not exhibiting massive stalls when there's a
>  > lot of disk writeout, etc.  I think history teaches us to value
>  > simplicity, predictability and robustness over performance-in-corner-cases.
> 
> Hmm, my case seems to be everything you say should not be happening
> any more. Sorry 8-)
> I *can't* be the only one seeing this though.
You arent ;)

> The laptop disk is no speed demon, but its quite nippy at ~12MB/s
> For obvious reasons, having swap and / on the same disk is making
> a considerable impact here.
> 		Dave

I'm seeing similar behavior, though not to the extent you describe. 512M
ram, ~600 or so swap on a U160 scsi disk (only one disk in the box
-definitely need one more). 

rpm -ba mozilla.spec and while its untar/gunziping i keep switching
desktops ("edge flip" in E) between one with a few Eterms and misc
stuff, and one with mozilla. At first it behaves fine, but eventually
the mouse pointer will start jerking around and itll be slightly slower
to switch, a little later the swapping starts and xmms will skip
(sometimes just once, othertimes repetedly). Once the untaring is done
and the build starts the box becomes responsive again. 

Doing the same thing on 2.4.20-pre5aa2 xmms never skipped, starting a
build of mozilla and evolution at the same time, still no skipping. Drop
xmms and play a music video in MPLayer -still no skipping. I could even
move the MPlayer output window back and forth between the desktops
repetedly although i didnt move it around as fast as when i was just
switching desktops, without sound skips video playback did freeze up a
bit and left funky trails across the mozilla page at times), but sound
didnt skip. Sound started skipping when i had mozilla and evolution both
untar/ungzipping and I moved the window around madly between heads and
desktops.

the attached vmstat 1 from 2.5.40 is taken from when the build has just
started until a little after I killed it (when it had untared and
started ./configure). A little time goes by after i kill it I see a
little more IO and then the box just idles again.

-- 
Andreas Boman <aboman@nerdfest.org>

[-- Attachment #1.2: vmstat-2.5 --]
[-- Type: text/x-troff-man, Size: 13760 bytes --]

   procs                      memory      swap          io     system      cpu
 r  b  w   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id
 0  1  0   3396  14400  20252 281056    0    0     7    31 1049   966  2  1 97
 2  1  0   3396  15276  20252 281032    0    0     0  9070 1435  2781  4 17 79
 2  1  1   3396  24692  20252 272660    0    0     0  9356 1391  2359  3 20 77
 1  1  0   3396  34404  20252 263960    0    0   108  8720 1361  2307  3 19 78
 2  1  1   3396  53132  20284 251936    0    0    36  9439 1459  2731  4 24 72
 1  1  0   3396  63500  20296 242480    0    0    12  7476 1378  3008 33 19 49
 4  0  0   3396  79712  20316 227232    0    0    20  9491 1586  3942 17 17 66
 2  1  0   3396  90452  20316 217404    0    0     0  6977 1338  4500 40 19 41
 3  0  0   3396 100776  20348 208072    0    0    32  8500 1462  3455 37 20 43
 2  1  0   3396 104468  20376 199008    0    0    28  7257 1371  4254 42 20 38
 1  1  0   3396 131784  20376 183716    0    0     0  9865 1431  4052 15 21 64
 3  1  0   3396 143788  20376 172712    0    0     0  8677 1391  4010 39 20 42
 1  1  1   3396 153436  20376 163860    0    0     0  7420 1331  2924 36 17 47
 9  0  0   3396 165512  20380 152860    0    0     4 10658 1481  4092 15 19 65
 1  1  0   3396 174536  20380 148644    0    0     0  8932 1514  4917 38 22 40
 1  1  0   3396 189456  20384 134752    0    0     4  8789 1418  4624 40 26 34
 2  1  0   3396 197220  20384 127816    0    0     0  8775 1448  3069 34 26 40
 1  1  0   3396 210400  20384 115596    0    0     0  7912 1406  4613 42 23 35
 4  0  0   3396 208716  20388 107332    0    0     4  7208 1383  4494 38 21 41
 3  0  0   3396 228860  20388  93812    0    0     0  8451 1447  4674 34 23 44
 2  1  0   3396 247848  20388  85264    0    0     0  8784 1444  4362 31 22 47
   procs                      memory      swap          io     system      cpu
 r  b  w   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id
 1  1  0   3396 236480  20532  96428    0    0   572  6653 1376 10165 53 31 16
 3  0  1   3396 207996  20680 112528    0    0  1332  4628 1448 12121 60 29 11
 4  1  0   3396 183432  20868 134940    0    0   808  5856 1393 14025 55 36  9
 2  1  1   3396 183628  20892 141036    0    0     0  8423 1311  7492 42 14 45
 2  0  1   3396 182692  20956 147336    0    0   256  6869 1314  6438 30 18 52
 1  1  1   3396 177700  21028 151484    0    0     0  7266 1368  6928 47 19 34
 4  0  0   3396 172476  21108 156040    0    0   256  9156 1331  4612 10 14 76
 1  1  1   3396 166332  21144 161548    0    0    76  5618 1221  6092 45 13 42
 2  1  1   3396 166288  21144 161548    0    0     0 14624 1231  3201 17  7 76
 4  0  0   3396 148396  21196 167636    0    0     0  3817 1362  5651 39 18 44
 1  1  1   3396 145884  21348 178680    0    0    44  6402 1338 10058 23 31 45
 3  1  0   3396 144648  21356 179820    0    0   136  9280 1232  4117 44  9 48
 1  1  1   3396 133908  21496 188956    0    0   152  4673 1214  6416 44 22 34
 1  1  1   3396 133836  21500 188988    0    0     0 12320 1172  2957 13  6 81
 3  0  0   3396 118440  21644 202500    0    0   644  4637 1264  9888 47 28 26
 4  0  0   3396 107768  21668 203516    0    0     0  8848 1245  4542 29 10 61
 1  1  1   3396 109644  21748 209964    0    0   388  7884 1273  6321 34 22 45
 5  0  0   3396 100180  21844 218488    0    0   444  8121 1252  7027 41 20 40
 3  1  1   3396  97868  21852 220556    0    0    76  8588 1370  4439 22 14 64
 1  1  1   3396  91240  21904 226416    0    0     0  5969 1267  7393 42 18 40
 3  0  0   3396  85724  21920 231624    0    0   424  7400 1217  4708 37 14 48
   procs                      memory      swap          io     system      cpu
 r  b  w   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id
 1  1  2   3396  80444  21932 236348    0    0     0 10248 1267  5512 19 15 66
 1  1  1   3396  73232  22000 242852    0    0   148  8248 1236  6901 48 19 34
 5  0  0   3396  55848  22088 248628    0    0   244  6668 1217  5089 37 15 49
 1  1  1   3396  60656  22212 253772    0    0   348  8276 1304  6179 22 14 64
 2  1  0   3396  53080  22392 260172    0    0   136  5636 1326  7550 52 23 25
 1  1  1   3396  49040  22492 263620    0    0   188  7792 1379  3531  7 11 82
 4  0  0   3396  44024  22620 267796    0    0   116  8148 1222  4894 37 14 49
 2  1  1   3396  36344  22808 274128    0    0   428  7889 1298  6797 19 22 59
 1  1  0   3396  33844  22868 276328    0    0    32  9904 1230  5689 48 12 40
 1  1  0   3396  24416  23072 284420    0    0   216  3138 1313  6549 44 19 37
 1  1  1   3396  17684  23196 290352    0    0    72  8516 1242  6248 23 14 63
 3  0  0   3396  14308  23280 293168    0    0   160  7528 1287  3761 41 11 48
 1  2  1   3396   1512  21128 302688    0    0   280  5103 1346  8892 29 24 47
 1  2  1   5216   3348  19120 299492    0 1828     0  7631 1423  1560  4  5 91
 1  2  1   5216   2916  19128 299732    0    0     8  9833 1346  1953  2  5 93
 1  1  1  12552  13856  19120 298196    0 7336   136 14580 1253  4235 36  9 55
 3  0  0  12552   3216  19140 299408    0    0   136  5540 1279  3163 20  7 73
 2  1  1  20460   2780  19468 308672    0 7908   484 11125 1282  9327 39 26 35
 1  2  1  23540   1528  19436 303452    0 3080     0  8232 1265  2440 14  5 81
 1  1  0  25572  11904  19424 299704    0 2032    24  8980 1288  2168 24  9 67
 2  1  1  27128   2492  19604 308280    0 1556  1456  6205 1356  7760 23 19 58
   procs                      memory      swap          io     system      cpu
 r  b  w   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id
 1  3  2  27868   1472  19584 307736    0  740     0 11104 1305  2033 10  9 81
 0  5  1  30432   1576  19544 306240    0 2564     8  8257 1394  1206  1  5 94
 0  5  2  30688   1548  19544 306236    0  256     0  9483 1269   631  0  6 94
 0  4  1  34788   1632  19516 303624    0 4336     0 11993 1285  1351  3  5 92
 2  1  1  37736  12796  19520 298740    0 3328     4 12364 1237  4040 35  8 57
 2  1  2  40640   2560  19640 297620    0 2928   540  6092 1320  4530 31 14 55
 3  0  0  40640   5576  19760 304528    0    0  1160  5912 1332  6053 22 16 62
 3  1  1  41448   2568  19776 306176    0  832   664 10389 1300  5790 20 13 67
 5  0  0  41740   8124  19728 300808    0  292   256  5973 1378  6105 40 21 40
 3  1  2  41764   2240  19644 300156    0  280   640  7426 1403  4245 17 18 65
 2  1  0  41764  12140  19580 295992    0    0   128  8229 1399  3599 31 12 57
 1  2  1  41772   1516  19732 301572    0    8  1416  5621 1392 10771 33 31 37
 3  0  0  41772   9276  19784 296776    0    0   640  7432 1342  4156 31 14 55
 1  1  0  41772   2460  20024 301428    0    0   896  5322 1412  7754 22 30 48
 1  2  1  41808   1512  19936 294832    0   36   896  7349 1342  5280 19 16 65
 3  1  1  41808   4932  20104 296940   28    0   812  5002 1402  8322 42 26 33
 1  2  1  41816   1556  20200 294032    0    8   768  7435 1378  5621 22 24 54
 0  1  0  41820   5240  20316 294572    0    4   928  4532 1343  7414 40 19 40
 1  2  1  41832   1504  20388 291856    0   12   792  7414 1380  5893 22 17 61
 3  0  0  41840   2608  20692 294840    0    8  1048  4801 1433  7643 31 35 35
 4  0  1  41840   2596  20888 293356    0    0     8  6648 1359  5357 18 25 57
   procs                      memory      swap          io     system      cpu
 r  b  w   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id
 4  0  0  41840   6004  20756 284540   40    4    40  5057 1348  2733 26 30 44
 1  1  0  41820  12672  21180 283368    4   24   844  2281 1387  3338 28 28 44
 1  1  0  41820  12412  21432 283368    0    0   268  2947 1339  3808 18 14 68
 1  1  0  41816  13396  21640 282212    0    0   232  1633 1378  3240 40 12 49
 1  1  0  41816  13216  21648 282212    0    0     8  5642 1429  3585 16 22 62
 2  0  0  41816  13196  21832 282212    0    0   184  4016 1336  2220  7 39 54
 1  1  0  41816  12876  22016 282212    0    0   184  4112 1363  2347  9 22 69
 2  1  0  41816  11968  22192 282924    0    0   768  3088 1476  2351  9 22 69
 2  1  0  41816   9140  22200 284200    0    0  1272    32 1217  3178 45 36 19
 4  0  0  41820  13712  22188 280732    0  100  1544   260 1305  3531 66 21 13
 3  0  0  41820  10560  22252 281876    0    0  1188   391 1222  4079 56 30 14
 2  0  1  41820   9348  22252 282160    0    0   284   512 1102  2343 58 38  4
 3  0  0  41820  10616  22340 282552    0    0   360   352 1301  2887 50 35 15
 2  0  0  41820  10432  22412 283064    0    0   584   448 1172  2411 44 38 17
 2  0  0  41820   9508  22452 283332    0    0   300   480 1155  2551 54 33 13
 2  0  0  41820   9336  22492 283484    0    0   188   739 1162  2359 55 31 14
 1  1  0  41820   9496  22492 283780    0    0   236   352 1074  1878 73 21  6
 1  0  0  41820  11308  22540 283928    0    0   264    96 1083  1619  8  6 86
 2  0  0  41820  11300  22540 283928    0    0     0     0 1044  1511  4  1 95
 2  0  0  41820  11304  22540 283928    0    0     0     0 1108  1894  4  1 95
 2  0  1  41820  11136  22540 284056    0    0     0  6400 1385  2240  4 23 73
   procs                      memory      swap          io     system      cpu
 r  b  w   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id
 1  0  0  41820  11196  22540 284056    0    0     0  1680 1091  1597  3  2 95
 1  0  0  41820  11188  22540 284056    0    0     0     0 1099  1809  3  1 96
 1  0  0  41820  11160  22540 284056    0    0     0    34 1077  1674  5  1 94
 1  0  0  41820  11164  22540 284056    0    0     0     0 1101  1751  2  1 97
 2  0  1  41820  11108  22540 284056    0    0     0  8363 1149  1689  3  6 91
 1  0  1  41820  11148  22540 284056    0    0     0  7648 1233  1798  1  6 93
 1  0  1  41820  11200  22540 284056    0    0     0 10272 1204  1782  3  6 91
 1  0  0  41820  11088  22540 284184    0    0     0  2020 1198  1587  1  2 97
 1  0  0  41820  11088  22540 284184    0    0     0     0 1044  1525  2  1 97
 2  0  1  41820  11036  22540 284184    0    0     0  8414 1149  1548  3  7 90
 2  0  1  41820  11044  22540 284184    0    0     0 10152 1232  1906  3  8 89
 1  0  0  41820  11068  22540 284184    0    0     0  4160 1224  1954  3  8 89
 1  0  0  41820  11052  22540 284184    0    0     0     0 1044  1503  3  1 96
 1  0  0  41820  11056  22540 284184    0    0     0     0 1048  1458  3  1 96
 1  0  0  41820  11036  22540 284184    0    0     0  1106 1066  1470  4  7 89
 1  0  0  41820  11040  22540 284184    0    0     0     8 1067  1589  3  1 96
 1  0  0  41820  10896  22540 284312    0    0     0     0 1264  2202  3  1 96
 1  0  0  41820  10904  22540 284312    0    0     0     0 1098  1797  4  1 95
 1  0  0  41820  10964  22540 284312    0    0     0     0 1105  1802  4  1 95
 1  0  0  41820  10968  22540 284312    0    0     0    46 1047  1444  3  3 94
 1  0  0  41820  11056  22540 284312    0    0     0     0 1058  1561  4  1 95
   procs                      memory      swap          io     system      cpu
 r  b  w   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id
 1  0  0  41820  11060  22540 284312    0    0     0     0 1133  1925  3  1 96
 0  0  0  41788  11288  22540 284312    0    0     0     0 1085  1414  5  1 94
 0  0  0  41788  11088  22540 284312  172    0   172     0 1053   712  3  0 97
 1  0  0  41788  11108  22540 284312    0    0     0   175 1081   779  2  2 96
 0  0  0  41788  11104  22540 284312    0    0     0     0 1032   562  1  1 98
 1  0  0  41788  11108  22540 284312    0    0     0     0 1024   469  1  0 99
 0  0  0  41788  11100  22540 284312    0    0     0     0 1022   501  2  1 97
 1  0  0  41788  11104  22540 284312    0    0     0     0 1027   504  1  0 99
 0  0  0  41788  11176  22540 284312    0    0     0  1112 1090   646  1  1 98
 0  0  0  41788  10476  22540 284312  660    0   660     0 1144  1500  1  0 99
 0  0  0  41788  10468  22540 284312    0    0     0     0 1057   870  2  0 98
 0  0  0  41788  10464  22540 284312    0    0     0     0 1026   521  2  1 97
 2  0  1  41788  10456  22540 284312    0    0     0     0 1069  1050  1  0 99
 1  0  0  41788  10448  22540 284312    0    0     0    85 1056   721  2  0 98
 1  0  0  41788  10456  22540 284312    0    0     0     9 1030   469  1  0 99
 0  0  0  41788  10448  22540 284312    0    0     0     0 1022   481  2  1 97
 0  0  0  41788  10488  22544 284320    0    0     4     0 1036   471  1  0 99
 0  0  0  41788  10480  22544 284320    0    0     0     0 1030   556  1  0 99
 0  0  0  41788  10500  22544 284320    0    0     0    69 1088   879  1  1 98
 0  0  0  41788  10492  22544 284320    0    0     0     0 1092   995  2  0 98
 0  0  0  41788  10496  22544 284320    0    0     0     0 1090  1328  1  0 99
   procs                      memory      swap          io     system      cpu
 r  b  w   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id
 0  0  0  41788  10460  22544 284328   12    0    20     0 1034   552  2  1 97
 0  0  0  41788  10448  22544 284328    0    0     0     0 1030   471  2  0 98
 0  0  0  41788  10440  22544 284328   32    0    32     0 1027   536  1  1 98
 0  0  0  41788  10432  22544 284328    0    0     0     0 1024   488  2  1 97
 1  0  0  41788  10432  22544 284328    0    0     0     0 1098   991  2  6 92
 1  0  0  41788  10424  22544 284328    0    0     0     0 1030   515  2  0 98
 0  0  0  41788  10428  22544 284328    0    0     0     0 1055   702  2  3 95
 0  0  0  41788  10416  22544 284328    0    0     0     8 1124  1021  7  4 89
 0  0  0  41788  10416  22544 284328    0    0     0     0 1103   934  4  2 94

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 232 bytes --]