linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* boring BK stats
@ 2002-09-22 23:56 Larry McVoy
  2002-09-23  2:01 ` Jeff Garzik
  0 siblings, 1 reply; 2+ messages in thread
From: Larry McVoy @ 2002-09-22 23:56 UTC (permalink / raw)
  To: linux-kernel; +Cc: dev

I should be working on getting the bk-3.0 release done but I'm sick of
fixing BK-on-windows bugs...

Linus' kernel tree has 13333 revision controlled files in it.  Without
repository compression, it eats up 280M in an ext2 fs.  With repository
compression, that drops to 129M.  After checking out all the files, the
size of the revision history and the checked out files is 317MB when
the revision history is compressed.  That means the tree without the
history is 188MB, we get the revision history in less space than the
checked out tree.  That's pretty cool, by the way, I know of no other
SCM system which can say that.

Checking out the tree takes 16 seconds.  Doing an integrity check takes 10
seconds if the repository is uncompressed, 15 seconds if it is compressed.
That's on 1.3Ghz Athlon w/ PC133 memory running at the slower CAS rate,
but lots of it, around 900MB.

An integrity check checksums the entire revision history and does a
checkout into /dev/null to make sure that both the overall and most
recent delta checksums are valid.

There are about 8600 changesets in the tree.  There have been 76998
deltas made to the tree since Feb 05 2002.  That's an average of 37
changesets and 333 deltas per *day* seven days a week.  If you assume
a 5 day work week then the numbers are 52 csets/day and 466 deltas/day.

Those changerate numbers are pretty zippy.  You guys are rockin'.

As for syncs with bkbits, I dunno, my guess is we're pushing 300,000 pulls
or so.  We're nowhere near to saturating the T1 line so BK compression
stuff is working well.

^ permalink raw reply	[flat|nested] 2+ messages in thread

* Re: boring BK stats
  2002-09-22 23:56 boring BK stats Larry McVoy
@ 2002-09-23  2:01 ` Jeff Garzik
  0 siblings, 0 replies; 2+ messages in thread
From: Jeff Garzik @ 2002-09-23  2:01 UTC (permalink / raw)
  To: Larry McVoy; +Cc: linux-kernel, dev

Larry McVoy wrote:
> I should be working on getting the bk-3.0 release done but I'm sick of
> fixing BK-on-windows bugs...
> 
> Linus' kernel tree has 13333 revision controlled files in it.  Without
> repository compression, it eats up 280M in an ext2 fs.  With repository
> compression, that drops to 129M.  After checking out all the files, the
> size of the revision history and the checked out files is 317MB when
> the revision history is compressed.  That means the tree without the
> history is 188MB, we get the revision history in less space than the
> checked out tree.  That's pretty cool, by the way, I know of no other
> SCM system which can say that.
> 
> Checking out the tree takes 16 seconds.  Doing an integrity check takes 10
> seconds if the repository is uncompressed, 15 seconds if it is compressed.
> That's on 1.3Ghz Athlon w/ PC133 memory running at the slower CAS rate,
> but lots of it, around 900MB.


If you can't fit a whole tree including metadata into RAM, though, BK 
crawls...   Going from "bk citool" at the command line to actually 
seeing the citool window approaches five minutes of runtime, on this 
200MB laptop...  [my dual athlon with 512MB RAM corroborates your 
numbers, though]  "bk -r co -Sq" takes a similar amount of time...

I also find that BK brings out the worst in the 2.4 kernel 
elevator/VM...  mouse clicks in Mozilla take upwards of 10 seconds to 
respond, when "bk -r co -Sq" is running on this laptop [any other 
read-from-disk process behaves similarly].  And running any two BK jobs 
at the same time is a huge mistake.  Two "bk -r co -Sq" runs easily take 
four or more times longer than a single run.  Ditto for consistency 
checks, or any other disk-intensive activity BK indulges in.

Next time I get super-annoyed at BK on this laptop, I'm gonna look into 
beating the disk scheduler into submission...  some starvation is 
clearly occurring.

</rant>

	Jeff




^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2002-09-23  1:57 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2002-09-22 23:56 boring BK stats Larry McVoy
2002-09-23  2:01 ` Jeff Garzik

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).