linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Andi Kleen <ak@suse.de>
To: "Bill Rugolsky Jr." <brugolsky@telemetry-investments.com>
Cc: Alan Cox <alan@lxorguk.ukuu.org.uk>, Ingo Molnar <mingo@elte.hu>,
	Lee Revell <rlrevell@joe-job.com>, Jeff Garzik <jeff@garzik.org>,
	Jason Baron <jbaron@redhat.com>,
	linux-kernel@vger.kernel.org, john stultz <johnstul@us.ibm.com>
Subject: Re: libata/sata_nv latency on NVIDIA CK804 [was Re: AMD64 X2 lost ticks on PM timer]
Date: Wed, 22 Mar 2006 17:09:08 +0100	[thread overview]
Message-ID: <200603221709.09846.ak@suse.de> (raw)
In-Reply-To: <20060316165737.GA23248@ti64.telemetry-investments.com>

On Thursday 16 March 2006 17:57, Bill Rugolsky Jr. wrote:
> On Thu, Mar 16, 2006 at 03:13:39PM +0000, Alan Cox wrote:
> > On Mer, 2006-03-15 at 23:00 +0100, Ingo Molnar wrote:
> > > so my guess would be that this device doesnt do MMIO, and the PIO inb() 
> > > causes some bad BIOS-based SMM handler/emulator to trigger, which takes 
> > > 16.6 msecs. If indeed the device is not in MMIO mode, is there a way to 
> > > force it into MMIO mode, to test this theory?
> > 
> > There is a much more reliable way to check this. Use the profiling
> > registers to check the instruction issue count before/after the I/O and
> > you'll know if its something like SMM or just a bus stall.
> 
> 
> Brilliant [as usual 8-)].
> 
> 
> So I imagine that the thing to do is just insert before/after
> rdmsr(MSR_K7_PERFCTR[0123]) into the code, with a suitable printk(),
> and then program the counters with oprofile to use large event
> counts (lasting seconds)? 


perfctr0 is already programmed. You can just use rdpmc on it

Also my latest patchkit has a debugging patch for lost tries

ftp://ftp.firstfloor.org/pub/ak/x86_64/quilt/patches/lost-cli-debug

Can you test it with this patch? 

I'm still not quite convinced you're barking at the right tree
with these latency traces because it doesn't match the symptoms.

If some particular critical section would take too long the 
interrupt should occur at its STI or POPF or one instruction after it. 
But they happen on STIs that are not related to any critical section. 
This more looks like a lost CLI to me.

>   <idle>-0     0dns. 1855us : _spin_unlock_irqrestore (blk_run_queue)

This is very long, but still less than a tick (assuming HZ=250) 
I guess it would be a good idea to add some code to split this up
though and enable interrupts more often, but that probably won't fix 
your problem.

-Andi

  reply	other threads:[~2006-03-22 16:51 UTC|newest]

Thread overview: 60+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2006-02-27 21:22 AMD64 X2 lost ticks on PM timer bubshait
2006-02-27 22:21 ` Bill Rugolsky Jr.
2006-02-27 22:47   ` Jason Baron
2006-02-28  7:41     ` Abdulla Bubshait
2006-02-28 22:00       ` Bill Rugolsky Jr.
2006-02-28 23:53         ` Andi Kleen
2006-03-01 14:46           ` Bill Rugolsky Jr.
2006-03-01 14:56             ` Andi Kleen
2006-03-01 15:43               ` Bill Rugolsky Jr.
2006-03-01 15:47                 ` Andi Kleen
2006-03-01 18:07                   ` Bill Rugolsky Jr.
2006-03-01 18:29                     ` Andi Kleen
2006-03-01 19:16                       ` Lee Revell
2006-03-03 19:18                         ` Bill Rugolsky Jr.
2006-03-03 21:26                           ` Lee Revell
2006-03-03 22:09                             ` Jeff Garzik
2006-03-03 23:43                               ` Bill Rugolsky Jr.
2006-03-03 23:46                                 ` Jeff Garzik
2006-03-03 23:49                                   ` Lee Revell
2006-03-04  0:08                                   ` Andi Kleen
2006-03-04  0:07                                 ` Andi Kleen
     [not found]                                   ` <20060315213638.GA17817@ti64.telemetry-investments.com>
2006-03-15 21:45                                     ` libata/sata_nv latency on NVIDIA CK804 [was Re: AMD64 X2 lost ticks on PM timer] Lee Revell
2006-03-15 21:58                                       ` Ingo Molnar
2006-03-15 22:00                                         ` Ingo Molnar
2006-03-15 22:25                                           ` Jeff Garzik
2006-03-16 15:13                                           ` Alan Cox
2006-03-16 16:57                                             ` Bill Rugolsky Jr.
2006-03-22 16:09                                               ` Andi Kleen [this message]
2006-03-22 18:39                                                 ` Bill Rugolsky Jr.
2006-03-22 23:07                                                 ` Bill Rugolsky Jr.
2006-03-15 22:22                                         ` Jeff Garzik
2006-03-15 22:24                                           ` Ingo Molnar
2006-03-15 22:36                                             ` Bill Rugolsky Jr.
2006-03-15 22:46                                               ` Ingo Molnar
2006-03-15 22:48                                               ` Jeff Garzik
2006-03-15 23:31                                                 ` Lee Revell
2006-03-15 21:50                                     ` Ingo Molnar
2006-03-15 22:11                                       ` Ingo Molnar
2006-03-15 22:33                                         ` Jeff Garzik
2006-03-15 22:44                                           ` Ingo Molnar
2006-03-15 22:50                                             ` Jeff Garzik
2006-03-15 23:14                                               ` Bill Rugolsky Jr.
2006-03-15 23:44                                                 ` Lee Revell
     [not found]                                                   ` <20060316002133.GE17817@ti64.telemetry-investments.com>
2006-03-16  0:48                                                     ` Long latencies with MD RAID 1 [was Re: libata/sata_nv latency on NVIDIA CK804 ] Lee Revell
2006-03-16  3:15                                                 ` libata/sata_nv latency on NVIDIA CK804 [was Re: AMD64 X2 lost ticks on PM timer] Bill Rugolsky Jr.
2006-03-16  4:20                                                   ` Lee Revell
2006-03-16  9:18                                                     ` Ingo Molnar
2006-03-16 14:42                                                     ` Gabor Gombas
2006-03-16  0:01                                               ` Lee Revell
2006-03-16  0:14                                                 ` Jeff Garzik
2006-03-15 22:30                                       ` Jeff Garzik
2006-03-15 22:36                                         ` Ingo Molnar
2006-03-15 22:04                                     ` [patch] latency-tracing-v2.6.16.patch Ingo Molnar
2006-03-15 22:32                                       ` Bill Rugolsky Jr.
2006-03-16  9:18                                         ` Ingo Molnar
2006-03-04 12:06                                 ` AMD64 X2 lost ticks on PM timer Martin Schlemmer
2006-03-05  7:07                                   ` Alexander Samad
2006-03-02 15:47                 ` Gabor Gombas
2006-02-28 21:17     ` Abdulla Bubshait
2006-03-16  0:33 libata/sata_nv latency on NVIDIA CK804 [was Re: AMD64 X2 lost ticks on PM timer] Allen Martin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=200603221709.09846.ak@suse.de \
    --to=ak@suse.de \
    --cc=alan@lxorguk.ukuu.org.uk \
    --cc=brugolsky@telemetry-investments.com \
    --cc=jbaron@redhat.com \
    --cc=jeff@garzik.org \
    --cc=johnstul@us.ibm.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mingo@elte.hu \
    --cc=rlrevell@joe-job.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).