* kcsbridged is failing
@ 2019-03-20 22:59 Vijay Khemka
2019-03-21 16:35 ` Kun Yi
0 siblings, 1 reply; 3+ messages in thread
From: Vijay Khemka @ 2019-03-20 22:59 UTC (permalink / raw)
To: OpenBMC Maillist
[-- Attachment #1: Type: text/plain, Size: 3085 bytes --]
Hi,
I am seeing latest failure in kcsbridged with following log.
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:18 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Any suggestions?
Regards
-Vijay
[-- Attachment #2: Type: text/html, Size: 7593 bytes --]
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: kcsbridged is failing
2019-03-20 22:59 kcsbridged is failing Vijay Khemka
@ 2019-03-21 16:35 ` Kun Yi
2019-03-21 18:12 ` Vijay Khemka
0 siblings, 1 reply; 3+ messages in thread
From: Kun Yi @ 2019-03-21 16:35 UTC (permalink / raw)
To: Vijay Khemka; +Cc: OpenBMC Maillist
[-- Attachment #1: Type: text/plain, Size: 3671 bytes --]
Hi Vijay,
The "Failed to send the time out response" error is
https://github.com/openbmc/openbmc/issues/3489. I don't think anyone has
taken actions on it though.
Repeatedly timing out could be due to several reasons, including IPMI
daemon crash or blocked. Is it consistent? Does it resolve itself if you
restart IPMI daemon? What's the system state roughly like (a 'top -n 1'
would suffice)?
On Wed, Mar 20, 2019 at 4:00 PM Vijay Khemka <vijaykhemka@fb.com> wrote:
> Hi,
>
> I am seeing latest failure in kcsbridged with following log.
>
>
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
> Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout
> response!
>
> Feb 28 00:16:18 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
>
>
>
>
>
> Any suggestions?
>
>
>
> Regards
>
> -Vijay
>
--
Regards,
Kun
[-- Attachment #2: Type: text/html, Size: 9211 bytes --]
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: kcsbridged is failing
2019-03-21 16:35 ` Kun Yi
@ 2019-03-21 18:12 ` Vijay Khemka
0 siblings, 0 replies; 3+ messages in thread
From: Vijay Khemka @ 2019-03-21 18:12 UTC (permalink / raw)
To: Kun Yi; +Cc: OpenBMC Maillist
[-- Attachment #1: Type: text/plain, Size: 4056 bytes --]
It doesn’t fix by itself and IPMI is still running. It is rolling continuously, I assume timeout is set for 5 second and dispatch_timer who is printing these logs should get triggered every 5 seconds not continuously.
Regards
-Vijay
From: Kun Yi <kunyi@google.com>
Date: Thursday, March 21, 2019 at 9:36 AM
To: Vijay Khemka <vijaykhemka@fb.com>
Cc: OpenBMC Maillist <openbmc@lists.ozlabs.org>
Subject: Re: kcsbridged is failing
Hi Vijay,
The "Failed to send the time out response" error is https://github.com/openbmc/openbmc/issues/3489. I don't think anyone has taken actions on it though.
Repeatedly timing out could be due to several reasons, including IPMI daemon crash or blocked. Is it consistent? Does it resolve itself if you restart IPMI daemon? What's the system state roughly like (a 'top -n 1' would suffice)?
On Wed, Mar 20, 2019 at 4:00 PM Vijay Khemka <vijaykhemka@fb.com<mailto:vijaykhemka@fb.com>> wrote:
Hi,
I am seeing latest failure in kcsbridged with following log.
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Feb 28 00:16:17 tiogapass kcsbridged[1042]: Failed to send the timeout response!
Feb 28 00:16:18 tiogapass kcsbridged[1042]: Timeout on msg with seq: 0xe9
Any suggestions?
Regards
-Vijay
--
Regards,
Kun
[-- Attachment #2: Type: text/html, Size: 12346 bytes --]
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2019-03-21 18:12 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-03-20 22:59 kcsbridged is failing Vijay Khemka
2019-03-21 16:35 ` Kun Yi
2019-03-21 18:12 ` Vijay Khemka
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.