All of lore.kernel.org
 help / color / mirror / Atom feed
* [SPDK] Re: The power consumption of spdk framework.
@ 2020-03-05 21:32 
  0 siblings, 0 replies; 7+ messages in thread
From:  @ 2020-03-05 21:32 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 4191 bytes --]

Hi Vincent,

I want to add a comment.

As we had a few talks on Slack, the current idea is not automatic and covers only configuration changes.
We may need to use something like
https://doc.dpdk.org/guides/prog_guide/power_man.html
43. Power Management — Data Plane Development Kit 20.02.0 documentation - DPDK<https://doc.dpdk.org/guides/prog_guide/power_man.html>
43.2. Core-load Throttling through C-States. Core state can be altered by speculative sleeps whenever the specified lcore has nothing to do. In the DPDK, if no packet is received after polling, speculative sleeps can be triggered according the strategies defined by the user space application.
doc.dpdk.org
https://doc.dpdk.org/guides/sample_app_ug/l3_forward_power_man.html
22. L3 Forwarding with Power Management Sample Application — Data Plane Development Kit 20.02.0-rc1 documentation - DPDK<https://doc.dpdk.org/guides/sample_app_ug/l3_forward_power_man.html>
22.1. Introduction. The L3 Forwarding with Power Management application is an example of power-aware packet processing using the DPDK. The application is based on existing L3 Forwarding sample application, with the power management algorithms to control the P-states and C-states of the Intel processor via a power management library.
doc.dpdk.org

I have not investigated in detail yet though.

I have just started and so your any interest and input are very appreciated.

Thanks,
Shuhei


________________________________
差出人: Vincent <cockroach1136(a)gmail.com>
送信日時: 2020年3月5日 18:45
宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
件名: [!][SPDK] Re: The power consumption of spdk framework.

Thank you so much for your response.

松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月5日 週四
上午10:51寫道:

> Hi Vincent,
>
> An idea is out there now.
>
> The current idea is to migrate SPDK threads among CPU cores and create
> idle reactor.
> Idle reactor sleeps until any thread runs on it.
>
> Related patche is https://clicktime.symantec.com/3Mv6ymv82pF8Qpw7hh4N1Su7Vc?u=https%3A%2F%2Freview.spdk.io%2Fgerrit%2Fc%2Fspdk%2Fspdk%2F%2B%2F1049 to
> sleep idle reactors.
> The recently added thread_set_cpumask can migrate SPDK thread among CPU
> cores.
>
> We discussed this topic in the last community meeting. Please check this
> together if you have interest.
>
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> Trello<
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> >
> Organize anything, together. Trello is a collaboration tool that organizes
> your projects into boards. In one glance, know what's being worked on,
> who's working on what, and where something is in a process.
> trello.com
>
>
> Thanks,
> Shuhei
>
>
>
> ________________________________
> 差出人: Vincent <cockroach1136(a)gmail.com>
> 送信日時: 2020年3月5日 11:38
> 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> 件名: [SPDK] The power consumption of spdk framework.
>
> Hello all,
>    We know when spdk start, The cpu-core used by spdk usage will become
> 100% due to busy loop of reactor.  I remember this topic has been discussed
> before. But I forget the conclusion. I cannot find out the conclusion in
> the internet and maillist too.
>
>     Does anyone can provide me the information about this topic ??
> Can spdk avoid the cpu usage 100% when idle now??
>
> Thank you so much.
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>
_______________________________________________
SPDK mailing list -- spdk(a)lists.01.org
To unsubscribe send an email to spdk-leave(a)lists.01.org

^ permalink raw reply	[flat|nested] 7+ messages in thread

* [SPDK] Re: The power consumption of spdk framework.
@ 2020-03-06  5:36 
  0 siblings, 0 replies; 7+ messages in thread
From:  @ 2020-03-06  5:36 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 6815 bytes --]

I want to add a few comments before getting any reply.

I will work on  but P state (frequency change) is not implemented yet due to its complexity.
All parameter has the same value as DPDK sample application.
I have not found any uniqueness for SPDK but we may have to make them tunable or change them according to SPDK's requirement.

Thanks,
Shuhei

________________________________
差出人: 松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com>
送信日時: 2020年3月6日 14:29
宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
件名: Re: [!][SPDK] Re: The power consumption of spdk framework.

Hi Vincent, Jesse, and all,

SPDK community has many nice communication tools and I have talked about this topic on each tool,
but mailinig list is the broadest. So I share the latest update  here too 🙂

Thanks to the great improvements about CPU stats, DPDK like CPU power saving was simpler than I thought.

https://review.spdk.io/gerrit/c/spdk/spdk/+/1049 is the patch to save CPU power when SPDK reactor is idle.

I enabled the feature by default but optionalizing may be better. Any feedback is very appreciated.
Please take a look at or try using it.
I will update the patch by myself too if I find any bug.

Thanks,
Shuhei

________________________________
差出人: Vincent <cockroach1136(a)gmail.com>
送信日時: 2020年3月6日 11:10
宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
件名: [!][SPDK] Re: The power consumption of spdk framework.

Hello  MATSUMOTO,
    Thanks for your information.
   I will spend sometime to investigate the material.
  Thank you

松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月6日 週五
上午5:33寫道:

> Hi Vincent,
>
> I want to add a comment.
>
> As we had a few talks on Slack, the current idea is not automatic and
> covers only configuration changes.
> We may need to use something like
> https://clicktime.symantec.com/323dHAnuiG4A3bphtxuCUZW7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fprog_guide%2Fpower_man.html
> 43. Power Management — Data Plane Development Kit 20.02.0 documentation -
> DPDK<https://clicktime.symantec.com/323dHAnuiG4A3bphtxuCUZW7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fprog_guide%2Fpower_man.html>
> 43.2. Core-load Throttling through C-States. Core state can be altered by
> speculative sleeps whenever the specified lcore has nothing to do. In the
> DPDK, if no packet is received after polling, speculative sleeps can be
> triggered according the strategies defined by the user space application.
> doc.dpdk.org
> https://clicktime.symantec.com/325xhCXULjJBcRD7JUcshtx7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fsample_app_ug%2Fl3_forward_power_man.html
> 22. L3 Forwarding with Power Management Sample Application — Data Plane
> Development Kit 20.02.0-rc1 documentation - DPDK<
> https://clicktime.symantec.com/325xhCXULjJBcRD7JUcshtx7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fsample_app_ug%2Fl3_forward_power_man.html>
> 22.1. Introduction. The L3 Forwarding with Power Management application is
> an example of power-aware packet processing using the DPDK. The application
> is based on existing L3 Forwarding sample application, with the power
> management algorithms to control the P-states and C-states of the Intel
> processor via a power management library.
> doc.dpdk.org
>
> I have not investigated in detail yet though.
>
> I have just started and so your any interest and input are very
> appreciated.
>
> Thanks,
> Shuhei
>
>
> ________________________________
> 差出人: Vincent <cockroach1136(a)gmail.com>
> 送信日時: 2020年3月5日 18:45
> 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> 件名: [!][SPDK] Re: The power consumption of spdk framework.
>
> Thank you so much for your response.
>
> 松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月5日 週四
> 上午10:51寫道:
>
> > Hi Vincent,
> >
> > An idea is out there now.
> >
> > The current idea is to migrate SPDK threads among CPU cores and create
> > idle reactor.
> > Idle reactor sleeps until any thread runs on it.
> >
> > Related patche is
> https://clicktime.symantec.com/3Mv6ymv82pF8Qpw7hh4N1Su7Vc?u=https%3A%2F%2Freview.spdk.io%2Fgerrit%2Fc%2Fspdk%2Fspdk%2F%2B%2F1049
> to
> > sleep idle reactors.
> > The recently added thread_set_cpumask can migrate SPDK thread among CPU
> > cores.
> >
> > We discussed this topic in the last community meeting. Please check this
> > together if you have interest.
> >
> >
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> > Trello<
> >
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> > >
> > Organize anything, together. Trello is a collaboration tool that
> organizes
> > your projects into boards. In one glance, know what's being worked on,
> > who's working on what, and where something is in a process.
> > trello.com
> >
> >
> > Thanks,
> > Shuhei
> >
> >
> >
> > ________________________________
> > 差出人: Vincent <cockroach1136(a)gmail.com>
> > 送信日時: 2020年3月5日 11:38
> > 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> > 件名: [SPDK] The power consumption of spdk framework.
> >
> > Hello all,
> >    We know when spdk start, The cpu-core used by spdk usage will become
> > 100% due to busy loop of reactor.  I remember this topic has been
> discussed
> > before. But I forget the conclusion. I cannot find out the conclusion in
> > the internet and maillist too.
> >
> >     Does anyone can provide me the information about this topic ??
> > Can spdk avoid the cpu usage 100% when idle now??
> >
> > Thank you so much.
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> >
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>
_______________________________________________
SPDK mailing list -- spdk(a)lists.01.org
To unsubscribe send an email to spdk-leave(a)lists.01.org

^ permalink raw reply	[flat|nested] 7+ messages in thread

* [SPDK] Re: The power consumption of spdk framework.
@ 2020-03-06  5:29 
  0 siblings, 0 replies; 7+ messages in thread
From:  @ 2020-03-06  5:29 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 6162 bytes --]

Hi Vincent, Jesse, and all,

SPDK community has many nice communication tools and I have talked about this topic on each tool,
but mailinig list is the broadest. So I share the latest update  here too 🙂

Thanks to the great improvements about CPU stats, DPDK like CPU power saving was simpler than I thought.

https://review.spdk.io/gerrit/c/spdk/spdk/+/1049 is the patch to save CPU power when SPDK reactor is idle.

I enabled the feature by default but optionalizing may be better. Any feedback is very appreciated.
Please take a look at or try using it.
I will update the patch by myself too if I find any bug.

Thanks,
Shuhei

________________________________
差出人: Vincent <cockroach1136(a)gmail.com>
送信日時: 2020年3月6日 11:10
宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
件名: [!][SPDK] Re: The power consumption of spdk framework.

Hello  MATSUMOTO,
    Thanks for your information.
   I will spend sometime to investigate the material.
  Thank you

松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月6日 週五
上午5:33寫道:

> Hi Vincent,
>
> I want to add a comment.
>
> As we had a few talks on Slack, the current idea is not automatic and
> covers only configuration changes.
> We may need to use something like
> https://clicktime.symantec.com/323dHAnuiG4A3bphtxuCUZW7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fprog_guide%2Fpower_man.html
> 43. Power Management — Data Plane Development Kit 20.02.0 documentation -
> DPDK<https://clicktime.symantec.com/323dHAnuiG4A3bphtxuCUZW7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fprog_guide%2Fpower_man.html>
> 43.2. Core-load Throttling through C-States. Core state can be altered by
> speculative sleeps whenever the specified lcore has nothing to do. In the
> DPDK, if no packet is received after polling, speculative sleeps can be
> triggered according the strategies defined by the user space application.
> doc.dpdk.org
> https://clicktime.symantec.com/325xhCXULjJBcRD7JUcshtx7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fsample_app_ug%2Fl3_forward_power_man.html
> 22. L3 Forwarding with Power Management Sample Application — Data Plane
> Development Kit 20.02.0-rc1 documentation - DPDK<
> https://clicktime.symantec.com/325xhCXULjJBcRD7JUcshtx7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fsample_app_ug%2Fl3_forward_power_man.html>
> 22.1. Introduction. The L3 Forwarding with Power Management application is
> an example of power-aware packet processing using the DPDK. The application
> is based on existing L3 Forwarding sample application, with the power
> management algorithms to control the P-states and C-states of the Intel
> processor via a power management library.
> doc.dpdk.org
>
> I have not investigated in detail yet though.
>
> I have just started and so your any interest and input are very
> appreciated.
>
> Thanks,
> Shuhei
>
>
> ________________________________
> 差出人: Vincent <cockroach1136(a)gmail.com>
> 送信日時: 2020年3月5日 18:45
> 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> 件名: [!][SPDK] Re: The power consumption of spdk framework.
>
> Thank you so much for your response.
>
> 松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月5日 週四
> 上午10:51寫道:
>
> > Hi Vincent,
> >
> > An idea is out there now.
> >
> > The current idea is to migrate SPDK threads among CPU cores and create
> > idle reactor.
> > Idle reactor sleeps until any thread runs on it.
> >
> > Related patche is
> https://clicktime.symantec.com/3Mv6ymv82pF8Qpw7hh4N1Su7Vc?u=https%3A%2F%2Freview.spdk.io%2Fgerrit%2Fc%2Fspdk%2Fspdk%2F%2B%2F1049
> to
> > sleep idle reactors.
> > The recently added thread_set_cpumask can migrate SPDK thread among CPU
> > cores.
> >
> > We discussed this topic in the last community meeting. Please check this
> > together if you have interest.
> >
> >
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> > Trello<
> >
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> > >
> > Organize anything, together. Trello is a collaboration tool that
> organizes
> > your projects into boards. In one glance, know what's being worked on,
> > who's working on what, and where something is in a process.
> > trello.com
> >
> >
> > Thanks,
> > Shuhei
> >
> >
> >
> > ________________________________
> > 差出人: Vincent <cockroach1136(a)gmail.com>
> > 送信日時: 2020年3月5日 11:38
> > 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> > 件名: [SPDK] The power consumption of spdk framework.
> >
> > Hello all,
> >    We know when spdk start, The cpu-core used by spdk usage will become
> > 100% due to busy loop of reactor.  I remember this topic has been
> discussed
> > before. But I forget the conclusion. I cannot find out the conclusion in
> > the internet and maillist too.
> >
> >     Does anyone can provide me the information about this topic ??
> > Can spdk avoid the cpu usage 100% when idle now??
> >
> > Thank you so much.
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> >
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>
_______________________________________________
SPDK mailing list -- spdk(a)lists.01.org
To unsubscribe send an email to spdk-leave(a)lists.01.org

^ permalink raw reply	[flat|nested] 7+ messages in thread

* [SPDK] Re: The power consumption of spdk framework.
@ 2020-03-06  2:10 Vincent
  0 siblings, 0 replies; 7+ messages in thread
From: Vincent @ 2020-03-06  2:10 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 4822 bytes --]

Hello  MATSUMOTO,
    Thanks for your information.
   I will spend sometime to investigate the material.
  Thank you

松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月6日 週五
上午5:33寫道:

> Hi Vincent,
>
> I want to add a comment.
>
> As we had a few talks on Slack, the current idea is not automatic and
> covers only configuration changes.
> We may need to use something like
> https://doc.dpdk.org/guides/prog_guide/power_man.html
> 43. Power Management — Data Plane Development Kit 20.02.0 documentation -
> DPDK<https://doc.dpdk.org/guides/prog_guide/power_man.html>
> 43.2. Core-load Throttling through C-States. Core state can be altered by
> speculative sleeps whenever the specified lcore has nothing to do. In the
> DPDK, if no packet is received after polling, speculative sleeps can be
> triggered according the strategies defined by the user space application.
> doc.dpdk.org
> https://doc.dpdk.org/guides/sample_app_ug/l3_forward_power_man.html
> 22. L3 Forwarding with Power Management Sample Application — Data Plane
> Development Kit 20.02.0-rc1 documentation - DPDK<
> https://doc.dpdk.org/guides/sample_app_ug/l3_forward_power_man.html>
> 22.1. Introduction. The L3 Forwarding with Power Management application is
> an example of power-aware packet processing using the DPDK. The application
> is based on existing L3 Forwarding sample application, with the power
> management algorithms to control the P-states and C-states of the Intel
> processor via a power management library.
> doc.dpdk.org
>
> I have not investigated in detail yet though.
>
> I have just started and so your any interest and input are very
> appreciated.
>
> Thanks,
> Shuhei
>
>
> ________________________________
> 差出人: Vincent <cockroach1136(a)gmail.com>
> 送信日時: 2020年3月5日 18:45
> 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> 件名: [!][SPDK] Re: The power consumption of spdk framework.
>
> Thank you so much for your response.
>
> 松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月5日 週四
> 上午10:51寫道:
>
> > Hi Vincent,
> >
> > An idea is out there now.
> >
> > The current idea is to migrate SPDK threads among CPU cores and create
> > idle reactor.
> > Idle reactor sleeps until any thread runs on it.
> >
> > Related patche is
> https://clicktime.symantec.com/3Mv6ymv82pF8Qpw7hh4N1Su7Vc?u=https%3A%2F%2Freview.spdk.io%2Fgerrit%2Fc%2Fspdk%2Fspdk%2F%2B%2F1049
> to
> > sleep idle reactors.
> > The recently added thread_set_cpumask can migrate SPDK thread among CPU
> > cores.
> >
> > We discussed this topic in the last community meeting. Please check this
> > together if you have interest.
> >
> >
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> > Trello<
> >
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> > >
> > Organize anything, together. Trello is a collaboration tool that
> organizes
> > your projects into boards. In one glance, know what's being worked on,
> > who's working on what, and where something is in a process.
> > trello.com
> >
> >
> > Thanks,
> > Shuhei
> >
> >
> >
> > ________________________________
> > 差出人: Vincent <cockroach1136(a)gmail.com>
> > 送信日時: 2020年3月5日 11:38
> > 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> > 件名: [SPDK] The power consumption of spdk framework.
> >
> > Hello all,
> >    We know when spdk start, The cpu-core used by spdk usage will become
> > 100% due to busy loop of reactor.  I remember this topic has been
> discussed
> > before. But I forget the conclusion. I cannot find out the conclusion in
> > the internet and maillist too.
> >
> >     Does anyone can provide me the information about this topic ??
> > Can spdk avoid the cpu usage 100% when idle now??
> >
> > Thank you so much.
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> >
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>

^ permalink raw reply	[flat|nested] 7+ messages in thread

* [SPDK] Re: The power consumption of spdk framework.
@ 2020-03-05 21:33 
  0 siblings, 0 replies; 7+ messages in thread
From:  @ 2020-03-05 21:33 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 4191 bytes --]

Hi Vincent,

I want to add a comment.

As we had a few talks on Slack, the current idea is not automatic and covers only configuration changes.
We may need to use something like
https://doc.dpdk.org/guides/prog_guide/power_man.html
43. Power Management — Data Plane Development Kit 20.02.0 documentation - DPDK<https://doc.dpdk.org/guides/prog_guide/power_man.html>
43.2. Core-load Throttling through C-States. Core state can be altered by speculative sleeps whenever the specified lcore has nothing to do. In the DPDK, if no packet is received after polling, speculative sleeps can be triggered according the strategies defined by the user space application.
doc.dpdk.org
https://doc.dpdk.org/guides/sample_app_ug/l3_forward_power_man.html
22. L3 Forwarding with Power Management Sample Application — Data Plane Development Kit 20.02.0-rc1 documentation - DPDK<https://doc.dpdk.org/guides/sample_app_ug/l3_forward_power_man.html>
22.1. Introduction. The L3 Forwarding with Power Management application is an example of power-aware packet processing using the DPDK. The application is based on existing L3 Forwarding sample application, with the power management algorithms to control the P-states and C-states of the Intel processor via a power management library.
doc.dpdk.org

I have not investigated in detail yet though.

I have just started and so your any interest and input are very appreciated.

Thanks,
Shuhei


________________________________
差出人: Vincent <cockroach1136(a)gmail.com>
送信日時: 2020年3月5日 18:45
宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
件名: [!][SPDK] Re: The power consumption of spdk framework.

Thank you so much for your response.

松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月5日 週四
上午10:51寫道:

> Hi Vincent,
>
> An idea is out there now.
>
> The current idea is to migrate SPDK threads among CPU cores and create
> idle reactor.
> Idle reactor sleeps until any thread runs on it.
>
> Related patche is https://clicktime.symantec.com/3Mv6ymv82pF8Qpw7hh4N1Su7Vc?u=https%3A%2F%2Freview.spdk.io%2Fgerrit%2Fc%2Fspdk%2Fspdk%2F%2B%2F1049 to
> sleep idle reactors.
> The recently added thread_set_cpumask can migrate SPDK thread among CPU
> cores.
>
> We discussed this topic in the last community meeting. Please check this
> together if you have interest.
>
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> Trello<
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> >
> Organize anything, together. Trello is a collaboration tool that organizes
> your projects into boards. In one glance, know what's being worked on,
> who's working on what, and where something is in a process.
> trello.com
>
>
> Thanks,
> Shuhei
>
>
>
> ________________________________
> 差出人: Vincent <cockroach1136(a)gmail.com>
> 送信日時: 2020年3月5日 11:38
> 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> 件名: [SPDK] The power consumption of spdk framework.
>
> Hello all,
>    We know when spdk start, The cpu-core used by spdk usage will become
> 100% due to busy loop of reactor.  I remember this topic has been discussed
> before. But I forget the conclusion. I cannot find out the conclusion in
> the internet and maillist too.
>
>     Does anyone can provide me the information about this topic ??
> Can spdk avoid the cpu usage 100% when idle now??
>
> Thank you so much.
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>
_______________________________________________
SPDK mailing list -- spdk(a)lists.01.org
To unsubscribe send an email to spdk-leave(a)lists.01.org

^ permalink raw reply	[flat|nested] 7+ messages in thread

* [SPDK] Re: The power consumption of spdk framework.
@ 2020-03-05  9:45 Vincent
  0 siblings, 0 replies; 7+ messages in thread
From: Vincent @ 2020-03-05  9:45 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 2116 bytes --]

Thank you so much for your response.

松本周平 / MATSUMOTO,SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月5日 週四
上午10:51寫道:

> Hi Vincent,
>
> An idea is out there now.
>
> The current idea is to migrate SPDK threads among CPU cores and create
> idle reactor.
> Idle reactor sleeps until any thread runs on it.
>
> Related patche is https://review.spdk.io/gerrit/c/spdk/spdk/+/1049 to
> sleep idle reactors.
> The recently added thread_set_cpumask can migrate SPDK thread among CPU
> cores.
>
> We discussed this topic in the last community meeting. Please check this
> together if you have interest.
>
> https://trello.com/c/JndSGRoW/277-simple-cpu-core-parking-when-reactor-has-no-threads
> Trello<
> https://trello.com/c/JndSGRoW/277-simple-cpu-core-parking-when-reactor-has-no-threads
> >
> Organize anything, together. Trello is a collaboration tool that organizes
> your projects into boards. In one glance, know what's being worked on,
> who's working on what, and where something is in a process.
> trello.com
>
>
> Thanks,
> Shuhei
>
>
>
> ________________________________
> 差出人: Vincent <cockroach1136(a)gmail.com>
> 送信日時: 2020年3月5日 11:38
> 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> 件名: [SPDK] The power consumption of spdk framework.
>
> Hello all,
>    We know when spdk start, The cpu-core used by spdk usage will become
> 100% due to busy loop of reactor.  I remember this topic has been discussed
> before. But I forget the conclusion. I cannot find out the conclusion in
> the internet and maillist too.
>
>     Does anyone can provide me the information about this topic ??
> Can spdk avoid the cpu usage 100% when idle now??
>
> Thank you so much.
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>

^ permalink raw reply	[flat|nested] 7+ messages in thread

* [SPDK] Re: The power consumption of spdk framework.
@ 2020-03-05  2:51 
  0 siblings, 0 replies; 7+ messages in thread
From:  @ 2020-03-05  2:51 UTC (permalink / raw)
  To: spdk

[-- Attachment #1: Type: text/plain, Size: 1695 bytes --]

Hi Vincent,

An idea is out there now.

The current idea is to migrate SPDK threads among CPU cores and create idle reactor.
Idle reactor sleeps until any thread runs on it.

Related patche is https://review.spdk.io/gerrit/c/spdk/spdk/+/1049 to sleep idle reactors.
The recently added thread_set_cpumask can migrate SPDK thread among CPU cores.

We discussed this topic in the last community meeting. Please check this together if you have interest.
https://trello.com/c/JndSGRoW/277-simple-cpu-core-parking-when-reactor-has-no-threads
Trello<https://trello.com/c/JndSGRoW/277-simple-cpu-core-parking-when-reactor-has-no-threads>
Organize anything, together. Trello is a collaboration tool that organizes your projects into boards. In one glance, know what's being worked on, who's working on what, and where something is in a process.
trello.com


Thanks,
Shuhei



________________________________
差出人: Vincent <cockroach1136(a)gmail.com>
送信日時: 2020年3月5日 11:38
宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
件名: [SPDK] The power consumption of spdk framework.

Hello all,
   We know when spdk start, The cpu-core used by spdk usage will become
100% due to busy loop of reactor.  I remember this topic has been discussed
before. But I forget the conclusion. I cannot find out the conclusion in
the internet and maillist too.

    Does anyone can provide me the information about this topic ??
Can spdk avoid the cpu usage 100% when idle now??

Thank you so much.
_______________________________________________
SPDK mailing list -- spdk(a)lists.01.org
To unsubscribe send an email to spdk-leave(a)lists.01.org

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2020-03-06  5:36 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-03-05 21:32 [SPDK] Re: The power consumption of spdk framework 
  -- strict thread matches above, loose matches on Subject: below --
2020-03-06  5:36 
2020-03-06  5:29 
2020-03-06  2:10 Vincent
2020-03-05 21:33 
2020-03-05  9:45 Vincent
2020-03-05  2:51 

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.