linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: "Song Bao Hua (Barry Song)" <song.bao.hua@hisilicon.com>
To: Greg KH <gregkh@linuxfoundation.org>
Cc: "andriy.shevchenko@linux.intel.com" 
	<andriy.shevchenko@linux.intel.com>,
	"yury.norov@gmail.com" <yury.norov@gmail.com>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"akpm@linux-foundation.org" <akpm@linux-foundation.org>,
	"dave.hansen@intel.com" <dave.hansen@intel.com>,
	"linux@rasmusvillemoes.dk" <linux@rasmusvillemoes.dk>,
	"rafael@kernel.org" <rafael@kernel.org>,
	"rdunlap@infradead.org" <rdunlap@infradead.org>,
	"agordeev@linux.ibm.com" <agordeev@linux.ibm.com>,
	"sbrivio@redhat.com" <sbrivio@redhat.com>,
	"jianpeng.ma@intel.com" <jianpeng.ma@intel.com>,
	"valentin.schneider@arm.com" <valentin.schneider@arm.com>,
	"peterz@infradead.org" <peterz@infradead.org>,
	"bristot@redhat.com" <bristot@redhat.com>,
	"guodong.xu@linaro.org" <guodong.xu@linaro.org>,
	tangchengchang <tangchengchang@huawei.com>,
	"Zengtao (B)" <prime.zeng@hisilicon.com>,
	yangyicong <yangyicong@huawei.com>,
	"tim.c.chen@linux.intel.com" <tim.c.chen@linux.intel.com>,
	Linuxarm <linuxarm@huawei.com>,
	"tiantao (H)" <tiantao6@hisilicon.com>,
	"Jonathan Cameron" <jonathan.cameron@huawei.com>
Subject: RE: [PATCH v8 1/5] cpumask: introduce cpumap_print_to_buf to support large bitmask and list
Date: Thu, 5 Aug 2021 23:05:59 +0000	[thread overview]
Message-ID: <53c5fec4223f4c398b81362acf7441b5@hisilicon.com> (raw)
In-Reply-To: <YQvfD701nvqbClLd@kroah.com>



> -----Original Message-----
> From: Greg KH [mailto:gregkh@linuxfoundation.org]
> Sent: Friday, August 6, 2021 12:53 AM
> To: Song Bao Hua (Barry Song) <song.bao.hua@hisilicon.com>
> Cc: andriy.shevchenko@linux.intel.com; yury.norov@gmail.com;
> linux-kernel@vger.kernel.org; akpm@linux-foundation.org;
> dave.hansen@intel.com; linux@rasmusvillemoes.dk; rafael@kernel.org;
> rdunlap@infradead.org; agordeev@linux.ibm.com; sbrivio@redhat.com;
> jianpeng.ma@intel.com; valentin.schneider@arm.com; peterz@infradead.org;
> bristot@redhat.com; guodong.xu@linaro.org; tangchengchang
> <tangchengchang@huawei.com>; Zengtao (B) <prime.zeng@hisilicon.com>;
> yangyicong <yangyicong@huawei.com>; tim.c.chen@linux.intel.com; Linuxarm
> <linuxarm@huawei.com>; tiantao (H) <tiantao6@hisilicon.com>; Jonathan Cameron
> <jonathan.cameron@huawei.com>
> Subject: Re: [PATCH v8 1/5] cpumask: introduce cpumap_print_to_buf to support
> large bitmask and list
> 
> On Thu, Jul 29, 2021 at 05:42:04PM +1200, Barry Song wrote:
> > From: Tian Tao <tiantao6@hisilicon.com>
> >
> > The existing cpumap_print_to_pagebuf() is used by cpu topology and other
> > drivers to export hexadecimal bitmask and decimal list to userspace by
> > sysfs ABI.
> >
> > Right now, those drivers are using a normal attribute for this kind of
> > ABIs. A normal attribute typically has show entry as below:
> >
> > static ssize_t example_dev_show(struct device *dev,
> >                 struct device_attribute *attr, char *buf)
> > {
> > 	...
> > 	return cpumap_print_to_pagebuf(true, buf, &pmu_mmdc->cpu);
> > }
> > show entry of attribute has no offset and count parameters and this
> > means the file is limited to one page only.
> >
> > cpumap_print_to_pagebuf() API works terribly well for this kind of
> > normal attribute with buf parameter and without offset, count:
> >
> > static inline ssize_t
> > cpumap_print_to_pagebuf(bool list, char *buf, const struct cpumask *mask)
> > {
> > 	return bitmap_print_to_pagebuf(list, buf, cpumask_bits(mask),
> > 				       nr_cpu_ids);
> > }
> >
> > The problem is once we have many cpus, we have a chance to make bitmask
> > or list more than one page. Especially for list, it could be as complex
> > as 0,3,5,7,9,...... We have no simple way to know it exact size.
> >
> > It turns out bin_attribute is a way to break this limit. bin_attribute
> > has show entry as below:
> > static ssize_t
> > example_bin_attribute_show(struct file *filp, struct kobject *kobj,
> >              struct bin_attribute *attr, char *buf,
> >              loff_t offset, size_t count)
> > {
> > 	...
> > }
> >
> > With the new offset and count parameters, this makes sysfs ABI be able
> > to support file size more than one page. For example, offset could be
> > >= 4096.
> >
> > This patch introduces cpumap_print_to_buf() and its bitmap infrastructure
> > bitmap_print_to_buf() so that those drivers can move to bin_attribute to
> > support large bitmask and list. At the same time, we have to pass those
> > corresponding parameters such as offset, count from bin_attribute to this
> > new API.
> >
> > Signed-off-by: Tian Tao <tiantao6@hisilicon.com>
> > Cc: Andrew Morton <akpm@linux-foundation.org>
> > Cc: Andy Shevchenko <andriy.shevchenko@linux.intel.com>
> > Cc: Randy Dunlap <rdunlap@infradead.org>
> > Cc: Stefano Brivio <sbrivio@redhat.com>
> > Cc: Alexander Gordeev <agordeev@linux.ibm.com>
> > Cc: "Ma, Jianpeng" <jianpeng.ma@intel.com>
> > Cc: Yury Norov <yury.norov@gmail.com>
> > Cc: Valentin Schneider <valentin.schneider@arm.com>
> > Cc: Peter Zijlstra <peterz@infradead.org>
> > Cc: Daniel Bristot de Oliveira <bristot@redhat.com>
> > Reviewed-by: Jonathan Cameron <Jonathan.Cameron@huawei.com>
> > Signed-off-by: Barry Song <song.bao.hua@hisilicon.com>
> > ---
> >  include/linux/bitmap.h  |  2 ++
> >  include/linux/cpumask.h | 63 +++++++++++++++++++++++++++++++++
> >  lib/bitmap.c            | 78 +++++++++++++++++++++++++++++++++++++++++
> >  3 files changed, 143 insertions(+)
> >
> > diff --git a/include/linux/bitmap.h b/include/linux/bitmap.h
> > index a36cfcec4e77..0de6effa2797 100644
> > --- a/include/linux/bitmap.h
> > +++ b/include/linux/bitmap.h
> > @@ -226,6 +226,8 @@ void bitmap_copy_le(unsigned long *dst, const unsigned
> long *src, unsigned int n
> >  unsigned int bitmap_ord_to_pos(const unsigned long *bitmap, unsigned int ord,
> unsigned int nbits);
> >  int bitmap_print_to_pagebuf(bool list, char *buf,
> >  				   const unsigned long *maskp, int nmaskbits);
> > +int bitmap_print_to_buf(bool list, char *buf, const unsigned long *maskp,
> > +			int nmaskbits, loff_t off, size_t count);
> >
> >  #define BITMAP_FIRST_WORD_MASK(start) (~0UL << ((start) & (BITS_PER_LONG -
> 1)))
> >  #define BITMAP_LAST_WORD_MASK(nbits) (~0UL >> (-(nbits) & (BITS_PER_LONG -
> 1)))
> > diff --git a/include/linux/cpumask.h b/include/linux/cpumask.h
> > index f3689a52bfd0..4b838eb6294c 100644
> > --- a/include/linux/cpumask.h
> > +++ b/include/linux/cpumask.h
> > @@ -983,6 +983,69 @@ cpumap_print_to_pagebuf(bool list, char *buf, const
> struct cpumask *mask)
> >  				      nr_cpu_ids);
> >  }
> >
> > +/**
> > + * cpumap_print_to_buf  - copies the cpumask into the buffer
> > + * @list: indicates whether the cpumap must be list
> > + *      true:  print in decimal list format
> > + *      false: print in hexadecimal bitmask format
> > + *
> > + * The existing cpumap_print_to_pagebuf() is used by cpu topology and other
> > + * drivers to export hexadecimal bitmask and decimal list to userspace by
> > + * sysfs ABI.
> > + * Drivers might be using a normal attribute for this kind of ABIs. A
> > + * normal attribute typically has show entry as below:
> > + * static ssize_t example_attribute_show(struct device *dev,
> > + * 		struct device_attribute *attr, char *buf)
> > + * {
> > + * 	...
> > + * 	return cpumap_print_to_pagebuf(true, buf, &pmu_mmdc->cpu);
> > + * }
> > + * show entry of attribute has no offset and count parameters. this means
> > + * the file is limited to one page only.
> > + * cpumap_print_to_pagebuf() API works terribly well for this kind of
> > + * normal attribute with buf parameter and without offset, count:
> > + * cpumap_print_to_pagebuf(bool list, char *buf, const struct cpumask *mask)
> > + * {
> > + * }
> > + * The problem is once we have many cpus, we have a chance to make bitmask
> > + * or list more than one page. Especially for list, it could be as complex
> > + * as 0,3,5,7,9,... We have no simple way to know it exact size.
> > + * It turns out bin_attribute is a way to break this limit. bin_attribute
> > + * has show entry as below:
> > + * static ssize_t
> > + * example_bin_attribute_show(struct file *filp, struct kobject *kobj,
> > + * 		struct bin_attribute *attr, char *buf,
> > + * 		loff_t offset, size_t count)
> > + * {
> > + * 	...
> > + * }
> > + * With the new offset and count parameters, this makes sysfs ABI be able
> > + * to support file size more than one page. For example, offset could be
> > + * >= 4096.
> > + * cpumap_print_to_buf() makes those drivers be able to support large
> > + * bitmask and list after they move to use bin_attribute. In result, we
> > + * have to pass the corresponding parameters such as off, count from
> > + * bin_attribute show entry to this API.
> > + *
> > + * @mask: the cpumask to copy
> > + * @buf: the buffer to copy into
> > + * @off: in the string from which we are copying, We copy to @buf
> > + * @count: the maximum number of bytes to print
> > + *
> > + * The function copies the cpumask into the buffer either as comma-separated
> > + * list of cpus or hex values of cpumask; Typically used by bin_attribute
> to
> > + * export cpumask bitmask and list ABI.
> > + *
> > + * Returns the length of how many bytes have been copied.
> > + */
> > +static inline ssize_t
> > +cpumap_print_to_buf(bool list, char *buf, const struct cpumask *mask,
> > +		loff_t off, size_t count)
> > +{
> > +	return bitmap_print_to_buf(list, buf, cpumask_bits(mask),
> > +				   nr_cpu_ids, off, count);
> > +}
> > +
> >  #if NR_CPUS <= BITS_PER_LONG
> >  #define CPU_MASK_ALL							\
> >  (cpumask_t) { {								\
> > diff --git a/lib/bitmap.c b/lib/bitmap.c
> > index 9401d39e4722..56bcffe2fa8c 100644
> > --- a/lib/bitmap.c
> > +++ b/lib/bitmap.c
> > @@ -487,6 +487,84 @@ int bitmap_print_to_pagebuf(bool list, char *buf, const
> unsigned long *maskp,
> >  }
> >  EXPORT_SYMBOL(bitmap_print_to_pagebuf);
> >
> > +/**
> > + * bitmap_print_to_buf  - convert bitmap to list or hex format ASCII string
> > + * @list: indicates whether the bitmap must be list
> > + *      true:  print in decimal list format
> > + *      false: print in hexadecimal bitmask format
> 
> I do not understand "list" or not here.  Having binary values in a
> function makes it almost impossible to read when they are being called
> without having to go dig up the real user.
> 
> Are you using this in both ways?  If so, make this the common, static
> function and have:
> 	bitmap_print_list_to_buf()
> 	bitmap_print_bitmask_to_buf()
> 
> so that the caller knows exactly what is happening here.

Sounds reasonable to remove bool parameter.

> 
> 
> 
> > + *
> > + * The bitmap_print_to_pagebuf() is used indirectly via its cpumap wrapper
> > + * cpumap_print_to_pagebuf() or directly by drivers to export hexadecimal
> > + * bitmask and decimal list to userspace by sysfs ABI.
> > + * Drivers might be using a normal attribute for this kind of ABIs. A
> > + * normal attribute typically has show entry as below:
> > + * static ssize_t example_attribute_show(struct device *dev,
> > + * 		struct device_attribute *attr, char *buf)
> > + * {
> > + * 	...
> > + * 	return bitmap_print_to_pagebuf(true, buf, &mask, nr_trig_max);
> > + * }
> > + * show entry of attribute has no offset and count parameters and this
> > + * means the file is limited to one page only.
> > + * bitmap_print_to_pagebuf() API works terribly well for this kind of
> > + * normal attribute with buf parameter and without offset, count:
> > + * bitmap_print_to_pagebuf(bool list, char *buf, const unsigned long *maskp,
> > + * 			   int nmaskbits)
> > + * {
> > + * }
> > + * The problem is once we have a large bitmap, we have a chance to get a
> > + * bitmask or list more than one page. Especially for list, it could be
> > + * as complex as 0,3,5,7,9,... We have no simple way to know it exact size.
> > + * It turns out bin_attribute is a way to break this limit. bin_attribute
> > + * has show entry as below:
> > + * static ssize_t
> > + * example_bin_attribute_show(struct file *filp, struct kobject *kobj,
> > + * 		struct bin_attribute *attr, char *buf,
> > + * 		loff_t offset, size_t count)
> > + * {
> > + * 	...
> > + * }
> > + * With the new offset and count parameters, this makes sysfs ABI be able
> > + * to support file size more than one page. For example, offset could be
> > + * >= 4096.
> > + * bitmap_print_to_buf() and its cpumap wrapper cpumap_print_to_buf() makes
> > + * those drivers be able to support large bitmask and list after they move
> > + * to use bin_attribute. In result, we have to pass the corresponding
> > + * parameters such as off, count from bin_attribute show entry to this API.
> > + *
> > + * @buf: buffer into which string is placed
> > + * @maskp: pointer to bitmap to convert
> > + * @nmaskbits: size of bitmap, in bits
> > + * @off: in the string from which we are copying, We copy to @buf
> > + * @count: the maximum number of bytes to print
> > + *
> > + * The role of cpumap_print_to_buf() and cpumap_print_to_pagebuf() is
> similar,
> > + * the difference is that bitmap_print_to_pagebuf() mainly serves sysfs
> > + * attribute with the assumption the destination buffer is exactly one page
> > + * and won't be more than one page. cpumap_print_to_buf(), on the other hand,
> > + * mainly serves bin_attribute which doesn't work with exact one page, and
> it
> > + * can break the size limit of converted decimal list and hexadecimal bitmask.
> > + *
> > + * Returns the number of characters actually printed to @buf
> > + */
> > +int bitmap_print_to_buf(bool list, char *buf, const unsigned long *maskp,
> > +		int nmaskbits, loff_t off, size_t count)
> 
> No need to put the kernel doc for both the .h and .c file, only put it
> in one place please (where ever it ties into the kernel documentation)
> 

Actually they are two different modules. One is cpumap, the other one is
bitmap. But they do have some duplicated content.
I'd prefer to remove the duplicated part from cpumap.

> thanks,
> 
> greg k-h

Thanks
Barry


  reply	other threads:[~2021-08-05 23:06 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-07-29  5:42 [PATCH v8 0/5] use bin_attribute to break the size limitation of cpumap ABI Barry Song
2021-07-29  5:42 ` [PATCH v8 1/5] cpumask: introduce cpumap_print_to_buf to support large bitmask and list Barry Song
2021-08-05 12:52   ` Greg KH
2021-08-05 23:05     ` Song Bao Hua (Barry Song) [this message]
2021-08-06  4:46       ` Greg KH
2021-07-29  5:42 ` [PATCH v8 2/5] topology: use bin_attribute to break the size limitation of cpumap ABI Barry Song
2021-07-29  5:42 ` [PATCH v8 3/5] drivers/base/node.c: " Barry Song
2021-07-29  5:42 ` [PATCH v8 4/5] lib: test_bitmap: add bitmap_print_to_buf test cases Barry Song
2021-07-29  5:42 ` [PATCH v8 5/5] bitmap: extend comment to bitmap_print_to_buf Barry Song
2021-07-29 17:50 ` [PATCH v8 0/5] use bin_attribute to break the size limitation of cpumap ABI Andrew Morton
2021-07-30  5:22   ` Greg KH

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=53c5fec4223f4c398b81362acf7441b5@hisilicon.com \
    --to=song.bao.hua@hisilicon.com \
    --cc=agordeev@linux.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=andriy.shevchenko@linux.intel.com \
    --cc=bristot@redhat.com \
    --cc=dave.hansen@intel.com \
    --cc=gregkh@linuxfoundation.org \
    --cc=guodong.xu@linaro.org \
    --cc=jianpeng.ma@intel.com \
    --cc=jonathan.cameron@huawei.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux@rasmusvillemoes.dk \
    --cc=linuxarm@huawei.com \
    --cc=peterz@infradead.org \
    --cc=prime.zeng@hisilicon.com \
    --cc=rafael@kernel.org \
    --cc=rdunlap@infradead.org \
    --cc=sbrivio@redhat.com \
    --cc=tangchengchang@huawei.com \
    --cc=tiantao6@hisilicon.com \
    --cc=tim.c.chen@linux.intel.com \
    --cc=valentin.schneider@arm.com \
    --cc=yangyicong@huawei.com \
    --cc=yury.norov@gmail.com \
    --subject='RE: [PATCH v8 1/5] cpumask: introduce cpumap_print_to_buf to support large bitmask and list' \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).