From mboxrd@z Thu Jan 1 00:00:00 1970 From: Doug Ledford Subject: Re: [PATCH 00/14] Present useful limits to user (v2) Date: Mon, 18 Jul 2016 17:25:09 -0400 Message-ID: References: <1468578983-28229-1-git-send-email-toiwoton@gmail.com> <5788F0E1.8090203@nod.at> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="M3ixGbs6cpxcT1XHlVgIucud5P4hN5WcC" Return-path: In-Reply-To: <5788F0E1.8090203@nod.at> Sender: owner-linux-mm@kvack.org To: Richard Weinberger , Topi Miettinen , linux-kernel@vger.kernel.org Cc: Jonathan Corbet , Tony Luck , Fenghua Yu , Alexander Graf , Paolo Bonzini , =?UTF-8?B?UmFkaW0gS3LEjW3DocWZ?= , Benjamin Herrenschmidt , Paul Mackerras , Michael Ellerman , Thomas Gleixner , Ingo Molnar , "H. Peter Anvin" , "maintainer:X86 ARCHITECTURE (32-BIT AND 64-BIT)" , Sean Hefty , Hal Rosenstock , Mike Marciniszyn , Dennis Dalessandro , Christian Benvenuti , Dave Goodell List-Id: linux-rdma@vger.kernel.org This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --M3ixGbs6cpxcT1XHlVgIucud5P4hN5WcC Content-Type: multipart/mixed; boundary="8frEMwdTsgB3uuLViGNWprrwlex3S9Tn0" From: Doug Ledford To: Richard Weinberger , Topi Miettinen , linux-kernel@vger.kernel.org Cc: Jonathan Corbet , Tony Luck , Fenghua Yu , Alexander Graf , Paolo Bonzini , =?UTF-8?B?UmFkaW0gS3LEjW3DocWZ?= , Benjamin Herrenschmidt , Paul Mackerras , Michael Ellerman , Thomas Gleixner , Ingo Molnar , "H. Peter Anvin" , "maintainer:X86 ARCHITECTURE (32-BIT AND 64-BIT)" , Sean Hefty , Hal Rosenstock , Mike Marciniszyn , Dennis Dalessandro , Christian Benvenuti , Dave Goodell , Sudeep Dutt , Ashutosh Dixit , Alex Williamson , Alexander Viro , Tejun Heo , Li Zefan , Johannes Weiner , Peter Zijlstra , Alexei Starovoitov , Arnaldo Carvalho de Melo , Alexander Shishkin , Balbir Singh , Markus Elfring , "David S. Miller" , Nicolas Dichtel , Andrew Morton , Konstantin Khlebnikov , Jiri Slaby , Cyrill Gorcunov , Michal Hocko , Vlastimil Babka , Dave Hansen , Greg Kroah-Hartman , Dan Carpenter , Michael Kerrisk , "Kirill A. Shutemov" , Marcus Gelderie , Vladimir Davydov , Joe Perches , Frederic Weisbecker , Andrea Arcangeli , "Eric W. Biederman" , Andi Kleen , Oleg Nesterov , Stas Sergeev , Amanieu d'Antras , Wang Xiaoqiang , Helge Deller , Mateusz Guzik , Alex Thorlton , Ben Segall , John Stultz , Rik van Riel , Eric B Munson , Alexey Klimov , Chen Gang , Andrey Ryabinin , David Rientjes , Hugh Dickins , Alexander Kuleshov , "open list:DOCUMENTATION" , "open list:IA64 (Itanium) PLATFORM" , "open list:KERNEL VIRTUAL MACHINE (KVM) FOR POWERPC" , "open list:KERNEL VIRTUAL MACHINE (KVM)" , "open list:LINUX FOR POWERPC (32-BIT AND 64-BIT)" , "open list:INFINIBAND SUBSYSTEM" , "open list:FILESYSTEMS (VFS and infrastructure)" , "open list:CONTROL GROUP (CGROUP)" , "open list:BPF (Safe dynamic programs and tools)" , "open list:MEMORY MANAGEMENT" Message-ID: Subject: Re: [PATCH 00/14] Present useful limits to user (v2) References: <1468578983-28229-1-git-send-email-toiwoton@gmail.com> <5788F0E1.8090203@nod.at> In-Reply-To: <5788F0E1.8090203@nod.at> --8frEMwdTsgB3uuLViGNWprrwlex3S9Tn0 Content-Type: text/plain; charset=iso-8859-15 Content-Transfer-Encoding: quoted-printable On 7/15/2016 10:19 AM, Richard Weinberger wrote: > Hi! >=20 > Am 15.07.2016 um 12:35 schrieb Topi Miettinen: >> Hello, >> >> There are many basic ways to control processes, including capabilities= , >> cgroups and resource limits. However, there are far fewer ways to find= out >> useful values for the limits, except blind trial and error. >> >> This patch series attempts to fix that by giving at least a nice start= ing >> point from the highwater mark values of the resources in question. >> I looked where each limit is checked and added a call to update the ma= rk >> nearby. >> >> Example run of program from Documentation/accounting/getdelauys.c: >> >> ./getdelays -R -p `pidof smartd` >> printing resource accounting >> RLIMIT_CPU=3D0 >> RLIMIT_FSIZE=3D0 >> RLIMIT_DATA=3D18198528 >> RLIMIT_STACK=3D135168 >> RLIMIT_CORE=3D0 >> RLIMIT_RSS=3D0 >> RLIMIT_NPROC=3D1 >> RLIMIT_NOFILE=3D55 >> RLIMIT_MEMLOCK=3D0 >> RLIMIT_AS=3D130879488 >> RLIMIT_LOCKS=3D0 >> RLIMIT_SIGPENDING=3D0 >> RLIMIT_MSGQUEUE=3D0 >> RLIMIT_NICE=3D0 >> RLIMIT_RTPRIO=3D0 >> RLIMIT_RTTIME=3D0 >> >> ./getdelays -R -C /sys/fs/cgroup/systemd/system.slice/smartd.service/ >> printing resource accounting >> sleeping 1, blocked 0, running 0, stopped 0, uninterruptible 0 >> RLIMIT_CPU=3D0 >> RLIMIT_FSIZE=3D0 >> RLIMIT_DATA=3D18198528 >> RLIMIT_STACK=3D135168 >> RLIMIT_CORE=3D0 >> RLIMIT_RSS=3D0 >> RLIMIT_NPROC=3D1 >> RLIMIT_NOFILE=3D55 >> RLIMIT_MEMLOCK=3D0 >> RLIMIT_AS=3D130879488 >> RLIMIT_LOCKS=3D0 >> RLIMIT_SIGPENDING=3D0 >> RLIMIT_MSGQUEUE=3D0 >> RLIMIT_NICE=3D0 >> RLIMIT_RTPRIO=3D0 >> RLIMIT_RTTIME=3D0 >> >> In this example, smartd is running as a non-root user. The presented >> values can be used as a starting point for giving new limits to the >> service. >=20 > I don't think it is worth sprinkling the kernel with update_resource_hi= ghwatermark() > calls just to get these metrics. >=20 > Can't we teach the existing perf infrastructure to collect these highwa= termarks for us? I'm not sure about perf (I don't know the internals of perf well enough to comment), but I'm sure the systemtap infrastructure could do this, and a preconfigured systemtap script could be shipped with the package that would allow this. --=20 Doug Ledford GPG Key ID: 0E572FDD --8frEMwdTsgB3uuLViGNWprrwlex3S9Tn0-- --M3ixGbs6cpxcT1XHlVgIucud5P4hN5WcC Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBCAAGBQJXjUk1AAoJELgmozMOVy/dP3IP/0hyIoxdsn8gLJYXycXi6cLC /tgtRfkmEm93ThsKdpY398nopgmsonKaSOACfmsQeH6iiTz6n39jQe/kkAWoYekV iwfri7KBDuC2c8EHHPSgPtMEV1NaG2GPO8HiR7ai2IiKXPfLHTpF6IUW08jCKCot WnSF47svlaWU6lzsx2OSlzDVzxmMx/cVyAVU+mgsgsX1TjSuWlTC89UHf/pbsMAG 8+9pKyuR6WbdQfl7/n7z86MA5ElFWA/WkkWVkrtkfUaLS1SAhqS4Y6/7+HTXkkgL deUgXCrXpfFuUezUEOuU50jejfG4KyX2xlQmQuxB/AbzSb/GlnBNMSg6RFUJt/uD VRIV5oedBGTsnvGmzB3rURG6JhpZEbe3FGh+sGx40GxQgdqn5QPCixljiw8rBR76 +yibZeaVEiBHtTJjiXzYe0kt3KmquzMvIC0alv/0lw8BMLMokBhfd2j97yL9qcvs 2DHTJxYcWFxzv6HFPxKYLoqUphTAfwYaQILwqdQtLD7VCvfjpBvqo5bCr2o/ZWeS w7SFIhlHvKvr5rDT7aLUXbs7AiXDQM5MX1NL7K/8eFhzogpDTPwQUiPVQpZ4nTjl o1KtYhLFdjnEDIgxDBvxSPZLH8xSm9bwkbJDvBc+BeJF8irRZnkQGLr7Gmwto3mu CuW23JN0mA7RnFIRKsr6 =umnq -----END PGP SIGNATURE----- --M3ixGbs6cpxcT1XHlVgIucud5P4hN5WcC-- -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Subject: Re: [PATCH 00/14] Present useful limits to user (v2) To: Richard Weinberger , Topi Miettinen , linux-kernel@vger.kernel.org References: <1468578983-28229-1-git-send-email-toiwoton@gmail.com> <5788F0E1.8090203@nod.at> Cc: Jonathan Corbet , Tony Luck , Fenghua Yu , Alexander Graf , Paolo Bonzini , =?UTF-8?B?UmFkaW0gS3LEjW3DocWZ?= , Benjamin Herrenschmidt , Paul Mackerras , Michael Ellerman , Thomas Gleixner , Ingo Molnar , "H. Peter Anvin" , "maintainer:X86 ARCHITECTURE (32-BIT AND 64-BIT)" , Sean Hefty , Hal Rosenstock , Mike Marciniszyn , Dennis Dalessandro , Christian Benvenuti , Dave Goodell , Sudeep Dutt , Ashutosh Dixit , Alex Williamson , Alexander Viro , Tejun Heo , Li Zefan , Johannes Weiner , Peter Zijlstra , Alexei Starovoitov , Arnaldo Carvalho de Melo , Alexander Shishkin , Balbir Singh , Markus Elfring , "David S. Miller" , Nicolas Dichtel , Andrew Morton , Konstantin Khlebnikov , Jiri Slaby , Cyrill Gorcunov , Michal Hocko , Vlastimil Babka , Dave Hansen , Greg Kroah-Hartman , Dan Carpenter , Michael Kerrisk , "Kirill A. Shutemov" , Marcus Gelderie , Vladimir Davydov , Joe Perches , Frederic Weisbecker , Andrea Arcangeli , "Eric W. Biederman" , Andi Kleen , Oleg Nesterov , Stas Sergeev , "Amanieu d'Antras" , Wang Xiaoqiang , Helge Deller , Mateusz Guzik , Alex Thorlton , Ben Segall , John Stultz , Rik van Riel , Eric B Munson , Alexey Klimov , Chen Gang , Andrey Ryabinin , David Rientjes , Hugh Dickins , Alexander Kuleshov , "open list:DOCUMENTATION" , "open list:IA64 (Itanium) PLATFORM" , "open list:KERNEL VIRTUAL MACHINE (KVM) FOR POWERPC" , "open list:KERNEL VIRTUAL MACHINE (KVM)" , "open list:LINUX FOR POWERPC (32-BIT AND 64-BIT)" , "open list:INFINIBAND SUBSYSTEM" , "open list:FILESYSTEMS (VFS and infrastructure)" , "open list:CONTROL GROUP (CGROUP)" , "open list:BPF (Safe dynamic programs and tools)" , "open list:MEMORY MANAGEMENT" From: Doug Ledford Message-ID: Date: Mon, 18 Jul 2016 17:25:09 -0400 MIME-Version: 1.0 In-Reply-To: <5788F0E1.8090203@nod.at> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="M3ixGbs6cpxcT1XHlVgIucud5P4hN5WcC" Sender: owner-linux-mm@kvack.org List-ID: This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --M3ixGbs6cpxcT1XHlVgIucud5P4hN5WcC Content-Type: multipart/mixed; boundary="8frEMwdTsgB3uuLViGNWprrwlex3S9Tn0" From: Doug Ledford To: Richard Weinberger , Topi Miettinen , linux-kernel@vger.kernel.org Cc: Jonathan Corbet , Tony Luck , Fenghua Yu , Alexander Graf , Paolo Bonzini , =?UTF-8?B?UmFkaW0gS3LEjW3DocWZ?= , Benjamin Herrenschmidt , Paul Mackerras , Michael Ellerman , Thomas Gleixner , Ingo Molnar , "H. Peter Anvin" , "maintainer:X86 ARCHITECTURE (32-BIT AND 64-BIT)" , Sean Hefty , Hal Rosenstock , Mike Marciniszyn , Dennis Dalessandro , Christian Benvenuti , Dave Goodell , Sudeep Dutt , Ashutosh Dixit , Alex Williamson , Alexander Viro , Tejun Heo , Li Zefan , Johannes Weiner , Peter Zijlstra , Alexei Starovoitov , Arnaldo Carvalho de Melo , Alexander Shishkin , Balbir Singh , Markus Elfring , "David S. Miller" , Nicolas Dichtel , Andrew Morton , Konstantin Khlebnikov , Jiri Slaby , Cyrill Gorcunov , Michal Hocko , Vlastimil Babka , Dave Hansen , Greg Kroah-Hartman , Dan Carpenter , Michael Kerrisk , "Kirill A. Shutemov" , Marcus Gelderie , Vladimir Davydov , Joe Perches , Frederic Weisbecker , Andrea Arcangeli , "Eric W. Biederman" , Andi Kleen , Oleg Nesterov , Stas Sergeev , Amanieu d'Antras , Wang Xiaoqiang , Helge Deller , Mateusz Guzik , Alex Thorlton , Ben Segall , John Stultz , Rik van Riel , Eric B Munson , Alexey Klimov , Chen Gang , Andrey Ryabinin , David Rientjes , Hugh Dickins , Alexander Kuleshov , "open list:DOCUMENTATION" , "open list:IA64 (Itanium) PLATFORM" , "open list:KERNEL VIRTUAL MACHINE (KVM) FOR POWERPC" , "open list:KERNEL VIRTUAL MACHINE (KVM)" , "open list:LINUX FOR POWERPC (32-BIT AND 64-BIT)" , "open list:INFINIBAND SUBSYSTEM" , "open list:FILESYSTEMS (VFS and infrastructure)" , "open list:CONTROL GROUP (CGROUP)" , "open list:BPF (Safe dynamic programs and tools)" , "open list:MEMORY MANAGEMENT" Message-ID: Subject: Re: [PATCH 00/14] Present useful limits to user (v2) References: <1468578983-28229-1-git-send-email-toiwoton@gmail.com> <5788F0E1.8090203@nod.at> In-Reply-To: <5788F0E1.8090203@nod.at> --8frEMwdTsgB3uuLViGNWprrwlex3S9Tn0 Content-Type: text/plain; charset=iso-8859-15 Content-Transfer-Encoding: quoted-printable On 7/15/2016 10:19 AM, Richard Weinberger wrote: > Hi! >=20 > Am 15.07.2016 um 12:35 schrieb Topi Miettinen: >> Hello, >> >> There are many basic ways to control processes, including capabilities= , >> cgroups and resource limits. However, there are far fewer ways to find= out >> useful values for the limits, except blind trial and error. >> >> This patch series attempts to fix that by giving at least a nice start= ing >> point from the highwater mark values of the resources in question. >> I looked where each limit is checked and added a call to update the ma= rk >> nearby. >> >> Example run of program from Documentation/accounting/getdelauys.c: >> >> ./getdelays -R -p `pidof smartd` >> printing resource accounting >> RLIMIT_CPU=3D0 >> RLIMIT_FSIZE=3D0 >> RLIMIT_DATA=3D18198528 >> RLIMIT_STACK=3D135168 >> RLIMIT_CORE=3D0 >> RLIMIT_RSS=3D0 >> RLIMIT_NPROC=3D1 >> RLIMIT_NOFILE=3D55 >> RLIMIT_MEMLOCK=3D0 >> RLIMIT_AS=3D130879488 >> RLIMIT_LOCKS=3D0 >> RLIMIT_SIGPENDING=3D0 >> RLIMIT_MSGQUEUE=3D0 >> RLIMIT_NICE=3D0 >> RLIMIT_RTPRIO=3D0 >> RLIMIT_RTTIME=3D0 >> >> ./getdelays -R -C /sys/fs/cgroup/systemd/system.slice/smartd.service/ >> printing resource accounting >> sleeping 1, blocked 0, running 0, stopped 0, uninterruptible 0 >> RLIMIT_CPU=3D0 >> RLIMIT_FSIZE=3D0 >> RLIMIT_DATA=3D18198528 >> RLIMIT_STACK=3D135168 >> RLIMIT_CORE=3D0 >> RLIMIT_RSS=3D0 >> RLIMIT_NPROC=3D1 >> RLIMIT_NOFILE=3D55 >> RLIMIT_MEMLOCK=3D0 >> RLIMIT_AS=3D130879488 >> RLIMIT_LOCKS=3D0 >> RLIMIT_SIGPENDING=3D0 >> RLIMIT_MSGQUEUE=3D0 >> RLIMIT_NICE=3D0 >> RLIMIT_RTPRIO=3D0 >> RLIMIT_RTTIME=3D0 >> >> In this example, smartd is running as a non-root user. The presented >> values can be used as a starting point for giving new limits to the >> service. >=20 > I don't think it is worth sprinkling the kernel with update_resource_hi= ghwatermark() > calls just to get these metrics. >=20 > Can't we teach the existing perf infrastructure to collect these highwa= termarks for us? I'm not sure about perf (I don't know the internals of perf well enough to comment), but I'm sure the systemtap infrastructure could do this, and a preconfigured systemtap script could be shipped with the package that would allow this. --=20 Doug Ledford GPG Key ID: 0E572FDD --8frEMwdTsgB3uuLViGNWprrwlex3S9Tn0-- --M3ixGbs6cpxcT1XHlVgIucud5P4hN5WcC Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBCAAGBQJXjUk1AAoJELgmozMOVy/dP3IP/0hyIoxdsn8gLJYXycXi6cLC /tgtRfkmEm93ThsKdpY398nopgmsonKaSOACfmsQeH6iiTz6n39jQe/kkAWoYekV iwfri7KBDuC2c8EHHPSgPtMEV1NaG2GPO8HiR7ai2IiKXPfLHTpF6IUW08jCKCot WnSF47svlaWU6lzsx2OSlzDVzxmMx/cVyAVU+mgsgsX1TjSuWlTC89UHf/pbsMAG 8+9pKyuR6WbdQfl7/n7z86MA5ElFWA/WkkWVkrtkfUaLS1SAhqS4Y6/7+HTXkkgL deUgXCrXpfFuUezUEOuU50jejfG4KyX2xlQmQuxB/AbzSb/GlnBNMSg6RFUJt/uD VRIV5oedBGTsnvGmzB3rURG6JhpZEbe3FGh+sGx40GxQgdqn5QPCixljiw8rBR76 +yibZeaVEiBHtTJjiXzYe0kt3KmquzMvIC0alv/0lw8BMLMokBhfd2j97yL9qcvs 2DHTJxYcWFxzv6HFPxKYLoqUphTAfwYaQILwqdQtLD7VCvfjpBvqo5bCr2o/ZWeS w7SFIhlHvKvr5rDT7aLUXbs7AiXDQM5MX1NL7K/8eFhzogpDTPwQUiPVQpZ4nTjl o1KtYhLFdjnEDIgxDBvxSPZLH8xSm9bwkbJDvBc+BeJF8irRZnkQGLr7Gmwto3mu CuW23JN0mA7RnFIRKsr6 =umnq -----END PGP SIGNATURE----- --M3ixGbs6cpxcT1XHlVgIucud5P4hN5WcC-- -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org