Re: [PATCH 0/7] selftests/resctrl: Add resctrl selftest

From: Fenghua Yu <fenghua.yu@intel.com>
To: "Moger, Babu" <Babu.Moger@amd.com>
Cc: Thomas Gleixner <tglx@linutronix.de>,
	Ingo Molnar <mingo@redhat.com>, H Peter Anvin <hpa@zytor.com>,
	Tony Luck <tony.luck@intel.com>,
	Reinette Chatre <reinette.chatre@intel.com>,
	Peter Zijlstra <peterz@infradead.org>,
	James Morse <james.morse@arm.com>,
	Sai Praneeth Prakhya <sai.praneeth.prakhya@intel.com>,
	Arshiya Hayatkhan Pathan <arshiya.hayatkhan.pathan@intel.com>,
	Ravi V Shankar <ravi.v.shankar@intel.com>,
	linux-kernel <linux-kernel@vger.kernel.org>,
	Fenghua Yu <fenghua.yu@intel.com>
Subject: Re: [PATCH 0/7] selftests/resctrl: Add resctrl selftest
Date: Tue, 16 Oct 2018 13:32:15 -0700	[thread overview]
Message-ID: <20181016203215.GA39177@romley-ivt3.sc.intel.com> (raw)
In-Reply-To: <FFF73D592F13FD46B8700F0A279B802F485D47DE@ORSMSX114.amr.corp.intel.com>

> From: Moger, Babu [mailto:Babu.Moger@amd.com] 
> On 10/16/2018 11:56 AM, Fenghua Yu wrote:
> > With more and more resctrl features are being added by Intel, AMD and 
> > ARM, a test tool is becoming more and more useful to validate that 
> > both hardware and software functionalities work as expected.
> 
> I like the initiative here. It is always good to have a single code base.
> 
> One question. I see that there is a tool at https://github.com/intel/intel-cmt-cat to test and verify the functionality of resctrl feature. I also see some of the distros have this tool already.
> Is this tool going to replace intel-cmt-cat? I have not looked at the
> patches closely yet.

No, the selftest in this patch set will not replace intel-cmt-cat or
vice versa.

The selftest in this patch set has a different purpose from intel-cmt-cat:
the selftest is a test tool which validates resctrl functionalities while
intel-cmt-cat is mainly a utility that provides base library for higher
level applications including performance analysis tools, benchmark measurement
tools, and potential resctrl tests. For example, running MBA test in the
selftests tells MBA working or not working (fail/pass) right way. The
intel-cmt-cat doesn't have this testing capability unless we extend the
tool.

And intel-cmt-cat is maintained and developed by Intel. I don't think it's
easy to extend it to AMD and ARM features. The selftest will be maintained
and developed by the community and will hopefully cover all architectures.

We have seen a few issues recently in resctrl and may see more issues
while expending the features. A convevient selftest may be useful to help
identify and fix those potential issues.

Thanks.

-Fenghua 