* [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities
@ 2020-08-27 15:08 Rafael J. Wysocki
2020-08-27 15:10 ` [PATCH v3 1/5] cpufreq: intel_pstate: Refuse to turn off with HWP enabled Rafael J. Wysocki
` (5 more replies)
0 siblings, 6 replies; 9+ messages in thread
From: Rafael J. Wysocki @ 2020-08-27 15:08 UTC (permalink / raw)
To: Linux PM; +Cc: Srinivas Pandruvada, LKML, Doug Smythies, Artem Bityutskiy
Hi All,
The v3 is here to address feedback from Srinivas and Doug, and Artem concerns
regarding the EPP sysfs interface changes.
The purpose of this series is to address some peculiarities related to
taking CPUs offline/online and switching between different operation
modes with HWP enabled that have become visible after allowing the
driver to work in the passive mode with HWP enabled in 5.9-rc1 (and
one that was there earlier, but can be addressed easily after the
changes made in 5.9-rc1).
Please refer to the patch changelogs for details.
For easier testing/review, the series is available from the git branch at:
git://git.kernel.org/pub/scm/linux/kernel/git/rafael/linux-pm.git \
intel_pstate-testing
I've done my best to address all of the possible corner cases, but the test
matrix is quite extensive and I may have missed something, so go ahead
and test.
Thanks,
Rafael
^ permalink raw reply [flat|nested] 9+ messages in thread
* [PATCH v3 1/5] cpufreq: intel_pstate: Refuse to turn off with HWP enabled
2020-08-27 15:08 [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Rafael J. Wysocki
@ 2020-08-27 15:10 ` Rafael J. Wysocki
2020-08-27 15:13 ` [PATCH v3 2/5] cpufreq: intel_pstate: Update cached EPP in the active mode Rafael J. Wysocki
` (4 subsequent siblings)
5 siblings, 0 replies; 9+ messages in thread
From: Rafael J. Wysocki @ 2020-08-27 15:10 UTC (permalink / raw)
To: Linux PM; +Cc: Srinivas Pandruvada, LKML, Doug Smythies, Artem Bityutskiy
From: "Rafael J. Wysocki" <rafael.j.wysocki@intel.com>
After commit f6ebbcf08f37 ("cpufreq: intel_pstate: Implement passive
mode with HWP enabled") it is possible to change the driver status
to "off" via sysfs with HWP enabled, which effectively causes the
driver to unregister itself, but HWP remains active and it forces the
minimum performance, so even if another cpufreq driver is loaded,
it will not be able to control the CPU frequency.
For this reason, make the driver refuse to change the status to
"off" with HWP enabled.
Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
---
v1 -> v3: No changes
---
drivers/cpufreq/intel_pstate.c | 12 +++++++++---
1 file changed, 9 insertions(+), 3 deletions(-)
diff --git a/drivers/cpufreq/intel_pstate.c b/drivers/cpufreq/intel_pstate.c
index e0220a6fbc69..bcda1e700a73 100644
--- a/drivers/cpufreq/intel_pstate.c
+++ b/drivers/cpufreq/intel_pstate.c
@@ -2716,9 +2716,15 @@ static int intel_pstate_update_status(const char *buf, size_t size)
{
int ret;
- if (size == 3 && !strncmp(buf, "off", size))
- return intel_pstate_driver ?
- intel_pstate_unregister_driver() : -EINVAL;
+ if (size == 3 && !strncmp(buf, "off", size)) {
+ if (!intel_pstate_driver)
+ return -EINVAL;
+
+ if (hwp_active)
+ return -EBUSY;
+
+ return intel_pstate_unregister_driver();
+ }
if (size == 6 && !strncmp(buf, "active", size)) {
if (intel_pstate_driver) {
--
2.26.2
^ permalink raw reply related [flat|nested] 9+ messages in thread
* [PATCH v3 2/5] cpufreq: intel_pstate: Update cached EPP in the active mode
2020-08-27 15:08 [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Rafael J. Wysocki
2020-08-27 15:10 ` [PATCH v3 1/5] cpufreq: intel_pstate: Refuse to turn off with HWP enabled Rafael J. Wysocki
@ 2020-08-27 15:13 ` Rafael J. Wysocki
2020-08-27 15:14 ` [PATCH v3 3/5] cpufreq: intel_pstate: Tweak the EPP sysfs interface Rafael J. Wysocki
` (3 subsequent siblings)
5 siblings, 0 replies; 9+ messages in thread
From: Rafael J. Wysocki @ 2020-08-27 15:13 UTC (permalink / raw)
To: Linux PM; +Cc: Srinivas Pandruvada, LKML, Doug Smythies, Artem Bityutskiy
From: "Rafael J. Wysocki" <rafael.j.wysocki@intel.com>
Make intel_pstate update the cached EPP value when setting the EPP
via sysfs in the active mode just like it is the case in the passive
mode, for consistency, but also for the benefit of subsequent
changes.
No intentional functional impact.
Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
---
-> v2: No changes
v2 -> v3:
* Do not change the read part of the EPP sysfs interface.
* Change the subject and update the changelog.
---
drivers/cpufreq/intel_pstate.c | 20 +++++++++++++++-----
1 file changed, 15 insertions(+), 5 deletions(-)
diff --git a/drivers/cpufreq/intel_pstate.c b/drivers/cpufreq/intel_pstate.c
index bcda1e700a73..e540448e0bd0 100644
--- a/drivers/cpufreq/intel_pstate.c
+++ b/drivers/cpufreq/intel_pstate.c
@@ -644,6 +644,8 @@ static int intel_pstate_get_energy_pref_index(struct cpudata *cpu_data, int *raw
static int intel_pstate_set_epp(struct cpudata *cpu, u32 epp)
{
+ int ret;
+
/*
* Use the cached HWP Request MSR value, because in the active mode the
* register itself may be updated by intel_pstate_hwp_boost_up() or
@@ -659,7 +661,11 @@ static int intel_pstate_set_epp(struct cpudata *cpu, u32 epp)
* function, so it cannot run in parallel with the update below.
*/
WRITE_ONCE(cpu->hwp_req_cached, value);
- return wrmsrl_on_cpu(cpu->cpu, MSR_HWP_REQUEST, value);
+ ret = wrmsrl_on_cpu(cpu->cpu, MSR_HWP_REQUEST, value);
+ if (!ret)
+ cpu->epp_cached = epp;
+
+ return ret;
}
static int intel_pstate_set_energy_pref_index(struct cpudata *cpu_data,
@@ -762,10 +768,8 @@ static ssize_t store_energy_performance_preference(
cpufreq_stop_governor(policy);
ret = intel_pstate_set_epp(cpu, epp);
err = cpufreq_start_governor(policy);
- if (!ret) {
- cpu->epp_cached = epp;
+ if (!ret)
ret = err;
- }
}
}
@@ -2378,6 +2382,12 @@ static int intel_pstate_cpu_init(struct cpufreq_policy *policy)
*/
policy->policy = CPUFREQ_POLICY_POWERSAVE;
+ if (hwp_active) {
+ struct cpudata *cpu = all_cpu_data[policy->cpu];
+
+ cpu->epp_cached = intel_pstate_get_epp(cpu, 0);
+ }
+
return 0;
}
@@ -2585,7 +2595,7 @@ static int intel_cpufreq_cpu_init(struct cpufreq_policy *policy)
policy->transition_delay_us = INTEL_CPUFREQ_TRANSITION_DELAY_HWP;
rdmsrl_on_cpu(cpu->cpu, MSR_HWP_REQUEST, &value);
WRITE_ONCE(cpu->hwp_req_cached, value);
- cpu->epp_cached = (value & GENMASK_ULL(31, 24)) >> 24;
+ cpu->epp_cached = intel_pstate_get_epp(cpu, value);
} else {
turbo_max = cpu->pstate.turbo_pstate;
policy->transition_delay_us = INTEL_CPUFREQ_TRANSITION_DELAY;
--
2.26.2
^ permalink raw reply related [flat|nested] 9+ messages in thread
* [PATCH v3 3/5] cpufreq: intel_pstate: Tweak the EPP sysfs interface
2020-08-27 15:08 [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Rafael J. Wysocki
2020-08-27 15:10 ` [PATCH v3 1/5] cpufreq: intel_pstate: Refuse to turn off with HWP enabled Rafael J. Wysocki
2020-08-27 15:13 ` [PATCH v3 2/5] cpufreq: intel_pstate: Update cached EPP in the active mode Rafael J. Wysocki
@ 2020-08-27 15:14 ` Rafael J. Wysocki
2020-08-28 12:36 ` Artem Bityutskiy
2020-08-27 15:20 ` [PATCH v3 4/5] cpufreq: intel_pstate: Add ->offline and ->online callbacks Rafael J. Wysocki
` (2 subsequent siblings)
5 siblings, 1 reply; 9+ messages in thread
From: Rafael J. Wysocki @ 2020-08-27 15:14 UTC (permalink / raw)
To: Linux PM; +Cc: Srinivas Pandruvada, LKML, Doug Smythies, Artem Bityutskiy
From: "Rafael J. Wysocki" <rafael.j.wysocki@intel.com>
Modify the EPP sysfs interface to reject attempts to change the EPP
to values different from 0 ("performance") in the active mode with
the "performance" policy (ie. scaling_governor set to "performance"),
to avoid situations in which the kernel appears to discard data
passed to it via the EPP sysfs attribute.
Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
---
v2 -> v3: New patch
---
Documentation/admin-guide/pm/intel_pstate.rst | 4 +++-
drivers/cpufreq/intel_pstate.c | 8 ++++++++
2 files changed, 11 insertions(+), 1 deletion(-)
diff --git a/Documentation/admin-guide/pm/intel_pstate.rst b/Documentation/admin-guide/pm/intel_pstate.rst
index cdd1a9a7f9a2..5072e7064d13 100644
--- a/Documentation/admin-guide/pm/intel_pstate.rst
+++ b/Documentation/admin-guide/pm/intel_pstate.rst
@@ -123,7 +123,9 @@ Energy-Performance Bias (EPB) knob (otherwise), which means that the processor's
internal P-state selection logic is expected to focus entirely on performance.
This will override the EPP/EPB setting coming from the ``sysfs`` interface
-(see `Energy vs Performance Hints`_ below).
+(see `Energy vs Performance Hints`_ below). Moreover, any attempts to change
+the EPP/EPB to a value different from 0 ("performance") via ``sysfs`` in this
+configuration will be rejected.
Also, in this configuration the range of P-states available to the processor's
internal P-state selection logic is always restricted to the upper boundary
diff --git a/drivers/cpufreq/intel_pstate.c b/drivers/cpufreq/intel_pstate.c
index e540448e0bd0..b308c39b6204 100644
--- a/drivers/cpufreq/intel_pstate.c
+++ b/drivers/cpufreq/intel_pstate.c
@@ -684,6 +684,14 @@ static int intel_pstate_set_energy_pref_index(struct cpudata *cpu_data,
else if (epp == -EINVAL)
epp = epp_values[pref_index - 1];
+ /*
+ * To avoid confusion, refuse to set EPP to any values different
+ * from 0 (performance) if the current policy is "performance",
+ * because those values would be overridden.
+ */
+ if (epp > 0 && cpu_data->policy == CPUFREQ_POLICY_PERFORMANCE)
+ return -EBUSY;
+
ret = intel_pstate_set_epp(cpu_data, epp);
} else {
if (epp == -EINVAL)
--
2.26.2
^ permalink raw reply related [flat|nested] 9+ messages in thread
* [PATCH v3 4/5] cpufreq: intel_pstate: Add ->offline and ->online callbacks
2020-08-27 15:08 [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Rafael J. Wysocki
` (2 preceding siblings ...)
2020-08-27 15:14 ` [PATCH v3 3/5] cpufreq: intel_pstate: Tweak the EPP sysfs interface Rafael J. Wysocki
@ 2020-08-27 15:20 ` Rafael J. Wysocki
2020-08-31 18:15 ` Rafael J. Wysocki
2020-08-27 15:27 ` [PATCH v3 5/5] cpufreq: intel_pstate: Free memory only when turning off Rafael J. Wysocki
2020-08-27 19:52 ` [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Srinivas Pandruvada
5 siblings, 1 reply; 9+ messages in thread
From: Rafael J. Wysocki @ 2020-08-27 15:20 UTC (permalink / raw)
To: Linux PM; +Cc: Srinivas Pandruvada, LKML, Doug Smythies, Artem Bityutskiy
From: "Rafael J. Wysocki" <rafael.j.wysocki@intel.com>
Add ->offline and ->online driver callbacks to prepare for taking a
CPU offline and to restore its working configuration when it goes
back online, respectively, to avoid invoking the ->init callback on
every CPU online which is quite a bit of unnecessary overhead.
Define ->offline and ->online so that they can be used in the
passive mode as well as in the active mode and because ->offline
will do the majority of ->stop_cpu work, the passive mode does
not need that callback any more, so drop it from there.
Also modify the active mode ->suspend and ->resume callbacks to
prevent them from interfering with the new ->offline and ->online
ones in case the latter are invoked withing the system-wide suspend
and resume code flow and make the passive mode use them too.
Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
---
-> v2: Rearrange intel_pstate_init_cpu() to restore some of the previous
behavior of it to retain the current active-mode EPP management.
v2 -> v3:
* Fold the previous [5/5] in, rework intel_pstate_resume(), add
intel_pstate_suspend().
* Drop intel_pstate_hwp_save_state() and drop epp_saved from struct cpudata.
* Update the changelog.
---
drivers/cpufreq/intel_pstate.c | 139 +++++++++++++++++++++------------
1 file changed, 91 insertions(+), 48 deletions(-)
diff --git a/drivers/cpufreq/intel_pstate.c b/drivers/cpufreq/intel_pstate.c
index b308c39b6204..a265ccbcbbd7 100644
--- a/drivers/cpufreq/intel_pstate.c
+++ b/drivers/cpufreq/intel_pstate.c
@@ -219,14 +219,13 @@ struct global_params {
* @epp_policy: Last saved policy used to set EPP/EPB
* @epp_default: Power on default HWP energy performance
* preference/bias
- * @epp_saved: Saved EPP/EPB during system suspend or CPU offline
- * operation
* @epp_cached Cached HWP energy-performance preference value
* @hwp_req_cached: Cached value of the last HWP Request MSR
* @hwp_cap_cached: Cached value of the last HWP Capabilities MSR
* @last_io_update: Last time when IO wake flag was set
* @sched_flags: Store scheduler flags for possible cross CPU update
* @hwp_boost_min: Last HWP boosted min performance
+ * @suspended: Whether or not the driver has been suspended.
*
* This structure stores per CPU instance data for all CPUs.
*/
@@ -258,13 +257,13 @@ struct cpudata {
s16 epp_powersave;
s16 epp_policy;
s16 epp_default;
- s16 epp_saved;
s16 epp_cached;
u64 hwp_req_cached;
u64 hwp_cap_cached;
u64 last_io_update;
unsigned int sched_flags;
u32 hwp_boost_min;
+ bool suspended;
};
static struct cpudata **all_cpu_data;
@@ -871,12 +870,6 @@ static void intel_pstate_hwp_set(unsigned int cpu)
cpu_data->epp_policy = cpu_data->policy;
- if (cpu_data->epp_saved >= 0) {
- epp = cpu_data->epp_saved;
- cpu_data->epp_saved = -EINVAL;
- goto update_epp;
- }
-
if (cpu_data->policy == CPUFREQ_POLICY_PERFORMANCE) {
epp = intel_pstate_get_epp(cpu_data, value);
cpu_data->epp_powersave = epp;
@@ -903,7 +896,6 @@ static void intel_pstate_hwp_set(unsigned int cpu)
epp = cpu_data->epp_powersave;
}
-update_epp:
if (boot_cpu_has(X86_FEATURE_HWP_EPP)) {
value &= ~GENMASK_ULL(31, 24);
value |= (u64)epp << 24;
@@ -915,14 +907,24 @@ static void intel_pstate_hwp_set(unsigned int cpu)
wrmsrl_on_cpu(cpu, MSR_HWP_REQUEST, value);
}
-static void intel_pstate_hwp_force_min_perf(int cpu)
+static void intel_pstate_hwp_offline(struct cpudata *cpu)
{
- u64 value;
+ u64 value = READ_ONCE(cpu->hwp_req_cached);
int min_perf;
- value = all_cpu_data[cpu]->hwp_req_cached;
+ if (boot_cpu_has(X86_FEATURE_HWP_EPP)) {
+ /*
+ * In case the EPP has been set to "performance" by the
+ * active mode "performance" scaling algorithm, replace that
+ * temporary value with the cached EPP one.
+ */
+ value &= ~GENMASK_ULL(31, 24);
+ value |= HWP_ENERGY_PERF_PREFERENCE(cpu->epp_cached);
+ WRITE_ONCE(cpu->hwp_req_cached, value);
+ }
+
value &= ~GENMASK_ULL(31, 0);
- min_perf = HWP_LOWEST_PERF(all_cpu_data[cpu]->hwp_cap_cached);
+ min_perf = HWP_LOWEST_PERF(cpu->hwp_cap_cached);
/* Set hwp_max = hwp_min */
value |= HWP_MAX_PERF(min_perf);
@@ -932,19 +934,7 @@ static void intel_pstate_hwp_force_min_perf(int cpu)
if (boot_cpu_has(X86_FEATURE_HWP_EPP))
value |= HWP_ENERGY_PERF_PREFERENCE(HWP_EPP_POWERSAVE);
- wrmsrl_on_cpu(cpu, MSR_HWP_REQUEST, value);
-}
-
-static int intel_pstate_hwp_save_state(struct cpufreq_policy *policy)
-{
- struct cpudata *cpu_data = all_cpu_data[policy->cpu];
-
- if (!hwp_active)
- return 0;
-
- cpu_data->epp_saved = intel_pstate_get_epp(cpu_data, 0);
-
- return 0;
+ wrmsrl_on_cpu(cpu->cpu, MSR_HWP_REQUEST, value);
}
#define POWER_CTL_EE_ENABLE 1
@@ -971,8 +961,22 @@ static void set_power_ctl_ee_state(bool input)
static void intel_pstate_hwp_enable(struct cpudata *cpudata);
+static int intel_pstate_suspend(struct cpufreq_policy *policy)
+{
+ struct cpudata *cpu = all_cpu_data[policy->cpu];
+
+ pr_debug("CPU %d suspending\n", cpu->cpu);
+
+ cpu->suspended = true;
+
+ return 0;
+}
+
static int intel_pstate_resume(struct cpufreq_policy *policy)
{
+ struct cpudata *cpu = all_cpu_data[policy->cpu];
+
+ pr_debug("CPU %d resuming\n", cpu->cpu);
/* Only restore if the system default is changed */
if (power_ctl_ee_state == POWER_CTL_EE_ENABLE)
@@ -980,18 +984,22 @@ static int intel_pstate_resume(struct cpufreq_policy *policy)
else if (power_ctl_ee_state == POWER_CTL_EE_DISABLE)
set_power_ctl_ee_state(false);
- if (!hwp_active)
- return 0;
+ if (hwp_active) {
+ mutex_lock(&intel_pstate_limits_lock);
- mutex_lock(&intel_pstate_limits_lock);
+ /*
+ * Enable for all CPUs, because the boot CPU may not be the
+ * first one to resume.
+ */
+ intel_pstate_hwp_enable(cpu);
- if (policy->cpu == 0)
- intel_pstate_hwp_enable(all_cpu_data[policy->cpu]);
+ wrmsrl_on_cpu(cpu->cpu, MSR_HWP_REQUEST,
+ READ_ONCE(cpu->hwp_req_cached));
- all_cpu_data[policy->cpu]->epp_policy = 0;
- intel_pstate_hwp_set(policy->cpu);
+ mutex_unlock(&intel_pstate_limits_lock);
+ }
- mutex_unlock(&intel_pstate_limits_lock);
+ cpu->suspended = false;
return 0;
}
@@ -1440,7 +1448,6 @@ static void intel_pstate_hwp_enable(struct cpudata *cpudata)
wrmsrl_on_cpu(cpudata->cpu, MSR_HWP_INTERRUPT, 0x00);
wrmsrl_on_cpu(cpudata->cpu, MSR_PM_ENABLE, 0x1);
- cpudata->epp_policy = 0;
if (cpudata->epp_default == -EINVAL)
cpudata->epp_default = intel_pstate_get_epp(cpudata, 0);
}
@@ -2111,7 +2118,6 @@ static int intel_pstate_init_cpu(unsigned int cpunum)
cpu->epp_default = -EINVAL;
cpu->epp_powersave = -EINVAL;
- cpu->epp_saved = -EINVAL;
}
cpu = all_cpu_data[cpunum];
@@ -2122,6 +2128,7 @@ static int intel_pstate_init_cpu(unsigned int cpunum)
const struct x86_cpu_id *id;
intel_pstate_hwp_enable(cpu);
+ cpu->epp_policy = 0;
id = x86_match_cpu(intel_pstate_hwp_boost_ids);
if (id && intel_pstate_acpi_pm_profile_server())
@@ -2308,28 +2315,59 @@ static int intel_pstate_verify_policy(struct cpufreq_policy_data *policy)
return 0;
}
-static void intel_cpufreq_stop_cpu(struct cpufreq_policy *policy)
+static int intel_pstate_cpu_offline(struct cpufreq_policy *policy)
{
+ struct cpudata *cpu = all_cpu_data[policy->cpu];
+
+ pr_debug("CPU %d going offline\n", cpu->cpu);
+
+ if (cpu->suspended)
+ return 0;
+
+ intel_pstate_exit_perf_limits(policy);
+
+ /*
+ * If the CPU is an SMT thread and it goes offline with the performance
+ * settings different from the minimum, it will prevent its sibling
+ * from getting to lower performance levels, so force the minimum
+ * performance on CPU offline to prevent that from happening.
+ */
if (hwp_active)
- intel_pstate_hwp_force_min_perf(policy->cpu);
+ intel_pstate_hwp_offline(cpu);
else
- intel_pstate_set_min_pstate(all_cpu_data[policy->cpu]);
+ intel_pstate_set_min_pstate(cpu);
+
+ return 0;
}
-static void intel_pstate_stop_cpu(struct cpufreq_policy *policy)
+static int intel_pstate_cpu_online(struct cpufreq_policy *policy)
{
- pr_debug("CPU %d exiting\n", policy->cpu);
+ struct cpudata *cpu = all_cpu_data[policy->cpu];
+
+ pr_debug("CPU %d going online\n", cpu->cpu);
+
+ if (cpu->suspended)
+ return 0;
+
+ intel_pstate_init_acpi_perf_limits(policy);
- intel_pstate_clear_update_util_hook(policy->cpu);
if (hwp_active)
- intel_pstate_hwp_save_state(policy);
+ wrmsrl_on_cpu(policy->cpu, MSR_HWP_REQUEST,
+ READ_ONCE(cpu->hwp_req_cached));
+
+ return 0;
+}
+
+static void intel_pstate_stop_cpu(struct cpufreq_policy *policy)
+{
+ pr_debug("CPU %d stopping\n", policy->cpu);
- intel_cpufreq_stop_cpu(policy);
+ intel_pstate_clear_update_util_hook(policy->cpu);
}
static int intel_pstate_cpu_exit(struct cpufreq_policy *policy)
{
- intel_pstate_exit_perf_limits(policy);
+ pr_debug("CPU %d exiting\n", policy->cpu);
policy->fast_switch_possible = false;
@@ -2403,11 +2441,13 @@ static struct cpufreq_driver intel_pstate = {
.flags = CPUFREQ_CONST_LOOPS,
.verify = intel_pstate_verify_policy,
.setpolicy = intel_pstate_set_policy,
- .suspend = intel_pstate_hwp_save_state,
+ .suspend = intel_pstate_suspend,
.resume = intel_pstate_resume,
.init = intel_pstate_cpu_init,
.exit = intel_pstate_cpu_exit,
.stop_cpu = intel_pstate_stop_cpu,
+ .offline = intel_pstate_cpu_offline,
+ .online = intel_pstate_cpu_online,
.update_limits = intel_pstate_update_limits,
.name = "intel_pstate",
};
@@ -2662,7 +2702,10 @@ static struct cpufreq_driver intel_cpufreq = {
.fast_switch = intel_cpufreq_fast_switch,
.init = intel_cpufreq_cpu_init,
.exit = intel_cpufreq_cpu_exit,
- .stop_cpu = intel_cpufreq_stop_cpu,
+ .offline = intel_pstate_cpu_offline,
+ .online = intel_pstate_cpu_online,
+ .suspend = intel_pstate_suspend,
+ .resume = intel_pstate_resume,
.update_limits = intel_pstate_update_limits,
.name = "intel_cpufreq",
};
--
2.26.2
^ permalink raw reply related [flat|nested] 9+ messages in thread
* [PATCH v3 5/5] cpufreq: intel_pstate: Free memory only when turning off
2020-08-27 15:08 [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Rafael J. Wysocki
` (3 preceding siblings ...)
2020-08-27 15:20 ` [PATCH v3 4/5] cpufreq: intel_pstate: Add ->offline and ->online callbacks Rafael J. Wysocki
@ 2020-08-27 15:27 ` Rafael J. Wysocki
2020-08-27 19:52 ` [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Srinivas Pandruvada
5 siblings, 0 replies; 9+ messages in thread
From: Rafael J. Wysocki @ 2020-08-27 15:27 UTC (permalink / raw)
To: Linux PM; +Cc: Srinivas Pandruvada, LKML, Doug Smythies, Artem Bityutskiy
From: "Rafael J. Wysocki" <rafael.j.wysocki@intel.com>
When intel_pstate switches the operation mode from "active" to
"passive" or the other way around, freeing its data structures
representing CPUs and allocating them again from scratch is not
necessary and wasteful. Moreover, if these data structures are
preserved, the cached HWP Request MSR value from there may be
written to the MSR to start with to reinitialize it and help to
restore the EPP value set previously (it is set to 0xFF when CPUs
go offline to allow their SMT siblings to use the full range of
EPP values and that also happens when the driver gets unregistered).
Accordingly, modify the driver to only do a full cleanup on driver
object registration errors and when its status is changed to "off"
via sysfs and to write the cached HWP Request MSR value back to
the MSR on CPU init if the data structure representing the given
CPU is still there.
Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
---
-> v2: Rearrange intel_pstate_init_cpu() to restore some of the previous
behavior of it to retain the current active-mode EPP management.
v2 -> v3:
* Rebase (it was [4/5] previously).
---
drivers/cpufreq/intel_pstate.c | 53 +++++++++++++---------------------
1 file changed, 20 insertions(+), 33 deletions(-)
diff --git a/drivers/cpufreq/intel_pstate.c b/drivers/cpufreq/intel_pstate.c
index a265ccbcbbd7..259de3c0e658 100644
--- a/drivers/cpufreq/intel_pstate.c
+++ b/drivers/cpufreq/intel_pstate.c
@@ -2116,25 +2116,27 @@ static int intel_pstate_init_cpu(unsigned int cpunum)
all_cpu_data[cpunum] = cpu;
- cpu->epp_default = -EINVAL;
- cpu->epp_powersave = -EINVAL;
- }
+ cpu->cpu = cpunum;
- cpu = all_cpu_data[cpunum];
+ cpu->epp_default = -EINVAL;
- cpu->cpu = cpunum;
+ if (hwp_active) {
+ const struct x86_cpu_id *id;
- if (hwp_active) {
- const struct x86_cpu_id *id;
+ intel_pstate_hwp_enable(cpu);
- intel_pstate_hwp_enable(cpu);
- cpu->epp_policy = 0;
-
- id = x86_match_cpu(intel_pstate_hwp_boost_ids);
- if (id && intel_pstate_acpi_pm_profile_server())
- hwp_boost = true;
+ id = x86_match_cpu(intel_pstate_hwp_boost_ids);
+ if (id && intel_pstate_acpi_pm_profile_server())
+ hwp_boost = true;
+ }
+ } else if (hwp_active) {
+ wrmsrl_on_cpu(cpunum, MSR_HWP_REQUEST,
+ READ_ONCE(cpu->hwp_req_cached));
}
+ cpu->epp_powersave = -EINVAL;
+ cpu->epp_policy = 0;
+
intel_pstate_get_cpu_pstates(cpu);
pr_debug("controlling: cpu %d\n", cpunum);
@@ -2728,9 +2730,6 @@ static void intel_pstate_driver_cleanup(void)
}
put_online_cpus();
- if (intel_pstate_driver == &intel_pstate)
- intel_pstate_sysfs_hide_hwp_dynamic_boost();
-
intel_pstate_driver = NULL;
}
@@ -2756,14 +2755,6 @@ static int intel_pstate_register_driver(struct cpufreq_driver *driver)
return 0;
}
-static int intel_pstate_unregister_driver(void)
-{
- cpufreq_unregister_driver(intel_pstate_driver);
- intel_pstate_driver_cleanup();
-
- return 0;
-}
-
static ssize_t intel_pstate_show_status(char *buf)
{
if (!intel_pstate_driver)
@@ -2775,8 +2766,6 @@ static ssize_t intel_pstate_show_status(char *buf)
static int intel_pstate_update_status(const char *buf, size_t size)
{
- int ret;
-
if (size == 3 && !strncmp(buf, "off", size)) {
if (!intel_pstate_driver)
return -EINVAL;
@@ -2784,7 +2773,8 @@ static int intel_pstate_update_status(const char *buf, size_t size)
if (hwp_active)
return -EBUSY;
- return intel_pstate_unregister_driver();
+ cpufreq_unregister_driver(intel_pstate_driver);
+ intel_pstate_driver_cleanup();
}
if (size == 6 && !strncmp(buf, "active", size)) {
@@ -2792,9 +2782,7 @@ static int intel_pstate_update_status(const char *buf, size_t size)
if (intel_pstate_driver == &intel_pstate)
return 0;
- ret = intel_pstate_unregister_driver();
- if (ret)
- return ret;
+ cpufreq_unregister_driver(intel_pstate_driver);
}
return intel_pstate_register_driver(&intel_pstate);
@@ -2805,9 +2793,8 @@ static int intel_pstate_update_status(const char *buf, size_t size)
if (intel_pstate_driver == &intel_cpufreq)
return 0;
- ret = intel_pstate_unregister_driver();
- if (ret)
- return ret;
+ cpufreq_unregister_driver(intel_pstate_driver);
+ intel_pstate_sysfs_hide_hwp_dynamic_boost();
}
return intel_pstate_register_driver(&intel_cpufreq);
--
2.26.2
^ permalink raw reply related [flat|nested] 9+ messages in thread
* Re: [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities
2020-08-27 15:08 [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Rafael J. Wysocki
` (4 preceding siblings ...)
2020-08-27 15:27 ` [PATCH v3 5/5] cpufreq: intel_pstate: Free memory only when turning off Rafael J. Wysocki
@ 2020-08-27 19:52 ` Srinivas Pandruvada
5 siblings, 0 replies; 9+ messages in thread
From: Srinivas Pandruvada @ 2020-08-27 19:52 UTC (permalink / raw)
To: Rafael J. Wysocki, Linux PM; +Cc: LKML, Doug Smythies, Artem Bityutskiy
[-- Attachment #1: Type: text/plain, Size: 8487 bytes --]
On Thu, 2020-08-27 at 17:08 +0200, Rafael J. Wysocki wrote:
> Hi All,
>
> The v3 is here to address feedback from Srinivas and Doug, and Artem
> concerns
> regarding the EPP sysfs interface changes.
>
> The purpose of this series is to address some peculiarities related
> to
> taking CPUs offline/online and switching between different operation
> modes with HWP enabled that have become visible after allowing the
> driver to work in the passive mode with HWP enabled in 5.9-rc1 (and
> one that was there earlier, but can be addressed easily after the
> changes made in 5.9-rc1).
>
> Please refer to the patch changelogs for details.
>
> For easier testing/review, the series is available from the git
> branch at:
>
> git://git.kernel.org/pub/scm/linux/kernel/git/rafael/linux-pm.git \
> intel_pstate-testing
>
> I've done my best to address all of the possible corner cases, but
> the test
> matrix is quite extensive and I may have missed something, so go
> ahead
> and test.
Unchecked MSR access (attached dmesg) then all HWP settings goes to 0s
except CPU 0 after resume after S3.
Full log of my console (full copy paste)
[labuser@otcpl-perf-test-skx-i9 ~]$ sudo -s
[root@otcpl-perf-test-skx-i9 labuser]# cd
/sys/devices/system/cpu/intel_pstate/
[root@otcpl-perf-test-skx-i9 intel_pstate]# grep . *
hwp_dynamic_boost:0
max_perf_pct:100
min_perf_pct:27
no_turbo:0
num_pstates:32
status:active
turbo_pct:32
[root@otcpl-perf-test-skx-i9 intel_pstate]# cd ../cpu0/cpufreq/
[root@otcpl-perf-test-skx-i9 cpufreq]# grep . *
affected_cpus:0
base_frequency:3300000
cpuinfo_max_freq:4300000
cpuinfo_min_freq:1200000
cpuinfo_transition_latency:0
energy_performance_available_preferences:default performance
balance_performance balance_power power
energy_performance_preference:balance_performance
related_cpus:0
scaling_available_governors:performance powersave
scaling_cur_freq:1199695
scaling_driver:intel_pstate
scaling_governor:powersave
scaling_max_freq:4300000
scaling_min_freq:1200000
scaling_setspeed:<unsupported>
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -a 0x771
70c212b
70c212b
70c212b
70c212d
70c212b
70c212b
70c212b
70c212b
70c212b
70c212d
70c212b
70c212b
70c212b
70c212d
70c212b
70c212b
70c212b
70c212b
70c212b
70c212d
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -a 0x774
80002b0c
80002b0c
80002b0c
80002d0c
80002b0c
80002b0c
80002b0c
80002b0c
80002b0c
80002d0c
80002b0c
80002b0c
80002b0c
80002d0c
80002b0c
80002b0c
80002b0c
80002b0c
80002b0c
80002d0d
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 4000000 > scaling_max_freq
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 9x774
rdmsr: CPU 0 cannot read MSR 0x00000009
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 0x774
8000280c
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 4200000 > scaling_max_freq
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 0x774
80002a0c
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 4300000 > scaling_max_freq
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 0x774
80002b0c
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 4000000 > scaling_max_freq
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 0x774
8000280c
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 127 >
energy_performance_preference
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 0x774
7f00280c
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 0 > ../../
cpu0/ cpu13/ cpu18/ cpu5/ cpu
freq/ kernel_max online uevent
cpu1/ cpu14/ cpu19/ cpu6/ cpu
idle/ microcode/ possible vulnerabilities/
cpu10/ cpu15/ cpu2/ cpu7/ hot
plug/ modalias power/
cpu11/ cpu16/ cpu3/ cpu8/ int
el_pstate/ nohz_full present
cpu12/ cpu17/ cpu4/ cpu9/ iso
lated offline smt/
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 0 > ../
acpi_cppc/ cpuidle/ driver/ microcode/
subsystem/ uevent
cache/ crash_notes firmware_node/ node0/
thermal_throttle/
cpufreq/ crash_notes_size hotplug/ power/
topology/
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 128 >
energy_performance_preference
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 4300000 > scaling_max_freq
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 0x774
80002b0c
[root@otcpl-perf-test-skx-i9 cpufreq]# cd ../../cpu1
cpu1/ cpu10/ cpu11/ cpu12/ cpu13/ cpu14/ cpu15/ cpu16/ cpu17/ cpu18/
cpu19/
[root@otcpl-perf-test-skx-i9 cpufreq]# cd ../../cpu1
[root@otcpl-perf-test-skx-i9 cpu1]# cd cpufreq/
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 0x774
80002b0c
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 127 >
energy_performance_preference
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 4000000 > scaling_max_freq
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 0 0x774
80002b0c
[root@otcpl-perf-test-skx-i9 cpufreq]# cat scaling_max_freq
4000000
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 1 0x774
7f00280c
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 0 > ../online
bash: ../online: Permission denied
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 0 > ../online
affected_cpus energy_performance_available_
preferences scaling_driver
base_frequency energy_performance_preference
scaling_governor
cpuinfo_max_freq related_cpus
scaling_max_freq
cpuinfo_min_freq scaling_available_governors
scaling_min_freq
cpuinfo_transition_latency scaling_cur_freq
scaling_setspeed
[root@otcpl-perf-test-skx-i9 cpufreq]# cat ../
cat: ../: Is a directory
[root@otcpl-perf-test-skx-i9 cpufreq]# cat ../online
cat: ../online: No such file or directory
[root@otcpl-perf-test-skx-i9 cpufreq]# ls ../../
cpu0 cpu11 cpu14 cpu17 cpu2 cpu5 cpu8 cpuidle isolated
modalias online present vulnerabilities
cpu1 cpu12 cpu15 cpu18 cpu3 cpu6 cpu9 hotplug kernel_m
ax nohz_full possible smt
cpu10 cpu13 cpu16 cpu19 cpu4 cpu7 cpufreq intel_pstate microcod
e offline power uevent
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 0 > ../../cpu1
cpu1/ cpu10/ cpu11/ cpu12/ cpu13/ cpu14/ cpu15/ cpu16/ cpu17/ cpu18/
cpu19/
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 0 > ../../cpu1/online
[root@otcpl-perf-test-skx-i9 cpufreq]# echo 1 > ../../cpu1/online
[root@otcpl-perf-test-skx-i9 cpufreq]# dmesg | tail
[ 626.188805] intel_pstate: CPU 1 stopping
[ 626.188808] intel_pstate: CPU 1 going offline
[ 626.205589] smpboot: CPU 1 is now offline
[ 633.671812] x86: Booting SMP configuration:
[ 633.671815] smpboot: Booting Node 0 Processor 1 APIC 0x2
[ 633.677208] intel_pstate: CPU 1 going online
[ 633.677253] intel_pstate: set_policy cpuinfo.max 4300000 policy->max
4000000
[ 633.677259] intel_pstate: cpu:1 max_state 43 min_policy_perf:12
max_policy_perf:40
[ 633.677260] intel_pstate: cpu:1 global_min:12 global_max:43
[ 633.677262] intel_pstate: cpu:1 max_perf_ratio:40 min_perf_ratio:12
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 1 0x774
7f00280c
[root@otcpl-perf-test-skx-i9 cpufreq]# rtcwake -m mem -s 10
rtcwake: wakeup from "mem" using /dev/rtc0 at Thu Aug 27 19:42:51 2020
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -p 1 0x774
0
[root@otcpl-perf-test-skx-i9 cpufreq]# grep . *
affected_cpus:1
base_frequency:3300000
cpuinfo_max_freq:4300000
cpuinfo_min_freq:1200000
cpuinfo_transition_latency:0
energy_performance_available_preferences:default performance
balance_performance balance_power power
energy_performance_preference:performance
related_cpus:1
scaling_available_governors:performance powersave
scaling_cur_freq:699896
scaling_driver:intel_pstate
scaling_governor:powersave
scaling_max_freq:4000000
scaling_min_freq:1200000
scaling_setspeed:<unsupported>
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -a 0x774
80002b0c
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
[root@otcpl-perf-test-skx-i9 cpufreq]# dmesg > /tmp/dmesg.txt
[root@otcpl-perf-test-skx-i9 cpufreq]# vi /tmp/dmesg.txt
[root@otcpl-perf-test-skx-i9 cpufreq]# rdmsr -a 0x774
80002b0c
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
[root@otcpl-perf-test-skx-i9 cpufreq]#
Thanks,
Srinivas
>
> Thanks,
> Rafael
>
>
>
[-- Attachment #2: dmesg_08_27.txt --]
[-- Type: text/plain, Size: 118159 bytes --]
[ 0.000000] microcode: microcode updated early to revision 0x200005e, date = 2019-04-02
[ 0.000000] Linux version 5.9.0-rc2+ (labuser@otcpl-perf-test-skx-i9) (gcc (GCC) 8.3.1 20190223 (Red Hat 8.3.1-2), GNU ld version 2.29.1-23.fc28) #3 SMP Thu Aug 27 12:28:34 PDT 2020
[ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-5.9.0-rc2+ root=/dev/mapper/fedora-root ro rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet "dyndbg=file intel_pstate.c +p" 3 LANG=en_US.UTF-8
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x010: 'MPX CSR'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: xstate_offset[3]: 832, xstate_sizes[3]: 64
[ 0.000000] x86/fpu: xstate_offset[4]: 896, xstate_sizes[4]: 64
[ 0.000000] x86/fpu: xstate_offset[5]: 960, xstate_sizes[5]: 64
[ 0.000000] x86/fpu: xstate_offset[6]: 1024, xstate_sizes[6]: 512
[ 0.000000] x86/fpu: xstate_offset[7]: 1536, xstate_sizes[7]: 1024
[ 0.000000] x86/fpu: Enabled xstate features 0xff, context size is 2560 bytes, using 'compacted' format.
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009d7ff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009d800-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003542afff] usable
[ 0.000000] BIOS-e820: [mem 0x000000003542b000-0x0000000036425fff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000036426000-0x000000003680cfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000003680d000-0x0000000037641fff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x0000000037642000-0x0000000038518fff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000038519000-0x000000004fffffff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000050000000-0x000000006fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fe000000-0x00000000fe010fff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed00fff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000089fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 3.0.0 present.
[ 0.000000] DMI: Gigabyte Technology Co., Ltd. X299 AORUS Gaming 3 Pro/X299 AORUS Gaming 3 Pro-CF, BIOS F3 12/28/2017
[ 0.000000] tsc: Detected 3300.000 MHz processor
[ 0.000000] tsc: Detected 3299.994 MHz TSC
[ 0.000000] [Firmware Bug]: TSC ADJUST: CPU0: -625416065048012 force to 0
[ 0.000382] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000383] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000386] last_pfn = 0x8a0000 max_arch_pfn = 0x400000000
[ 0.000389] MTRR default type: uncachable
[ 0.000389] MTRR fixed ranges enabled:
[ 0.000390] 00000-9FFFF write-back
[ 0.000390] A0000-BFFFF uncachable
[ 0.000390] C0000-FFFFF write-protect
[ 0.000391] MTRR variable ranges enabled:
[ 0.000392] 0 base 000000000000 mask 3FF800000000 write-back
[ 0.000392] 1 base 000800000000 mask 3FFF80000000 write-back
[ 0.000393] 2 base 000880000000 mask 3FFFE0000000 write-back
[ 0.000393] 3 base 000060000000 mask 3FFFE0000000 uncachable
[ 0.000394] 4 base 000080000000 mask 3FFF80000000 uncachable
[ 0.000394] 5 base 00005F000000 mask 3FFFFF000000 uncachable
[ 0.000394] 6 disabled
[ 0.000394] 7 disabled
[ 0.000395] 8 disabled
[ 0.000395] 9 disabled
[ 0.000846] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.000985] e820: update [mem 0x5f000000-0xffffffff] usable ==> reserved
[ 0.000988] last_pfn = 0x50000 max_arch_pfn = 0x400000000
[ 0.006155] found SMP MP-table at [mem 0x000fcf60-0x000fcf6f]
[ 0.006210] Using GB pages for direct mapping
[ 0.006339] RAMDISK: [mem 0x23c1d000-0x2de06fff]
[ 0.006344] ACPI: Early table checksum verification disabled
[ 0.006346] ACPI: RSDP 0x00000000000F05B0 000024 (v02 ALASKA)
[ 0.006348] ACPI: XSDT 0x000000003680D0D0 000124 (v01 ALASKA A M I 01072009 AMI 00010013)
[ 0.006351] ACPI: FACP 0x000000003682CA20 000114 (v06 ALASKA A M I 01072009 AMI 00010013)
[ 0.006354] ACPI: DSDT 0x000000003680D290 01F78F (v02 ALASKA A M I 01072009 INTL 20160422)
[ 0.006356] ACPI: FACS 0x000000003763F080 000040
[ 0.006357] ACPI: FPDT 0x000000003682CB38 000044 (v01 ALASKA A M I 01072009 AMI 00010013)
[ 0.006358] ACPI: FIDT 0x000000003682CB80 00009C (v01 ALASKA A M I 01072009 AMI 00010013)
[ 0.006360] ACPI: SSDT 0x000000003682CC20 007A4A (v01 GBT GSWApp 00000001 INTL 20160422)
[ 0.006362] ACPI: UEFI 0x0000000036834670 000042 (v01 ALASKA A M I 00000002 01000013)
[ 0.006363] ACPI: MCFG 0x00000000368346B8 00003C (v01 ALASKA A M I 01072009 MSFT 00000097)
[ 0.006364] ACPI: HPET 0x00000000368346F8 000038 (v01 ALASKA A M I 00000001 INTL 20091013)
[ 0.006366] ACPI: APIC 0x0000000036834730 00071E (v03 ALASKA A M I 00000000 INTL 20091013)
[ 0.006367] ACPI: MCFG 0x0000000036834E50 00003C (v01 ALASKA A M I 00000001 INTL 20091013)
[ 0.006368] ACPI: MIGT 0x0000000036834E90 000040 (v01 ALASKA A M I 00000000 INTL 20091013)
[ 0.006370] ACPI: MSCT 0x0000000036834ED0 00004E (v01 ALASKA A M I 00000001 INTL 20091013)
[ 0.006371] ACPI: PCCT 0x0000000036834F20 00006E (v01 ALASKA A M I 00000002 INTL 20091013)
[ 0.006372] ACPI: RASF 0x0000000036834F90 000030 (v01 ALASKA A M I 00000001 INTL 20091013)
[ 0.006374] ACPI: SLIT 0x0000000036834FC0 00006C (v01 ALASKA A M I 00000001 INTL 20091013)
[ 0.006375] ACPI: SRAT 0x0000000036835030 000A30 (v03 ALASKA A M I 00000002 INTL 20091013)
[ 0.006377] ACPI: SVOS 0x0000000036835A60 000032 (v01 ALASKA A M I 00000000 INTL 20091013)
[ 0.006378] ACPI: WDDT 0x0000000036835A98 000040 (v01 ALASKA A M I 00000000 INTL 20091013)
[ 0.006379] ACPI: OEM4 0x0000000036835AD8 029A72 (v02 INTEL CPU CST 00003000 INTL 20160422)
[ 0.006381] ACPI: OEM1 0x000000003685F550 00ABCB (v02 INTEL CPU EIST 00003000 INTL 20160422)
[ 0.006382] ACPI: OEM2 0x000000003686A120 006AB0 (v02 INTEL CPU HWP 00003000 INTL 20160422)
[ 0.006384] ACPI: SSDT 0x0000000036870BD0 00D427 (v02 INTEL SSDT PM 00004000 INTL 20160422)
[ 0.006385] ACPI: NITR 0x000000003687DFF8 000071 (v02 ALASKA A M I 00000001 INTL 20091013)
[ 0.006387] ACPI: SSDT 0x000000003687E070 000956 (v02 ALASKA A M I 00000000 INTL 20091013)
[ 0.006388] ACPI: LPIT 0x000000003687E9C8 000094 (v01 INTEL SKL 00000000 MSFT 0000005F)
[ 0.006390] ACPI: WSMT 0x000000003687EA60 000028 (v01 INTEL SKL 00000000 MSFT 0000005F)
[ 0.006391] ACPI: WDAT 0x000000003687EA88 000134 (v01 INTEL SKL 00000000 MSFT 0000005F)
[ 0.006393] ACPI: SSDT 0x000000003687EBC0 00029F (v02 INTEL sensrhub 00000000 INTL 20160422)
[ 0.006394] ACPI: SSDT 0x000000003687EE60 003002 (v02 INTEL PtidDevc 00001000 INTL 20160422)
[ 0.006396] ACPI: DBGP 0x0000000036881E68 000034 (v01 INTEL 00000002 MSFT 0000005F)
[ 0.006397] ACPI: DBG2 0x0000000036881EA0 000054 (v00 INTEL 00000002 MSFT 0000005F)
[ 0.006399] ACPI: DMAR 0x0000000036881EF8 0000D8 (v01 ALASKA A M I 00000001 INTL 20091013)
[ 0.006400] ACPI: WSMT 0x0000000036881FD0 000028 (v01 ALASKA A M I 01072009 AMI 00010013)
[ 0.006406] ACPI: Local APIC address 0xfee00000
[ 0.006432] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.006433] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.006433] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.006433] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.006433] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.006434] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.006434] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.006434] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.006435] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.006435] SRAT: PXM 0 -> APIC 0x18 -> Node 0
[ 0.006435] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[ 0.006436] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[ 0.006436] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[ 0.006436] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[ 0.006436] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[ 0.006437] SRAT: PXM 0 -> APIC 0x11 -> Node 0
[ 0.006437] SRAT: PXM 0 -> APIC 0x13 -> Node 0
[ 0.006437] SRAT: PXM 0 -> APIC 0x15 -> Node 0
[ 0.006438] SRAT: PXM 0 -> APIC 0x17 -> Node 0
[ 0.006438] SRAT: PXM 0 -> APIC 0x19 -> Node 0
[ 0.006441] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0xffffffff]
[ 0.006442] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x89fffffff]
[ 0.006447] NUMA: Initialized distance table, cnt=1
[ 0.006448] NUMA: Node 0 [mem 0x00000000-0xffffffff] + [mem 0x100000000-0x89fffffff] -> [mem 0x00000000-0x89fffffff]
[ 0.006453] NODE_DATA(0) allocated [mem 0x89ffd4000-0x89fffefff]
[ 0.046730] Zone ranges:
[ 0.046731] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.046732] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.046732] Normal [mem 0x0000000100000000-0x000000089fffffff]
[ 0.046733] Device empty
[ 0.046734] Movable zone start for each node
[ 0.046736] Early memory node ranges
[ 0.046736] node 0: [mem 0x0000000000001000-0x000000000009cfff]
[ 0.046737] node 0: [mem 0x0000000000100000-0x000000003542afff]
[ 0.046737] node 0: [mem 0x0000000036426000-0x000000003680cfff]
[ 0.046737] node 0: [mem 0x0000000038519000-0x000000004fffffff]
[ 0.046738] node 0: [mem 0x0000000100000000-0x000000089fffffff]
[ 0.046823] Zeroed struct page in unavailable ranges: 11627 pages
[ 0.046824] Initmem setup node 0 [mem 0x0000000000001000-0x000000089fffffff]
[ 0.046825] On node 0 totalpages: 8311445
[ 0.046826] DMA zone: 64 pages used for memmap
[ 0.046826] DMA zone: 21 pages reserved
[ 0.046827] DMA zone: 3996 pages, LIFO batch:0
[ 0.046840] DMA32 zone: 4876 pages used for memmap
[ 0.046840] DMA32 zone: 312057 pages, LIFO batch:63
[ 0.047997] Normal zone: 124928 pages used for memmap
[ 0.047997] Normal zone: 7995392 pages, LIFO batch:63
[ 0.087737] ACPI: PM-Timer IO Port: 0x1808
[ 0.087738] ACPI: Local APIC address 0xfee00000
[ 0.087745] ACPI: X2APIC_NMI (uid[0xffffffff] high level lint[0x1])
[ 0.087746] ACPI: LAPIC_NMI (acpi_id[0xff] high level lint[0x1])
[ 0.087772] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 0.087775] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-31
[ 0.087779] IOAPIC[2]: apic_id 10, version 32, address 0xfec08000, GSI 32-39
[ 0.087782] IOAPIC[3]: apic_id 11, version 32, address 0xfec10000, GSI 40-47
[ 0.087785] IOAPIC[4]: apic_id 12, version 32, address 0xfec18000, GSI 48-55
[ 0.087787] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.087787] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.087788] ACPI: IRQ0 used by override.
[ 0.087789] ACPI: IRQ9 used by override.
[ 0.087790] Using ACPI (MADT) for SMP configuration information
[ 0.087791] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[ 0.087793] TSC deadline timer available
[ 0.087793] smpboot: Allowing 20 CPUs, 0 hotplug CPUs
[ 0.087802] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.087803] PM: hibernation: Registered nosave memory: [mem 0x0009d000-0x0009dfff]
[ 0.087803] PM: hibernation: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[ 0.087804] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.087804] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.087805] PM: hibernation: Registered nosave memory: [mem 0x3542b000-0x36425fff]
[ 0.087805] PM: hibernation: Registered nosave memory: [mem 0x3680d000-0x37641fff]
[ 0.087806] PM: hibernation: Registered nosave memory: [mem 0x37642000-0x38518fff]
[ 0.087806] PM: hibernation: Registered nosave memory: [mem 0x50000000-0x6fffffff]
[ 0.087807] PM: hibernation: Registered nosave memory: [mem 0x70000000-0xfdffffff]
[ 0.087807] PM: hibernation: Registered nosave memory: [mem 0xfe000000-0xfe010fff]
[ 0.087807] PM: hibernation: Registered nosave memory: [mem 0xfe011000-0xfebfffff]
[ 0.087808] PM: hibernation: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[ 0.087808] PM: hibernation: Registered nosave memory: [mem 0xfec01000-0xfecfffff]
[ 0.087808] PM: hibernation: Registered nosave memory: [mem 0xfed00000-0xfed00fff]
[ 0.087809] PM: hibernation: Registered nosave memory: [mem 0xfed01000-0xfedfffff]
[ 0.087809] PM: hibernation: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[ 0.087809] PM: hibernation: Registered nosave memory: [mem 0xfee01000-0xfeffffff]
[ 0.087809] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff]
[ 0.087811] [mem 0x70000000-0xfdffffff] available for PCI devices
[ 0.087811] Booting paravirtualized kernel on bare hardware
[ 0.087813] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[ 0.091202] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:20 nr_node_ids:1
[ 0.091660] percpu: Embedded 54 pages/cpu s184320 r8192 d28672 u262144
[ 0.091664] pcpu-alloc: s184320 r8192 d28672 u262144 alloc=1*2097152
[ 0.091665] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15
[ 0.091667] pcpu-alloc: [0] 16 17 18 19 -- -- -- --
[ 0.091683] Built 1 zonelists, mobility grouping on. Total pages: 8181556
[ 0.091683] Policy zone: Normal
[ 0.091684] Kernel command line: BOOT_IMAGE=/vmlinuz-5.9.0-rc2+ root=/dev/mapper/fedora-root ro rd.lvm.lv=fedora/root rd.lvm.lv=fedora/swap rhgb quiet "dyndbg=file intel_pstate.c +p" 3 LANG=en_US.UTF-8
[ 0.093203] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear)
[ 0.093890] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear)
[ 0.094001] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.149737] Memory: 32404944K/33245780K available (14339K kernel code, 1590K rwdata, 4692K rodata, 2216K init, 4284K bss, 840576K reserved, 0K cma-reserved)
[ 0.149743] random: get_random_u64 called from __kmem_cache_create+0x2e/0x430 with crng_init=0
[ 0.149833] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=20, Nodes=1
[ 0.149842] Kernel/User page tables isolation: enabled
[ 0.149859] ftrace: allocating 42894 entries in 168 pages
[ 0.161222] ftrace: allocated 168 pages with 3 groups
[ 0.161324] rcu: Hierarchical RCU implementation.
[ 0.161324] rcu: RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=20.
[ 0.161325] Trampoline variant of Tasks RCU enabled.
[ 0.161325] Rude variant of Tasks RCU enabled.
[ 0.161326] Tracing variant of Tasks RCU enabled.
[ 0.161326] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[ 0.161327] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=20
[ 0.163336] NR_IRQS: 4352, nr_irqs: 1128, preallocated irqs: 16
[ 0.163510] rcu: Offload RCU callbacks from CPUs: (none).
[ 0.163635] random: crng done (trusting CPU's manufacturer)
[ 0.167256] Console: colour VGA+ 80x25
[ 0.167261] printk: console [tty0] enabled
[ 0.167277] ACPI: Core revision 20200717
[ 0.167613] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635855245 ns
[ 0.167679] APIC: Switch to symmetric I/O mode setup
[ 0.167681] DMAR: Host address width 46
[ 0.167681] DMAR: DRHD base: 0x000000b5ffc000 flags: 0x0
[ 0.167685] DMAR: dmar0: reg_base_addr b5ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[ 0.167686] DMAR: DRHD base: 0x000000d8ffc000 flags: 0x0
[ 0.167689] DMAR: dmar1: reg_base_addr d8ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[ 0.167690] DMAR: DRHD base: 0x000000fbffc000 flags: 0x0
[ 0.167692] DMAR: dmar2: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[ 0.167693] DMAR: DRHD base: 0x00000092ffc000 flags: 0x1
[ 0.167695] DMAR: dmar3: reg_base_addr 92ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[ 0.167696] DMAR: RMRR base: 0x00000037639000 end: 0x0000003763bfff
[ 0.167697] DMAR: [Firmware Bug]: No firmware reserved region can cover this RMRR [0x0000000037639000-0x000000003763bfff], contact BIOS vendor for fixes
[ 0.167698] DMAR: [Firmware Bug]: Your BIOS is broken; bad RMRR [0x0000000037639000-0x000000003763bfff]
BIOS vendor: American Megatrends Inc.; Ver: F3; Product Version: Default string
[ 0.167699] DMAR: ATSR flags: 0x0
[ 0.167700] DMAR-IR: IOAPIC id 12 under DRHD base 0xfbffc000 IOMMU 2
[ 0.167701] DMAR-IR: IOAPIC id 11 under DRHD base 0xd8ffc000 IOMMU 1
[ 0.167701] DMAR-IR: IOAPIC id 10 under DRHD base 0xb5ffc000 IOMMU 0
[ 0.167702] DMAR-IR: IOAPIC id 8 under DRHD base 0x92ffc000 IOMMU 3
[ 0.167702] DMAR-IR: IOAPIC id 9 under DRHD base 0x92ffc000 IOMMU 3
[ 0.167703] DMAR-IR: HPET id 0 under DRHD base 0x92ffc000
[ 0.167703] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[ 0.167704] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[ 0.168484] DMAR-IR: Enabled IRQ remapping in xapic mode
[ 0.168484] x2apic: IRQ remapping doesn't support X2APIC mode
[ 0.168494] Switched APIC routing to physical flat.
[ 0.169618] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.173675] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2f9146cb80a, max_idle_ns: 440795296911 ns
[ 0.173679] Calibrating delay loop (skipped), value calculated using timer frequency.. 6599.98 BogoMIPS (lpj=3299994)
[ 0.173680] pid_max: default: 32768 minimum: 301
[ 0.173708] LSM: Security Framework initializing
[ 0.173715] Yama: becoming mindful.
[ 0.173722] SELinux: Initializing.
[ 0.173780] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[ 0.173821] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[ 0.174031] mce: CPU0: Thermal monitoring enabled (TM1)
[ 0.174071] process: using mwait in idle threads
[ 0.174073] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8
[ 0.174073] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[ 0.174075] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[ 0.174076] Spectre V2 : Mitigation: Full generic retpoline
[ 0.174077] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[ 0.174077] Spectre V2 : Enabling Restricted Speculation for firmware calls
[ 0.174078] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[ 0.174078] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl
[ 0.174079] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[ 0.174081] TAA: Mitigation: Clear CPU buffers
[ 0.174081] MDS: Mitigation: Clear CPU buffers
[ 0.174256] Freeing SMP alternatives memory: 40K
[ 0.175544] smpboot: CPU0: Intel(R) Core(TM) i9-7900X CPU @ 3.30GHz (family: 0x6, model: 0x55, stepping: 0x4)
[ 0.175617] Performance Events: PEBS fmt3+, Skylake events, 32-deep LBR, full-width counters, Intel PMU driver.
[ 0.175628] ... version: 4
[ 0.175628] ... bit width: 48
[ 0.175628] ... generic registers: 4
[ 0.175629] ... value mask: 0000ffffffffffff
[ 0.175629] ... max period: 00007fffffffffff
[ 0.175629] ... fixed-purpose events: 3
[ 0.175630] ... event mask: 000000070000000f
[ 0.175660] rcu: Hierarchical SRCU implementation.
[ 0.175816] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[ 0.175922] smp: Bringing up secondary CPUs ...
[ 0.175971] x86: Booting SMP configuration:
[ 0.175972] .... node #0, CPUs: #1
[ 0.005074] [Firmware Bug]: TSC ADJUST differs within socket(s), fixing all errors
[ 0.179729] #2 #3 #4 #5 #6 #7 #8 #9 #10
[ 0.209787] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.
[ 0.209787] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details.
[ 0.209787] #11 #12 #13 #14 #15 #16 #17 #18 #19
[ 0.219209] smp: Brought up 1 node, 20 CPUs
[ 0.219209] smpboot: Max logical packages: 1
[ 0.219209] smpboot: Total of 20 processors activated (131999.76 BogoMIPS)
[ 0.220381] devtmpfs: initialized
[ 0.220381] x86/mm: Memory block size: 128MB
[ 0.221708] PM: Registering ACPI NVS region [mem 0x3680d000-0x37641fff] (14897152 bytes)
[ 0.221891] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[ 0.221891] futex hash table entries: 8192 (order: 7, 524288 bytes, linear)
[ 0.221891] pinctrl core: initialized pinctrl subsystem
[ 0.221951] PM: RTC time: 19:31:43, date: 2020-08-27
[ 0.222041] NET: Registered protocol family 16
[ 0.222122] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[ 0.222129] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[ 0.222136] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[ 0.222140] audit: initializing netlink subsys (disabled)
[ 0.222144] audit: type=2000 audit(1598556703.054:1): state=initialized audit_enabled=0 res=1
[ 0.222144] thermal_sys: Registered thermal governor 'fair_share'
[ 0.222144] thermal_sys: Registered thermal governor 'bang_bang'
[ 0.222144] thermal_sys: Registered thermal governor 'step_wise'
[ 0.222144] thermal_sys: Registered thermal governor 'user_space'
[ 0.222144] cpuidle: using governor menu
[ 0.222144] Detected 1 PCC Subspaces
[ 0.222144] Registering PCC driver as Mailbox controller
[ 0.222144] ACPI: bus type PCI registered
[ 0.222144] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 0.222144] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x60000000-0x6fffffff] (base 0x60000000)
[ 0.222144] PCI: MMCONFIG at [mem 0x60000000-0x6fffffff] reserved in E820
[ 0.222144] pmd_set_huge: Cannot satisfy [mem 0x60000000-0x60200000] with a huge-page mapping due to MTRR override.
[ 0.222144] PCI: Using configuration type 1 for base access
[ 0.222679] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[ 0.223863] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[ 0.223863] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[ 0.307700] cryptd: max_cpu_qlen set to 1000
[ 0.308871] alg: No test for 842 (842-generic)
[ 0.308871] alg: No test for 842 (842-scomp)
[ 0.310782] ACPI: Added _OSI(Module Device)
[ 0.310782] ACPI: Added _OSI(Processor Device)
[ 0.310782] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.310782] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.310782] ACPI: Added _OSI(Linux-Dell-Video)
[ 0.310782] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[ 0.310782] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[ 0.326978] ACPI: 6 ACPI AML tables successfully acquired and loaded
[ 0.340099] ACPI: Dynamic OEM Table Load:
[ 0.343471] ACPI: Dynamic OEM Table Load:
[ 0.345523] ACPI: Dynamic OEM Table Load:
[ 0.366328] ACPI: Interpreter enabled
[ 0.366344] ACPI: (supports S0 S3 S4 S5)
[ 0.366344] ACPI: Using IOAPIC for interrupt routing
[ 0.366359] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.366677] ACPI: Enabled 9 GPEs in block 00 to 7F
[ 0.376826] ACPI BIOS Error (bug): Could not resolve symbol [\SHAD._STA.SDS0], AE_NOT_FOUND (20200717/psargs-330)
[ 0.376829] ACPI Error: Aborting method \SHAD._STA due to previous error (AE_NOT_FOUND) (20200717/psparse-531)
[ 0.379248] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-15])
[ 0.379251] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[ 0.379325] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR]
[ 0.379393] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 0.379804] PCI host bridge to bus 0000:00
[ 0.379805] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 0.379805] pci_bus 0000:00: root bus resource [io 0x1000-0x3fff window]
[ 0.379806] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[ 0.379807] pci_bus 0000:00: root bus resource [mem 0xfe010000-0xfe010fff window]
[ 0.379807] pci_bus 0000:00: root bus resource [mem 0x70000000-0x92ffffff window]
[ 0.379808] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x3800ffffffff window]
[ 0.379808] pci_bus 0000:00: root bus resource [bus 00-15]
[ 0.379821] pci 0000:00:00.0: [8086:2020] type 00 class 0x060000
[ 0.379954] pci 0000:00:04.0: [8086:2021] type 00 class 0x088000
[ 0.379961] pci 0000:00:04.0: reg 0x10: [mem 0x92f64000-0x92f67fff 64bit]
[ 0.380069] pci 0000:00:04.1: [8086:2021] type 00 class 0x088000
[ 0.380075] pci 0000:00:04.1: reg 0x10: [mem 0x92f60000-0x92f63fff 64bit]
[ 0.380181] pci 0000:00:04.2: [8086:2021] type 00 class 0x088000
[ 0.380187] pci 0000:00:04.2: reg 0x10: [mem 0x92f5c000-0x92f5ffff 64bit]
[ 0.380292] pci 0000:00:04.3: [8086:2021] type 00 class 0x088000
[ 0.380299] pci 0000:00:04.3: reg 0x10: [mem 0x92f58000-0x92f5bfff 64bit]
[ 0.380405] pci 0000:00:04.4: [8086:2021] type 00 class 0x088000
[ 0.380412] pci 0000:00:04.4: reg 0x10: [mem 0x92f54000-0x92f57fff 64bit]
[ 0.380515] pci 0000:00:04.5: [8086:2021] type 00 class 0x088000
[ 0.380522] pci 0000:00:04.5: reg 0x10: [mem 0x92f50000-0x92f53fff 64bit]
[ 0.380627] pci 0000:00:04.6: [8086:2021] type 00 class 0x088000
[ 0.380634] pci 0000:00:04.6: reg 0x10: [mem 0x92f4c000-0x92f4ffff 64bit]
[ 0.380739] pci 0000:00:04.7: [8086:2021] type 00 class 0x088000
[ 0.380745] pci 0000:00:04.7: reg 0x10: [mem 0x92f48000-0x92f4bfff 64bit]
[ 0.380850] pci 0000:00:05.0: [8086:2024] type 00 class 0x088000
[ 0.380949] pci 0000:00:05.2: [8086:2025] type 00 class 0x088000
[ 0.381042] pci 0000:00:05.4: [8086:2026] type 00 class 0x080020
[ 0.381047] pci 0000:00:05.4: reg 0x10: [mem 0x92f6e000-0x92f6efff]
[ 0.381144] pci 0000:00:08.0: [8086:2014] type 00 class 0x088000
[ 0.381232] pci 0000:00:08.1: [8086:2015] type 00 class 0x110100
[ 0.381305] pci 0000:00:08.2: [8086:2016] type 00 class 0x088000
[ 0.381403] pci 0000:00:14.0: [8086:a2af] type 00 class 0x0c0330
[ 0.381417] pci 0000:00:14.0: reg 0x10: [mem 0x92f30000-0x92f3ffff 64bit]
[ 0.381467] pci 0000:00:14.0: PME# supported from D3hot D3cold
[ 0.381594] pci 0000:00:16.0: [8086:a2ba] type 00 class 0x078000
[ 0.381606] pci 0000:00:16.0: reg 0x10: [mem 0x92f6d000-0x92f6dfff 64bit]
[ 0.381664] pci 0000:00:16.0: PME# supported from D3hot
[ 0.381774] pci 0000:00:17.0: [8086:a282] type 00 class 0x010601
[ 0.381784] pci 0000:00:17.0: reg 0x10: [mem 0x92f68000-0x92f69fff]
[ 0.381789] pci 0000:00:17.0: reg 0x14: [mem 0x92f6c000-0x92f6c0ff]
[ 0.381795] pci 0000:00:17.0: reg 0x18: [io 0x3050-0x3057]
[ 0.381800] pci 0000:00:17.0: reg 0x1c: [io 0x3040-0x3043]
[ 0.381805] pci 0000:00:17.0: reg 0x20: [io 0x3020-0x303f]
[ 0.381810] pci 0000:00:17.0: reg 0x24: [mem 0x92f6b000-0x92f6b7ff]
[ 0.381840] pci 0000:00:17.0: PME# supported from D3hot
[ 0.381950] pci 0000:00:1b.0: [8086:a2e7] type 01 class 0x060400
[ 0.382009] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[ 0.382157] pci 0000:00:1c.0: [8086:a290] type 01 class 0x060400
[ 0.382216] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 0.382347] pci 0000:00:1c.4: [8086:a294] type 01 class 0x060400
[ 0.382400] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[ 0.382536] pci 0000:00:1d.0: [8086:a298] type 01 class 0x060400
[ 0.382641] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[ 0.382781] pci 0000:00:1f.0: [8086:a2d2] type 00 class 0x060100
[ 0.382950] pci 0000:00:1f.2: [8086:a2a1] type 00 class 0x058000
[ 0.382962] pci 0000:00:1f.2: reg 0x10: [mem 0x92f44000-0x92f47fff]
[ 0.383099] pci 0000:00:1f.3: [8086:a2f0] type 00 class 0x040300
[ 0.383113] pci 0000:00:1f.3: reg 0x10: [mem 0x92f40000-0x92f43fff 64bit]
[ 0.383134] pci 0000:00:1f.3: reg 0x20: [mem 0x92f20000-0x92f2ffff 64bit]
[ 0.383165] pci 0000:00:1f.3: PME# supported from D3hot D3cold
[ 0.383284] pci 0000:00:1f.4: [8086:a2a3] type 00 class 0x0c0500
[ 0.383340] pci 0000:00:1f.4: reg 0x10: [mem 0x92f6a000-0x92f6a0ff 64bit]
[ 0.383409] pci 0000:00:1f.4: reg 0x20: [io 0x3000-0x301f]
[ 0.383571] pci 0000:00:1f.6: [8086:15b8] type 00 class 0x020000
[ 0.383588] pci 0000:00:1f.6: reg 0x10: [mem 0x92f00000-0x92f1ffff]
[ 0.383683] pci 0000:00:1f.6: PME# supported from D0 D3hot D3cold
[ 0.383818] pci 0000:00:1b.0: PCI bridge to [bus 01]
[ 0.383857] pci 0000:00:1c.0: PCI bridge to [bus 02]
[ 0.383905] pci 0000:03:00.0: [1b21:2142] type 00 class 0x0c0330
[ 0.383923] pci 0000:03:00.0: reg 0x10: [mem 0x92e00000-0x92e07fff 64bit]
[ 0.383966] pci 0000:03:00.0: enabling Extended Tags
[ 0.384022] pci 0000:03:00.0: PME# supported from D0
[ 0.384101] pci 0000:00:1c.4: PCI bridge to [bus 03]
[ 0.384104] pci 0000:00:1c.4: bridge window [mem 0x92e00000-0x92efffff]
[ 0.384133] pci 0000:00:1d.0: PCI bridge to [bus 04]
[ 0.384155] pci_bus 0000:00: on NUMA node 0
[ 0.384620] ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 16-63])
[ 0.384622] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[ 0.384854] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER LTR]
[ 0.384982] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 0.385088] PCI host bridge to bus 0000:16
[ 0.385089] pci_bus 0000:16: root bus resource [io 0x4000-0x7fff window]
[ 0.385090] pci_bus 0000:16: root bus resource [mem 0x93000000-0xb5ffffff window]
[ 0.385090] pci_bus 0000:16: root bus resource [mem 0x380100000000-0x3801ffffffff window]
[ 0.385091] pci_bus 0000:16: root bus resource [bus 16-63]
[ 0.385099] pci 0000:16:05.0: [8086:2034] type 00 class 0x088000
[ 0.385161] pci 0000:16:05.2: [8086:2035] type 00 class 0x088000
[ 0.385219] pci 0000:16:05.4: [8086:2036] type 00 class 0x080020
[ 0.385224] pci 0000:16:05.4: reg 0x10: [mem 0xb5f00000-0xb5f00fff]
[ 0.385283] pci 0000:16:08.0: [8086:208d] type 00 class 0x088000
[ 0.385328] pci 0000:16:08.1: [8086:208d] type 00 class 0x088000
[ 0.385365] pci 0000:16:08.2: [8086:208d] type 00 class 0x088000
[ 0.385403] pci 0000:16:08.3: [8086:208d] type 00 class 0x088000
[ 0.385438] pci 0000:16:08.4: [8086:208d] type 00 class 0x088000
[ 0.385473] pci 0000:16:08.5: [8086:208d] type 00 class 0x088000
[ 0.385509] pci 0000:16:08.6: [8086:208d] type 00 class 0x088000
[ 0.385544] pci 0000:16:08.7: [8086:208d] type 00 class 0x088000
[ 0.385580] pci 0000:16:09.0: [8086:208d] type 00 class 0x088000
[ 0.385622] pci 0000:16:09.1: [8086:208d] type 00 class 0x088000
[ 0.385661] pci 0000:16:0e.0: [8086:208e] type 00 class 0x088000
[ 0.385705] pci 0000:16:0e.1: [8086:208e] type 00 class 0x088000
[ 0.385741] pci 0000:16:0e.2: [8086:208e] type 00 class 0x088000
[ 0.385776] pci 0000:16:0e.3: [8086:208e] type 00 class 0x088000
[ 0.385811] pci 0000:16:0e.4: [8086:208e] type 00 class 0x088000
[ 0.385847] pci 0000:16:0e.5: [8086:208e] type 00 class 0x088000
[ 0.385883] pci 0000:16:0e.6: [8086:208e] type 00 class 0x088000
[ 0.385918] pci 0000:16:0e.7: [8086:208e] type 00 class 0x088000
[ 0.385955] pci 0000:16:0f.0: [8086:208e] type 00 class 0x088000
[ 0.385998] pci 0000:16:0f.1: [8086:208e] type 00 class 0x088000
[ 0.386042] pci 0000:16:1d.0: [8086:2054] type 00 class 0x088000
[ 0.386085] pci 0000:16:1d.1: [8086:2055] type 00 class 0x088000
[ 0.386121] pci 0000:16:1d.2: [8086:2056] type 00 class 0x088000
[ 0.386157] pci 0000:16:1d.3: [8086:2057] type 00 class 0x088000
[ 0.386194] pci 0000:16:1e.0: [8086:2080] type 00 class 0x088000
[ 0.386238] pci 0000:16:1e.1: [8086:2081] type 00 class 0x088000
[ 0.386274] pci 0000:16:1e.2: [8086:2082] type 00 class 0x088000
[ 0.386311] pci 0000:16:1e.3: [8086:2083] type 00 class 0x088000
[ 0.386348] pci 0000:16:1e.4: [8086:2084] type 00 class 0x088000
[ 0.386384] pci 0000:16:1e.5: [8086:2085] type 00 class 0x088000
[ 0.386420] pci 0000:16:1e.6: [8086:2086] type 00 class 0x088000
[ 0.386457] pci_bus 0000:16: on NUMA node 0
[ 0.386513] ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 64-b1])
[ 0.386514] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[ 0.386736] acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug AER LTR]
[ 0.386855] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 0.386942] PCI host bridge to bus 0000:64
[ 0.386943] pci_bus 0000:64: root bus resource [mem 0x000a0000-0x000bffff window]
[ 0.386944] pci_bus 0000:64: root bus resource [io 0x8000-0xbfff window]
[ 0.386944] pci_bus 0000:64: root bus resource [io 0x03b0-0x03bb window]
[ 0.386945] pci_bus 0000:64: root bus resource [io 0x03c0-0x03df window]
[ 0.386946] pci_bus 0000:64: root bus resource [mem 0xb6000000-0xd8ffffff window]
[ 0.386946] pci_bus 0000:64: root bus resource [mem 0x380200000000-0x3802ffffffff window]
[ 0.386947] pci_bus 0000:64: root bus resource [bus 64-b1]
[ 0.386958] pci 0000:64:00.0: [8086:2030] type 01 class 0x060400
[ 0.386996] pci 0000:64:00.0: PME# supported from D0 D3hot D3cold
[ 0.387058] pci 0000:64:05.0: [8086:2034] type 00 class 0x088000
[ 0.387110] pci 0000:64:05.2: [8086:2035] type 00 class 0x088000
[ 0.387162] pci 0000:64:05.4: [8086:2036] type 00 class 0x080020
[ 0.387167] pci 0000:64:05.4: reg 0x10: [mem 0xd8100000-0xd8100fff]
[ 0.387222] pci 0000:64:08.0: [8086:2066] type 00 class 0x088000
[ 0.387272] pci 0000:64:09.0: [8086:2066] type 00 class 0x088000
[ 0.387322] pci 0000:64:0a.0: [8086:2040] type 00 class 0x088000
[ 0.387371] pci 0000:64:0a.1: [8086:2041] type 00 class 0x088000
[ 0.387414] pci 0000:64:0a.2: [8086:2042] type 00 class 0x088000
[ 0.387458] pci 0000:64:0a.3: [8086:2043] type 00 class 0x088000
[ 0.387500] pci 0000:64:0a.4: [8086:2044] type 00 class 0x088000
[ 0.387542] pci 0000:64:0a.5: [8086:2045] type 00 class 0x088000
[ 0.387585] pci 0000:64:0a.6: [8086:2046] type 00 class 0x088000
[ 0.387627] pci 0000:64:0a.7: [8086:2047] type 00 class 0x088000
[ 0.387670] pci 0000:64:0b.0: [8086:2048] type 00 class 0x088000
[ 0.387719] pci 0000:64:0b.1: [8086:2049] type 00 class 0x088000
[ 0.387761] pci 0000:64:0b.2: [8086:204a] type 00 class 0x088000
[ 0.387807] pci 0000:64:0b.3: [8086:204b] type 00 class 0x088000
[ 0.387851] pci 0000:64:0c.0: [8086:2040] type 00 class 0x088000
[ 0.387900] pci 0000:64:0c.1: [8086:2041] type 00 class 0x088000
[ 0.387943] pci 0000:64:0c.2: [8086:2042] type 00 class 0x088000
[ 0.387986] pci 0000:64:0c.3: [8086:2043] type 00 class 0x088000
[ 0.388029] pci 0000:64:0c.4: [8086:2044] type 00 class 0x088000
[ 0.388072] pci 0000:64:0c.5: [8086:2045] type 00 class 0x088000
[ 0.388115] pci 0000:64:0c.6: [8086:2046] type 00 class 0x088000
[ 0.388158] pci 0000:64:0c.7: [8086:2047] type 00 class 0x088000
[ 0.388202] pci 0000:64:0d.0: [8086:2048] type 00 class 0x088000
[ 0.388251] pci 0000:64:0d.1: [8086:2049] type 00 class 0x088000
[ 0.388294] pci 0000:64:0d.2: [8086:204a] type 00 class 0x088000
[ 0.388338] pci 0000:64:0d.3: [8086:204b] type 00 class 0x088000
[ 0.388421] pci 0000:65:00.0: [10de:1c03] type 00 class 0x030000
[ 0.388430] pci 0000:65:00.0: reg 0x10: [mem 0xd7000000-0xd7ffffff]
[ 0.388438] pci 0000:65:00.0: reg 0x14: [mem 0xc0000000-0xcfffffff 64bit pref]
[ 0.388446] pci 0000:65:00.0: reg 0x1c: [mem 0xd0000000-0xd1ffffff 64bit pref]
[ 0.388451] pci 0000:65:00.0: reg 0x24: [io 0xb000-0xb07f]
[ 0.388457] pci 0000:65:00.0: reg 0x30: [mem 0xd8000000-0xd807ffff pref]
[ 0.388538] pci 0000:65:00.0: 32.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x16 link at 0000:64:00.0 (capable of 126.016 Gb/s with 8.0 GT/s PCIe x16 link)
[ 0.388575] pci 0000:65:00.1: [10de:10f1] type 00 class 0x040300
[ 0.388584] pci 0000:65:00.1: reg 0x10: [mem 0xd8080000-0xd8083fff]
[ 0.388688] pci 0000:64:00.0: ASPM: current common clock configuration is inconsistent, reconfiguring
[ 0.391708] pci 0000:64:00.0: PCI bridge to [bus 65]
[ 0.391712] pci 0000:64:00.0: bridge window [io 0xb000-0xbfff]
[ 0.391715] pci 0000:64:00.0: bridge window [mem 0xd7000000-0xd80fffff]
[ 0.391721] pci 0000:64:00.0: bridge window [mem 0xc0000000-0xd1ffffff 64bit pref]
[ 0.391732] pci_bus 0000:64: on NUMA node 0
[ 0.391886] ACPI: PCI Root Bridge [PC03] (domain 0000 [bus b2-ff])
[ 0.391887] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[ 0.392109] acpi PNP0A08:03: _OSC: platform does not support [SHPCHotplug AER LTR]
[ 0.392230] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 0.392329] PCI host bridge to bus 0000:b2
[ 0.392330] pci_bus 0000:b2: root bus resource [io 0xc000-0xffff window]
[ 0.392331] pci_bus 0000:b2: root bus resource [mem 0xd9000000-0xfbffffff window]
[ 0.392331] pci_bus 0000:b2: root bus resource [mem 0x380300000000-0x3803ffffffff window]
[ 0.392332] pci_bus 0000:b2: root bus resource [bus b2-ff]
[ 0.392340] pci 0000:b2:05.0: [8086:2034] type 00 class 0x088000
[ 0.392398] pci 0000:b2:05.2: [8086:2035] type 00 class 0x088000
[ 0.392452] pci 0000:b2:05.4: [8086:2036] type 00 class 0x080020
[ 0.392457] pci 0000:b2:05.4: reg 0x10: [mem 0xfbf00000-0xfbf00fff]
[ 0.392516] pci 0000:b2:12.0: [8086:204c] type 00 class 0x110100
[ 0.392566] pci 0000:b2:12.1: [8086:204d] type 00 class 0x110100
[ 0.392598] pci 0000:b2:12.2: [8086:204e] type 00 class 0x088000
[ 0.392631] pci 0000:b2:15.0: [8086:2018] type 00 class 0x088000
[ 0.392670] pci 0000:b2:16.0: [8086:2018] type 00 class 0x088000
[ 0.392710] pci 0000:b2:16.4: [8086:2018] type 00 class 0x088000
[ 0.392744] pci 0000:b2:17.0: [8086:2018] type 00 class 0x088000
[ 0.392784] pci_bus 0000:b2: on NUMA node 0
[ 0.392875] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[ 0.392906] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[ 0.392935] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 10 *11 12 14 15)
[ 0.392965] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[ 0.392994] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 10 *11 12 14 15)
[ 0.393024] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[ 0.393053] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 10 *11 12 14 15)
[ 0.393083] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 10 *11 12 14 15)
[ 0.393125] ACPI BIOS Error (bug): Could not resolve symbol [\SHAD._STA.SDS0], AE_NOT_FOUND (20200717/psargs-330)
[ 0.393128] ACPI Error: Aborting method \SHAD._STA due to previous error (AE_NOT_FOUND) (20200717/psparse-531)
[ 0.393687] iommu: Default domain type: Translated
[ 0.393696] pci 0000:65:00.0: vgaarb: setting as boot VGA device
[ 0.393697] pci 0000:65:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 0.393699] pci 0000:65:00.0: vgaarb: bridge control possible
[ 0.393700] vgaarb: loaded
[ 0.393772] SCSI subsystem initialized
[ 0.393793] libata version 3.00 loaded.
[ 0.393793] ACPI: bus type USB registered
[ 0.393793] usbcore: registered new interface driver usbfs
[ 0.393793] usbcore: registered new interface driver hub
[ 0.393793] usbcore: registered new device driver usb
[ 0.393793] pps_core: LinuxPPS API ver. 1 registered
[ 0.393793] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 0.393793] PTP clock support registered
[ 0.393793] EDAC MC: Ver: 3.0.0
[ 0.394757] NetLabel: Initializing
[ 0.394758] NetLabel: domain hash size = 128
[ 0.394758] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 0.394767] NetLabel: unlabeled traffic allowed by default
[ 0.394768] PCI: Using ACPI for IRQ routing
[ 0.397812] PCI: pci_cache_line_size set to 64 bytes
[ 0.397907] e820: reserve RAM buffer [mem 0x0009d800-0x0009ffff]
[ 0.397908] e820: reserve RAM buffer [mem 0x3542b000-0x37ffffff]
[ 0.397908] e820: reserve RAM buffer [mem 0x3680d000-0x37ffffff]
[ 0.398728] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 0.398730] hpet0: 8 comparators, 64-bit 24.000000 MHz counter
[ 0.400716] clocksource: Switched to clocksource tsc-early
[ 0.409998] VFS: Disk quotas dquot_6.6.0
[ 0.410010] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.410044] pnp: PnP ACPI init
[ 0.410221] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 0.410284] system 00:01: [io 0x0500-0x053f] has been reserved
[ 0.410284] system 00:01: [io 0x0400-0x047f] could not be reserved
[ 0.410285] system 00:01: [io 0x0540-0x057f] has been reserved
[ 0.410286] system 00:01: [io 0x0600-0x061f] has been reserved
[ 0.410287] system 00:01: [io 0x0ca0-0x0ca5] has been reserved
[ 0.410287] system 00:01: [io 0x0880-0x0883] has been reserved
[ 0.410288] system 00:01: [io 0x0800-0x081f] has been reserved
[ 0.410289] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved
[ 0.410290] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[ 0.410290] system 00:01: [mem 0xff000000-0xffffffff] has been reserved
[ 0.410291] system 00:01: [mem 0xfee00000-0xfeefffff] could not be reserved
[ 0.410292] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 0.410292] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 0.410293] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 0.410296] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 0.410418] system 00:02: [io 0x0a00-0x0a2f] has been reserved
[ 0.410419] system 00:02: [io 0x0a30-0x0a3f] has been reserved
[ 0.410419] system 00:02: [io 0x0a40-0x0a4f] has been reserved
[ 0.410421] system 00:02: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 0.410528] system 00:03: [mem 0xfd000000-0xfdabffff] has been reserved
[ 0.410528] system 00:03: [mem 0xfdad0000-0xfdadffff] has been reserved
[ 0.410529] system 00:03: [mem 0xfdb00000-0xfdffffff] could not be reserved
[ 0.410530] system 00:03: [mem 0xfe000000-0xfe00ffff] has been reserved
[ 0.410530] system 00:03: [mem 0xfe011000-0xfe01ffff] has been reserved
[ 0.410531] system 00:03: [mem 0xfe036000-0xfe03bfff] has been reserved
[ 0.410531] system 00:03: [mem 0xfe03d000-0xfe3fffff] has been reserved
[ 0.410532] system 00:03: [mem 0xfe410000-0xfe7fffff] has been reserved
[ 0.410534] system 00:03: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 0.410667] system 00:04: [io 0x0f00-0x0ffe] has been reserved
[ 0.410669] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 0.411142] system 00:05: [mem 0xfdaf0000-0xfdafffff] has been reserved
[ 0.411142] system 00:05: [mem 0xfdae0000-0xfdaeffff] has been reserved
[ 0.411143] system 00:05: [mem 0xfdac0000-0xfdacffff] has been reserved
[ 0.411145] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 0.411516] ACPI BIOS Error (bug): Could not resolve symbol [\SHAD._STA.SDS0], AE_NOT_FOUND (20200717/psargs-330)
[ 0.411518] ACPI Error: Aborting method \SHAD._STA due to previous error (AE_NOT_FOUND) (20200717/psparse-531)
[ 0.411521] pnp: PnP ACPI: found 6 devices
[ 0.416825] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 0.416865] NET: Registered protocol family 2
[ 0.417021] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear)
[ 0.417047] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[ 0.417207] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[ 0.417280] TCP: Hash tables configured (established 262144 bind 65536)
[ 0.417313] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear)
[ 0.417358] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear)
[ 0.417451] NET: Registered protocol family 1
[ 0.417455] NET: Registered protocol family 44
[ 0.417465] pci 0000:00:1d.0: bridge window [io 0x1000-0x0fff] to [bus 04] add_size 1000
[ 0.417466] pci 0000:00:1d.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 04] add_size 200000 add_align 100000
[ 0.417467] pci 0000:00:1d.0: bridge window [mem 0x00100000-0x000fffff] to [bus 04] add_size 200000 add_align 100000
[ 0.417473] pci 0000:00:1d.0: BAR 14: assigned [mem 0x70000000-0x701fffff]
[ 0.417475] pci 0000:00:1d.0: BAR 15: assigned [mem 0x380000000000-0x3800001fffff 64bit pref]
[ 0.417477] pci 0000:00:1d.0: BAR 13: assigned [io 0x1000-0x1fff]
[ 0.417479] pci 0000:00:1b.0: PCI bridge to [bus 01]
[ 0.417487] pci 0000:00:1c.0: PCI bridge to [bus 02]
[ 0.417495] pci 0000:00:1c.4: PCI bridge to [bus 03]
[ 0.417497] pci 0000:00:1c.4: bridge window [mem 0x92e00000-0x92efffff]
[ 0.417501] pci 0000:00:1d.0: PCI bridge to [bus 04]
[ 0.417502] pci 0000:00:1d.0: bridge window [io 0x1000-0x1fff]
[ 0.417504] pci 0000:00:1d.0: bridge window [mem 0x70000000-0x701fffff]
[ 0.417506] pci 0000:00:1d.0: bridge window [mem 0x380000000000-0x3800001fffff 64bit pref]
[ 0.417510] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 0.417510] pci_bus 0000:00: resource 5 [io 0x1000-0x3fff window]
[ 0.417511] pci_bus 0000:00: resource 6 [mem 0x000c4000-0x000c7fff window]
[ 0.417511] pci_bus 0000:00: resource 7 [mem 0xfe010000-0xfe010fff window]
[ 0.417512] pci_bus 0000:00: resource 8 [mem 0x70000000-0x92ffffff window]
[ 0.417512] pci_bus 0000:00: resource 9 [mem 0x380000000000-0x3800ffffffff window]
[ 0.417513] pci_bus 0000:03: resource 1 [mem 0x92e00000-0x92efffff]
[ 0.417514] pci_bus 0000:04: resource 0 [io 0x1000-0x1fff]
[ 0.417514] pci_bus 0000:04: resource 1 [mem 0x70000000-0x701fffff]
[ 0.417515] pci_bus 0000:04: resource 2 [mem 0x380000000000-0x3800001fffff 64bit pref]
[ 0.417586] pci_bus 0000:16: resource 4 [io 0x4000-0x7fff window]
[ 0.417586] pci_bus 0000:16: resource 5 [mem 0x93000000-0xb5ffffff window]
[ 0.417587] pci_bus 0000:16: resource 6 [mem 0x380100000000-0x3801ffffffff window]
[ 0.417602] pci 0000:64:00.0: PCI bridge to [bus 65]
[ 0.417603] pci 0000:64:00.0: bridge window [io 0xb000-0xbfff]
[ 0.417605] pci 0000:64:00.0: bridge window [mem 0xd7000000-0xd80fffff]
[ 0.417606] pci 0000:64:00.0: bridge window [mem 0xc0000000-0xd1ffffff 64bit pref]
[ 0.417609] pci_bus 0000:64: resource 4 [mem 0x000a0000-0x000bffff window]
[ 0.417609] pci_bus 0000:64: resource 5 [io 0x8000-0xbfff window]
[ 0.417610] pci_bus 0000:64: resource 6 [io 0x03b0-0x03bb window]
[ 0.417610] pci_bus 0000:64: resource 7 [io 0x03c0-0x03df window]
[ 0.417611] pci_bus 0000:64: resource 8 [mem 0xb6000000-0xd8ffffff window]
[ 0.417612] pci_bus 0000:64: resource 9 [mem 0x380200000000-0x3802ffffffff window]
[ 0.417612] pci_bus 0000:65: resource 0 [io 0xb000-0xbfff]
[ 0.417613] pci_bus 0000:65: resource 1 [mem 0xd7000000-0xd80fffff]
[ 0.417613] pci_bus 0000:65: resource 2 [mem 0xc0000000-0xd1ffffff 64bit pref]
[ 0.417624] pci_bus 0000:b2: resource 4 [io 0xc000-0xffff window]
[ 0.417624] pci_bus 0000:b2: resource 5 [mem 0xd9000000-0xfbffffff window]
[ 0.417625] pci_bus 0000:b2: resource 6 [mem 0x380300000000-0x3803ffffffff window]
[ 0.418231] pci 0000:03:00.0: PME# does not work under D0, disabling it
[ 0.418319] pci 0000:16:05.0: disabled boot interrupts on device [8086:2034]
[ 0.418344] pci 0000:64:05.0: disabled boot interrupts on device [8086:2034]
[ 0.418370] pci 0000:65:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 0.418372] pci 0000:65:00.0: CLS mismatch (64 != 32), using 64 bytes
[ 0.418394] pci 0000:65:00.1: D0 power state depends on 0000:65:00.0
[ 0.418398] pci 0000:b2:05.0: disabled boot interrupts on device [8086:2034]
[ 0.418461] Trying to unpack rootfs image as initramfs...
[ 2.084970] Freeing initrd memory: 165800K
[ 2.085056] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 2.085057] software IO TLB: mapped [mem 0x4c000000-0x50000000] (64MB)
[ 2.086409] Initialise system trusted keyrings
[ 2.086416] Key type blacklist registered
[ 2.086444] workingset: timestamp_bits=36 max_order=23 bucket_order=0
[ 2.087213] zbud: loaded
[ 2.087531] integrity: Platform Keyring initialized
[ 2.093149] NET: Registered protocol family 38
[ 2.093151] Key type asymmetric registered
[ 2.093151] Asymmetric key parser 'x509' registered
[ 2.093156] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[ 2.093199] io scheduler mq-deadline registered
[ 2.093199] io scheduler kyber registered
[ 2.093213] io scheduler bfq registered
[ 2.093329] atomic64_test: passed for x86-64 platform with CX8 and with SSE
[ 2.093528] pcieport 0000:00:1b.0: PME: Signaling with IRQ 24
[ 2.093668] pcieport 0000:00:1c.0: PME: Signaling with IRQ 25
[ 2.093750] pcieport 0000:00:1c.4: PME: Signaling with IRQ 26
[ 2.093868] pcieport 0000:00:1d.0: PME: Signaling with IRQ 27
[ 2.093882] pcieport 0000:00:1d.0: pciehp: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ IbPresDis- LLActRep+
[ 2.094071] pcieport 0000:64:00.0: PME: Signaling with IRQ 29
[ 2.094191] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 2.094208] intel_idle: MWAIT substates: 0x2020
[ 2.094277] Monitor-Mwait will be used to enter C-1 state
[ 2.094282] Monitor-Mwait will be used to enter C-2 state
[ 2.094286] ACPI: \_SB_.SCK0.CP00: Found 2 idle states
[ 2.094287] intel_idle: v0.5.1 model 0x55
[ 2.094705] intel_idle: Local APIC timer is reliable in all C-states
[ 2.094838] input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input0
[ 2.094857] ACPI: Sleep Button [SLPB]
[ 2.094888] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input1
[ 2.094900] ACPI: Power Button [PWRB]
[ 2.094917] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2
[ 2.094937] ACPI: Power Button [PWRF]
[ 2.096264] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 2.097226] Non-volatile memory driver v1.3
[ 2.097241] Linux agpgart interface v0.103
[ 2.098242] ahci 0000:00:17.0: version 3.0
[ 2.108441] ahci 0000:00:17.0: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0xff impl SATA mode
[ 2.108445] ahci 0000:00:17.0: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst
[ 2.130987] scsi host0: ahci
[ 2.131198] scsi host1: ahci
[ 2.131418] scsi host2: ahci
[ 2.131576] scsi host3: ahci
[ 2.131737] scsi host4: ahci
[ 2.131849] scsi host5: ahci
[ 2.131969] scsi host6: ahci
[ 2.132082] scsi host7: ahci
[ 2.132138] ata1: SATA max UDMA/133 abar m2048@0x92f6b000 port 0x92f6b100 irq 30
[ 2.132140] ata2: SATA max UDMA/133 abar m2048@0x92f6b000 port 0x92f6b180 irq 30
[ 2.132142] ata3: SATA max UDMA/133 abar m2048@0x92f6b000 port 0x92f6b200 irq 30
[ 2.132144] ata4: SATA max UDMA/133 abar m2048@0x92f6b000 port 0x92f6b280 irq 30
[ 2.132146] ata5: SATA max UDMA/133 abar m2048@0x92f6b000 port 0x92f6b300 irq 30
[ 2.132147] ata6: SATA max UDMA/133 abar m2048@0x92f6b000 port 0x92f6b380 irq 30
[ 2.132149] ata7: SATA max UDMA/133 abar m2048@0x92f6b000 port 0x92f6b400 irq 30
[ 2.132151] ata8: SATA max UDMA/133 abar m2048@0x92f6b000 port 0x92f6b480 irq 30
[ 2.132300] libphy: Fixed MDIO Bus: probed
[ 2.132351] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 2.132352] ehci-pci: EHCI PCI platform driver
[ 2.132366] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 2.132367] ohci-pci: OHCI PCI platform driver
[ 2.132378] uhci_hcd: USB Universal Host Controller Interface driver
[ 2.132639] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 2.132698] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1
[ 2.133788] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810
[ 2.133794] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported
[ 2.134069] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.09
[ 2.134071] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 2.134073] usb usb1: Product: xHCI Host Controller
[ 2.134075] usb usb1: Manufacturer: Linux 5.9.0-rc2+ xhci-hcd
[ 2.134077] usb usb1: SerialNumber: 0000:00:14.0
[ 2.134212] hub 1-0:1.0: USB hub found
[ 2.134233] hub 1-0:1.0: 16 ports detected
[ 2.136396] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 2.136435] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2
[ 2.136439] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed
[ 2.136506] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.09
[ 2.136508] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 2.136510] usb usb2: Product: xHCI Host Controller
[ 2.136512] usb usb2: Manufacturer: Linux 5.9.0-rc2+ xhci-hcd
[ 2.136513] usb usb2: SerialNumber: 0000:00:14.0
[ 2.136635] hub 2-0:1.0: USB hub found
[ 2.136651] hub 2-0:1.0: 10 ports detected
[ 2.137775] usb: port power management may be unreliable
[ 2.138050] xhci_hcd 0000:03:00.0: xHCI Host Controller
[ 2.138097] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 3
[ 2.193113] xhci_hcd 0000:03:00.0: hcc params 0x0200ef80 hci version 0x110 quirks 0x0000000000800010
[ 2.193491] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.09
[ 2.193493] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 2.193495] usb usb3: Product: xHCI Host Controller
[ 2.193497] usb usb3: Manufacturer: Linux 5.9.0-rc2+ xhci-hcd
[ 2.193498] usb usb3: SerialNumber: 0000:03:00.0
[ 2.193609] hub 3-0:1.0: USB hub found
[ 2.193618] hub 3-0:1.0: 2 ports detected
[ 2.193792] xhci_hcd 0000:03:00.0: xHCI Host Controller
[ 2.193826] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 4
[ 2.193830] xhci_hcd 0000:03:00.0: Host supports USB 3.1 Enhanced SuperSpeed
[ 2.193863] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[ 2.193896] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.09
[ 2.193897] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 2.193899] usb usb4: Product: xHCI Host Controller
[ 2.193901] usb usb4: Manufacturer: Linux 5.9.0-rc2+ xhci-hcd
[ 2.193902] usb usb4: SerialNumber: 0000:03:00.0
[ 2.194006] hub 4-0:1.0: USB hub found
[ 2.194015] hub 4-0:1.0: 2 ports detected
[ 2.194152] usbcore: registered new interface driver usbserial_generic
[ 2.194155] usbserial: USB Serial support registered for generic
[ 2.194165] i8042: PNP: No PS/2 controller found.
[ 2.194184] mousedev: PS/2 mouse device common for all mice
[ 2.194250] rtc_cmos 00:00: RTC can wake from S4
[ 2.194779] rtc_cmos 00:00: registered as rtc0
[ 2.194927] rtc_cmos 00:00: setting system clock to 2020-08-27T19:31:45 UTC (1598556705)
[ 2.194928] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[ 2.194974] device-mapper: uevent: version 1.0.3
[ 2.195006] device-mapper: ioctl: 4.42.0-ioctl (2020-02-27) initialised: dm-devel@redhat.com
[ 2.195055] intel_pstate: Intel P-state driver initializing
[ 2.195076] intel_pstate: tdp_ratio 21
[ 2.195077] intel_pstate: tdp_ratio 21
[ 2.195085] intel_pstate: controlling: cpu 0
[ 2.195129] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195133] intel_pstate: cpu:0 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195134] intel_pstate: cpu:0 global_min:0 global_max:43
[ 2.195134] intel_pstate: cpu:0 max_perf_ratio:43 min_perf_ratio:12
[ 2.195147] intel_pstate: tdp_ratio 21
[ 2.195149] intel_pstate: tdp_ratio 21
[ 2.195154] intel_pstate: controlling: cpu 1
[ 2.195155] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195162] intel_pstate: cpu:0 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195162] intel_pstate: cpu:0 global_min:0 global_max:43
[ 2.195163] intel_pstate: cpu:0 max_perf_ratio:43 min_perf_ratio:12
[ 2.195179] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195187] intel_pstate: cpu:1 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195187] intel_pstate: cpu:1 global_min:0 global_max:43
[ 2.195188] intel_pstate: cpu:1 max_perf_ratio:43 min_perf_ratio:12
[ 2.195198] intel_pstate: tdp_ratio 21
[ 2.195200] intel_pstate: tdp_ratio 21
[ 2.195204] intel_pstate: controlling: cpu 2
[ 2.195207] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195209] intel_pstate: cpu:1 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195210] intel_pstate: cpu:1 global_min:0 global_max:43
[ 2.195210] intel_pstate: cpu:1 max_perf_ratio:43 min_perf_ratio:12
[ 2.195227] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195230] intel_pstate: cpu:2 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195230] intel_pstate: cpu:2 global_min:0 global_max:43
[ 2.195231] intel_pstate: cpu:2 max_perf_ratio:43 min_perf_ratio:12
[ 2.195243] intel_pstate: tdp_ratio 21
[ 2.195245] intel_pstate: tdp_ratio 21
[ 2.195250] intel_pstate: controlling: cpu 3
[ 2.195253] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195255] intel_pstate: cpu:2 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195256] intel_pstate: cpu:2 global_min:0 global_max:43
[ 2.195256] intel_pstate: cpu:2 max_perf_ratio:43 min_perf_ratio:12
[ 2.195274] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 2.195278] intel_pstate: cpu:3 max_state 45 min_policy_perf:12 max_policy_perf:45
[ 2.195278] intel_pstate: cpu:3 global_min:0 global_max:45
[ 2.195278] intel_pstate: cpu:3 max_perf_ratio:45 min_perf_ratio:12
[ 2.195291] intel_pstate: tdp_ratio 21
[ 2.195293] intel_pstate: tdp_ratio 21
[ 2.195298] intel_pstate: controlling: cpu 4
[ 2.195306] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 2.195308] intel_pstate: cpu:3 max_state 45 min_policy_perf:12 max_policy_perf:45
[ 2.195309] intel_pstate: cpu:3 global_min:0 global_max:45
[ 2.195309] intel_pstate: cpu:3 max_perf_ratio:45 min_perf_ratio:12
[ 2.195321] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195324] intel_pstate: cpu:4 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195325] intel_pstate: cpu:4 global_min:0 global_max:43
[ 2.195325] intel_pstate: cpu:4 max_perf_ratio:43 min_perf_ratio:12
[ 2.195338] intel_pstate: tdp_ratio 21
[ 2.195339] intel_pstate: tdp_ratio 21
[ 2.195349] intel_pstate: controlling: cpu 5
[ 2.195352] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195366] intel_pstate: cpu:4 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195366] intel_pstate: cpu:4 global_min:0 global_max:43
[ 2.195366] intel_pstate: cpu:4 max_perf_ratio:43 min_perf_ratio:12
[ 2.195389] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195393] intel_pstate: cpu:5 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195393] intel_pstate: cpu:5 global_min:0 global_max:43
[ 2.195393] intel_pstate: cpu:5 max_perf_ratio:43 min_perf_ratio:12
[ 2.195405] intel_pstate: tdp_ratio 21
[ 2.195407] intel_pstate: tdp_ratio 21
[ 2.195447] intel_pstate: controlling: cpu 6
[ 2.195449] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195454] intel_pstate: cpu:5 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195454] intel_pstate: cpu:5 global_min:0 global_max:43
[ 2.195454] intel_pstate: cpu:5 max_perf_ratio:43 min_perf_ratio:12
[ 2.195477] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195480] intel_pstate: cpu:6 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195481] intel_pstate: cpu:6 global_min:0 global_max:43
[ 2.195481] intel_pstate: cpu:6 max_perf_ratio:43 min_perf_ratio:12
[ 2.195496] intel_pstate: tdp_ratio 21
[ 2.195498] intel_pstate: tdp_ratio 21
[ 2.195505] intel_pstate: controlling: cpu 7
[ 2.195507] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195511] intel_pstate: cpu:6 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195511] intel_pstate: cpu:6 global_min:0 global_max:43
[ 2.195512] intel_pstate: cpu:6 max_perf_ratio:43 min_perf_ratio:12
[ 2.195528] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195531] intel_pstate: cpu:7 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195531] intel_pstate: cpu:7 global_min:0 global_max:43
[ 2.195532] intel_pstate: cpu:7 max_perf_ratio:43 min_perf_ratio:12
[ 2.195546] intel_pstate: tdp_ratio 21
[ 2.195548] intel_pstate: tdp_ratio 21
[ 2.195559] intel_pstate: controlling: cpu 8
[ 2.195562] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195564] intel_pstate: cpu:7 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195564] intel_pstate: cpu:7 global_min:0 global_max:43
[ 2.195565] intel_pstate: cpu:7 max_perf_ratio:43 min_perf_ratio:12
[ 2.195587] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195591] intel_pstate: cpu:8 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195591] intel_pstate: cpu:8 global_min:0 global_max:43
[ 2.195592] intel_pstate: cpu:8 max_perf_ratio:43 min_perf_ratio:12
[ 2.195607] intel_pstate: tdp_ratio 21
[ 2.195608] intel_pstate: tdp_ratio 21
[ 2.195616] intel_pstate: controlling: cpu 9
[ 2.195618] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195623] intel_pstate: cpu:8 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195623] intel_pstate: cpu:8 global_min:0 global_max:43
[ 2.195623] intel_pstate: cpu:8 max_perf_ratio:43 min_perf_ratio:12
[ 2.195651] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 2.195655] intel_pstate: cpu:9 max_state 45 min_policy_perf:12 max_policy_perf:45
[ 2.195656] intel_pstate: cpu:9 global_min:0 global_max:45
[ 2.195656] intel_pstate: cpu:9 max_perf_ratio:45 min_perf_ratio:12
[ 2.195664] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 2.195682] intel_pstate: cpu:9 max_state 45 min_policy_perf:12 max_policy_perf:45
[ 2.195682] intel_pstate: cpu:9 global_min:0 global_max:45
[ 2.195683] intel_pstate: cpu:9 max_perf_ratio:45 min_perf_ratio:12
[ 2.195698] intel_pstate: tdp_ratio 21
[ 2.195700] intel_pstate: tdp_ratio 21
[ 2.195705] intel_pstate: controlling: cpu 10
[ 2.195735] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195740] intel_pstate: cpu:10 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195740] intel_pstate: cpu:10 global_min:0 global_max:43
[ 2.195741] intel_pstate: cpu:10 max_perf_ratio:43 min_perf_ratio:12
[ 2.195757] intel_pstate: tdp_ratio 21
[ 2.195759] intel_pstate: tdp_ratio 21
[ 2.195765] intel_pstate: controlling: cpu 11
[ 2.195768] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195771] intel_pstate: cpu:10 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195772] intel_pstate: cpu:10 global_min:0 global_max:43
[ 2.195772] intel_pstate: cpu:10 max_perf_ratio:43 min_perf_ratio:12
[ 2.195786] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195788] intel_pstate: cpu:11 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195789] intel_pstate: cpu:11 global_min:0 global_max:43
[ 2.195789] intel_pstate: cpu:11 max_perf_ratio:43 min_perf_ratio:12
[ 2.195802] intel_pstate: tdp_ratio 21
[ 2.195804] intel_pstate: tdp_ratio 21
[ 2.195815] intel_pstate: controlling: cpu 12
[ 2.195817] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195820] intel_pstate: cpu:11 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195820] intel_pstate: cpu:11 global_min:0 global_max:43
[ 2.195821] intel_pstate: cpu:11 max_perf_ratio:43 min_perf_ratio:12
[ 2.195833] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195835] intel_pstate: cpu:12 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195836] intel_pstate: cpu:12 global_min:0 global_max:43
[ 2.195836] intel_pstate: cpu:12 max_perf_ratio:43 min_perf_ratio:12
[ 2.195850] intel_pstate: tdp_ratio 21
[ 2.195852] intel_pstate: tdp_ratio 21
[ 2.195859] intel_pstate: controlling: cpu 13
[ 2.195864] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195866] intel_pstate: cpu:12 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195866] intel_pstate: cpu:12 global_min:0 global_max:43
[ 2.195867] intel_pstate: cpu:12 max_perf_ratio:43 min_perf_ratio:12
[ 2.195881] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 2.195884] intel_pstate: cpu:13 max_state 45 min_policy_perf:12 max_policy_perf:45
[ 2.195884] intel_pstate: cpu:13 global_min:0 global_max:45
[ 2.195885] intel_pstate: cpu:13 max_perf_ratio:45 min_perf_ratio:12
[ 2.195897] intel_pstate: tdp_ratio 21
[ 2.195899] intel_pstate: tdp_ratio 21
[ 2.195903] intel_pstate: controlling: cpu 14
[ 2.195905] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 2.195909] intel_pstate: cpu:13 max_state 45 min_policy_perf:12 max_policy_perf:45
[ 2.195909] intel_pstate: cpu:13 global_min:0 global_max:45
[ 2.195909] intel_pstate: cpu:13 max_perf_ratio:45 min_perf_ratio:12
[ 2.195924] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195926] intel_pstate: cpu:14 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195926] intel_pstate: cpu:14 global_min:0 global_max:43
[ 2.195927] intel_pstate: cpu:14 max_perf_ratio:43 min_perf_ratio:12
[ 2.195938] intel_pstate: tdp_ratio 21
[ 2.195940] intel_pstate: tdp_ratio 21
[ 2.195947] intel_pstate: controlling: cpu 15
[ 2.195949] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195952] intel_pstate: cpu:14 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195952] intel_pstate: cpu:14 global_min:0 global_max:43
[ 2.195952] intel_pstate: cpu:14 max_perf_ratio:43 min_perf_ratio:12
[ 2.195963] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195966] intel_pstate: cpu:15 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195967] intel_pstate: cpu:15 global_min:0 global_max:43
[ 2.195967] intel_pstate: cpu:15 max_perf_ratio:43 min_perf_ratio:12
[ 2.195980] intel_pstate: tdp_ratio 21
[ 2.195982] intel_pstate: tdp_ratio 21
[ 2.195988] intel_pstate: controlling: cpu 16
[ 2.195990] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.195994] intel_pstate: cpu:15 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.195994] intel_pstate: cpu:15 global_min:0 global_max:43
[ 2.195995] intel_pstate: cpu:15 max_perf_ratio:43 min_perf_ratio:12
[ 2.196012] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.196015] intel_pstate: cpu:16 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.196016] intel_pstate: cpu:16 global_min:0 global_max:43
[ 2.196016] intel_pstate: cpu:16 max_perf_ratio:43 min_perf_ratio:12
[ 2.196030] intel_pstate: tdp_ratio 21
[ 2.196032] intel_pstate: tdp_ratio 21
[ 2.196038] intel_pstate: controlling: cpu 17
[ 2.196041] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.196044] intel_pstate: cpu:16 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.196045] intel_pstate: cpu:16 global_min:0 global_max:43
[ 2.196045] intel_pstate: cpu:16 max_perf_ratio:43 min_perf_ratio:12
[ 2.196059] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.196064] intel_pstate: cpu:17 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.196065] intel_pstate: cpu:17 global_min:0 global_max:43
[ 2.196065] intel_pstate: cpu:17 max_perf_ratio:43 min_perf_ratio:12
[ 2.196078] intel_pstate: tdp_ratio 21
[ 2.196080] intel_pstate: tdp_ratio 21
[ 2.196095] intel_pstate: controlling: cpu 18
[ 2.196097] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.196099] intel_pstate: cpu:17 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.196100] intel_pstate: cpu:17 global_min:0 global_max:43
[ 2.196100] intel_pstate: cpu:17 max_perf_ratio:43 min_perf_ratio:12
[ 2.196115] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.196121] intel_pstate: cpu:18 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.196121] intel_pstate: cpu:18 global_min:0 global_max:43
[ 2.196122] intel_pstate: cpu:18 max_perf_ratio:43 min_perf_ratio:12
[ 2.196136] intel_pstate: tdp_ratio 21
[ 2.196137] intel_pstate: tdp_ratio 21
[ 2.196144] intel_pstate: controlling: cpu 19
[ 2.196148] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 2.196150] intel_pstate: cpu:18 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 2.196151] intel_pstate: cpu:18 global_min:0 global_max:43
[ 2.196151] intel_pstate: cpu:18 max_perf_ratio:43 min_perf_ratio:12
[ 2.196161] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 2.196164] intel_pstate: cpu:19 max_state 45 min_policy_perf:12 max_policy_perf:45
[ 2.196164] intel_pstate: cpu:19 global_min:0 global_max:45
[ 2.196165] intel_pstate: cpu:19 max_perf_ratio:45 min_perf_ratio:12
[ 2.196167] intel_pstate: HWP enabled
[ 2.196365] hid: raw HID events driver (C) Jiri Kosina
[ 2.196395] usbcore: registered new interface driver usbhid
[ 2.196396] usbhid: USB HID core driver
[ 2.196500] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 2.196503] intel_pstate: cpu:19 max_state 45 min_policy_perf:12 max_policy_perf:45
[ 2.196504] intel_pstate: cpu:19 global_min:13 global_max:45
[ 2.196505] intel_pstate: cpu:19 max_perf_ratio:45 min_perf_ratio:13
[ 2.196521] drop_monitor: Initializing network drop monitor service
[ 2.196600] Initializing XFRM netlink socket
[ 2.196677] NET: Registered protocol family 10
[ 2.198538] Segment Routing with IPv6
[ 2.198550] mip6: Mobile IPv6
[ 2.198551] NET: Registered protocol family 17
[ 2.199515] microcode: sig=0x50654, pf=0x4, revision=0x200005e
[ 2.199581] microcode: Microcode Update Driver: v2.2.
[ 2.199775] resctrl: MB allocation detected
[ 2.199778] IPI shorthand broadcast: enabled
[ 2.199782] AVX2 version of gcm_enc/dec engaged.
[ 2.199782] AES CTR mode by8 optimization enabled
[ 2.209438] sched_clock: Marking stable (2205359948, 4074975)->(2219159150, -9724227)
[ 2.209576] registered taskstats version 1
[ 2.209589] Loading compiled-in X.509 certificates
[ 2.235786] Loaded X.509 cert 'Build time autogenerated kernel key: 1071d80bc8684e5b20e12fc23bd3162a5b4fbc14'
[ 2.235812] zswap: loaded using pool lzo/zbud
[ 2.235909] debug_vm_pgtable: [debug_vm_pgtable ]: Validating architecture page table helpers
[ 2.235947] Key type ._fscrypt registered
[ 2.235948] Key type .fscrypt registered
[ 2.235948] Key type fscrypt-provisioning registered
[ 2.239460] Key type encrypted registered
[ 2.239469] ima: No TPM chip found, activating TPM-bypass!
[ 2.239479] ima: Allocated hash algorithm: sha1
[ 2.239486] ima: No architecture policies found
[ 2.241304] PM: Magic number: 0:536:547
[ 2.241331] tty ttyS23: hash matches
[ 2.242016] RAS: Correctable Errors collector initialized.
[ 2.438287] ata4: SATA link down (SStatus 4 SControl 300)
[ 2.438307] ata1: SATA link down (SStatus 4 SControl 300)
[ 2.438329] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[ 2.438350] ata7: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[ 2.438369] ata3: SATA link down (SStatus 4 SControl 300)
[ 2.438391] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[ 2.438407] ata8: SATA link down (SStatus 4 SControl 300)
[ 2.438425] ata5: SATA link down (SStatus 4 SControl 300)
[ 2.439139] ata7.00: ATA-10: INTEL SSDSC2KW256G8, LHF002C, max UDMA/133
[ 2.439142] ata7.00: 500118192 sectors, multi 16: LBA48 NCQ (depth 32), AA
[ 2.439576] ata7.00: configured for UDMA/133
[ 2.441729] ata6.00: ATAPI: ATAPI iHAS124 F, CL9N, max UDMA/133
[ 2.442883] ata6.00: configured for UDMA/133
[ 2.453124] ata2.00: ATA-9: INTEL SSDSC2BW080A4, DC32, max UDMA/133
[ 2.453127] ata2.00: 156301488 sectors, multi 16: LBA48 NCQ (depth 32), AA
[ 2.457756] usb 1-2: new high-speed USB device number 2 using xhci_hcd
[ 2.479597] ata2.00: configured for UDMA/133
[ 2.479847] scsi 1:0:0:0: Direct-Access ATA INTEL SSDSC2BW08 DC32 PQ: 0 ANSI: 5
[ 2.480100] sd 1:0:0:0: Attached scsi generic sg0 type 0
[ 2.480180] sd 1:0:0:0: [sda] 156301488 512-byte logical blocks: (80.0 GB/74.5 GiB)
[ 2.480193] sd 1:0:0:0: [sda] Write Protect is off
[ 2.480195] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[ 2.480213] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 2.481589] sda: sda1 sda2 sda3 sda4 sda5
[ 2.482359] sd 1:0:0:0: [sda] Attached SCSI disk
[ 2.483514] scsi 5:0:0:0: CD-ROM ATAPI iHAS124 F CL9N PQ: 0 ANSI: 5
[ 2.530076] sr 5:0:0:0: [sr0] scsi3-mmc drive: 48x/48x writer cd/rw xa/form2 cdda tray
[ 2.530079] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 2.530845] sr 5:0:0:0: Attached scsi CD-ROM sr0
[ 2.530931] sr 5:0:0:0: Attached scsi generic sg1 type 5
[ 2.531195] scsi 6:0:0:0: Direct-Access ATA INTEL SSDSC2KW25 002C PQ: 0 ANSI: 5
[ 2.531387] sd 6:0:0:0: Attached scsi generic sg2 type 0
[ 2.531398] ata7.00: Enabling discard_zeroes_data
[ 2.531462] sd 6:0:0:0: [sdb] 500118192 512-byte logical blocks: (256 GB/238 GiB)
[ 2.531473] sd 6:0:0:0: [sdb] Write Protect is off
[ 2.531475] sd 6:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[ 2.531494] sd 6:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 2.531662] ata7.00: Enabling discard_zeroes_data
[ 2.532766] sdb: sdb1 sdb2
[ 2.533374] ata7.00: Enabling discard_zeroes_data
[ 2.533485] sd 6:0:0:0: [sdb] Attached SCSI disk
[ 2.535462] Freeing unused decrypted memory: 2040K
[ 2.536103] Freeing unused kernel image (initmem) memory: 2216K
[ 2.538806] Write protecting the kernel read-only data: 22528k
[ 2.539641] Freeing unused kernel image (text/rodata gap) memory: 2044K
[ 2.540127] Freeing unused kernel image (rodata/data gap) memory: 1452K
[ 2.583822] usb 1-2: New USB device found, idVendor=0409, idProduct=005a, bcdDevice= 1.00
[ 2.583823] usb 1-2: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 2.584342] hub 1-2:1.0: USB hub found
[ 2.584360] hub 1-2:1.0: 3 ports detected
[ 2.593525] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 2.593528] rodata_test: all tests were successful
[ 2.593528] x86/mm: Checking user space page tables
[ 2.648332] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 2.648337] Run /init as init process
[ 2.648338] with arguments:
[ 2.648338] /init
[ 2.648338] rhgb
[ 2.648339] 3
[ 2.648339] with environment:
[ 2.648339] HOME=/
[ 2.648340] TERM=linux
[ 2.648340] BOOT_IMAGE=/vmlinuz-5.9.0-rc2+
[ 2.648340] dyndbg=file intel_pstate.c +p
[ 2.648340] LANG=en_US.UTF-8
[ 2.655143] systemd[1]: systemd 238 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[ 2.666892] systemd[1]: Detected architecture x86-64.
[ 2.666898] systemd[1]: Running in initial RAM disk.
[ 2.673780] systemd[1]: Set hostname to <otcpl-perf-test-skx-i9>.
[ 2.754467] systemd[1]: Reached target Timers.
[ 2.754654] systemd[1]: Listening on Journal Socket.
[ 2.756471] systemd[1]: Starting Setup Virtual Console...
[ 2.756587] systemd[1]: Reached target Swap.
[ 2.756619] systemd[1]: Reached target Local File Systems.
[ 2.756764] systemd[1]: Listening on Journal Socket (/dev/log).
[ 2.831701] audit: type=1130 audit(1598556706.134:2): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 2.844671] audit: type=1130 audit(1598556706.147:3): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-vconsole-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 2.844692] audit: type=1131 audit(1598556706.147:4): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-vconsole-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 2.845138] audit: type=1130 audit(1598556706.148:5): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 2.867759] usb 1-2.3: new high-speed USB device number 3 using xhci_hcd
[ 2.943494] audit: type=1130 audit(1598556706.246:6): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 2.957237] usb 1-2.3: New USB device found, idVendor=14dd, idProduct=0002, bcdDevice= 0.01
[ 2.957240] usb 1-2.3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 2.957243] usb 1-2.3: Product: Multidevice
[ 2.957245] usb 1-2.3: Manufacturer: Peppercon AG
[ 2.957246] usb 1-2.3: SerialNumber: 2D53C242237FB5E8AE98823AD0A1E5E9
[ 2.959110] input: Peppercon AG Multidevice as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2.3/1-2.3:1.0/0003:14DD:0002.0001/input/input3
[ 2.959425] hid-generic 0003:14DD:0002.0001: input,hidraw0: USB HID v1.01 Keyboard [Peppercon AG Multidevice] on usb-0000:00:14.0-2.3/input0
[ 2.960127] input: Peppercon AG Multidevice as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2.3/1-2.3:1.1/0003:14DD:0002.0002/input/input4
[ 2.960238] hid-generic 0003:14DD:0002.0002: input,hidraw1: USB HID v1.01 Mouse [Peppercon AG Multidevice] on usb-0000:00:14.0-2.3/input1
[ 2.994222] audit: type=1130 audit(1598556706.297:7): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 2.995244] audit: type=1334 audit(1598556706.298:8): prog-id=4 op=LOAD
[ 2.995378] audit: type=1334 audit(1598556706.298:9): prog-id=5 op=LOAD
[ 3.014051] audit: type=1130 audit(1598556706.317:10): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 3.143712] tsc: Refined TSC clocksource calibration: 3312.010 MHz
[ 3.143730] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2fbd9dfdf56, max_idle_ns: 440795306065 ns
[ 3.171663] clocksource: Switched to clocksource tsc
[ 3.173856] acpi PNP0C14:03: duplicate WMI GUID DEADBEEF-4001-0000-00A0-C90629100000 (first instance was on PNP0C14:03)
[ 3.239469] e1000e: Intel(R) PRO/1000 Network Driver
[ 3.239470] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[ 3.239679] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode
[ 3.616405] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock
[ 3.681811] e1000e 0000:00:1f.6 eth0: (PCI Express:2.5GT/s:Width x1) e0:d5:5e:63:ab:d3
[ 3.681814] e1000e 0000:00:1f.6 eth0: Intel(R) PRO/1000 Network Connection
[ 3.681891] e1000e 0000:00:1f.6 eth0: MAC: 12, PHY: 12, PBA No: FFFFFF-0FF
[ 3.683796] e1000e 0000:00:1f.6 enp0s31f6: renamed from eth0
[ 4.718729] MXM: GUID detected in BIOS
[ 4.719278] nouveau 0000:65:00.0: vgaarb: deactivate vga console
[ 4.723591] Console: switching to colour dummy device 80x25
[ 4.723804] nouveau 0000:65:00.0: NVIDIA GP106 (136000a1)
[ 4.834011] nouveau 0000:65:00.0: bios: version 86.06.68.00.79
[ 4.834196] nouveau 0000:65:00.0: pmu: firmware unavailable
[ 4.834684] nouveau 0000:65:00.0: fb: 6144 MiB GDDR5
[ 4.849765] [TTM] Zone kernel: Available graphics memory: 16289398 KiB
[ 4.849765] [TTM] Zone dma32: Available graphics memory: 2097152 KiB
[ 4.849766] [TTM] Initializing pool allocator
[ 4.849769] [TTM] Initializing DMA pool allocator
[ 4.849775] nouveau 0000:65:00.0: DRM: VRAM: 6144 MiB
[ 4.849776] nouveau 0000:65:00.0: DRM: GART: 536870912 MiB
[ 4.849776] nouveau 0000:65:00.0: DRM: BIT table 'A' not found
[ 4.849777] nouveau 0000:65:00.0: DRM: BIT table 'L' not found
[ 4.849778] nouveau 0000:65:00.0: DRM: TMDS table version 2.0
[ 4.849778] nouveau 0000:65:00.0: DRM: DCB version 4.1
[ 4.849779] nouveau 0000:65:00.0: DRM: DCB outp 00: 01000f42 04620030
[ 4.849780] nouveau 0000:65:00.0: DRM: DCB outp 01: 04811f96 04600020
[ 4.849780] nouveau 0000:65:00.0: DRM: DCB outp 02: 04011f92 04620020
[ 4.849781] nouveau 0000:65:00.0: DRM: DCB outp 03: 04822f86 04600010
[ 4.849781] nouveau 0000:65:00.0: DRM: DCB outp 04: 04022f82 04620010
[ 4.849782] nouveau 0000:65:00.0: DRM: DCB outp 06: 02033f62 04620010
[ 4.849783] nouveau 0000:65:00.0: DRM: DCB outp 07: 02844f76 04600020
[ 4.849783] nouveau 0000:65:00.0: DRM: DCB outp 08: 02044f72 00020020
[ 4.849784] nouveau 0000:65:00.0: DRM: DCB conn 00: 00001031
[ 4.849784] nouveau 0000:65:00.0: DRM: DCB conn 01: 02000146
[ 4.849785] nouveau 0000:65:00.0: DRM: DCB conn 02: 01000246
[ 4.849785] nouveau 0000:65:00.0: DRM: DCB conn 03: 00010361
[ 4.849786] nouveau 0000:65:00.0: DRM: DCB conn 04: 00020446
[ 4.850068] nouveau 0000:65:00.0: DRM: MM: using COPY for buffer copies
[ 5.368756] nouveau 0000:65:00.0: DRM: allocated 1024x768 fb: 0x200000, bo 00000000b3b1c6e8
[ 5.371167] fbcon: nouveaudrmfb (fb0) is primary device
[ 5.498186] Console: switching to colour frame buffer device 128x48
[ 5.586730] nouveau 0000:65:00.0: [drm] fb0: nouveaudrmfb frame buffer device
[ 5.593735] [drm] Initialized nouveau 1.3.1 20120801 for 0000:65:00.0 on minor 0
[ 5.949223] sdb2: error: dax access failed (-95)
[ 5.949253] sdb2: error: dax access failed (-95)
[ 5.949383] sdb2: error: dax access failed (-95)
[ 6.008788] sdb2: error: dax access failed (-95)
[ 6.008801] sdb2: error: dax access failed (-95)
[ 6.008946] sdb2: error: dax access failed (-95)
[ 6.056401] kauditd_printk_skb: 2 callbacks suppressed
[ 6.056404] audit: type=1130 audit(1598556709.359:13): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 6.084110] audit: type=1130 audit(1598556709.387:14): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-fsck-root comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 6.098074] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
[ 6.117874] audit: type=1334 audit(1598556709.421:15): prog-id=3 op=UNLOAD
[ 6.117880] audit: type=1334 audit(1598556709.421:16): prog-id=2 op=UNLOAD
[ 6.117997] audit: type=1334 audit(1598556709.421:17): prog-id=5 op=UNLOAD
[ 6.118262] audit: type=1334 audit(1598556709.421:18): prog-id=4 op=UNLOAD
[ 6.211848] audit: type=1334 audit(1598556709.515:19): prog-id=6 op=LOAD
[ 6.212015] audit: type=1334 audit(1598556709.515:20): prog-id=7 op=LOAD
[ 6.212464] audit: type=1334 audit(1598556709.515:21): prog-id=8 op=LOAD
[ 6.212528] audit: type=1334 audit(1598556709.515:22): prog-id=9 op=LOAD
[ 6.535699] systemd-journald[328]: Received SIGTERM from PID 1 (systemd).
[ 6.593803] printk: systemd: 14 output lines suppressed due to ratelimiting
[ 6.772393] SELinux: Permission watch in class filesystem not defined in policy.
[ 6.772397] SELinux: Permission watch in class file not defined in policy.
[ 6.772397] SELinux: Permission watch_mount in class file not defined in policy.
[ 6.772397] SELinux: Permission watch_sb in class file not defined in policy.
[ 6.772398] SELinux: Permission watch_with_perm in class file not defined in policy.
[ 6.772398] SELinux: Permission watch_reads in class file not defined in policy.
[ 6.772399] SELinux: Permission watch in class dir not defined in policy.
[ 6.772400] SELinux: Permission watch_mount in class dir not defined in policy.
[ 6.772400] SELinux: Permission watch_sb in class dir not defined in policy.
[ 6.772400] SELinux: Permission watch_with_perm in class dir not defined in policy.
[ 6.772401] SELinux: Permission watch_reads in class dir not defined in policy.
[ 6.772402] SELinux: Permission watch in class lnk_file not defined in policy.
[ 6.772403] SELinux: Permission watch_mount in class lnk_file not defined in policy.
[ 6.772403] SELinux: Permission watch_sb in class lnk_file not defined in policy.
[ 6.772403] SELinux: Permission watch_with_perm in class lnk_file not defined in policy.
[ 6.772404] SELinux: Permission watch_reads in class lnk_file not defined in policy.
[ 6.772405] SELinux: Permission watch in class chr_file not defined in policy.
[ 6.772405] SELinux: Permission watch_mount in class chr_file not defined in policy.
[ 6.772405] SELinux: Permission watch_sb in class chr_file not defined in policy.
[ 6.772406] SELinux: Permission watch_with_perm in class chr_file not defined in policy.
[ 6.772406] SELinux: Permission watch_reads in class chr_file not defined in policy.
[ 6.772407] SELinux: Permission watch in class blk_file not defined in policy.
[ 6.772407] SELinux: Permission watch_mount in class blk_file not defined in policy.
[ 6.772407] SELinux: Permission watch_sb in class blk_file not defined in policy.
[ 6.772408] SELinux: Permission watch_with_perm in class blk_file not defined in policy.
[ 6.772408] SELinux: Permission watch_reads in class blk_file not defined in policy.
[ 6.772409] SELinux: Permission watch in class sock_file not defined in policy.
[ 6.772410] SELinux: Permission watch_mount in class sock_file not defined in policy.
[ 6.772410] SELinux: Permission watch_sb in class sock_file not defined in policy.
[ 6.772410] SELinux: Permission watch_with_perm in class sock_file not defined in policy.
[ 6.772411] SELinux: Permission watch_reads in class sock_file not defined in policy.
[ 6.772411] SELinux: Permission watch in class fifo_file not defined in policy.
[ 6.772412] SELinux: Permission watch_mount in class fifo_file not defined in policy.
[ 6.772412] SELinux: Permission watch_sb in class fifo_file not defined in policy.
[ 6.772412] SELinux: Permission watch_with_perm in class fifo_file not defined in policy.
[ 6.772412] SELinux: Permission watch_reads in class fifo_file not defined in policy.
[ 6.772434] SELinux: Permission perfmon in class capability2 not defined in policy.
[ 6.772435] SELinux: Permission bpf in class capability2 not defined in policy.
[ 6.772435] SELinux: Permission checkpoint_restore in class capability2 not defined in policy.
[ 6.772438] SELinux: Permission perfmon in class cap2_userns not defined in policy.
[ 6.772439] SELinux: Permission bpf in class cap2_userns not defined in policy.
[ 6.772439] SELinux: Permission checkpoint_restore in class cap2_userns not defined in policy.
[ 6.772451] SELinux: Class bpf not defined in policy.
[ 6.772451] SELinux: Class xdp_socket not defined in policy.
[ 6.772451] SELinux: Class perf_event not defined in policy.
[ 6.772452] SELinux: Class lockdown not defined in policy.
[ 6.772452] SELinux: the above unknown classes and permissions will be allowed
[ 6.772458] SELinux: policy capability network_peer_controls=1
[ 6.772458] SELinux: policy capability open_perms=1
[ 6.772458] SELinux: policy capability extended_socket_class=1
[ 6.772458] SELinux: policy capability always_check_network=0
[ 6.772459] SELinux: policy capability cgroup_seclabel=1
[ 6.772459] SELinux: policy capability nnp_nosuid_transition=1
[ 6.772459] SELinux: policy capability genfs_seclabel_symlinks=0
[ 6.789570] systemd[1]: Successfully loaded SELinux policy in 127.154ms.
[ 6.829159] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 21.871ms.
[ 6.832277] systemd[1]: systemd 238 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[ 6.844794] systemd[1]: Detected architecture x86-64.
[ 6.846742] systemd[1]: Set hostname to <otcpl-perf-test-skx-i9>.
[ 6.874250] systemd-system-update-generator[707]: Offline system update overriden by runlevel "3" on the kernel command line
[ 7.061479] systemd[1]: Stopped Switch Root.
[ 7.061795] systemd[1]: systemd-journald.service: Service has no hold-off time, scheduling restart.
[ 7.061871] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.
[ 7.061886] systemd[1]: Stopped Journal Service.
[ 7.062929] systemd[1]: Starting Journal Service...
[ 7.066192] systemd[1]: Listening on LVM2 metadata daemon socket.
[ 7.067059] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[ 7.102226] EXT4-fs (dm-0): re-mounted. Opts: (null)
[ 7.116737] systemd-journald[719]: Received request to flush runtime journal from PID 1
[ 7.342076] dca service started, version 1.12.1
[ 7.376356] ioatdma: Intel(R) QuickData Technology Driver 5.00
[ 7.453282] input: PC Speaker as /devices/platform/pcspkr/input/input5
[ 7.454740] i801_smbus 0000:00:1f.4: enabling device (0001 -> 0003)
[ 7.454969] i801_smbus 0000:00:1f.4: SPD Write Disable is set
[ 7.455008] i801_smbus 0000:00:1f.4: SMBus using PCI interrupt
[ 7.455342] mei_me 0000:00:16.0: enabling device (0000 -> 0002)
[ 7.456402] i2c i2c-17: 4/8 memory slots populated (from DMI)
[ 7.456403] i2c i2c-17: Systems with more than 4 memory slots not supported yet, not instantiating SPD
[ 7.526302] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer
[ 7.526304] RAPL PMU: hw unit of domain package 2^-14 Joules
[ 7.526305] RAPL PMU: hw unit of domain dram 2^-16 Joules
[ 7.652591] Adding 16383996k swap on /dev/mapper/fedora-swap. Priority:-2 extents:1 across:16383996k SSFS
[ 8.015601] snd_hda_intel 0000:65:00.1: Disabling MSI
[ 8.015650] snd_hda_intel 0000:65:00.1: Handle vga_switcheroo audio client
[ 8.062800] snd_hda_intel 0000:65:00.1: bound 0000:65:00.0 (ops nv50_audio_component_bind_ops [nouveau])
[ 8.070056] input: HDA NVidia HDMI/DP,pcm=3 as /devices/pci0000:64/0000:64:00.0/0000:65:00.1/sound/card1/input6
[ 8.070182] input: HDA NVidia HDMI/DP,pcm=7 as /devices/pci0000:64/0000:64:00.0/0000:65:00.1/sound/card1/input7
[ 8.070253] input: HDA NVidia HDMI/DP,pcm=8 as /devices/pci0000:64/0000:64:00.0/0000:65:00.1/sound/card1/input8
[ 8.070325] input: HDA NVidia HDMI/DP,pcm=9 as /devices/pci0000:64/0000:64:00.0/0000:65:00.1/sound/card1/input9
[ 8.070397] input: HDA NVidia HDMI/DP,pcm=10 as /devices/pci0000:64/0000:64:00.0/0000:65:00.1/sound/card1/input10
[ 8.070464] input: HDA NVidia HDMI/DP,pcm=11 as /devices/pci0000:64/0000:64:00.0/0000:65:00.1/sound/card1/input11
[ 8.070533] input: HDA NVidia HDMI/DP,pcm=12 as /devices/pci0000:64/0000:64:00.0/0000:65:00.1/sound/card1/input12
[ 8.109713] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC1220: line_outs=4 (0x14/0x15/0x16/0x17/0x0) type:line
[ 8.109717] snd_hda_codec_realtek hdaudioC0D0: speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[ 8.109720] snd_hda_codec_realtek hdaudioC0D0: hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[ 8.109722] snd_hda_codec_realtek hdaudioC0D0: mono: mono_out=0x0
[ 8.109724] snd_hda_codec_realtek hdaudioC0D0: dig-out=0x1e/0x0
[ 8.109726] snd_hda_codec_realtek hdaudioC0D0: inputs:
[ 8.109729] snd_hda_codec_realtek hdaudioC0D0: Front Mic=0x19
[ 8.109731] snd_hda_codec_realtek hdaudioC0D0: Rear Mic=0x18
[ 8.109733] snd_hda_codec_realtek hdaudioC0D0: Line=0x1a
[ 8.153435] input: HDA Intel PCH Front Mic as /devices/pci0000:00/0000:00:1f.3/sound/card0/input13
[ 8.153533] input: HDA Intel PCH Rear Mic as /devices/pci0000:00/0000:00:1f.3/sound/card0/input14
[ 8.153673] input: HDA Intel PCH Line as /devices/pci0000:00/0000:00:1f.3/sound/card0/input15
[ 8.153798] input: HDA Intel PCH Line Out Front as /devices/pci0000:00/0000:00:1f.3/sound/card0/input16
[ 8.153924] input: HDA Intel PCH Line Out Surround as /devices/pci0000:00/0000:00:1f.3/sound/card0/input17
[ 8.154026] input: HDA Intel PCH Line Out CLFE as /devices/pci0000:00/0000:00:1f.3/sound/card0/input18
[ 8.154132] input: HDA Intel PCH Line Out Side as /devices/pci0000:00/0000:00:1f.3/sound/card0/input19
[ 8.154300] input: HDA Intel PCH Front Headphone as /devices/pci0000:00/0000:00:1f.3/sound/card0/input20
[ 8.192294] EDAC skx: ECC is disabled on imc 0
[ 8.242483] EDAC skx: ECC is disabled on imc 0
[ 8.277696] EDAC skx: ECC is disabled on imc 0
[ 8.316873] EDAC skx: ECC is disabled on imc 0
[ 8.327403] intel_rapl_common: Found RAPL domain package
[ 8.327411] intel_rapl_common: Found RAPL domain dram
[ 8.327413] intel_rapl_common: DRAM domain energy unit 15300pj
[ 8.349826] EDAC skx: ECC is disabled on imc 0
[ 8.373913] EDAC skx: ECC is disabled on imc 0
[ 8.402872] EDAC skx: ECC is disabled on imc 0
[ 8.431951] EDAC skx: ECC is disabled on imc 0
[ 8.459754] EDAC skx: ECC is disabled on imc 0
[ 8.485827] EDAC skx: ECC is disabled on imc 0
[ 8.510785] EDAC skx: ECC is disabled on imc 0
[ 8.535798] EDAC skx: ECC is disabled on imc 0
[ 8.564936] EDAC skx: ECC is disabled on imc 0
[ 8.592862] EDAC skx: ECC is disabled on imc 0
[ 8.617759] EDAC skx: ECC is disabled on imc 0
[ 8.642712] EDAC skx: ECC is disabled on imc 0
[ 8.668022] EDAC skx: ECC is disabled on imc 0
[ 8.691679] EDAC skx: ECC is disabled on imc 0
[ 8.719822] EDAC skx: ECC is disabled on imc 0
[ 8.748648] EDAC skx: ECC is disabled on imc 0
[ 9.119551] sdb2: error: dax access failed (-95)
[ 9.119565] sdb2: error: dax access failed (-95)
[ 9.119692] sdb2: error: dax access failed (-95)
[ 9.126714] EXT4-fs (sdb1): mounted filesystem with ordered data mode. Opts: (null)
[ 9.193543] EXT4-fs (dm-2): mounted filesystem with ordered data mode. Opts: (null)
[ 9.459925] RPC: Registered named UNIX socket transport module.
[ 9.459926] RPC: Registered udp transport module.
[ 9.459927] RPC: Registered tcp transport module.
[ 9.459927] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 11.496367] L1TF CPU bug present and SMT on, data leak possible. See CVE-2018-3646 and https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/l1tf.html for details.
[ 12.670659] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[ 12.692331] tun: Universal TUN/TAP device driver, 1.6
[ 12.693498] virbr0: port 1(virbr0-nic) entered blocking state
[ 12.693501] virbr0: port 1(virbr0-nic) entered disabled state
[ 12.693623] device virbr0-nic entered promiscuous mode
[ 12.867333] virbr0: port 1(virbr0-nic) entered blocking state
[ 12.867338] virbr0: port 1(virbr0-nic) entered listening state
[ 12.946750] virbr0: port 1(virbr0-nic) entered disabled state
[ 15.252290] e1000e 0000:00:1f.6 enp0s31f6: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
[ 15.252360] IPv6: ADDRCONF(NETDEV_CHANGE): enp0s31f6: link becomes ready
[ 299.088993] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4000000
[ 299.089017] intel_pstate: cpu:0 max_state 43 min_policy_perf:12 max_policy_perf:40
[ 299.089018] intel_pstate: cpu:0 global_min:12 global_max:43
[ 299.089020] intel_pstate: cpu:0 max_perf_ratio:40 min_perf_ratio:12
[ 329.535690] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4200000
[ 329.535702] intel_pstate: cpu:0 max_state 43 min_policy_perf:12 max_policy_perf:42
[ 329.535703] intel_pstate: cpu:0 global_min:12 global_max:43
[ 329.535705] intel_pstate: cpu:0 max_perf_ratio:42 min_perf_ratio:12
[ 341.179436] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 341.179493] intel_pstate: cpu:0 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 341.179494] intel_pstate: cpu:0 global_min:12 global_max:43
[ 341.179496] intel_pstate: cpu:0 max_perf_ratio:43 min_perf_ratio:12
[ 375.308712] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4000000
[ 375.308724] intel_pstate: cpu:0 max_state 43 min_policy_perf:12 max_policy_perf:40
[ 375.308725] intel_pstate: cpu:0 global_min:12 global_max:43
[ 375.308727] intel_pstate: cpu:0 max_perf_ratio:40 min_perf_ratio:12
[ 489.724252] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 489.724311] intel_pstate: cpu:0 max_state 43 min_policy_perf:12 max_policy_perf:43
[ 489.724312] intel_pstate: cpu:0 global_min:12 global_max:43
[ 489.724313] intel_pstate: cpu:0 max_perf_ratio:43 min_perf_ratio:12
[ 523.474018] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4000000
[ 523.474031] intel_pstate: cpu:1 max_state 43 min_policy_perf:12 max_policy_perf:40
[ 523.474032] intel_pstate: cpu:1 global_min:12 global_max:43
[ 523.474034] intel_pstate: cpu:1 max_perf_ratio:40 min_perf_ratio:12
[ 626.188805] intel_pstate: CPU 1 stopping
[ 626.188808] intel_pstate: CPU 1 going offline
[ 626.205589] smpboot: CPU 1 is now offline
[ 633.671812] x86: Booting SMP configuration:
[ 633.671815] smpboot: Booting Node 0 Processor 1 APIC 0x2
[ 633.677208] intel_pstate: CPU 1 going online
[ 633.677253] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4000000
[ 633.677259] intel_pstate: cpu:1 max_state 43 min_policy_perf:12 max_policy_perf:40
[ 633.677260] intel_pstate: cpu:1 global_min:12 global_max:43
[ 633.677262] intel_pstate: cpu:1 max_perf_ratio:40 min_perf_ratio:12
[ 657.612648] PM: suspend entry (deep)
[ 657.612945] Filesystems sync: 0.000 seconds
[ 657.616624] Freezing user space processes ... (elapsed 0.001 seconds) done.
[ 657.617744] OOM killer disabled.
[ 657.617744] Freezing remaining freezable tasks ... (elapsed 0.001 seconds) done.
[ 657.618849] printk: Suspending console(s) (use no_console_suspend to debug)
[ 657.619374] intel_pstate: CPU 19 suspending
[ 657.619376] intel_pstate: CPU 18 suspending
[ 657.619378] intel_pstate: CPU 17 suspending
[ 657.619379] intel_pstate: CPU 16 suspending
[ 657.619381] intel_pstate: CPU 15 suspending
[ 657.619382] intel_pstate: CPU 14 suspending
[ 657.619383] intel_pstate: CPU 13 suspending
[ 657.619385] intel_pstate: CPU 12 suspending
[ 657.619386] intel_pstate: CPU 11 suspending
[ 657.619387] intel_pstate: CPU 10 suspending
[ 657.619389] intel_pstate: CPU 9 suspending
[ 657.619390] intel_pstate: CPU 8 suspending
[ 657.619391] intel_pstate: CPU 7 suspending
[ 657.619393] intel_pstate: CPU 6 suspending
[ 657.619394] intel_pstate: CPU 5 suspending
[ 657.619396] intel_pstate: CPU 4 suspending
[ 657.619397] intel_pstate: CPU 3 suspending
[ 657.619398] intel_pstate: CPU 2 suspending
[ 657.619400] intel_pstate: CPU 1 suspending
[ 657.619401] intel_pstate: CPU 0 suspending
[ 657.620880] e1000e: EEE TX LPI TIMER: 00000011
[ 657.627840] sd 1:0:0:0: [sda] Synchronizing SCSI cache
[ 657.627991] sd 6:0:0:0: [sdb] Synchronizing SCSI cache
[ 657.628086] sd 6:0:0:0: [sdb] Stopping disk
[ 657.810978] sd 1:0:0:0: [sda] Stopping disk
[ 658.182057] PM: suspend devices took 0.563 seconds
[ 658.210307] ACPI: Preparing to enter system sleep state S3
[ 658.210954] PM: Saving platform NVS memory
[ 658.211179] Disabling non-boot CPUs ...
[ 658.211907] intel_pstate: CPU 1 stopping
[ 658.211910] intel_pstate: CPU 1 going offline
[ 658.213254] smpboot: CPU 1 is now offline
[ 658.215537] intel_pstate: CPU 2 stopping
[ 658.215540] intel_pstate: CPU 2 going offline
[ 658.216878] smpboot: CPU 2 is now offline
[ 658.219102] intel_pstate: CPU 3 stopping
[ 658.219106] intel_pstate: CPU 3 going offline
[ 658.220442] smpboot: CPU 3 is now offline
[ 658.222637] intel_pstate: CPU 4 stopping
[ 658.222640] intel_pstate: CPU 4 going offline
[ 658.223979] smpboot: CPU 4 is now offline
[ 658.226151] intel_pstate: CPU 5 stopping
[ 658.226154] intel_pstate: CPU 5 going offline
[ 658.227488] smpboot: CPU 5 is now offline
[ 658.229638] intel_pstate: CPU 6 stopping
[ 658.229640] intel_pstate: CPU 6 going offline
[ 658.230971] smpboot: CPU 6 is now offline
[ 658.233078] intel_pstate: CPU 7 stopping
[ 658.233081] intel_pstate: CPU 7 going offline
[ 658.236123] smpboot: CPU 7 is now offline
[ 658.237367] intel_pstate: CPU 8 stopping
[ 658.237370] intel_pstate: CPU 8 going offline
[ 658.238679] smpboot: CPU 8 is now offline
[ 658.240741] intel_pstate: CPU 9 stopping
[ 658.240744] intel_pstate: CPU 9 going offline
[ 658.243665] smpboot: CPU 9 is now offline
[ 658.245001] intel_pstate: CPU 10 stopping
[ 658.245003] intel_pstate: CPU 10 going offline
[ 658.247954] smpboot: CPU 10 is now offline
[ 658.249118] intel_pstate: CPU 11 stopping
[ 658.249120] intel_pstate: CPU 11 going offline
[ 658.250401] smpboot: CPU 11 is now offline
[ 658.251470] intel_pstate: CPU 12 stopping
[ 658.251473] intel_pstate: CPU 12 going offline
[ 658.252759] smpboot: CPU 12 is now offline
[ 658.253829] intel_pstate: CPU 13 stopping
[ 658.253832] intel_pstate: CPU 13 going offline
[ 658.255131] smpboot: CPU 13 is now offline
[ 658.256030] intel_pstate: CPU 14 stopping
[ 658.256033] intel_pstate: CPU 14 going offline
[ 658.257348] smpboot: CPU 14 is now offline
[ 658.258382] intel_pstate: CPU 15 stopping
[ 658.258385] intel_pstate: CPU 15 going offline
[ 658.259672] smpboot: CPU 15 is now offline
[ 658.260657] intel_pstate: CPU 16 stopping
[ 658.260659] intel_pstate: CPU 16 going offline
[ 658.262002] smpboot: CPU 16 is now offline
[ 658.263009] intel_pstate: CPU 17 stopping
[ 658.263012] intel_pstate: CPU 17 going offline
[ 658.264312] smpboot: CPU 17 is now offline
[ 658.265300] intel_pstate: CPU 18 stopping
[ 658.265303] intel_pstate: CPU 18 going offline
[ 658.266660] smpboot: CPU 18 is now offline
[ 658.267708] intel_pstate: CPU 19 stopping
[ 658.267710] intel_pstate: CPU 19 going offline
[ 658.269051] smpboot: CPU 19 is now offline
[18446555219.232087] [Firmware Bug]: TSC ADJUST differs: CPU0 0 --> -4019287218. Restoring
[ 658.271576] x86/cpu: VMX (outside TXT) disabled by BIOS
[ 658.271577] ACPI: Low-level resume complete
[ 658.271639] PM: Restoring platform NVS memory
[ 658.276430] smpboot: Scheduler frequency invariance went wobbly, disabling!
[ 658.276502] Enabling non-boot CPUs ...
[ 658.276544] x86: Booting SMP configuration:
[ 658.276545] smpboot: Booting Node 0 Processor 1 APIC 0x2
[ 658.280237] intel_pstate: CPU 1 going online
[ 658.280240] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4000000
[ 658.280245] unchecked MSR access error: RDMSR from 0x771 at rIP: 0xffffffff8406e253 (native_read_msr+0x3/0x30)
[ 658.280245] Call Trace:
[ 658.280250] __rdmsr_on_cpu+0x2f/0x40
[ 658.280254] generic_exec_single+0x59/0x90
[ 658.280255] smp_call_function_single+0xde/0x120
[ 658.280256] ? pldmfw_flash_image+0xb30/0xb30
[ 658.280259] ? vprintk_emit+0x18b/0x270
[ 658.280259] rdmsrl_on_cpu+0x57/0x80
[ 658.280262] intel_pstate_get_hwp_max+0x34/0x90
[ 658.280264] intel_pstate_update_perf_limits+0xe3/0x1f0
[ 658.280265] intel_pstate_set_policy+0x60/0x2b4
[ 658.280267] cpufreq_set_policy+0x11c/0x350
[ 658.280269] cpufreq_online+0x7e8/0x8a0
[ 658.280270] ? cpufreq_online+0x8a0/0x8a0
[ 658.280271] cpuhp_cpufreq_online+0xa/0x10
[ 658.280273] cpuhp_invoke_callback+0x94/0x540
[ 658.280275] ? padata_free_shell+0x80/0x80
[ 658.280277] ? sort_range+0x20/0x20
[ 658.280278] cpuhp_thread_fun+0xb0/0x110
[ 658.280279] smpboot_thread_fn+0xc5/0x160
[ 658.280281] kthread+0x116/0x130
[ 658.280282] ? kthread_park+0x80/0x80
[ 658.280285] ret_from_fork+0x22/0x30
[ 658.280286] intel_pstate: cpu:1 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.280287] intel_pstate: cpu:1 global_min:0 global_max:0
[ 658.280287] intel_pstate: cpu:1 max_perf_ratio:0 min_perf_ratio:0
[ 658.280290] unchecked MSR access error: WRMSR to 0x774 (tried to write 0x0000000000000000) at rIP: 0xffffffff8406e334 (native_write_msr+0x4/0x20)
[ 658.280290] Call Trace:
[ 658.280291] __wrmsr_on_cpu+0x33/0x40
[ 658.280292] generic_exec_single+0x59/0x90
[ 658.280293] smp_call_function_single+0xde/0x120
[ 658.280294] ? __rdmsr_on_cpu+0x40/0x40
[ 658.280294] ? intel_pstate_update_perf_limits+0x124/0x1f0
[ 658.280295] wrmsrl_on_cpu+0x58/0x80
[ 658.280296] intel_pstate_set_policy+0x233/0x2b4
[ 658.280297] cpufreq_set_policy+0x11c/0x350
[ 658.280298] cpufreq_online+0x7e8/0x8a0
[ 658.280299] ? cpufreq_online+0x8a0/0x8a0
[ 658.280300] cpuhp_cpufreq_online+0xa/0x10
[ 658.280301] cpuhp_invoke_callback+0x94/0x540
[ 658.280302] ? padata_free_shell+0x80/0x80
[ 658.280303] ? sort_range+0x20/0x20
[ 658.280303] cpuhp_thread_fun+0xb0/0x110
[ 658.280304] smpboot_thread_fn+0xc5/0x160
[ 658.280305] kthread+0x116/0x130
[ 658.280306] ? kthread_park+0x80/0x80
[ 658.280307] ret_from_fork+0x22/0x30
[ 658.280425] CPU1 is up
[ 658.280452] smpboot: Booting Node 0 Processor 2 APIC 0x4
[ 658.284132] intel_pstate: CPU 2 going online
[ 658.284134] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.284136] intel_pstate: cpu:2 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.284137] intel_pstate: cpu:2 global_min:0 global_max:0
[ 658.284137] intel_pstate: cpu:2 max_perf_ratio:0 min_perf_ratio:0
[ 658.284257] CPU2 is up
[ 658.284281] smpboot: Booting Node 0 Processor 3 APIC 0x6
[ 658.287924] intel_pstate: CPU 3 going online
[ 658.287927] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 658.287929] intel_pstate: cpu:3 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.287929] intel_pstate: cpu:3 global_min:0 global_max:0
[ 658.287929] intel_pstate: cpu:3 max_perf_ratio:0 min_perf_ratio:0
[ 658.288048] CPU3 is up
[ 658.288071] smpboot: Booting Node 0 Processor 4 APIC 0x8
[ 658.291814] intel_pstate: CPU 4 going online
[ 658.291816] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.291819] intel_pstate: cpu:4 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.291819] intel_pstate: cpu:4 global_min:0 global_max:0
[ 658.291820] intel_pstate: cpu:4 max_perf_ratio:0 min_perf_ratio:0
[ 658.291941] CPU4 is up
[ 658.291971] smpboot: Booting Node 0 Processor 5 APIC 0x10
[ 658.295709] intel_pstate: CPU 5 going online
[ 658.295712] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.295714] intel_pstate: cpu:5 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.295715] intel_pstate: cpu:5 global_min:0 global_max:0
[ 658.295715] intel_pstate: cpu:5 max_perf_ratio:0 min_perf_ratio:0
[ 658.295850] CPU5 is up
[ 658.295875] smpboot: Booting Node 0 Processor 6 APIC 0x12
[ 658.299512] intel_pstate: CPU 6 going online
[ 658.299515] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.299517] intel_pstate: cpu:6 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.299517] intel_pstate: cpu:6 global_min:0 global_max:0
[ 658.299518] intel_pstate: cpu:6 max_perf_ratio:0 min_perf_ratio:0
[ 658.299648] CPU6 is up
[ 658.299673] smpboot: Booting Node 0 Processor 7 APIC 0x14
[ 658.303307] intel_pstate: CPU 7 going online
[ 658.303309] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.303312] intel_pstate: cpu:7 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.303312] intel_pstate: cpu:7 global_min:0 global_max:0
[ 658.303313] intel_pstate: cpu:7 max_perf_ratio:0 min_perf_ratio:0
[ 658.303456] CPU7 is up
[ 658.303479] smpboot: Booting Node 0 Processor 8 APIC 0x16
[ 658.307057] intel_pstate: CPU 8 going online
[ 658.307060] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.307062] intel_pstate: cpu:8 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.307062] intel_pstate: cpu:8 global_min:0 global_max:0
[ 658.307063] intel_pstate: cpu:8 max_perf_ratio:0 min_perf_ratio:0
[ 658.307216] CPU8 is up
[ 658.307239] smpboot: Booting Node 0 Processor 9 APIC 0x18
[ 658.311010] intel_pstate: CPU 9 going online
[ 658.311013] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 658.311015] intel_pstate: cpu:9 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.311015] intel_pstate: cpu:9 global_min:0 global_max:0
[ 658.311016] intel_pstate: cpu:9 max_perf_ratio:0 min_perf_ratio:0
[ 658.311179] CPU9 is up
[ 658.311204] smpboot: Booting Node 0 Processor 10 APIC 0x1
[ 658.312420] intel_pstate: CPU 10 going online
[ 658.312422] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.312424] intel_pstate: cpu:10 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.312424] intel_pstate: cpu:10 global_min:0 global_max:0
[ 658.312425] intel_pstate: cpu:10 max_perf_ratio:0 min_perf_ratio:0
[ 658.312635] CPU10 is up
[ 658.312660] smpboot: Booting Node 0 Processor 11 APIC 0x3
[ 658.313864] intel_pstate: CPU 11 going online
[ 658.313867] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.313868] intel_pstate: cpu:11 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.313869] intel_pstate: cpu:11 global_min:0 global_max:0
[ 658.313869] intel_pstate: cpu:11 max_perf_ratio:0 min_perf_ratio:0
[ 658.314040] CPU11 is up
[ 658.314065] smpboot: Booting Node 0 Processor 12 APIC 0x5
[ 658.315273] intel_pstate: CPU 12 going online
[ 658.315275] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.315277] intel_pstate: cpu:12 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.315278] intel_pstate: cpu:12 global_min:0 global_max:0
[ 658.315278] intel_pstate: cpu:12 max_perf_ratio:0 min_perf_ratio:0
[ 658.315466] CPU12 is up
[ 658.315490] smpboot: Booting Node 0 Processor 13 APIC 0x7
[ 658.316598] intel_pstate: CPU 13 going online
[ 658.316600] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 658.316602] intel_pstate: cpu:13 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.316603] intel_pstate: cpu:13 global_min:0 global_max:0
[ 658.316603] intel_pstate: cpu:13 max_perf_ratio:0 min_perf_ratio:0
[ 658.316789] CPU13 is up
[ 658.316816] smpboot: Booting Node 0 Processor 14 APIC 0x9
[ 658.318057] intel_pstate: CPU 14 going online
[ 658.318060] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.318062] intel_pstate: cpu:14 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.318062] intel_pstate: cpu:14 global_min:0 global_max:0
[ 658.318063] intel_pstate: cpu:14 max_perf_ratio:0 min_perf_ratio:0
[ 658.318263] CPU14 is up
[ 658.318287] smpboot: Booting Node 0 Processor 15 APIC 0x11
[ 658.319518] intel_pstate: CPU 15 going online
[ 658.319521] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.319523] intel_pstate: cpu:15 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.319523] intel_pstate: cpu:15 global_min:0 global_max:0
[ 658.319524] intel_pstate: cpu:15 max_perf_ratio:0 min_perf_ratio:0
[ 658.319728] CPU15 is up
[ 658.319753] smpboot: Booting Node 0 Processor 16 APIC 0x13
[ 658.320937] intel_pstate: CPU 16 going online
[ 658.320940] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.320941] intel_pstate: cpu:16 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.320942] intel_pstate: cpu:16 global_min:0 global_max:0
[ 658.320942] intel_pstate: cpu:16 max_perf_ratio:0 min_perf_ratio:0
[ 658.321168] CPU16 is up
[ 658.321190] smpboot: Booting Node 0 Processor 17 APIC 0x15
[ 658.322282] intel_pstate: CPU 17 going online
[ 658.322284] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.322286] intel_pstate: cpu:17 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.322287] intel_pstate: cpu:17 global_min:0 global_max:0
[ 658.322287] intel_pstate: cpu:17 max_perf_ratio:0 min_perf_ratio:0
[ 658.322506] CPU17 is up
[ 658.322537] smpboot: Booting Node 0 Processor 18 APIC 0x17
[ 658.323738] intel_pstate: CPU 18 going online
[ 658.323740] intel_pstate: set_policy cpuinfo.max 4300000 policy->max 4300000
[ 658.323742] intel_pstate: cpu:18 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.323743] intel_pstate: cpu:18 global_min:0 global_max:0
[ 658.323743] intel_pstate: cpu:18 max_perf_ratio:0 min_perf_ratio:0
[ 658.323975] CPU18 is up
[ 658.323998] smpboot: Booting Node 0 Processor 19 APIC 0x19
[ 658.325164] intel_pstate: CPU 19 going online
[ 658.325166] intel_pstate: set_policy cpuinfo.max 4500000 policy->max 4500000
[ 658.325168] intel_pstate: cpu:19 max_state 0 min_policy_perf:0 max_policy_perf:0
[ 658.325169] intel_pstate: cpu:19 global_min:0 global_max:0
[ 658.325169] intel_pstate: cpu:19 max_perf_ratio:0 min_perf_ratio:0
[ 658.325408] CPU19 is up
[ 658.333941] ACPI: Waking up from system sleep state S3
[ 658.371624] pci 0000:16:05.0: disabled boot interrupts on device [8086:2034]
[ 658.371669] pci 0000:64:05.0: disabled boot interrupts on device [8086:2034]
[ 658.371784] pci 0000:b2:05.0: disabled boot interrupts on device [8086:2034]
[ 658.372238] usb usb1: root hub lost power or was reset
[ 658.372239] usb usb2: root hub lost power or was reset
[ 658.372487] hpet_rtc_timer_reinit: 80 callbacks suppressed
[ 658.372488] hpet: Lost 177 RTC interrupts
[ 658.373401] sd 1:0:0:0: [sda] Starting disk
[ 658.373420] sd 6:0:0:0: [sdb] Starting disk
[ 658.703478] ata1: SATA link down (SStatus 4 SControl 300)
[ 658.703492] ata3: SATA link down (SStatus 4 SControl 300)
[ 658.704037] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[ 658.704132] ata7: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[ 658.704382] ata5: SATA link down (SStatus 4 SControl 300)
[ 658.704408] ata8: SATA link down (SStatus 4 SControl 300)
[ 658.704422] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[ 658.704433] ata4: SATA link down (SStatus 4 SControl 300)
[ 658.705178] ata7.00: configured for UDMA/133
[ 658.705211] ata7.00: Enabling discard_zeroes_data
[ 658.708254] usb 1-2: reset high-speed USB device number 2 using xhci_hcd
[ 658.709119] ata6.00: configured for UDMA/133
[ 658.745341] ata2.00: configured for UDMA/133
[ 660.174295] usb 1-2.3: reset high-speed USB device number 3 using xhci_hcd
[ 660.263942] intel_pstate: CPU 19 resuming
[ 660.263950] intel_pstate: CPU 18 resuming
[ 660.263958] intel_pstate: CPU 17 resuming
[ 660.263962] intel_pstate: CPU 16 resuming
[ 660.263969] intel_pstate: CPU 15 resuming
[ 660.263976] intel_pstate: CPU 14 resuming
[ 660.263984] intel_pstate: CPU 13 resuming
[ 660.263992] intel_pstate: CPU 12 resuming
[ 660.264000] intel_pstate: CPU 11 resuming
[ 660.264008] intel_pstate: CPU 10 resuming
[ 660.264015] intel_pstate: CPU 9 resuming
[ 660.264021] intel_pstate: CPU 8 resuming
[ 660.264027] intel_pstate: CPU 7 resuming
[ 660.264033] intel_pstate: CPU 6 resuming
[ 660.264039] intel_pstate: CPU 5 resuming
[ 660.264045] intel_pstate: CPU 4 resuming
[ 660.264051] intel_pstate: CPU 3 resuming
[ 660.264053] intel_pstate: CPU 2 resuming
[ 660.264059] intel_pstate: CPU 1 resuming
[ 660.264065] intel_pstate: CPU 0 resuming
[ 660.264725] PM: resume devices took 1.893 seconds
[ 660.264763] OOM killer enabled.
[ 660.264764] Restarting tasks ... done.
[ 660.265584] PM: suspend exit
[ 663.863248] e1000e 0000:00:1f.6 enp0s31f6: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [PATCH v3 3/5] cpufreq: intel_pstate: Tweak the EPP sysfs interface
2020-08-27 15:14 ` [PATCH v3 3/5] cpufreq: intel_pstate: Tweak the EPP sysfs interface Rafael J. Wysocki
@ 2020-08-28 12:36 ` Artem Bityutskiy
0 siblings, 0 replies; 9+ messages in thread
From: Artem Bityutskiy @ 2020-08-28 12:36 UTC (permalink / raw)
To: Rafael J. Wysocki, Linux PM; +Cc: Srinivas Pandruvada, LKML, Doug Smythies
On Thu, 2020-08-27 at 17:14 +0200, Rafael J. Wysocki wrote:
> From: "Rafael J. Wysocki" <rafael.j.wysocki@intel.com>
>
> Modify the EPP sysfs interface to reject attempts to change the EPP
> to values different from 0 ("performance") in the active mode with
> the "performance" policy (ie. scaling_governor set to "performance"),
> to avoid situations in which the kernel appears to discard data
> passed to it via the EPP sysfs attribute.
>
> Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
This one looks good to me, thanks.
Reviewed-by: Artem Bityutskiy <artem.bityutskiy@linux.intel.com>
--
Best Regards,
Artem Bityutskiy
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [PATCH v3 4/5] cpufreq: intel_pstate: Add ->offline and ->online callbacks
2020-08-27 15:20 ` [PATCH v3 4/5] cpufreq: intel_pstate: Add ->offline and ->online callbacks Rafael J. Wysocki
@ 2020-08-31 18:15 ` Rafael J. Wysocki
0 siblings, 0 replies; 9+ messages in thread
From: Rafael J. Wysocki @ 2020-08-31 18:15 UTC (permalink / raw)
To: Rafael J. Wysocki
Cc: Linux PM, Srinivas Pandruvada, LKML, Doug Smythies, Artem Bityutskiy
On Thu, Aug 27, 2020 at 5:28 PM Rafael J. Wysocki <rjw@rjwysocki.net> wrote:
>
> From: "Rafael J. Wysocki" <rafael.j.wysocki@intel.com>
>
> Add ->offline and ->online driver callbacks to prepare for taking a
> CPU offline and to restore its working configuration when it goes
> back online, respectively, to avoid invoking the ->init callback on
> every CPU online which is quite a bit of unnecessary overhead.
>
> Define ->offline and ->online so that they can be used in the
> passive mode as well as in the active mode and because ->offline
> will do the majority of ->stop_cpu work, the passive mode does
> not need that callback any more, so drop it from there.
>
> Also modify the active mode ->suspend and ->resume callbacks to
> prevent them from interfering with the new ->offline and ->online
> ones in case the latter are invoked withing the system-wide suspend
> and resume code flow and make the passive mode use them too.
>
> Signed-off-by: Rafael J. Wysocki <rafael.j.wysocki@intel.com>
> ---
>
> -> v2: Rearrange intel_pstate_init_cpu() to restore some of the previous
> behavior of it to retain the current active-mode EPP management.
>
> v2 -> v3:
> * Fold the previous [5/5] in, rework intel_pstate_resume(), add
> intel_pstate_suspend().
> * Drop intel_pstate_hwp_save_state() and drop epp_saved from struct cpudata.
> * Update the changelog.
>
> ---
> drivers/cpufreq/intel_pstate.c | 139 +++++++++++++++++++++------------
> 1 file changed, 91 insertions(+), 48 deletions(-)
>
> diff --git a/drivers/cpufreq/intel_pstate.c b/drivers/cpufreq/intel_pstate.c
> index b308c39b6204..a265ccbcbbd7 100644
> --- a/drivers/cpufreq/intel_pstate.c
> +++ b/drivers/cpufreq/intel_pstate.c
> @@ -219,14 +219,13 @@ struct global_params {
> * @epp_policy: Last saved policy used to set EPP/EPB
> * @epp_default: Power on default HWP energy performance
> * preference/bias
> - * @epp_saved: Saved EPP/EPB during system suspend or CPU offline
> - * operation
> * @epp_cached Cached HWP energy-performance preference value
> * @hwp_req_cached: Cached value of the last HWP Request MSR
> * @hwp_cap_cached: Cached value of the last HWP Capabilities MSR
> * @last_io_update: Last time when IO wake flag was set
> * @sched_flags: Store scheduler flags for possible cross CPU update
> * @hwp_boost_min: Last HWP boosted min performance
> + * @suspended: Whether or not the driver has been suspended.
> *
> * This structure stores per CPU instance data for all CPUs.
> */
> @@ -258,13 +257,13 @@ struct cpudata {
> s16 epp_powersave;
> s16 epp_policy;
> s16 epp_default;
> - s16 epp_saved;
> s16 epp_cached;
> u64 hwp_req_cached;
> u64 hwp_cap_cached;
> u64 last_io_update;
> unsigned int sched_flags;
> u32 hwp_boost_min;
> + bool suspended;
> };
>
> static struct cpudata **all_cpu_data;
> @@ -871,12 +870,6 @@ static void intel_pstate_hwp_set(unsigned int cpu)
>
> cpu_data->epp_policy = cpu_data->policy;
>
> - if (cpu_data->epp_saved >= 0) {
> - epp = cpu_data->epp_saved;
> - cpu_data->epp_saved = -EINVAL;
> - goto update_epp;
> - }
> -
> if (cpu_data->policy == CPUFREQ_POLICY_PERFORMANCE) {
> epp = intel_pstate_get_epp(cpu_data, value);
> cpu_data->epp_powersave = epp;
> @@ -903,7 +896,6 @@ static void intel_pstate_hwp_set(unsigned int cpu)
>
> epp = cpu_data->epp_powersave;
> }
> -update_epp:
> if (boot_cpu_has(X86_FEATURE_HWP_EPP)) {
> value &= ~GENMASK_ULL(31, 24);
> value |= (u64)epp << 24;
> @@ -915,14 +907,24 @@ static void intel_pstate_hwp_set(unsigned int cpu)
> wrmsrl_on_cpu(cpu, MSR_HWP_REQUEST, value);
> }
>
> -static void intel_pstate_hwp_force_min_perf(int cpu)
> +static void intel_pstate_hwp_offline(struct cpudata *cpu)
> {
> - u64 value;
> + u64 value = READ_ONCE(cpu->hwp_req_cached);
> int min_perf;
>
> - value = all_cpu_data[cpu]->hwp_req_cached;
> + if (boot_cpu_has(X86_FEATURE_HWP_EPP)) {
> + /*
> + * In case the EPP has been set to "performance" by the
> + * active mode "performance" scaling algorithm, replace that
> + * temporary value with the cached EPP one.
> + */
> + value &= ~GENMASK_ULL(31, 24);
> + value |= HWP_ENERGY_PERF_PREFERENCE(cpu->epp_cached);
> + WRITE_ONCE(cpu->hwp_req_cached, value);
> + }
> +
> value &= ~GENMASK_ULL(31, 0);
> - min_perf = HWP_LOWEST_PERF(all_cpu_data[cpu]->hwp_cap_cached);
> + min_perf = HWP_LOWEST_PERF(cpu->hwp_cap_cached);
>
> /* Set hwp_max = hwp_min */
> value |= HWP_MAX_PERF(min_perf);
> @@ -932,19 +934,7 @@ static void intel_pstate_hwp_force_min_perf(int cpu)
> if (boot_cpu_has(X86_FEATURE_HWP_EPP))
> value |= HWP_ENERGY_PERF_PREFERENCE(HWP_EPP_POWERSAVE);
>
> - wrmsrl_on_cpu(cpu, MSR_HWP_REQUEST, value);
> -}
> -
> -static int intel_pstate_hwp_save_state(struct cpufreq_policy *policy)
> -{
> - struct cpudata *cpu_data = all_cpu_data[policy->cpu];
> -
> - if (!hwp_active)
> - return 0;
> -
> - cpu_data->epp_saved = intel_pstate_get_epp(cpu_data, 0);
> -
> - return 0;
> + wrmsrl_on_cpu(cpu->cpu, MSR_HWP_REQUEST, value);
> }
>
> #define POWER_CTL_EE_ENABLE 1
> @@ -971,8 +961,22 @@ static void set_power_ctl_ee_state(bool input)
>
> static void intel_pstate_hwp_enable(struct cpudata *cpudata);
>
> +static int intel_pstate_suspend(struct cpufreq_policy *policy)
> +{
> + struct cpudata *cpu = all_cpu_data[policy->cpu];
> +
> + pr_debug("CPU %d suspending\n", cpu->cpu);
> +
> + cpu->suspended = true;
> +
> + return 0;
> +}
> +
> static int intel_pstate_resume(struct cpufreq_policy *policy)
> {
> + struct cpudata *cpu = all_cpu_data[policy->cpu];
> +
> + pr_debug("CPU %d resuming\n", cpu->cpu);
>
> /* Only restore if the system default is changed */
> if (power_ctl_ee_state == POWER_CTL_EE_ENABLE)
> @@ -980,18 +984,22 @@ static int intel_pstate_resume(struct cpufreq_policy *policy)
> else if (power_ctl_ee_state == POWER_CTL_EE_DISABLE)
> set_power_ctl_ee_state(false);
>
> - if (!hwp_active)
> - return 0;
> + if (hwp_active) {
> + mutex_lock(&intel_pstate_limits_lock);
>
> - mutex_lock(&intel_pstate_limits_lock);
> + /*
> + * Enable for all CPUs, because the boot CPU may not be the
> + * first one to resume.
> + */
> + intel_pstate_hwp_enable(cpu);
>
> - if (policy->cpu == 0)
> - intel_pstate_hwp_enable(all_cpu_data[policy->cpu]);
> + wrmsrl_on_cpu(cpu->cpu, MSR_HWP_REQUEST,
> + READ_ONCE(cpu->hwp_req_cached));
>
> - all_cpu_data[policy->cpu]->epp_policy = 0;
> - intel_pstate_hwp_set(policy->cpu);
> + mutex_unlock(&intel_pstate_limits_lock);
> + }
>
> - mutex_unlock(&intel_pstate_limits_lock);
> + cpu->suspended = false;
>
> return 0;
> }
> @@ -1440,7 +1448,6 @@ static void intel_pstate_hwp_enable(struct cpudata *cpudata)
> wrmsrl_on_cpu(cpudata->cpu, MSR_HWP_INTERRUPT, 0x00);
>
> wrmsrl_on_cpu(cpudata->cpu, MSR_PM_ENABLE, 0x1);
> - cpudata->epp_policy = 0;
> if (cpudata->epp_default == -EINVAL)
> cpudata->epp_default = intel_pstate_get_epp(cpudata, 0);
> }
> @@ -2111,7 +2118,6 @@ static int intel_pstate_init_cpu(unsigned int cpunum)
>
> cpu->epp_default = -EINVAL;
> cpu->epp_powersave = -EINVAL;
> - cpu->epp_saved = -EINVAL;
> }
>
> cpu = all_cpu_data[cpunum];
> @@ -2122,6 +2128,7 @@ static int intel_pstate_init_cpu(unsigned int cpunum)
> const struct x86_cpu_id *id;
>
> intel_pstate_hwp_enable(cpu);
> + cpu->epp_policy = 0;
>
> id = x86_match_cpu(intel_pstate_hwp_boost_ids);
> if (id && intel_pstate_acpi_pm_profile_server())
> @@ -2308,28 +2315,59 @@ static int intel_pstate_verify_policy(struct cpufreq_policy_data *policy)
> return 0;
> }
>
> -static void intel_cpufreq_stop_cpu(struct cpufreq_policy *policy)
> +static int intel_pstate_cpu_offline(struct cpufreq_policy *policy)
> {
> + struct cpudata *cpu = all_cpu_data[policy->cpu];
> +
> + pr_debug("CPU %d going offline\n", cpu->cpu);
> +
> + if (cpu->suspended)
> + return 0;
> +
> + intel_pstate_exit_perf_limits(policy);
> +
> + /*
> + * If the CPU is an SMT thread and it goes offline with the performance
> + * settings different from the minimum, it will prevent its sibling
> + * from getting to lower performance levels, so force the minimum
> + * performance on CPU offline to prevent that from happening.
> + */
> if (hwp_active)
> - intel_pstate_hwp_force_min_perf(policy->cpu);
> + intel_pstate_hwp_offline(cpu);
> else
> - intel_pstate_set_min_pstate(all_cpu_data[policy->cpu]);
> + intel_pstate_set_min_pstate(cpu);
> +
> + return 0;
> }
>
> -static void intel_pstate_stop_cpu(struct cpufreq_policy *policy)
> +static int intel_pstate_cpu_online(struct cpufreq_policy *policy)
> {
> - pr_debug("CPU %d exiting\n", policy->cpu);
> + struct cpudata *cpu = all_cpu_data[policy->cpu];
> +
> + pr_debug("CPU %d going online\n", cpu->cpu);
> +
> + if (cpu->suspended)
_cpu_online() needs to enable HWP if "suspended", or the MSR accesses
in _set_policy() will trigger warnings when resuming from ACPI S3.
This has been fixed in the intel_pstate-testing branch already and I
will send an update of the patch tomorrow.
Thanks!
^ permalink raw reply [flat|nested] 9+ messages in thread
end of thread, other threads:[~2020-08-31 18:16 UTC | newest]
Thread overview: 9+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-08-27 15:08 [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Rafael J. Wysocki
2020-08-27 15:10 ` [PATCH v3 1/5] cpufreq: intel_pstate: Refuse to turn off with HWP enabled Rafael J. Wysocki
2020-08-27 15:13 ` [PATCH v3 2/5] cpufreq: intel_pstate: Update cached EPP in the active mode Rafael J. Wysocki
2020-08-27 15:14 ` [PATCH v3 3/5] cpufreq: intel_pstate: Tweak the EPP sysfs interface Rafael J. Wysocki
2020-08-28 12:36 ` Artem Bityutskiy
2020-08-27 15:20 ` [PATCH v3 4/5] cpufreq: intel_pstate: Add ->offline and ->online callbacks Rafael J. Wysocki
2020-08-31 18:15 ` Rafael J. Wysocki
2020-08-27 15:27 ` [PATCH v3 5/5] cpufreq: intel_pstate: Free memory only when turning off Rafael J. Wysocki
2020-08-27 19:52 ` [PATCH v3 0/5] cpufreq: intel_pstate: Address some HWP-related oddities Srinivas Pandruvada
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).