From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751590AbdBIEQU (ORCPT ); Wed, 8 Feb 2017 23:16:20 -0500 Received: from mail-pg0-f67.google.com ([74.125.83.67]:36181 "EHLO mail-pg0-f67.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751096AbdBIEQS (ORCPT ); Wed, 8 Feb 2017 23:16:18 -0500 From: Hoeun Ryu To: Andrew Morton , Michal Hocko , Ingo Molnar , Andy Lutomirski , Kees Cook , "Eric W. Biederman" , Mateusz Guzik Cc: linux-kernel@vger.kernel.org, kernel-hardening@lists.openwall.com, Hoeun Ryu Subject: [PATCH v2 1/2] fork: free vmapped stacks in cache when cpus are offline Date: Thu, 9 Feb 2017 13:03:46 +0900 Message-Id: <1486613040-30555-1-git-send-email-hoeun.ryu@gmail.com> X-Mailer: git-send-email 2.7.4 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Using virtually mapped stack, kernel stacks are allocated via vmalloc. In the current implementation, two stacks per cpu can be cached when tasks are freed and the cached stacks are used again in task duplications. but the cached stacks may remain unfreed even when cpu are offline. By adding a cpu hotplug callback to free the cached stacks when a cpu goes offline, the pages of the cached stacks are not wasted. Signed-off-by: Hoeun Ryu --- Changes in v2: remove cpuhp callback for `starup`, only `teardown` callback is installed. kernel/fork.c | 21 +++++++++++++++++++++ 1 file changed, 21 insertions(+) diff --git a/kernel/fork.c b/kernel/fork.c index 61284d8..7911ed2 100644 --- a/kernel/fork.c +++ b/kernel/fork.c @@ -170,6 +170,22 @@ void __weak arch_release_thread_stack(unsigned long *stack) static DEFINE_PER_CPU(struct vm_struct *, cached_stacks[NR_CACHED_STACKS]); #endif +static int free_vm_stack_cache(unsigned int cpu) +{ + int i; + + for (i = 0; i < NR_CACHED_STACKS; i++) { + struct vm_struct *vm_stack = this_cpu_read(cached_stacks[i]); + if (!vm_stack) + continue; + + vfree(vm_stack->addr); + this_cpu_write(cached_stacks[i], NULL); + } + + return 0; +} + static unsigned long *alloc_thread_stack_node(struct task_struct *tsk, int node) { #ifdef CONFIG_VMAP_STACK @@ -456,6 +472,11 @@ void __init fork_init(void) for (i = 0; i < UCOUNT_COUNTS; i++) { init_user_ns.ucount_max[i] = max_threads/2; } + +#ifdef CONFIG_VMAP_STACK + cpuhp_setup_state(CPUHP_AP_ONLINE_DYN, "vm_stack_cache", + NULL, free_vm_stack_cache); +#endif } int __weak arch_dup_task_struct(struct task_struct *dst, -- 2.7.4