From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.0 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0C76DC4360C for ; Thu, 10 Oct 2019 07:18:29 +0000 (UTC) Received: from shelob.surriel.com (shelob.surriel.com [96.67.55.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 98C5D2067B for ; Thu, 10 Oct 2019 07:18:28 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=kroah.com header.i=@kroah.com header.b="tAT5ZaRw"; dkim=fail reason="signature verification failed" (2048-bit key) header.d=messagingengine.com header.i=@messagingengine.com header.b="sidpDNE/" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 98C5D2067B Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=kroah.com Authentication-Results: mail.kernel.org; spf=fail smtp.mailfrom=kernelnewbies-bounces@kernelnewbies.org Received: from localhost ([::1] helo=shelob.surriel.com) by shelob.surriel.com with esmtp (Exim 4.92.3) (envelope-from ) id 1iISi3-0001TY-SQ; Thu, 10 Oct 2019 03:18:03 -0400 Received: from out5-smtp.messagingengine.com ([66.111.4.29]) by shelob.surriel.com with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.92.3) (envelope-from ) id 1iISi2-0001TR-3R for kernelnewbies@kernelnewbies.org; Thu, 10 Oct 2019 03:18:02 -0400 Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id B343321CC3; Thu, 10 Oct 2019 03:18:00 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute6.internal (MEProxy); Thu, 10 Oct 2019 03:18:00 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kroah.com; h= date:from:to:cc:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=sOpPjcISuh8/5nE+d8qGq4sFUPu JAn3QfCwChZVeYDo=; b=tAT5ZaRwyEg7fYQNW+fmyGles/4SyNEvzAF5Ln80+tw k4exJjSOUjbZez2riRtrTLPKd90fUEaIZVrW9utHLZBTZnvO8S8zqKVBRRmG6toL E/MSkd0+DEV+ne7BzkFz6ZuZUKqbYaEtCQY2DpXrzxBJOOPsa39Mq9JVClEA5NQL xa8XSRlVCepPojdDHQMgfnNLytn7kMwwAgtZeRTf0g2mdKRUuszY0MhUscO97e9R WljFQ2qcs6bRUSzTLUezTN/RfrSZSR1dCkDj9H0wq/y6JllEKjJhKNxabTVKyUBT jIkrIBKp9kJJQMFzUKG7bo+tvduKqxNah4VRg8jDK2A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=sOpPjc ISuh8/5nE+d8qGq4sFUPuJAn3QfCwChZVeYDo=; b=sidpDNE/lK1nIG16k6nWhf nb/vD8s9/prS4t7mCzuLiROhcGkkeQaVZSA/ew8oNO3wSBy2I0BA8aBhNQDTZn5a opTop8yWAqgXRK9cWyr9k3z1B85tTRLq5YIvxWDYdsh/nWFz8lIR7xBYN9h3FR4Z vQEtaqygbPshH2/Sm7BhqjfleudeJo+NkZe/aH5edcjZHBlVZdDImo5Tw1kSxw2Z UwywZ8MSdOUeXiJTjuHrpOOL2xBO1GNRFrS8ZV2JBLR/IC4FHoIjEudwZT5AtiSN cDP7WAuUcOe4Ht13g4os1DguDcal3UktYnsJvgXmFx1up4uQ8wrtG+Arhvgq16Zw == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedufedriedvgdduvdduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepfffhvffukfhfgggtuggjfgesthdtredttdervdenucfhrhhomhepifhrvghg ucfmjfcuoehgrhgvgheskhhrohgrhhdrtghomheqnecuffhomhgrihhnpegsrhgvnhgurg hnghhrvghgghdrtghomhenucfkphepkeefrdekiedrkeelrddutdejnecurfgrrhgrmhep mhgrihhlfhhrohhmpehgrhgvgheskhhrohgrhhdrtghomhenucevlhhushhtvghrufhiii gvpedt X-ME-Proxy: Received: from localhost (83-86-89-107.cable.dynamic.v4.ziggo.nl [83.86.89.107]) by mail.messagingengine.com (Postfix) with ESMTPA id 0C7AE80059; Thu, 10 Oct 2019 03:17:59 -0400 (EDT) Date: Thu, 10 Oct 2019 09:17:58 +0200 From: Greg KH To: prathamesh naik Subject: Re: Predicting Process crash / Memory utlization using machine learning Message-ID: <20191010071758.GB258938@kroah.com> References: <177218.1570656506@turing-police> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.2 (2019-09-21) Cc: Valdis =?utf-8?Q?Kl=C4=93tnieks?= , kernelnewbies@kernelnewbies.org X-BeenThere: kernelnewbies@kernelnewbies.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Learn about the Linux kernel List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: kernelnewbies-bounces@kernelnewbies.org On Wed, Oct 09, 2019 at 04:40:45PM -0700, prathamesh naik wrote: > Thanks a lot for sharing. > One of the problem I am facing is not having enough actual data. I can > create simulated data but it is overfitting my algorithm. > Second problem is I am not sure what all factors (called features in ML > terms) are useful for pattern creation. > Some of the factors I could think of were : > 1. Memory used > 2. CPU > 3. shared memory > 4. vmstat > 5. message queue sizes There are loads and loads of things you can monitor in a system. See any of the talks by Brendan Gregg http://www.brendangregg.com/ for lots of examples. good luck! greg k-h _______________________________________________ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies