linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Ingo Molnar <mingo@elte.hu>
To: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Jakob Oestergaard <jakob@unthought.net>,
	Jeff Garzik <jeff@garzik.org>,
	miklos@szeredi.hu, akpm@linux-foundation.org, neilb@suse.de,
	dgc@sgi.com, tomoki.sekiyama.qu@hitachi.com,
	Peter Zijlstra <a.p.zijlstra@chello.nl>,
	linux-mm@kvack.org,
	Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
	nikita@clusterfs.com, trond.myklebust@fys.uio.no,
	yingchao.zhou@gmail.com, richard@rsk.demon.co.uk, david@lang.hm
Subject: [patch] implement smarter atime updates support
Date: Sun, 5 Aug 2007 21:22:26 +0200	[thread overview]
Message-ID: <20070805192226.GA20234@elte.hu> (raw)
In-Reply-To: <20070805190928.GA17433@elte.hu>


* Ingo Molnar <mingo@elte.hu> wrote:

> tested it by moving the date forward:
> 
>   # date
>   Sun Aug  5 22:55:14 CEST 2007
>   # date -s "Tue Aug  7 22:55:14 CEST 2007"
>   Tue Aug  7 22:55:14 CEST 2007
> 
> access to a file did not generate disk IO before the date was set, and 
> it generated exactly one IO after the date was set.
> 
> ( should i perhaps reduce the number of boot options and only use a
>   single "norelatime_default" boot option to turn this off? )

ok, cleaned it up some more: only a single, consistent boot option and 
all the switches (be that config, boot or sysctl) are now called 
"default_relatime". Also, got rid of that #ifdef ugliness in namespace.c 
via a cleaner Kconfig solution (suggested by Peter Zijlstra).

	Ingo

---------------------------->
Subject: [patch] implement smarter atime updates support
From: Ingo Molnar <mingo@elte.hu>

change relatime updates to be performed once per day. This makes
relatime a compatible solution for HSM, mailer-notification and
tmpwatch applications too.

also add the CONFIG_DEFAULT_RELATIME kernel option, which makes
"norelatime" the default for all mounts without an extra kernel
boot option.

add the "default_relatime=0" boot option to turn this off.

also add the /proc/sys/kernel/default_relatime flag which can be changed
runtime to modify the behavior of subsequent new mounts.

tested by moving the date forward:

   # date
   Sun Aug  5 22:55:14 CEST 2007
   # date -s "Tue Aug  7 22:55:14 CEST 2007"
   Tue Aug  7 22:55:14 CEST 2007

access to a file did not generate disk IO before the date was set, and
it generated exactly one IO after the date was set.

Signed-off-by: Ingo Molnar <mingo@elte.hu>
---
 Documentation/kernel-parameters.txt |    4 +++
 fs/Kconfig                          |   22 ++++++++++++++++
 fs/inode.c                          |   48 ++++++++++++++++++++++++++----------
 fs/namespace.c                      |   25 ++++++++++++++++++
 include/linux/mount.h               |    2 +
 kernel/sysctl.c                     |    9 ++++++
 6 files changed, 97 insertions(+), 13 deletions(-)

Index: linux/Documentation/kernel-parameters.txt
===================================================================
--- linux.orig/Documentation/kernel-parameters.txt
+++ linux/Documentation/kernel-parameters.txt
@@ -525,6 +525,10 @@ and is between 256 and 4096 characters. 
 			This is a 16-member array composed of values
 			ranging from 0-255.
 
+	default_relatime=
+			[FS] mount all filesystems with relative atime
+			updates by default.
+
 	default_utf8=   [VT]
 			Format=<0|1>
 			Set system-wide default UTF-8 mode for all tty's.
Index: linux/fs/Kconfig
===================================================================
--- linux.orig/fs/Kconfig
+++ linux/fs/Kconfig
@@ -2060,6 +2060,28 @@ config 9P_FS
 
 endmenu
 
+config DEFAULT_RELATIME
+	bool "Mount all filesystems with relatime by default"
+	default y
+	help
+	  If you say Y here, all your filesystems will be mounted
+	  with the "relatime" mount option. This eliminates many atime
+	  ('file last accessed' timestamp) updates (which otherwise
+	  is performed on every file access and generates a write
+	  IO to the inode) and thus speeds up IO. Atime is still updated,
+	  but only once per day.
+
+	  The mtime ('file last modified') and ctime ('file created')
+	  timestamp are unaffected by this change.
+
+	  Use the "norelatime" kernel boot option to turn off this
+	  feature.
+
+config DEFAULT_RELATIME_VAL
+	int
+	default "1" if DEFAULT_RELATIME
+	default "0"
+
 if BLOCK
 menu "Partition Types"
 
Index: linux/fs/inode.c
===================================================================
--- linux.orig/fs/inode.c
+++ linux/fs/inode.c
@@ -1162,6 +1162,36 @@ sector_t bmap(struct inode * inode, sect
 }
 EXPORT_SYMBOL(bmap);
 
+/*
+ * With relative atime, only update atime if the
+ * previous atime is earlier than either the ctime or
+ * mtime.
+ */
+static int relatime_need_update(struct inode *inode, struct timespec now)
+{
+	/*
+	 * Is mtime younger than atime? If yes, update atime:
+	 */
+	if (timespec_compare(&inode->i_mtime, &inode->i_atime) >= 0)
+		return 1;
+	/*
+	 * Is ctime younger than atime? If yes, update atime:
+	 */
+	if (timespec_compare(&inode->i_ctime, &inode->i_atime) >= 0)
+		return 1;
+
+	/*
+	 * Is the previous atime value older than a day? If yes,
+	 * update atime:
+	 */
+	if ((long)(now.tv_sec - inode->i_atime.tv_sec) >= 24*60*60)
+		return 1;
+	/*
+	 * Good, we can skip the atime update:
+	 */
+	return 0;
+}
+
 /**
  *	touch_atime	-	update the access time
  *	@mnt: mount the inode is accessed on
@@ -1191,22 +1221,14 @@ void touch_atime(struct vfsmount *mnt, s
 			return;
 		if ((mnt->mnt_flags & MNT_NODIRATIME) && S_ISDIR(inode->i_mode))
 			return;
-
-		if (mnt->mnt_flags & MNT_RELATIME) {
-			/*
-			 * With relative atime, only update atime if the
-			 * previous atime is earlier than either the ctime or
-			 * mtime.
-			 */
-			if (timespec_compare(&inode->i_mtime,
-						&inode->i_atime) < 0 &&
-			    timespec_compare(&inode->i_ctime,
-						&inode->i_atime) < 0)
+	}
+	now = current_fs_time(inode->i_sb);
+	if (mnt) {
+		if (mnt->mnt_flags & MNT_RELATIME)
+			if (!relatime_need_update(inode, now))
 				return;
-		}
 	}
 
-	now = current_fs_time(inode->i_sb);
 	if (timespec_equal(&inode->i_atime, &now))
 		return;
 
Index: linux/fs/namespace.c
===================================================================
--- linux.orig/fs/namespace.c
+++ linux/fs/namespace.c
@@ -1107,6 +1107,8 @@ int do_add_mount(struct vfsmount *newmnt
 		goto unlock;
 
 	newmnt->mnt_flags = mnt_flags;
+	WARN_ON_ONCE(newmnt->mnt_flags & MNT_RELATIME);
+
 	if ((err = graft_tree(newmnt, nd)))
 		goto unlock;
 
@@ -1362,6 +1364,24 @@ int copy_mount_options(const void __user
 }
 
 /*
+ * Allow users to disable (or enable) atime updates via a .config
+ * option or via the boot line, or via /proc/sys/fs/default_relatime:
+ */
+int default_relatime __read_mostly = CONFIG_DEFAULT_RELATIME_VAL;
+
+static int __init set_default_relatime(char *str)
+{
+	get_option(&str, &default_relatime);
+
+	printk(KERN_INFO "Mount all filesystems with"
+		"default relative atime updates: %s.\n",
+		default_relatime ? "enabled" : "disabled");
+
+	return 1;
+}
+__setup("default_relatime=", set_default_relatime);
+
+/*
  * Flags is a 32-bit value that allows up to 31 non-fs dependent flags to
  * be given to the mount() call (ie: read-only, no-dev, no-suid etc).
  *
@@ -1409,6 +1429,11 @@ long do_mount(char *dev_name, char *dir_
 		mnt_flags |= MNT_NODIRATIME;
 	if (flags & MS_RELATIME)
 		mnt_flags |= MNT_RELATIME;
+	else if (default_relatime &&
+				!(flags & (MNT_NOATIME | MNT_NODIRATIME))) {
+		mnt_flags |= MNT_RELATIME;
+		flags |= MS_RELATIME;
+	}
 
 	flags &= ~(MS_NOSUID | MS_NOEXEC | MS_NODEV | MS_ACTIVE |
 		   MS_NOATIME | MS_NODIRATIME | MS_RELATIME);
Index: linux/include/linux/mount.h
===================================================================
--- linux.orig/include/linux/mount.h
+++ linux/include/linux/mount.h
@@ -103,5 +103,7 @@ extern void shrink_submounts(struct vfsm
 extern spinlock_t vfsmount_lock;
 extern dev_t name_to_dev_t(char *name);
 
+extern int default_relatime;
+
 #endif
 #endif /* _LINUX_MOUNT_H */
Index: linux/kernel/sysctl.c
===================================================================
--- linux.orig/kernel/sysctl.c
+++ linux/kernel/sysctl.c
@@ -30,6 +30,7 @@
 #include <linux/capability.h>
 #include <linux/smp_lock.h>
 #include <linux/fs.h>
+#include <linux/mount.h>
 #include <linux/init.h>
 #include <linux/kernel.h>
 #include <linux/kobject.h>
@@ -1206,6 +1207,14 @@ static ctl_table fs_table[] = {
 		.mode		= 0644,
 		.proc_handler	= &proc_dointvec,
 	},
+	{
+		.ctl_name	= CTL_UNNUMBERED,
+		.procname	= "default_relatime",
+		.data		= &default_relatime,
+		.maxlen		= sizeof(int),
+		.mode		= 0644,
+		.proc_handler	= &proc_dointvec,
+	},
 #if defined(CONFIG_BINFMT_MISC) || defined(CONFIG_BINFMT_MISC_MODULE)
 	{
 		.ctl_name	= CTL_UNNUMBERED,

  reply	other threads:[~2007-08-05 19:23 UTC|newest]

Thread overview: 188+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-08-03 12:37 [PATCH 00/23] per device dirty throttling -v8 Peter Zijlstra
2007-08-03 12:37 ` [PATCH 01/23] nfs: remove congestion_end() Peter Zijlstra
2007-08-03 12:37 ` [PATCH 02/23] lib: percpu_counter_add Peter Zijlstra
2007-08-03 12:37 ` [PATCH 03/23] lib: percpu_counter variable batch Peter Zijlstra
2007-08-03 12:37 ` [PATCH 04/23] lib: make percpu_counter_add take s64 Peter Zijlstra
2007-08-03 12:37 ` [PATCH 05/23] lib: percpu_counter_set Peter Zijlstra
2007-08-03 12:37 ` [PATCH 06/23] lib: percpu_counter_sum_positive Peter Zijlstra
2007-08-03 12:37 ` [PATCH 07/23] lib: percpu_count_sum() Peter Zijlstra
2007-08-03 12:37 ` [PATCH 08/23] lib: percpu_counter_init error handling Peter Zijlstra
2007-08-03 12:37 ` [PATCH 09/23] lib: percpu_counter_init_irq Peter Zijlstra
2007-08-03 12:37 ` [PATCH 10/23] mm: bdi init hooks Peter Zijlstra
2007-08-03 12:37 ` [PATCH 11/23] containers: " Peter Zijlstra
2007-08-03 12:37 ` [PATCH 12/23] mtd: " Peter Zijlstra
2007-08-03 12:37 ` [PATCH 13/23] mtd: clean up the backing_dev_info usage Peter Zijlstra
2007-08-03 12:37 ` [PATCH 14/23] mtd: give mtdconcat devices their own backing_dev_info Peter Zijlstra
2007-08-03 12:37 ` [PATCH 15/23] mm: scalable bdi statistics counters Peter Zijlstra
2007-08-03 12:37 ` [PATCH 16/23] mm: count reclaimable pages per BDI Peter Zijlstra
2007-08-03 12:37 ` [PATCH 17/23] mm: count writeback " Peter Zijlstra
2007-08-09 19:15   ` Christoph Lameter
2007-08-09 19:23     ` Peter Zijlstra
2007-08-09 19:27       ` Christoph Lameter
2007-08-13  8:36         ` Peter Zijlstra
2007-08-03 12:37 ` [PATCH 18/23] mm: expose BDI statistics in sysfs Peter Zijlstra
2007-08-03 12:37 ` [PATCH 19/23] lib: floating proportions Peter Zijlstra
2007-08-03 12:37 ` [PATCH 20/23] lib: floating proportions _single Peter Zijlstra
2007-08-03 12:37 ` [PATCH 21/23] mm: per device dirty threshold Peter Zijlstra
2007-08-03 12:37 ` [PATCH 22/23] mm: dirty balancing for tasks Peter Zijlstra
2007-08-03 12:37 ` [PATCH 23/23] debug: sysfs files for the current ratio/size/total Peter Zijlstra
2007-08-03 22:21 ` [PATCH 00/23] per device dirty throttling -v8 Linus Torvalds
2007-08-04  6:32   ` Ingo Molnar
2007-08-04  7:07     ` Ingo Molnar
2007-08-04  7:44       ` david
2007-08-04 16:01         ` Ray Lee
2007-08-04 17:15           ` david
2007-08-09  5:11           ` david
2007-08-04 10:33       ` Ingo Molnar
2007-08-04 16:17         ` Linus Torvalds
2007-08-04 16:37           ` Ingo Molnar
2007-08-04 16:51             ` Andrew Morton
2007-08-04 16:56               ` Ingo Molnar
2007-08-04 20:23                 ` Alan Cox
2007-08-04 17:02             ` Diego Calleja
2007-08-04 17:17               ` Ingo Molnar
2007-08-04 17:38                 ` Diego Calleja
2007-08-04 17:51                   ` Diego Calleja
2007-08-08 10:43                 ` Karel Zak
2007-08-04 17:39             ` Linus Torvalds
2007-08-04 18:08               ` Jeff Garzik
2007-08-04 19:12                 ` Jörn Engel
2007-08-04 19:21                   ` Ingo Molnar
2007-08-04 19:26                     ` Jörn Engel
2007-08-04 19:42                       ` Jörn Engel
2007-08-05 20:36                         ` Christoph Hellwig
2007-08-06 18:03                           ` Chuck Ebbert
2007-08-06 18:53                             ` Jeff Garzik
2007-08-06 19:37                             ` Alan Cox
2007-08-06 19:46                               ` Chuck Ebbert
2007-08-07  7:05                                 ` Ingo Molnar
2007-08-08 21:10                           ` Martin J. Bligh
2007-08-08 21:21                             ` Andrew Morton
2007-08-09  0:54                               ` Martin Bligh
2007-08-11 23:14                                 ` Valerie Henson
2007-08-10  0:21                               ` Bill Davidsen
2007-08-14  9:57                           ` Helge Hafting
2007-08-04 19:47                       ` Linus Torvalds
2007-08-04 19:49                         ` Linus Torvalds
2007-08-04 20:00                         ` Ingo Molnar
2007-08-04 20:11                           ` Ingo Molnar
2007-08-04 20:13                             ` Arjan van de Ven
2007-08-05  8:18                           ` [patch] add noatime/atime boot options, CONFIG_DEFAULT_NOATIME Ingo Molnar
2007-08-04 20:13                         ` [PATCH 00/23] per device dirty throttling -v8 Arjan van de Ven
2007-08-04 21:48                           ` Theodore Tso
2007-08-05 18:01                             ` Arjan van de Ven
2007-08-05 20:34                               ` Christoph Hellwig
     [not found]                         ` <fa.7rstQpXif2z9y2n2HD+qxLFnueg@ifi.uio.no>
     [not found]                           ` <fa.6VOZrceT65Vh8CIRIta0zSg2V38@ifi.uio.no>
     [not found]                             ` <fa.xcZCTa5cHDOhrcyXZ2gZbzbu7g0@ifi.uio.no>
     [not found]                               ` <fa.JjZwG90x+07YaOx8h5VLN+9AL/8@ifi.uio.no>
     [not found]                                 ` <fa.V9U4mAEXVjNqblhzu7GRmxif7Uw@ifi.uio.no>
     [not found]                                   ` <fa.uq0BQtrgp66a08hpsF+vrqXUNC4@ifi.uio.no>
2007-08-15 18:16                                     ` david.balazic
2007-08-04 20:11                     ` [PATCH 00/23] " Alan Cox
2007-08-04 20:28                       ` Jeff Garzik
2007-08-04 21:47                         ` Alan Cox
2007-08-04 23:51                           ` Claudio Martins
2007-08-05  0:49                             ` Alan Cox
2007-08-05  7:28                               ` Ingo Molnar
2007-08-05 10:29                                 ` Jakob Oestergaard
2007-08-05 12:46                                 ` Alan Cox
2007-08-05 12:58                                   ` Ingo Molnar
2007-08-05 13:29                                     ` Willy Tarreau
2007-08-06  6:57                                       ` Ingo Molnar
2007-08-06 13:12                                         ` Willy Tarreau
2007-08-05 14:46                               ` Theodore Tso
2007-08-05 17:55                                 ` Ingo Molnar
2007-08-05 17:59                                   ` Jeff Garzik
2007-08-05 18:09                                     ` Ingo Molnar
2007-08-05 18:08                                 ` Arjan van de Ven
2007-08-07 21:20                             ` Bill Davidsen
2007-08-05  7:18                           ` Ingo Molnar
2007-08-07 18:55                         ` Bill Davidsen
2007-08-07 19:35                           ` Alan Cox
2007-08-08 17:44                             ` Bill Davidsen
2007-08-04 20:28                       ` Ingo Molnar
2007-08-04 20:34                         ` Arjan van de Ven
2007-08-04 21:03                         ` Ingo Molnar
2007-08-04 21:51                           ` Alan Cox
2007-08-05  7:21                             ` Ingo Molnar
2007-08-05  7:29                               ` Andrew Morton
2007-08-05  7:39                                 ` Ingo Molnar
2007-08-05  8:53                               ` Willy Tarreau
2007-08-05 14:17                                 ` Jörn Engel
2007-08-05 18:02                                   ` Arjan van de Ven
2007-08-05 18:37                                     ` Jörn Engel
2007-08-05 20:21                                       ` Jörn Engel
2007-08-05 20:33                                         ` Andrew Morton
2007-08-05 12:47                               ` Alan Cox
2007-08-05 12:56                                 ` Ingo Molnar
2007-08-05 18:44                               ` Dave Jones
2007-08-05 18:58                                 ` adi
2007-08-06  6:39                                 ` Ingo Molnar
2007-08-06 15:59                                   ` Dave Jones
2007-08-06 16:16                                     ` Ingo Molnar
2007-08-05  7:37                             ` Ingo Molnar
2007-08-05  9:04                               ` Jeff Garzik
2007-08-05 12:43                               ` Alan Cox
2007-08-05 12:54                                 ` Ingo Molnar
2007-08-05 13:37                                   ` Alan Cox
2007-08-05 18:08                                     ` Ingo Molnar
2007-08-05 19:11                                       ` Alan Cox
2007-08-08 18:22                                       ` Bill Davidsen
2007-08-08 19:39                                         ` Jeff Garzik
2007-08-08 20:31                                           ` Bill Davidsen
2007-08-08 23:18                                           ` Alan Cox
2007-08-07 19:09                             ` Bill Davidsen
2007-08-04 21:48                         ` Alan Cox
2007-08-05  7:13                           ` Ingo Molnar
2007-08-05 13:22                             ` Diego Calleja
2007-08-05 19:03                               ` david
2007-08-06  6:52                                 ` Ingo Molnar
2007-08-10  4:04                                 ` Bill Davidsen
2007-08-11  5:19                                   ` Valdis.Kletnieks
2007-08-06  6:58                               ` Ingo Molnar
2007-08-09  0:57                             ` Greg Trounson
2007-08-09  1:26                               ` david
2007-08-09  2:33                               ` Andi Kleen
2007-08-04 22:39                         ` Ilpo Järvinen
2007-08-05 10:20                 ` Jakob Oestergaard
2007-08-05 10:42                   ` Jeff Garzik
2007-08-05 10:58                     ` Jakob Oestergaard
2007-08-05 12:46                       ` Ingo Molnar
2007-08-05 13:46                         ` Jakob Oestergaard
2007-08-05 16:45                         ` Linus Torvalds
2007-08-05 19:09                           ` Ingo Molnar
2007-08-05 19:22                             ` Ingo Molnar [this message]
2007-08-05 19:28                               ` [patch] implement smarter atime updates support, v2 Ingo Molnar
2007-08-05 20:42                                 ` Theodore Tso
2007-08-06  5:36                                   ` Ingo Molnar
2007-08-05 19:53                               ` [patch] implement smarter atime updates support Arjan van de Ven
2007-08-05 20:04                                 ` Alan Cox
2007-08-05 20:22                                   ` Arjan van de Ven
2007-08-05 19:29                             ` [PATCH 00/23] per device dirty throttling -v8 Alan Cox
2007-08-05 19:32                               ` Ingo Molnar
2007-08-05 23:43                     ` David Chinner
2007-08-05  0:26             ` Andi Kleen
2007-08-05 15:00               ` Theodore Tso
2007-08-06 13:47                 ` Chris Mason
2007-08-17  0:45                 ` Dave Jones
2007-08-05 20:41               ` Christoph Hellwig
2007-08-06 10:42                 ` Andi Kleen
2007-08-16 10:18               ` Helge Hafting
2007-08-09  6:25             ` Lionel Elie Mamane
2007-08-09 15:02               ` Chuck Ebbert
2007-08-09 16:22                 ` Diego Calleja
2007-08-04 16:41           ` Andrew Morton
2007-08-04 17:26             ` Nikita Danilov
2007-08-04 19:16             ` Florian Weimer
2007-08-05  6:00               ` Andrew Morton
2007-08-05  7:57                 ` Florian Weimer
2007-08-05 20:43                   ` Christoph Hellwig
2007-08-05 22:46               ` Theodore Tso
2007-08-06  0:24               ` David Chinner
2007-08-05  0:28         ` Andi Kleen
2007-08-04 16:15       ` Linus Torvalds
2007-08-05 17:22     ` Brice Figureau
2007-08-05 22:17       ` Andi Kleen
2007-08-06  8:40         ` Brice Figureau
2007-08-14  1:44           ` Stewart Smith
2007-08-14  2:25             ` Andi Kleen
2007-08-14  7:59               ` Brice Figureau
2007-08-06 20:26 ` Miklos Szeredi
2007-08-08 12:25 ` richard kennedy
2007-08-08 13:54   ` Andi Kleen
2007-08-10  4:17     ` Bill Davidsen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20070805192226.GA20234@elte.hu \
    --to=mingo@elte.hu \
    --cc=a.p.zijlstra@chello.nl \
    --cc=akpm@linux-foundation.org \
    --cc=david@lang.hm \
    --cc=dgc@sgi.com \
    --cc=jakob@unthought.net \
    --cc=jeff@garzik.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=miklos@szeredi.hu \
    --cc=neilb@suse.de \
    --cc=nikita@clusterfs.com \
    --cc=richard@rsk.demon.co.uk \
    --cc=tomoki.sekiyama.qu@hitachi.com \
    --cc=torvalds@linux-foundation.org \
    --cc=trond.myklebust@fys.uio.no \
    --cc=yingchao.zhou@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).