From: Steve Lord <lord@sgi.com>
To: Hirotaka Sasaki <sasaki@valinux.co.jp>
Cc: Linux Kernel <linux-kernel@vger.kernel.org>,
taka@valinux.co.jp, minoura@valinux.co.jp, alexr@valinux.co.jp
Subject: Re: [PATCH] remove 2TB block device limit
Date: 15 May 2002 16:49:16 -0500 [thread overview]
Message-ID: <1021499356.19994.686.camel@jen.americas.sgi.com> (raw)
In-Reply-To: <20020515094613.DA2C97001F@sv1.valinux.co.jp>
On Wed, 2002-05-15 at 04:41, Hirotaka Sasaki wrote:
> Hi,
> My name is Hirotaka Sasaki and I work for VA Linux Japan.
> We've had a need for large disk support as well, and so I've developed
> support for 64-bit block numbers and page cache indices.
>
> I'm not subscribed to this list so please CC on any responses.
>
> All development I've done so far has been tested on 2.4.17 w/XFS
> - linux-2.4.17
> - xfs-1.0.2
> - x86 (p3) architecture
>
> The main revisions my patch includes:
> - 64-bit page cache indices (doesn't support 64-bit mmap)
You will need to extend this into the xfs code base, particularly pagebuf.
> - 64-bit block #'s, sector #'s in the block I/O layer
> - 64-bit block device file (support for block #'s)
> - raw and direct I/O support for 64-bit block and sector #'s
> - 64-bit start_sect/nr_sect support in struct hd_struct
> - 64-bit blk_size table
> - 64-bit SCSI device sizes (sd_sizes/sr_sizes)
> - 64-bit loop device
>
> This patch at:
> ftp://ftp.valinux.co.jp/pub/people/sasaki/blk64/va-block64-2.4.17.patch
>
> Other revisions (not necessarily including the kernel):
>
> In order to create a file system larger than 2TB on XFS I,
> - changed ioctl(BLKGETSIZE) to ioctl(BLKGETSIZE64) in mkfs.xfs
> - in the kernel fixed an error in the handling of ioctl(BLKGETSIZE64)
>
> This patches at:
> ftp://ftp.valinux.co.jp/pub/people/sasaki/blk64/va-blkgetsize64-2.4.17.patch
> ftp://ftp.valinux.co.jp/pub/people/sasaki/blk64/xfsprogs-1.3.17-blkgetsize64.patch
>
> In order to display a file system size larger than 16TB using df I,
> - added a new system call to the kernel, statfs64
> - added statfs64 to struct super
> - modified XFS and NFSv3 to support statfs64
> - created a new library, statvfs64, to use statfs64 which is
> then called by df command
>
> This patches at:
> ftp://ftp.valinux.co.jp/pub/people/sasaki/blk64/va-statfs64-2.4.17.patch
> ftp://ftp.valinux.co.jp/pub/people/sasaki/blk64/va-statfs64_xfs-2.4.17.patch
> ftp://ftp.valinux.co.jp/pub/people/sasaki/blk64/va-statfs64_nfsd-2.4.17.patch
> ftp://ftp.valinux.co.jp/pub/people/sasaki/blk64/va-statfs64_nfs-2.4.17.patch
> ftp://ftp.valinux.co.jp/pub/people/sasaki/blk64/fileutils-4.1-df_statvfs64.patch
>
> I ran several tests on XFS by creating a file system and mounting
> it on the loop device. I noticed that the size of the file system
> is limited to 16TB by XFS_MAX_FILE_OFFSET. I need to test file systems
> > 16TB so I changed XFS_MAX_FILE_OFFSET to (long long)((1ULL<<63)-1ULL).
> However, XFS internally uses unsigned long's for the page cache indices
> which means everything works great until you mount the file system, but
> after that it all falls apart.
XFS_MAX_FILE_OFFSET on linux was reduced to reflect the maximum
cachable offset in a file. This only affects access to files themselves,
not to metadata. For the metadata end of things you need to look at
_pagebuf_lookup_pages in fs/xfs/pagebuf/page_buf.c. I have not looked
at your patches yet, but abstracting the page index into a special
typedef would be the way to go if you have not already done so.
I am about to totally revamp the XFS I/O path, so you might want to
wait a bit and then pick up the xfs cvs tree from oss.sgi.com.
Steve
--
Steve Lord voice: +1-651-683-3511
Principal Engineer, Filesystem Software email: lord@sgi.com
next prev parent reply other threads:[~2002-05-15 21:50 UTC|newest]
Thread overview: 41+ messages / expand[flat|nested] mbox.gz Atom feed top
2002-05-15 9:41 [PATCH] remove 2TB block device limit Hirotaka Sasaki
2002-05-15 21:49 ` Steve Lord [this message]
[not found] <581856778@toto.iv>
2002-05-17 0:04 ` Peter Chubb
2002-05-17 0:18 ` Daniel Phillips
2002-05-17 13:32 ` Jesse Pollard
2002-05-17 18:02 ` Daniel Phillips
2002-05-17 18:26 ` Jesse Pollard
2002-05-17 18:36 ` Andreas Dilger
2002-05-17 19:52 ` Daniel Phillips
2002-05-17 20:25 ` Andrew Morton
2002-05-17 15:26 ` Jason L Tibbitts III
[not found] <1060250300@toto.iv>
2002-05-13 10:28 ` Peter Chubb
2002-05-13 12:13 ` Christoph Hellwig
2002-05-14 0:30 ` Peter Chubb
2002-05-14 1:36 ` Anton Altaparmakov
2002-05-16 20:32 ` Daniel Phillips
2002-05-14 2:09 ` Andrew Morton
2002-05-14 2:58 ` Peter Chubb
2002-05-14 7:22 ` Christoph Hellwig
2002-05-14 7:21 ` Christoph Hellwig
-- strict thread matches above, loose matches on Subject: below --
2002-05-10 3:53 Neil Brown
2002-05-10 3:36 Peter Chubb
2002-05-10 4:05 ` Andrew Morton
2002-05-10 8:43 ` Anton Altaparmakov
2002-05-10 9:04 ` Andrew Morton
2002-05-16 19:08 ` Daniel Phillips
2002-05-10 9:05 ` Jens Axboe
2002-05-10 9:53 ` Peter Chubb
2002-05-10 10:01 ` Jens Axboe
2002-05-10 11:43 ` Anton Altaparmakov
2002-05-10 4:51 ` Martin Dalecki
[not found] ` <20020510084713.43ce396e.jeremy@kerneltrap.org>
2002-05-10 19:12 ` Peter Chubb
2002-05-10 23:46 ` Andreas Dilger
2002-05-11 0:07 ` David Mosberger
2002-05-15 22:17 ` Andreas Dilger
2002-05-16 20:22 ` Daniel Phillips
2002-05-16 22:54 ` Andreas Dilger
2002-05-17 1:17 ` Daniel Phillips
2002-05-11 4:40 ` Peter Chubb
2002-05-15 13:49 ` Pavel Machek
2002-05-11 18:13 ` Padraig Brady
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1021499356.19994.686.camel@jen.americas.sgi.com \
--to=lord@sgi.com \
--cc=alexr@valinux.co.jp \
--cc=linux-kernel@vger.kernel.org \
--cc=minoura@valinux.co.jp \
--cc=sasaki@valinux.co.jp \
--cc=taka@valinux.co.jp \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).