All of lore.kernel.org
 help / color / mirror / Atom feed
From: Kent Overstreet <koverstreet@google.com>
To: Amit Kale <akale@stec-inc.com>
Cc: Michel Lespinasse <walken@google.com>,
	"Darrick J. Wong" <darrick.wong@oracle.com>,
	linux-bcache <linux-bcache@vger.kernel.org>,
	device-mapper development <dm-devel@redhat.com>,
	Kent Overstreet <kent.overstreet@gmail.com>,
	Mike Snitzer <snitzer@redhat.com>,
	LKML <linux-kernel@vger.kernel.org>, Jason Warr <jason@warr.net>,
	"thornber@redhat.com" <thornber@redhat.com>
Subject: Re: [RFC] [DONOTAPPLY] [PATCH] enhanceio: STEC EnhanceIO SSD caching software for Linux kernel
Date: Wed, 6 Feb 2013 16:00:45 -0800	[thread overview]
Message-ID: <20130207000045.GE27179@google.com> (raw)
In-Reply-To: <C4B5704C6FEB5244B2A1BCC8CF83B86B0A624D66FE@MYMBX.MY.STEC-INC.AD>

On Thu, Feb 07, 2013 at 06:57:40AM +0800, Amit Kale wrote:
> > -----Original Message-----
> > From: Michel Lespinasse [mailto:walken@google.com]
> > Sent: Friday, February 01, 2013 4:58 PM
> > To: Darrick J. Wong
> > Cc: Amit Kale; linux-bcache; device-mapper development; Kent
> > Overstreet; Mike Snitzer; LKML; Jason Warr; thornber@redhat.com
> > Subject: Re: [RFC] [DONOTAPPLY] [PATCH] enhanceio: STEC EnhanceIO SSD
> > caching software for Linux kernel
> > 
> > On Fri, Feb 1, 2013 at 4:44 PM, Darrick J. Wong
> > <darrick.wong@oracle.com> wrote:
> > > This is a patch to migrate STEC's enhanceio driver out of their
> > github
> > > repository and into the staging tree.  From their README:
> > >
> > > "EnhanceIO driver is based on EnhanceIO SSD caching software product
> > > developed by STEC Inc. EnhanceIO was derived from Facebook's open
> > > source Flashcache project. EnhanceIO uses SSDs as cache devices for
> > > traditional rotating hard disk drives (referred to as source volumes
> > throughout this document).
> > > EnhanceIO can work with any block device, be it an entire physical
> > > disk, an individual disk partition,  a RAIDed DAS device, a SAN
> > > volume, a device mapper volume or a software RAID (md) device."
> > 
> > What's your take on the benefits of this vs bcache ?
> 
> EnhanceIO was designed for and has been validated in enterprise environments. The important benefits are - 
> 1. There is no downtime for cache creation, deletion, editing properties, writeback/readonly/writethrough mode change.

True of bcache.

> 2. Wb mode comes with an option to control whether dirty data should be clean-up across reboots, which prevents SSD/HDD going out of sync.

No idea why you'd want this. You have to be able to handle a rebooting
with a dirty cache, if you hope to handle unclean shutdown - bcache does
this. And if you're running in writeback mode there's probably going to
be many gigabytes of dirty data in your cache, at least sometimes, and
you aren't going to want to wait for that to flush before you reboot.

If you want to flush dirty data with bcache, you can switch back to
writethrough mode whenever you want.

> 3. Our in-house testing was done for large setups with 500GB+SSDs and proportionately large HDDs, on 24CPU machines with plenty of RAM. It's survived heavy IO loads without any locking or corruption problems.

True of bcache.

> 4. Error handling is exactly what enterprises look for - writethrough/readonly modes work seamlessly regardless of SSD failures. In all the three caching modes, the guarantees of completion in presence of IO errors or shutdowns, in terms of granularity and persistence of data written, is identical to underlying HDDs.

True of bcache.

> 5. It works for all known block devices - Software RAIDs, full block devices with or without partitions, individual partitions, various intelligent block devices.

True of bcache.

> -Amit
> 
> PROPRIETARY-CONFIDENTIAL INFORMATION INCLUDED
> 
> This electronic transmission, and any documents attached hereto, may contain confidential, proprietary and/or legally privileged information. The information is intended only for use by the recipient named above. If you received this electronic message in error, please notify the sender and delete the electronic message. Any disclosure, copying, distribution, or use of the contents of information received in error is strictly prohibited, and violators will be pursued legally.

Which of the above information was proprietary, and should I not be
resending this to lkml or - who?

...

WARNING: multiple messages have this Message-ID (diff)
From: Kent Overstreet <koverstreet-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>
To: Amit Kale <akale-FZ1t8LVTR2ZWk0Htik3J/w@public.gmane.org>
Cc: Michel Lespinasse
	<walken-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>,
	"Darrick J. Wong"
	<darrick.wong-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>,
	linux-bcache
	<linux-bcache-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	device-mapper development
	<dm-devel-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
	Kent Overstreet
	<kent.overstreet-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>,
	Mike Snitzer <snitzer-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>,
	LKML <linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Jason Warr <jason-/cow75dQlsI@public.gmane.org>,
	"thornber-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org"
	<thornber-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
Subject: Re: [RFC] [DONOTAPPLY] [PATCH] enhanceio: STEC EnhanceIO SSD caching software for Linux kernel
Date: Wed, 6 Feb 2013 16:00:45 -0800	[thread overview]
Message-ID: <20130207000045.GE27179@google.com> (raw)
In-Reply-To: <C4B5704C6FEB5244B2A1BCC8CF83B86B0A624D66FE-AQg6BlXVjylhNUoibfp7lHKnxlUjViKd@public.gmane.org>

On Thu, Feb 07, 2013 at 06:57:40AM +0800, Amit Kale wrote:
> > -----Original Message-----
> > From: Michel Lespinasse [mailto:walken-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org]
> > Sent: Friday, February 01, 2013 4:58 PM
> > To: Darrick J. Wong
> > Cc: Amit Kale; linux-bcache; device-mapper development; Kent
> > Overstreet; Mike Snitzer; LKML; Jason Warr; thornber-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org
> > Subject: Re: [RFC] [DONOTAPPLY] [PATCH] enhanceio: STEC EnhanceIO SSD
> > caching software for Linux kernel
> > 
> > On Fri, Feb 1, 2013 at 4:44 PM, Darrick J. Wong
> > <darrick.wong-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org> wrote:
> > > This is a patch to migrate STEC's enhanceio driver out of their
> > github
> > > repository and into the staging tree.  From their README:
> > >
> > > "EnhanceIO driver is based on EnhanceIO SSD caching software product
> > > developed by STEC Inc. EnhanceIO was derived from Facebook's open
> > > source Flashcache project. EnhanceIO uses SSDs as cache devices for
> > > traditional rotating hard disk drives (referred to as source volumes
> > throughout this document).
> > > EnhanceIO can work with any block device, be it an entire physical
> > > disk, an individual disk partition,  a RAIDed DAS device, a SAN
> > > volume, a device mapper volume or a software RAID (md) device."
> > 
> > What's your take on the benefits of this vs bcache ?
> 
> EnhanceIO was designed for and has been validated in enterprise environments. The important benefits are - 
> 1. There is no downtime for cache creation, deletion, editing properties, writeback/readonly/writethrough mode change.

True of bcache.

> 2. Wb mode comes with an option to control whether dirty data should be clean-up across reboots, which prevents SSD/HDD going out of sync.

No idea why you'd want this. You have to be able to handle a rebooting
with a dirty cache, if you hope to handle unclean shutdown - bcache does
this. And if you're running in writeback mode there's probably going to
be many gigabytes of dirty data in your cache, at least sometimes, and
you aren't going to want to wait for that to flush before you reboot.

If you want to flush dirty data with bcache, you can switch back to
writethrough mode whenever you want.

> 3. Our in-house testing was done for large setups with 500GB+SSDs and proportionately large HDDs, on 24CPU machines with plenty of RAM. It's survived heavy IO loads without any locking or corruption problems.

True of bcache.

> 4. Error handling is exactly what enterprises look for - writethrough/readonly modes work seamlessly regardless of SSD failures. In all the three caching modes, the guarantees of completion in presence of IO errors or shutdowns, in terms of granularity and persistence of data written, is identical to underlying HDDs.

True of bcache.

> 5. It works for all known block devices - Software RAIDs, full block devices with or without partitions, individual partitions, various intelligent block devices.

True of bcache.

> -Amit
> 
> PROPRIETARY-CONFIDENTIAL INFORMATION INCLUDED
> 
> This electronic transmission, and any documents attached hereto, may contain confidential, proprietary and/or legally privileged information. The information is intended only for use by the recipient named above. If you received this electronic message in error, please notify the sender and delete the electronic message. Any disclosure, copying, distribution, or use of the contents of information received in error is strictly prohibited, and violators will be pursued legally.

Which of the above information was proprietary, and should I not be
resending this to lkml or - who?

...

  reply	other threads:[~2013-02-07  0:00 UTC|newest]

Thread overview: 23+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-02-02  0:44 [RFC] [DONOTAPPLY] [PATCH] enhanceio: STEC EnhanceIO SSD caching software for Linux kernel Darrick J. Wong
2013-02-02  0:57 ` Michel Lespinasse
2013-02-02  1:23   ` Kent Overstreet
2013-02-02  1:23     ` Kent Overstreet
2013-02-02  1:25     ` Kent Overstreet
2013-02-02  1:25       ` Kent Overstreet
2013-02-02  1:39       ` Amit Kale
2013-02-02  1:39         ` Amit Kale
2013-02-02  1:49       ` Darrick J. Wong
2013-02-06 22:57   ` Amit Kale
2013-02-07  0:00     ` Kent Overstreet [this message]
2013-02-07  0:00       ` Kent Overstreet
2013-02-07  1:54       ` Amit Kale
2013-02-07  1:54         ` Amit Kale
2013-02-09  9:09         ` Joseph Glanville
2013-02-11  7:04           ` Amit Kale
2013-02-11  7:04             ` Amit Kale
2013-02-04 14:40 ` thornber
2013-02-04 14:40   ` thornber-H+wXaHxf7aLQT0dZR+AlfA
2013-02-04 16:30   ` Amit Kale
2013-02-04 16:30     ` Amit Kale
2013-02-04 20:53   ` Darrick J. Wong
2013-02-04 20:53     ` Darrick J. Wong

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20130207000045.GE27179@google.com \
    --to=koverstreet@google.com \
    --cc=akale@stec-inc.com \
    --cc=darrick.wong@oracle.com \
    --cc=dm-devel@redhat.com \
    --cc=jason@warr.net \
    --cc=kent.overstreet@gmail.com \
    --cc=linux-bcache@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=snitzer@redhat.com \
    --cc=thornber@redhat.com \
    --cc=walken@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.