RE: Performance Issue with multiple dataserver

[<Shyam_Iyer@Dell.com>]

> -----Original Message-----
> From: linux-nfs-owner@vger.kernel.org [mailto:linux-nfs-
> owner@vger.kernel.org] On Behalf Of Ansari, Taousif - Dell Team
> 
> Can you please elaborate GFS2-setup a bit more...


I guess Bruce is saying the step-by-step procedure is not written up...

Create a Redhat cluster using the shared block storage(iSCSI in your case I guess). You would get documentation on creating a RH cluster in many places..

All the MDSs and the DSs need to be part of the cluster.

Format GFS2 on the shared iSCSI storage.

Mount the GFS2 formatted iSCSI storage on all the MDSs and DSs and export them via NFS. Use Benny's tree for NFS.

The GFS2 cluster backend is your glue to scale the MDSes and DSes.

> 
> -----Original Message-----
> From: J. Bruce Fields [mailto:bfields@fieldses.org]
> Sent: Thursday, May 19, 2011 7:14 PM
> To: Ansari, Taousif - Dell Team
> Cc: linux-nfs@vger.kernel.org
> Subject: Re: Performance Issue with multiple dataserver
> 
> On Thu, May 19, 2011 at 06:44:59PM +0530, Taousif_Ansari@DELLTEAM.com
> wrote:
> > Then what should I follow, and what details are needed....
> 
> There isn't really any supported server-side pNFS.
> 
> The closest is the GFS2-based code, for which you need to install
> Benny's latest tree, configure a shared block device, create a GFS2
> filesystem on it, mount it across all DS's and the MDS, and export it
> from all of them--but I don't believe anyone has written step-by-step
> instructions for that.
> 
> --b.
> 
> >
> > -----Original Message-----
> > From: linux-nfs-owner@vger.kernel.org [mailto:linux-nfs-
> owner@vger.kernel.org] On Behalf Of J. Bruce Fields
> > Sent: Thursday, May 19, 2011 6:43 PM
> > To: Ansari, Taousif - Dell Team
> > Cc: linux-nfs@vger.kernel.org
> > Subject: Re: Performance Issue with multiple dataserver
> >
> > On Thu, May 19, 2011 at 06:09:21PM +0530, Taousif_Ansari@DELLTEAM.com
> wrote:
> > > I have followed the way given on http://wiki.linux-
> nfs.org/wiki/index.php/Configuring_pNFS/spnfsd .
> >
> > Oh.  As noted there, spnfs is unmaintained.
> >
> > And, in any case, we'd need many more details about your setup.
> >
> > --b.
> >
> > >
> > > -Taousif
> > >
> > > -----Original Message-----
> > > From: J. Bruce Fields [mailto:bfields@fieldses.org]
> > > Sent: Thursday, May 19, 2011 5:20 PM
> > > To: Ansari, Taousif - Dell Team
> > > Cc: linux-nfs@vger.kernel.org
> > > Subject: Re: Performance Issue with multiple dataserver
> > >
> > > On Thu, May 19, 2011 at 10:56:44AM +0530,
> Taousif_Ansari@DELLTEAM.com wrote:
> > > > Hi,
> > > >
> > > > I am using on Server linux-pnfs-2.6.38(linux-pnfs-ae7441f.tar)
> and on client also linux-pnfs-2.6.38(linux-pnfs-ae7441f.tar) downloaded
> from http://git.linux-nfs.org/?p=bhalevy/linux-pnfs.git;a=summary on
> Fedora 14.
> > >
> > > So you're using GFS2 on the server?  With what sort of storage?
> > >
> > > --b.
> > >
> > > >
> > > > Extremely sorry for causing confusing .
> > > > -----Original Message-----
> > > > From: J. Bruce Fields [mailto:bfields@fieldses.org]
> > > > Sent: Wednesday, May 18, 2011 9:43 PM
> > > > To: Ansari, Taousif - Dell Team
> > > > Cc: linux-nfs@vger.kernel.org
> > > > Subject: Re: Performance Issue with multiple dataserver
> > > >
> > > > You sent this message as a reply to an unrelated message, which
> is
> > > > confusing to those of us with threaded mail readers.
> > > >
> > > > On Wed, May 18, 2011 at 05:24:45PM +0530,
> Taousif_Ansari@DELLTEAM.com wrote:
> > > > > I have done pNFS setup with single Dataserver and Two
> Dataserver and ran the IOzone tool on both, I found that the
> performance with multiple dataservers is less than the performance with
> single dataservers.
> > > >
> > > > What are you using as the server, and what as the client?
> > > >
> > > > --b.
> > > >
> > > > >
> > > > > Here are some numbers, which were captured by the IOzone tool.
> > > > >
> > > > >
> > > > > 							  4	  8	 16	 32
> 	 64	 128	 256	 512	1024	<== Record Length in KB
> > > > > With Single Dataserver:
> > > > > Read operation for file size 1 MB-		66415	66359	63630
> 	70358	86223	70256	66047	66068	68489	<== IO kB/sec
> > > > > Write operation for file size 1 MB-		18827	16920	18846
> 	17039	18896	17009	17173	19206	17947	<== IO kB/sec
> > > > >
> > > > > With Two Dataservers :
> > > > > Read operation for file size 1 MB-		36882	381198
> 	38150	38084	38749	33663	34398	37313	37847	<== IO kB/sec
> > > > > Write operation for file size 1 MB-		5461	4661	5586
> 	4870	5227	4922	4214	5572	4658	<== IO kB/sec
> > > > >
> > > > >
> > > > > Can somebody tell me What could be the issue....
> > > > > --
> > > > > To unsubscribe from this list: send the line "unsubscribe
> linux-nfs" in
> > > > > the body of a message to majordomo@vger.kernel.org
> > > > > More majordomo info at  http://vger.kernel.org/majordomo-
> info.html
> > --
> > To unsubscribe from this list: send the line "unsubscribe linux-nfs"
> in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html