All of lore.kernel.org
 help / color / mirror / Atom feed
* Re: xfsrestore Does Only Only Partial Restore
@ 2011-08-29 16:36 Gim Leong Chin
  2011-08-29 16:44 ` Bill Kendall
  0 siblings, 1 reply; 10+ messages in thread
From: Gim Leong Chin @ 2011-08-29 16:36 UTC (permalink / raw)
  To: Bill Kendall; +Cc: xfs

Hi Bill,

Right now the log file is already over 500 MB and growing.  Even after compression I do not think I can mail it as an attachment.

Is there any other way that I can send you the log files?


GL

--- On Mon, 29/8/11, Bill Kendall <wkendall@sgi.com> wrote:

> From: Bill Kendall <wkendall@sgi.com>
> Subject: Re: xfsrestore Does Only Only Partial Restore
> To: "Gim Leong Chin" <chingimleong@yahoo.com.sg>
> Cc: xfs@oss.sgi.com
> Date: Monday, 29 August, 2011, 10:11 PM
> Gim Leong Chin wrote:
> > Hi,
> > 
> > This is the very first time I tried doing a xfsrestore
> of a back up and I hit some serious trouble.
> > 
> > I had openSUSE 11.1 (kernel 2.6.27) on my Acer
> notebook.  I did a xfsdump of /home to a WD My Passport
> external USB hard drive with XFS on it.
> > 
> > I installed openSUSE 11.4 (kernel 2.6.37), then tried
> to do xfsrestore from the WD USB drive.  The dump file
> is 121 GB.
> > 
> > I tried two times on two different days, but each time
> the xfsrestore would stop writing at the exact same point,
> 49 GB and say success at the end.
> > 
> > I then copied the dump file to one hard drive on my
> desk top, and did a dump to another hard drive, to
> /tmp/mnt3.  I get back identical messages:
> > 
> 
> ...
> 
> > 9>xfsrestore: attempt to read 1008286921 bytes
> failed: end of recorded data
> 
> xfsdump breaks a file's data into "extents" that are a max
> size of 16 MB.
> The fact that this is trying to read almost 1 GB here
> indicates that
> the extend header is corrupt.
> 
> ...
> 
> >   xfsrestore: content.c:7510:
> restore_extent_group: Assertion `ehdr.eh_type == 4' failed.
> 
> As Dave said, this also indicates a corrupt extent header.
> 
> I'd recommend adding "-v 5" to your xfsrestore command line
> and redirecting the
> (very verbose) output to a file, and send that compressed
> output to me or the
> list. It'd be best to do this with more than one of your
> dumps so we can see
> if there's a pattern to where the corruption occurs.
> 
> Bill
> 
> _______________________________________________
> xfs mailing list
> xfs@oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs
>


_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* Re: xfsrestore Does Only Only Partial Restore
  2011-08-29 16:36 xfsrestore Does Only Only Partial Restore Gim Leong Chin
@ 2011-08-29 16:44 ` Bill Kendall
  0 siblings, 0 replies; 10+ messages in thread
From: Bill Kendall @ 2011-08-29 16:44 UTC (permalink / raw)
  To: Gim Leong Chin; +Cc: xfs

Gim Leong Chin wrote:
> Hi Bill,
> 
> Right now the log file is already over 500 MB and growing.  Even after compression I do not think I can mail it as an attachment.
> 
> Is there any other way that I can send you the log files?

If you could just send the last few thousand lines that should be sufficient.
If I do end up needing more than that I can provide an ftp drop for you.

Thanks,
Bill

> 
> 
> GL
> 
> --- On Mon, 29/8/11, Bill Kendall <wkendall@sgi.com> wrote:
> 
>> From: Bill Kendall <wkendall@sgi.com>
>> Subject: Re: xfsrestore Does Only Only Partial Restore
>> To: "Gim Leong Chin" <chingimleong@yahoo.com.sg>
>> Cc: xfs@oss.sgi.com
>> Date: Monday, 29 August, 2011, 10:11 PM
>> Gim Leong Chin wrote:
>>> Hi,
>>>
>>> This is the very first time I tried doing a xfsrestore
>> of a back up and I hit some serious trouble.
>>> I had openSUSE 11.1 (kernel 2.6.27) on my Acer
>> notebook.  I did a xfsdump of /home to a WD My Passport
>> external USB hard drive with XFS on it.
>>> I installed openSUSE 11.4 (kernel 2.6.37), then tried
>> to do xfsrestore from the WD USB drive.  The dump file
>> is 121 GB.
>>> I tried two times on two different days, but each time
>> the xfsrestore would stop writing at the exact same point,
>> 49 GB and say success at the end.
>>> I then copied the dump file to one hard drive on my
>> desk top, and did a dump to another hard drive, to
>> /tmp/mnt3.  I get back identical messages:
>> ...
>>
>>> 9>xfsrestore: attempt to read 1008286921 bytes
>> failed: end of recorded data
>>
>> xfsdump breaks a file's data into "extents" that are a max
>> size of 16 MB.
>> The fact that this is trying to read almost 1 GB here
>> indicates that
>> the extend header is corrupt.
>>
>> ...
>>
>>>    xfsrestore: content.c:7510:
>> restore_extent_group: Assertion `ehdr.eh_type == 4' failed.
>>
>> As Dave said, this also indicates a corrupt extent header.
>>
>> I'd recommend adding "-v 5" to your xfsrestore command line
>> and redirecting the
>> (very verbose) output to a file, and send that compressed
>> output to me or the
>> list. It'd be best to do this with more than one of your
>> dumps so we can see
>> if there's a pattern to where the corruption occurs.
>>
>> Bill
>>
>> _______________________________________________
>> xfs mailing list
>> xfs@oss.sgi.com
>> http://oss.sgi.com/mailman/listinfo/xfs
>>
> 

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* Re: xfsrestore Does Only Only Partial Restore
  2011-08-30  3:06 Gim Leong Chin
@ 2011-08-30  4:07 ` Bill Kendall
  0 siblings, 0 replies; 10+ messages in thread
From: Bill Kendall @ 2011-08-30  4:07 UTC (permalink / raw)
  To: Gim Leong Chin; +Cc: xfs

Gim Leong Chin wrote:
> Hi Bill,
> 
> I have attached the xfsrestore version 3.0.1 last 20k log of my last dump file.  I will be doing with version 3.0.5 of all three of my dumps (all three are bad, I got 32 GB, 44 GB and 49 GB back).
> 
> Please let me know if this is useful.
> 
> Thank you.

Looks like the corrupt portion of the dump caused xfsdump to think it
needed to read a ton of data before it could move on. So it was
reading 256 KiB at a time until it hit the end of the file. I'll
probably need the last 1 million lines or so in order to see what
happened before it got into this state.

Thanks,
Bill

> 
> 
> GL
> 
> 
> --- On Tue, 30/8/11, Bill Kendall <wkendall@sgi.com> wrote:
> 
>> From: Bill Kendall <wkendall@sgi.com>
>> Subject: Re: xfsrestore Does Only Only Partial Restore
>> To: "Gim Leong Chin" <chingimleong@yahoo.com.sg>
>> Cc: xfs@oss.sgi.com
>> Date: Tuesday, 30 August, 2011, 12:44 AM
>> Gim Leong Chin wrote:
>>> Hi Bill,
>>>
>>> Right now the log file is already over 500 MB and
>> growing.  Even after compression I do not think I can
>> mail it as an attachment.
>>> Is there any other way that I can send you the log
>> files?
>>
>> If you could just send the last few thousand lines that
>> should be sufficient.
>> If I do end up needing more than that I can provide an ftp
>> drop for you.
>>
>> Thanks,
>> Bill
>>
>>>
>>> GL
>>>
>>> --- On Mon, 29/8/11, Bill Kendall <wkendall@sgi.com>
>> wrote:
>>>> From: Bill Kendall <wkendall@sgi.com>
>>>> Subject: Re: xfsrestore Does Only Only Partial
>> Restore
>>>> To: "Gim Leong Chin" <chingimleong@yahoo.com.sg>
>>>> Cc: xfs@oss.sgi.com
>>>> Date: Monday, 29 August, 2011, 10:11 PM
>>>> Gim Leong Chin wrote:
>>>>> Hi,
>>>>>
>>>>> This is the very first time I tried doing a
>> xfsrestore
>>>> of a back up and I hit some serious trouble.
>>>>> I had openSUSE 11.1 (kernel 2.6.27) on my
>> Acer
>>>> notebook.  I did a xfsdump of /home to a WD
>> My Passport
>>>> external USB hard drive with XFS on it.
>>>>> I installed openSUSE 11.4 (kernel 2.6.37),
>> then tried
>>>> to do xfsrestore from the WD USB drive.  The
>> dump file
>>>> is 121 GB.
>>>>> I tried two times on two different days, but
>> each time
>>>> the xfsrestore would stop writing at the exact
>> same point,
>>>> 49 GB and say success at the end.
>>>>> I then copied the dump file to one hard drive
>> on my
>>>> desk top, and did a dump to another hard drive,
>> to
>>>> /tmp/mnt3.  I get back identical messages:
>>>> ...
>>>>
>>>>> 9>xfsrestore: attempt to read 1008286921
>> bytes
>>>> failed: end of recorded data
>>>>
>>>> xfsdump breaks a file's data into "extents" that
>> are a max
>>>> size of 16 MB.
>>>> The fact that this is trying to read almost 1 GB
>> here
>>>> indicates that
>>>> the extend header is corrupt.
>>>>
>>>> ...
>>>>
>>>>>     xfsrestore: content.c:7510:
>>>> restore_extent_group: Assertion `ehdr.eh_type ==
>> 4' failed.
>>>> As Dave said, this also indicates a corrupt extent
>> header.
>>>> I'd recommend adding "-v 5" to your xfsrestore
>> command line
>>>> and redirecting the
>>>> (very verbose) output to a file, and send that
>> compressed
>>>> output to me or the
>>>> list. It'd be best to do this with more than one
>> of your
>>>> dumps so we can see
>>>> if there's a pattern to where the corruption
>> occurs.
>>>> Bill
>>>>
>>>> _______________________________________________
>>>> xfs mailing list
>>>> xfs@oss.sgi.com
>>>> http://oss.sgi.com/mailman/listinfo/xfs
>>>>
>> _______________________________________________
>> xfs mailing list
>> xfs@oss.sgi.com
>> http://oss.sgi.com/mailman/listinfo/xfs
>>

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* Re: xfsrestore Does Only Only Partial Restore
@ 2011-08-30  3:06 Gim Leong Chin
  2011-08-30  4:07 ` Bill Kendall
  0 siblings, 1 reply; 10+ messages in thread
From: Gim Leong Chin @ 2011-08-30  3:06 UTC (permalink / raw)
  To: Bill Kendall; +Cc: xfs

[-- Attachment #1: Type: text/plain, Size: 3356 bytes --]

Hi Bill,

I have attached the xfsrestore version 3.0.1 last 20k log of my last dump file.  I will be doing with version 3.0.5 of all three of my dumps (all three are bad, I got 32 GB, 44 GB and 49 GB back).

Please let me know if this is useful.

Thank you.


GL


--- On Tue, 30/8/11, Bill Kendall <wkendall@sgi.com> wrote:

> From: Bill Kendall <wkendall@sgi.com>
> Subject: Re: xfsrestore Does Only Only Partial Restore
> To: "Gim Leong Chin" <chingimleong@yahoo.com.sg>
> Cc: xfs@oss.sgi.com
> Date: Tuesday, 30 August, 2011, 12:44 AM
> Gim Leong Chin wrote:
> > Hi Bill,
> > 
> > Right now the log file is already over 500 MB and
> growing.  Even after compression I do not think I can
> mail it as an attachment.
> > 
> > Is there any other way that I can send you the log
> files?
> 
> If you could just send the last few thousand lines that
> should be sufficient.
> If I do end up needing more than that I can provide an ftp
> drop for you.
> 
> Thanks,
> Bill
> 
> > 
> > 
> > GL
> > 
> > --- On Mon, 29/8/11, Bill Kendall <wkendall@sgi.com>
> wrote:
> > 
> >> From: Bill Kendall <wkendall@sgi.com>
> >> Subject: Re: xfsrestore Does Only Only Partial
> Restore
> >> To: "Gim Leong Chin" <chingimleong@yahoo.com.sg>
> >> Cc: xfs@oss.sgi.com
> >> Date: Monday, 29 August, 2011, 10:11 PM
> >> Gim Leong Chin wrote:
> >>> Hi,
> >>>
> >>> This is the very first time I tried doing a
> xfsrestore
> >> of a back up and I hit some serious trouble.
> >>> I had openSUSE 11.1 (kernel 2.6.27) on my
> Acer
> >> notebook.  I did a xfsdump of /home to a WD
> My Passport
> >> external USB hard drive with XFS on it.
> >>> I installed openSUSE 11.4 (kernel 2.6.37),
> then tried
> >> to do xfsrestore from the WD USB drive.  The
> dump file
> >> is 121 GB.
> >>> I tried two times on two different days, but
> each time
> >> the xfsrestore would stop writing at the exact
> same point,
> >> 49 GB and say success at the end.
> >>> I then copied the dump file to one hard drive
> on my
> >> desk top, and did a dump to another hard drive,
> to
> >> /tmp/mnt3.  I get back identical messages:
> >> ...
> >>
> >>> 9>xfsrestore: attempt to read 1008286921
> bytes
> >> failed: end of recorded data
> >>
> >> xfsdump breaks a file's data into "extents" that
> are a max
> >> size of 16 MB.
> >> The fact that this is trying to read almost 1 GB
> here
> >> indicates that
> >> the extend header is corrupt.
> >>
> >> ...
> >>
> >>>    xfsrestore: content.c:7510:
> >> restore_extent_group: Assertion `ehdr.eh_type ==
> 4' failed.
> >>
> >> As Dave said, this also indicates a corrupt extent
> header.
> >>
> >> I'd recommend adding "-v 5" to your xfsrestore
> command line
> >> and redirecting the
> >> (very verbose) output to a file, and send that
> compressed
> >> output to me or the
> >> list. It'd be best to do this with more than one
> of your
> >> dumps so we can see
> >> if there's a pattern to where the corruption
> occurs.
> >>
> >> Bill
> >>
> >> _______________________________________________
> >> xfs mailing list
> >> xfs@oss.sgi.com
> >> http://oss.sgi.com/mailman/listinfo/xfs
> >>
> > 
> 
> _______________________________________________
> xfs mailing list
> xfs@oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs
>

[-- Attachment #2: xfsrestore3.0.1v5_rat18Aug2011_tail20k.gz --]
[-- Type: application/x-gzip, Size: 56538 bytes --]

[-- Attachment #3: Type: text/plain, Size: 121 bytes --]

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* Re: xfsrestore Does Only Only Partial Restore
  2011-08-28 12:31 Gim Leong Chin
  2011-08-28 15:15 ` Gim Leong Chin
  2011-08-29  5:00 ` Dave Chinner
@ 2011-08-29 14:11 ` Bill Kendall
  2 siblings, 0 replies; 10+ messages in thread
From: Bill Kendall @ 2011-08-29 14:11 UTC (permalink / raw)
  To: Gim Leong Chin; +Cc: xfs

Gim Leong Chin wrote:
> Hi,
> 
> This is the very first time I tried doing a xfsrestore of a back up and I hit some serious trouble.
> 
> I had openSUSE 11.1 (kernel 2.6.27) on my Acer notebook.  I did a xfsdump of /home to a WD My Passport external USB hard drive with XFS on it.
> 
> I installed openSUSE 11.4 (kernel 2.6.37), then tried to do xfsrestore from the WD USB drive.  The dump file is 121 GB.
> 
> I tried two times on two different days, but each time the xfsrestore would stop writing at the exact same point, 49 GB and say success at the end.
> 
> I then copied the dump file to one hard drive on my desk top, and did a dump to another hard drive, to /tmp/mnt3.  I get back identical messages:
> 

...

> 9>xfsrestore: attempt to read 1008286921 bytes failed: end of recorded data

xfsdump breaks a file's data into "extents" that are a max size of 16 MB.
The fact that this is trying to read almost 1 GB here indicates that
the extend header is corrupt.

...

>   xfsrestore: content.c:7510: restore_extent_group: Assertion `ehdr.eh_type == 4' failed.

As Dave said, this also indicates a corrupt extent header.

I'd recommend adding "-v 5" to your xfsrestore command line and redirecting the
(very verbose) output to a file, and send that compressed output to me or the
list. It'd be best to do this with more than one of your dumps so we can see
if there's a pattern to where the corruption occurs.

Bill

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* Re: xfsrestore Does Only Only Partial Restore
  2011-08-29  5:00 ` Dave Chinner
@ 2011-08-29  5:47   ` Gim Leong Chin
  0 siblings, 0 replies; 10+ messages in thread
From: Gim Leong Chin @ 2011-08-29  5:47 UTC (permalink / raw)
  To: Dave Chinner; +Cc: xfs

Hi,

I just tried the 26 Aug 2011 commited version of xfsrestore from xfsdump, I got the same message:

xfsrestore: content.c:7510: restore_extent_group: Assertion `ehdr.eh_type == 4' failed.
Aborted

It is interesting that two different back-ups are corrupt after around 44 to 49 GB, more than half of the back-ups!

I did not look at /var/log/messages or dmesg while doing the back-ups.  I only saw that the xfsdump session was successful.


GL

--- On Mon, 29/8/11, Dave Chinner <david@fromorbit.com> wrote:

> From: Dave Chinner <david@fromorbit.com>
> Subject: Re: xfsrestore Does Only Only Partial Restore
> To: "Gim Leong Chin" <chingimleong@yahoo.com.sg>
> Cc: xfs@oss.sgi.com
> Date: Monday, 29 August, 2011, 1:00 PM
> On Sun, Aug 28, 2011 at 08:31:40PM
> +0800, Gim Leong Chin wrote:
> > Hi,
> > 
> > This is the very first time I tried doing a xfsrestore
> of a back
> > up and I hit some serious trouble.
> > 
> > I had openSUSE 11.1 (kernel 2.6.27) on my Acer
> notebook.  I did a
> > xfsdump of /home to a WD My Passport external USB hard
> drive with
> > XFS on it.
> > 
> > I installed openSUSE 11.4 (kernel 2.6.37), then tried
> to do
> > xfsrestore from the WD USB drive.  The dump file
> is 121 GB.
> > 
> > I tried two times on two different days, but each time
> the
> > xfsrestore would stop writing at the exact same point,
> 49 GB and
> > say success at the end.
> > 
> > I then copied the dump file to one hard drive on my
> desk top, and
> > did a dump to another hard drive, to /tmp/mnt3. 
> I get back
> > identical messages:
> 
> ....
> > I downloaded xfsdump-3.0.5.tar.gz, did a build, and
> tried to do a restore using the newly built xfsrestore:
> 
> > {>
> >   optimus:/home/chingl/archive/rat #
> /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore -f
> ./rat18Aug2011 /tmp/mnt3
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> using file dump (drive_simple) strategy
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> version 3.0.5 (dump format 3.0) - Running single-threaded
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> searching media for dump
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> examining media file 0
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> dump description:
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> hostname: rat
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> mount point: /home
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> volume: /dev/sdb3
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> session time: Thu Aug 18 12:57:36 2011
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> level: 0
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> session label: "rat_18Aug2011"
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> media label: "rat18Aug2011"
> >
> 3>/home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: file
> system id: f3b08587-cf98-4b7b-99b0-dc9d4e77b631
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> session id: d8069cd0-a092-4fb2-b378-0eda33474aae
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> media id: 96370000-6e2c-40eb-9c3c-93ca42de7524
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> searching media for directory dump
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> reading directories
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> 90820 directories and 539579 entries processed
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> directory post-processing
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> restoring non-directory files
> >   xfsrestore: content.c:7510:
> restore_extent_group: Assertion `ehdr.eh_type == 4' failed.
> 
> Which indicates that the dump file on your external drive
> is
> probably corrupt. xfs_restore only has a certain number of
> known
> extent types, and this ASSERT failure occurs if the extent
> type is
> not valid - the restore code has checked for all special
> types,
> and is now expecting a data extent, which it isn't. That's
> where the
> restore will stop.
> 
> All the other restore attempts you've made have equivalent
> "failed
> to read" errors that also indicate some kind of corruption
> in the
> dump file.
> 
> > (>Aborted 2>optimus:/home/chingl/archive/rat #
> > 
> > 
> > Could some one please assist to enlighten me what is
> going on, why
> > does the restoration fail?  The xfsdump session
> looked OK.
> 
> Well, I can't tell you if the dump was ok or not without
> that
> output. Even if the dump was successful, it could have
> easily been
> corrupted by a memory or other hardware bit error on the
> way to
> disk. Were there any IO errors reported in the kernel dmesg
> messages
> while the dump was being taken?
> 
> > Is there any way I can extract back my /home back
> up?  This is my
> > only back up copy.  i have two other xfsdump dump
> files taken
> > earlier, I have not tried those.
> 
> No idea, you'll have to wait for the xfsdump experts to
> come online.
> 
> > Is xfsdump and xfsrestore really robust for dump to
> regular file,
> > or should I have done a tar instead?
> 
> It should be fine, but if there was a hardware related
> problem then
> all bets are off...
> 
> Cheers,
> 
> Dave.
> -- 
> Dave Chinner
> david@fromorbit.com
> 

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* Re: xfsrestore Does Only Only Partial Restore
  2011-08-28 12:31 Gim Leong Chin
  2011-08-28 15:15 ` Gim Leong Chin
@ 2011-08-29  5:00 ` Dave Chinner
  2011-08-29  5:47   ` Gim Leong Chin
  2011-08-29 14:11 ` Bill Kendall
  2 siblings, 1 reply; 10+ messages in thread
From: Dave Chinner @ 2011-08-29  5:00 UTC (permalink / raw)
  To: Gim Leong Chin; +Cc: xfs

On Sun, Aug 28, 2011 at 08:31:40PM +0800, Gim Leong Chin wrote:
> Hi,
> 
> This is the very first time I tried doing a xfsrestore of a back
> up and I hit some serious trouble.
> 
> I had openSUSE 11.1 (kernel 2.6.27) on my Acer notebook.  I did a
> xfsdump of /home to a WD My Passport external USB hard drive with
> XFS on it.
> 
> I installed openSUSE 11.4 (kernel 2.6.37), then tried to do
> xfsrestore from the WD USB drive.  The dump file is 121 GB.
> 
> I tried two times on two different days, but each time the
> xfsrestore would stop writing at the exact same point, 49 GB and
> say success at the end.
> 
> I then copied the dump file to one hard drive on my desk top, and
> did a dump to another hard drive, to /tmp/mnt3.  I get back
> identical messages:

....
> I downloaded xfsdump-3.0.5.tar.gz, did a build, and tried to do a restore using the newly built xfsrestore:

> {>
>   optimus:/home/chingl/archive/rat # /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore -f ./rat18Aug2011 /tmp/mnt3
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: using file dump (drive_simple) strategy
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: version 3.0.5 (dump format 3.0) - Running single-threaded
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: searching media for dump
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: examining media file 0
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: dump description:
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: hostname: rat
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: mount point: /home
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: volume: /dev/sdb3
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: session time: Thu Aug 18 12:57:36 2011
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: level: 0
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: session label: "rat_18Aug2011"
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: media label: "rat18Aug2011"
> 3>/home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: file system id: f3b08587-cf98-4b7b-99b0-dc9d4e77b631
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: session id: d8069cd0-a092-4fb2-b378-0eda33474aae
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: media id: 96370000-6e2c-40eb-9c3c-93ca42de7524
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: searching media for directory dump
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: reading directories
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: 90820 directories and 539579 entries processed
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: directory post-processing
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: restoring non-directory files
>   xfsrestore: content.c:7510: restore_extent_group: Assertion `ehdr.eh_type == 4' failed.

Which indicates that the dump file on your external drive is
probably corrupt. xfs_restore only has a certain number of known
extent types, and this ASSERT failure occurs if the extent type is
not valid - the restore code has checked for all special types,
and is now expecting a data extent, which it isn't. That's where the
restore will stop.

All the other restore attempts you've made have equivalent "failed
to read" errors that also indicate some kind of corruption in the
dump file.

> (>Aborted 2>optimus:/home/chingl/archive/rat #
> 
> 
> Could some one please assist to enlighten me what is going on, why
> does the restoration fail?  The xfsdump session looked OK.

Well, I can't tell you if the dump was ok or not without that
output. Even if the dump was successful, it could have easily been
corrupted by a memory or other hardware bit error on the way to
disk. Were there any IO errors reported in the kernel dmesg messages
while the dump was being taken?

> Is there any way I can extract back my /home back up?  This is my
> only back up copy.  i have two other xfsdump dump files taken
> earlier, I have not tried those.

No idea, you'll have to wait for the xfsdump experts to come online.

> Is xfsdump and xfsrestore really robust for dump to regular file,
> or should I have done a tar instead?

It should be fine, but if there was a hardware related problem then
all bets are off...

Cheers,

Dave.
-- 
Dave Chinner
david@fromorbit.com

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* Re: xfsrestore Does Only Only Partial Restore
  2011-08-28 15:15 ` Gim Leong Chin
@ 2011-08-29  3:53   ` Gim Leong Chin
  0 siblings, 0 replies; 10+ messages in thread
From: Gim Leong Chin @ 2011-08-29  3:53 UTC (permalink / raw)
  To: xfs

Thinking that it might be a xfsdump version incompatibility, I dug out the openSUSE 11.1 installation DVD, got the xfsdump-2.2.48-1.59 rpm and extracted the xfsdump and xfsrestore from it.  I then attempted a restore using it, but I still have only 49 GB of 121 GB extracted:

chingl@optimus:~> df -h
  Filesystem            Size  Used Avail Use% Mounted on
  rootfs                101G   41G   60G  41% /
  devtmpfs              998M  484K  997M   1% /dev
  tmpfs                1004M  1.1M 1003M   1% /dev/shm
  /dev/sda2             101G   41G   60G  41% /
  /dev/sda3             824G  697G  127G  85% /home
  /dev/sdb2              70G  5.8G   65G   9% /tmp/mnt2
  /dev/sr0              4.4G  4.4G     0 100% /media/SU1110.001
  /dev/sdb3             830G   49G  781G   6% /tmp/mnt3
  chingl@optimus:~>
  chingl@optimus:~> df
  Filesystem           1K-blocks      Used Available Use% Mounted on
  rootfs               104878048  42055420  62822628  41% /
  devtmpfs               1021032       484   1020548   1% /dev
  tmpfs                  1027960      1060   1026900   1% /dev/shm
  /dev/sda2            104878048  42055420  62822628  41% /
  /dev/sda3            863017248 730332548 132684700  85% /home
  /dev/sdb2             73363456   6071484  67291972   9% /tmp/mnt2
  /dev/sr0               4549218   4549218         0 100% /media/SU1110.001
  /dev/sdb3            869382652  50566648 818816004   6% /tmp/mnt3
  chingl@optimus:~>
{>
(>optimus:/home/chingl/archive/rat # /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore -f ./rat18Aug2011 /tmp/mnt3
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: using file dump (drive_simple) strategy
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: version 2.2.48 (dump format 3.0) - Running single-threaded                                                                    
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: searching media for dump
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: examining media file 0
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: dump description:
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: hostname: rat
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: mount point: /home
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: volume: /dev/sdb3
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: session time: Thu Aug 18 12:57:36 2011
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: level: 0
6>/home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: session label: "rat_18Aug2011"
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: media label: "rat18Aug2011"
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: file system id: f3b08587-cf98-4b7b-99b0-dc9d4e77b631                                                                          
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: session id: d8069cd0-a092-4fb2-b378-0eda33474aae                                                                              
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: media id: 96370000-6e2c-40eb-9c3c-93ca42de7524
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: searching media for directory dump
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: reading directories
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: 90820 directories and 539579 entries processed
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: directory post-processing
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: restoring non-directory files
4>/home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: attempt to read 1008286921 bytes failed: end of recorded data
1>/home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: user quota information written to '/tmp/mnt3/xfsdump_quotas'
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: group quota information written to '/tmp/mnt3/xfsdump_quotas_group'
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: use 'xfs_quota' to restore quotas
8>/home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: restore complete: 2546 seconds elapsed
  /home/chingl/XFS/xfsdump-2.2.48-1.59/sbin/xfsrestore: Restore Status: SUCCESS
0>optimus:/home/chingl/archive/rat #


Is this a case of xfsdump bug that causes null data to be written, or xfsrestore bug that is unable to read back the data?


Thanks!


GL






--- On Sun, 28/8/11, Gim Leong Chin <chingimleong@yahoo.com.sg> wrote:

> From: Gim Leong Chin <chingimleong@yahoo.com.sg>
> Subject: Re: xfsrestore Does Only Only Partial Restore
> To: xfs@oss.sgi.com
> Date: Sunday, 28 August, 2011, 11:15 PM
> Hi,
> 
> I just tried an older back up to test, and the restore is
> again partial, looks like I am screwed, only 44 GB of 113 GB
> got restored:
> 
> optimus:/mnt/rat # ll
> total 345143448
> -rw-r--r-- 1 root root     
>    1085 Sep 19  2010 fstab
> -rw-r--r-- 1 root root 103295383456 Jul 10 04:02
> rat10July2011
> -rw-r--r-- 1 root root 129677563808 Aug 18 14:41
> rat18Aug2011
> -rw-r--r-- 1 root root 120453920672 Jul 31 02:06
> rat30July2011
> optimus:/mnt/rat # xfsrestore -f ./rat30July2011 
> /tmp/mnt3
> xfsrestore: using file dump (drive_simple) strategy
> xfsrestore: version 3.0.1 (dump format 3.0) - Running
> single-threaded
> xfsrestore: searching media for dump
> xfsrestore: examining media file 0
> xfsrestore: dump description: 
> xfsrestore: hostname: rat
> xfsrestore: mount point: /home
> xfsrestore: volume: /dev/sdb3
> xfsrestore: session time: Sun Jul 31 00:24:34 2011
> xfsrestore: level: 0
> xfsrestore: session label: "rat30July2011"
> xfsrestore: media label: "rat30July2011"
> xfsrestore: file system id:
> f3b08587-cf98-4b7b-99b0-dc9d4e77b631
> xfsrestore: session id:
> 8c0a0114-dc68-4e10-a48f-106c4aceecc6
> xfsrestore: media id: d8f1694a-b641-43bc-a7eb-5f86a2a84221
> xfsrestore: searching media for directory dump
> xfsrestore: reading directories
> xfsrestore: 90681 directories and 539455 entries processed
> xfsrestore: directory post-processing
> xfsrestore: restoring non-directory files
> xfsrestore: attempt to read 388926665 bytes failed: end of
> recorded data
> xfsrestore: user quota information written to
> '/tmp/mnt3/xfsdump_quotas'
> xfsrestore: group quota information written to
> '/tmp/mnt3/xfsdump_quotas_group'
> xfsrestore: use 'xfs_quota' to restore quotas
> xfsrestore: restore complete: 4235 seconds elapsed
> xfsrestore: Restore Status: SUCCESS
> optimus:/mnt/rat # df -h
> Filesystem           
> Size  Used Avail Use% Mounted on
> rootfs             
>   101G   41G   60G 
> 41% /
> devtmpfs             
> 998M  496K  997M   1% /dev
> tmpfs             
>   1004M  1.1M 1003M   1% /dev/shm
> /dev/sda2         
>    101G   41G   60G 
> 41% /
> /dev/sda3         
>    824G  697G  127G  85%
> /home
> /dev/sdb2             
> 70G  5.8G   65G   9%
> /tmp/mnt2
> /dev/sdb3         
>    830G   44G 
> 786G   6% /tmp/mnt3
> /dev/sdc1         
>    698G  504G  195G  73% /mnt
> optimus:/mnt/rat # ll -h
> total 330G
> -rw-r--r-- 1 root root 1.1K Sep 19  2010 fstab
> -rw-r--r-- 1 root root  97G Jul 10 04:02
> rat10July2011
> -rw-r--r-- 1 root root 121G Aug 18 14:41 rat18Aug2011
> -rw-r--r-- 1 root root 113G Jul 31 02:06 rat30July2011
> optimus:/mnt/rat #
> 
> 
> 
> --- On Sun, 28/8/11, Gim Leong Chin <chingimleong@yahoo.com.sg>
> wrote:
> 
> > From: Gim Leong Chin <chingimleong@yahoo.com.sg>
> > Subject: xfsrestore Does Only Only Partial Restore
> > To: xfs@oss.sgi.com
> > Date: Sunday, 28 August, 2011, 8:31 PM
> > Hi,
> > 
> > This is the very first time I tried doing a xfsrestore
> of a
> > back up and I hit some serious trouble.
> > 
> > I had openSUSE 11.1 (kernel 2.6.27) on my Acer
> > notebook.  I did a xfsdump of /home to a WD My
> Passport
> > external USB hard drive with XFS on it.
> > 
> > I installed openSUSE 11.4 (kernel 2.6.37), then tried
> to do
> > xfsrestore from the WD USB drive.  The dump file is
> 121
> > GB.
> > 
> > I tried two times on two different days, but each time
> the
> > xfsrestore would stop writing at the exact same point,
> 49 GB
> > and say success at the end.
> > 
> > I then copied the dump file to one hard drive on my
> desk
> > top, and did a dump to another hard drive, to
> > /tmp/mnt3.  I get back identical messages:
> > 
> > chingl@optimus:~> df
> >   Filesystem       
> >    1K-blocks      Used
> > Available Use% Mounted on
> >   rootfs           
> >    104878048  42063828 
> > 62814220  41% /
> >   devtmpfs           
> >    1021032   
> >    480   1020552   1%
> > /dev
> >   tmpfs           
> >       1027960     
> > 1064   1026896   1% /dev/shm
> >   /dev/sda2           
> > 104878048  42063828  62814220  41% /
> >   /dev/sda3           
> > 863017248 730313100 132704148  85% /home
> >   /dev/sdb2         
> >    73363456   6071484 
> > 67291972   9% /tmp/mnt2
> >   /dev/sdb3           
> > 869382652  50612736 818769916   6%
> > /tmp/mnt3
> >   chingl@optimus:~> df -h
> >   Filesystem           
> > Size  Used Avail Use% Mounted on
> >   rootfs           
> >    
> > 101G   41G   60G  41% /
> >   devtmpfs           
> >   998M  480K  997M   1% /dev
> >   tmpfs           
> >     1004M  1.1M 1003M   1%
> > /dev/shm
> >   /dev/sda2         
> >    101G   41G   60G 
> > 41% /
> >   /dev/sda3         
> >    824G  697G  127G  85%
> > /home
> >   /dev/sdb2           
> >   70G 
> > 5.8G   65G   9% /tmp/mnt2
> >   /dev/sdb3         
> >    830G   49G 
> > 781G   6% /tmp/mnt3
> >   chingl@optimus:~> cd archive/rat
> >   chingl@optimus:~/archive/rat> ll
> >   total 126638256
> >   -rw-r--r-- 1 chingl users 129677563808 Aug 18
> 14:41
> > rat18Aug2011
> >   chingl@optimus:~/archive/rat>
> > {>
> > (>optimus:~ # xfsrestore -f
> > /home/chingl/archive/rat/rat18Aug2011 /tmp/mnt3
> >   xfsrestore: using file dump (drive_simple)
> strategy
> >   xfsrestore: version 3.0.1 (dump format 3.0) -
> > Running single-threaded
> >   xfsrestore: searching media for dump
> >   xfsrestore: examining media file 0
> >   xfsrestore: dump description:
> >   xfsrestore: hostname: rat
> >   xfsrestore: mount point: /home
> >   xfsrestore: volume: /dev/sdb3
> >   xfsrestore: session time: Thu Aug 18 12:57:36 2011
> > 2>xfsrestore: level: 0
> >   xfsrestore: session label: "rat_18Aug2011"
> >   xfsrestore: media label: "rat18Aug2011"
> >   xfsrestore: file system id:
> > f3b08587-cf98-4b7b-99b0-dc9d4e77b631
> >   xfsrestore: session id:
> > d8069cd0-a092-4fb2-b378-0eda33474aae
> >   xfsrestore: media id:
> > 96370000-6e2c-40eb-9c3c-93ca42de7524
> >   xfsrestore: searching media for directory dump
> >   xfsrestore: reading directories
> >   xfsrestore: 90820 directories and 539579 entries
> > processed
> >   xfsrestore: directory post-processing
> > 1>xfsrestore: restoring non-directory files
> > 9>xfsrestore: attempt to read 1008286921 bytes
> failed:
> > end of recorded data
> >   xfsrestore: user quota information written to
> > '/tmp/mnt3/xfsdump_quotas'
> > 7>xfsrestore: group quota information written to
> > '/tmp/mnt3/xfsdump_quotas_group'
> > 4>xfsrestore: use 'xfs_quota' to restore quotas
> >   xfsrestore: restore complete: 2522 seconds elapsed
> >   xfsrestore: Restore Status: SUCCESS
> >   optimus:~ #
> > 
> > I downloaded xfsdump-3.0.5.tar.gz, did a build, and
> tried
> > to do a restore using the newly built xfsrestore:
> > 
> > chingl@optimus:~/testdump> df -h
> >   Filesystem           
> > Size  Used Avail Use% Mounted on
> >   rootfs           
> >    
> > 101G   41G   60G  41% /
> >   devtmpfs           
> >   998M  480K  997M   1% /dev
> >   tmpfs           
> >     1004M  1.1M 1003M   1%
> > /dev/shm
> >   /dev/sda2         
> >    101G   41G   60G 
> > 41% /
> >   /dev/sda3         
> >    824G  697G  127G  85%
> > /home
> >   /dev/sdb2           
> >   70G 
> > 5.8G   65G   9% /tmp/mnt2
> >   /dev/sdb3         
> >    830G   49G 
> > 781G   6% /tmp/mnt3
> >   chingl@optimus:~/testdump> df
> >   Filesystem       
> >    1K-blocks      Used
> > Available Use% Mounted on
> >   rootfs           
> >    104878048  42063828 
> > 62814220  41% /
> >   devtmpfs           
> >    1021032   
> >    480   1020552   1%
> > /dev
> >   tmpfs           
> >       1027960     
> > 1064   1026896   1% /dev/shm
> >   /dev/sda2           
> > 104878048  42063828  62814220  41% /
> >   /dev/sda3           
> > 863017248 730313900 132703348  85% /home
> >   /dev/sdb2         
> >    73363456   6071484 
> > 67291972   9% /tmp/mnt2
> >   /dev/sdb3           
> > 869382652  50612640 818770012   6%
> > /tmp/mnt3
> >   chingl@optimus:~/testdump>
> >   
> > {>
> >   optimus:/home/chingl/archive/rat #
> > /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore -f
> > ./rat18Aug2011 /tmp/mnt3
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > using file dump (drive_simple) strategy
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > version 3.0.5 (dump format 3.0) - Running
> single-threaded
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > searching media for dump
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > examining media file 0
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > dump description:
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > hostname: rat
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > mount point: /home
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > volume: /dev/sdb3
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > session time: Thu Aug 18 12:57:36 2011
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > level: 0
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > session label: "rat_18Aug2011"
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > media label: "rat18Aug2011"
> >
> 3>/home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > file system id: f3b08587-cf98-4b7b-99b0-dc9d4e77b631
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > session id: d8069cd0-a092-4fb2-b378-0eda33474aae
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > media id: 96370000-6e2c-40eb-9c3c-93ca42de7524
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > searching media for directory dump
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > reading directories
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > 90820 directories and 539579 entries processed
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > directory post-processing
> >   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> > restoring non-directory files
> >   xfsrestore: content.c:7510: restore_extent_group:
> > Assertion `ehdr.eh_type == 4' failed.
> > (>Aborted
> > 2>optimus:/home/chingl/archive/rat #
> > 
> > 
> > Could some one please assist to enlighten me what is
> going
> > on, why does the restoration fail?  The xfsdump
> session
> > looked OK.
> > 
> > Is there any way I can extract back my /home back
> up? 
> > This is my only back up copy.  i have two other
> xfsdump
> > dump files taken earlier, I have not tried those.
> > 
> > Is xfsdump and xfsrestore really robust for dump to
> regular
> > file, or should I have done a tar instead?
> > 
> > Thank you.
> > 
> > GL
> > 
> > _______________________________________________
> > xfs mailing list
> > xfs@oss.sgi.com
> > http://oss.sgi.com/mailman/listinfo/xfs
> > 
> 
> _______________________________________________
> xfs mailing list
> xfs@oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs
> 

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* Re: xfsrestore Does Only Only Partial Restore
  2011-08-28 12:31 Gim Leong Chin
@ 2011-08-28 15:15 ` Gim Leong Chin
  2011-08-29  3:53   ` Gim Leong Chin
  2011-08-29  5:00 ` Dave Chinner
  2011-08-29 14:11 ` Bill Kendall
  2 siblings, 1 reply; 10+ messages in thread
From: Gim Leong Chin @ 2011-08-28 15:15 UTC (permalink / raw)
  To: xfs

Hi,

I just tried an older back up to test, and the restore is again partial, looks like I am screwed, only 44 GB of 113 GB got restored:

optimus:/mnt/rat # ll
total 345143448
-rw-r--r-- 1 root root         1085 Sep 19  2010 fstab
-rw-r--r-- 1 root root 103295383456 Jul 10 04:02 rat10July2011
-rw-r--r-- 1 root root 129677563808 Aug 18 14:41 rat18Aug2011
-rw-r--r-- 1 root root 120453920672 Jul 31 02:06 rat30July2011
optimus:/mnt/rat # xfsrestore -f ./rat30July2011  /tmp/mnt3
xfsrestore: using file dump (drive_simple) strategy
xfsrestore: version 3.0.1 (dump format 3.0) - Running single-threaded
xfsrestore: searching media for dump
xfsrestore: examining media file 0
xfsrestore: dump description: 
xfsrestore: hostname: rat
xfsrestore: mount point: /home
xfsrestore: volume: /dev/sdb3
xfsrestore: session time: Sun Jul 31 00:24:34 2011
xfsrestore: level: 0
xfsrestore: session label: "rat30July2011"
xfsrestore: media label: "rat30July2011"
xfsrestore: file system id: f3b08587-cf98-4b7b-99b0-dc9d4e77b631
xfsrestore: session id: 8c0a0114-dc68-4e10-a48f-106c4aceecc6
xfsrestore: media id: d8f1694a-b641-43bc-a7eb-5f86a2a84221
xfsrestore: searching media for directory dump
xfsrestore: reading directories
xfsrestore: 90681 directories and 539455 entries processed
xfsrestore: directory post-processing
xfsrestore: restoring non-directory files
xfsrestore: attempt to read 388926665 bytes failed: end of recorded data
xfsrestore: user quota information written to '/tmp/mnt3/xfsdump_quotas'
xfsrestore: group quota information written to '/tmp/mnt3/xfsdump_quotas_group'
xfsrestore: use 'xfs_quota' to restore quotas
xfsrestore: restore complete: 4235 seconds elapsed
xfsrestore: Restore Status: SUCCESS
optimus:/mnt/rat # df -h
Filesystem            Size  Used Avail Use% Mounted on
rootfs                101G   41G   60G  41% /
devtmpfs              998M  496K  997M   1% /dev
tmpfs                1004M  1.1M 1003M   1% /dev/shm
/dev/sda2             101G   41G   60G  41% /
/dev/sda3             824G  697G  127G  85% /home
/dev/sdb2              70G  5.8G   65G   9% /tmp/mnt2
/dev/sdb3             830G   44G  786G   6% /tmp/mnt3
/dev/sdc1             698G  504G  195G  73% /mnt
optimus:/mnt/rat # ll -h
total 330G
-rw-r--r-- 1 root root 1.1K Sep 19  2010 fstab
-rw-r--r-- 1 root root  97G Jul 10 04:02 rat10July2011
-rw-r--r-- 1 root root 121G Aug 18 14:41 rat18Aug2011
-rw-r--r-- 1 root root 113G Jul 31 02:06 rat30July2011
optimus:/mnt/rat #



--- On Sun, 28/8/11, Gim Leong Chin <chingimleong@yahoo.com.sg> wrote:

> From: Gim Leong Chin <chingimleong@yahoo.com.sg>
> Subject: xfsrestore Does Only Only Partial Restore
> To: xfs@oss.sgi.com
> Date: Sunday, 28 August, 2011, 8:31 PM
> Hi,
> 
> This is the very first time I tried doing a xfsrestore of a
> back up and I hit some serious trouble.
> 
> I had openSUSE 11.1 (kernel 2.6.27) on my Acer
> notebook.  I did a xfsdump of /home to a WD My Passport
> external USB hard drive with XFS on it.
> 
> I installed openSUSE 11.4 (kernel 2.6.37), then tried to do
> xfsrestore from the WD USB drive.  The dump file is 121
> GB.
> 
> I tried two times on two different days, but each time the
> xfsrestore would stop writing at the exact same point, 49 GB
> and say success at the end.
> 
> I then copied the dump file to one hard drive on my desk
> top, and did a dump to another hard drive, to
> /tmp/mnt3.  I get back identical messages:
> 
> chingl@optimus:~> df
>   Filesystem       
>    1K-blocks      Used
> Available Use% Mounted on
>   rootfs           
>    104878048  42063828 
> 62814220  41% /
>   devtmpfs           
>    1021032   
>    480   1020552   1%
> /dev
>   tmpfs           
>       1027960     
> 1064   1026896   1% /dev/shm
>   /dev/sda2           
> 104878048  42063828  62814220  41% /
>   /dev/sda3           
> 863017248 730313100 132704148  85% /home
>   /dev/sdb2         
>    73363456   6071484 
> 67291972   9% /tmp/mnt2
>   /dev/sdb3           
> 869382652  50612736 818769916   6%
> /tmp/mnt3
>   chingl@optimus:~> df -h
>   Filesystem           
> Size  Used Avail Use% Mounted on
>   rootfs           
>    
> 101G   41G   60G  41% /
>   devtmpfs           
>   998M  480K  997M   1% /dev
>   tmpfs           
>     1004M  1.1M 1003M   1%
> /dev/shm
>   /dev/sda2         
>    101G   41G   60G 
> 41% /
>   /dev/sda3         
>    824G  697G  127G  85%
> /home
>   /dev/sdb2           
>   70G 
> 5.8G   65G   9% /tmp/mnt2
>   /dev/sdb3         
>    830G   49G 
> 781G   6% /tmp/mnt3
>   chingl@optimus:~> cd archive/rat
>   chingl@optimus:~/archive/rat> ll
>   total 126638256
>   -rw-r--r-- 1 chingl users 129677563808 Aug 18 14:41
> rat18Aug2011
>   chingl@optimus:~/archive/rat>
> {>
> (>optimus:~ # xfsrestore -f
> /home/chingl/archive/rat/rat18Aug2011 /tmp/mnt3
>   xfsrestore: using file dump (drive_simple) strategy
>   xfsrestore: version 3.0.1 (dump format 3.0) -
> Running single-threaded
>   xfsrestore: searching media for dump
>   xfsrestore: examining media file 0
>   xfsrestore: dump description:
>   xfsrestore: hostname: rat
>   xfsrestore: mount point: /home
>   xfsrestore: volume: /dev/sdb3
>   xfsrestore: session time: Thu Aug 18 12:57:36 2011
> 2>xfsrestore: level: 0
>   xfsrestore: session label: "rat_18Aug2011"
>   xfsrestore: media label: "rat18Aug2011"
>   xfsrestore: file system id:
> f3b08587-cf98-4b7b-99b0-dc9d4e77b631
>   xfsrestore: session id:
> d8069cd0-a092-4fb2-b378-0eda33474aae
>   xfsrestore: media id:
> 96370000-6e2c-40eb-9c3c-93ca42de7524
>   xfsrestore: searching media for directory dump
>   xfsrestore: reading directories
>   xfsrestore: 90820 directories and 539579 entries
> processed
>   xfsrestore: directory post-processing
> 1>xfsrestore: restoring non-directory files
> 9>xfsrestore: attempt to read 1008286921 bytes failed:
> end of recorded data
>   xfsrestore: user quota information written to
> '/tmp/mnt3/xfsdump_quotas'
> 7>xfsrestore: group quota information written to
> '/tmp/mnt3/xfsdump_quotas_group'
> 4>xfsrestore: use 'xfs_quota' to restore quotas
>   xfsrestore: restore complete: 2522 seconds elapsed
>   xfsrestore: Restore Status: SUCCESS
>   optimus:~ #
> 
> I downloaded xfsdump-3.0.5.tar.gz, did a build, and tried
> to do a restore using the newly built xfsrestore:
> 
> chingl@optimus:~/testdump> df -h
>   Filesystem           
> Size  Used Avail Use% Mounted on
>   rootfs           
>    
> 101G   41G   60G  41% /
>   devtmpfs           
>   998M  480K  997M   1% /dev
>   tmpfs           
>     1004M  1.1M 1003M   1%
> /dev/shm
>   /dev/sda2         
>    101G   41G   60G 
> 41% /
>   /dev/sda3         
>    824G  697G  127G  85%
> /home
>   /dev/sdb2           
>   70G 
> 5.8G   65G   9% /tmp/mnt2
>   /dev/sdb3         
>    830G   49G 
> 781G   6% /tmp/mnt3
>   chingl@optimus:~/testdump> df
>   Filesystem       
>    1K-blocks      Used
> Available Use% Mounted on
>   rootfs           
>    104878048  42063828 
> 62814220  41% /
>   devtmpfs           
>    1021032   
>    480   1020552   1%
> /dev
>   tmpfs           
>       1027960     
> 1064   1026896   1% /dev/shm
>   /dev/sda2           
> 104878048  42063828  62814220  41% /
>   /dev/sda3           
> 863017248 730313900 132703348  85% /home
>   /dev/sdb2         
>    73363456   6071484 
> 67291972   9% /tmp/mnt2
>   /dev/sdb3           
> 869382652  50612640 818770012   6%
> /tmp/mnt3
>   chingl@optimus:~/testdump>
>   
> {>
>   optimus:/home/chingl/archive/rat #
> /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore -f
> ./rat18Aug2011 /tmp/mnt3
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> using file dump (drive_simple) strategy
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> version 3.0.5 (dump format 3.0) - Running single-threaded
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> searching media for dump
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> examining media file 0
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> dump description:
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> hostname: rat
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> mount point: /home
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> volume: /dev/sdb3
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> session time: Thu Aug 18 12:57:36 2011
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> level: 0
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> session label: "rat_18Aug2011"
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> media label: "rat18Aug2011"
> 3>/home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> file system id: f3b08587-cf98-4b7b-99b0-dc9d4e77b631
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> session id: d8069cd0-a092-4fb2-b378-0eda33474aae
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> media id: 96370000-6e2c-40eb-9c3c-93ca42de7524
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> searching media for directory dump
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> reading directories
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> 90820 directories and 539579 entries processed
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> directory post-processing
>   /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore:
> restoring non-directory files
>   xfsrestore: content.c:7510: restore_extent_group:
> Assertion `ehdr.eh_type == 4' failed.
> (>Aborted
> 2>optimus:/home/chingl/archive/rat #
> 
> 
> Could some one please assist to enlighten me what is going
> on, why does the restoration fail?  The xfsdump session
> looked OK.
> 
> Is there any way I can extract back my /home back up? 
> This is my only back up copy.  i have two other xfsdump
> dump files taken earlier, I have not tried those.
> 
> Is xfsdump and xfsrestore really robust for dump to regular
> file, or should I have done a tar instead?
> 
> Thank you.
> 
> GL
> 
> _______________________________________________
> xfs mailing list
> xfs@oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs
> 

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
* xfsrestore Does Only Only Partial Restore
@ 2011-08-28 12:31 Gim Leong Chin
  2011-08-28 15:15 ` Gim Leong Chin
                   ` (2 more replies)
  0 siblings, 3 replies; 10+ messages in thread
From: Gim Leong Chin @ 2011-08-28 12:31 UTC (permalink / raw)
  To: xfs

Hi,

This is the very first time I tried doing a xfsrestore of a back up and I hit some serious trouble.

I had openSUSE 11.1 (kernel 2.6.27) on my Acer notebook.  I did a xfsdump of /home to a WD My Passport external USB hard drive with XFS on it.

I installed openSUSE 11.4 (kernel 2.6.37), then tried to do xfsrestore from the WD USB drive.  The dump file is 121 GB.

I tried two times on two different days, but each time the xfsrestore would stop writing at the exact same point, 49 GB and say success at the end.

I then copied the dump file to one hard drive on my desk top, and did a dump to another hard drive, to /tmp/mnt3.  I get back identical messages:

chingl@optimus:~> df
  Filesystem           1K-blocks      Used Available Use% Mounted on
  rootfs               104878048  42063828  62814220  41% /
  devtmpfs               1021032       480   1020552   1% /dev
  tmpfs                  1027960      1064   1026896   1% /dev/shm
  /dev/sda2            104878048  42063828  62814220  41% /
  /dev/sda3            863017248 730313100 132704148  85% /home
  /dev/sdb2             73363456   6071484  67291972   9% /tmp/mnt2
  /dev/sdb3            869382652  50612736 818769916   6% /tmp/mnt3
  chingl@optimus:~> df -h
  Filesystem            Size  Used Avail Use% Mounted on
  rootfs                101G   41G   60G  41% /
  devtmpfs              998M  480K  997M   1% /dev
  tmpfs                1004M  1.1M 1003M   1% /dev/shm
  /dev/sda2             101G   41G   60G  41% /
  /dev/sda3             824G  697G  127G  85% /home
  /dev/sdb2              70G  5.8G   65G   9% /tmp/mnt2
  /dev/sdb3             830G   49G  781G   6% /tmp/mnt3
  chingl@optimus:~> cd archive/rat
  chingl@optimus:~/archive/rat> ll
  total 126638256
  -rw-r--r-- 1 chingl users 129677563808 Aug 18 14:41 rat18Aug2011
  chingl@optimus:~/archive/rat>
{>
(>optimus:~ # xfsrestore -f /home/chingl/archive/rat/rat18Aug2011 /tmp/mnt3
  xfsrestore: using file dump (drive_simple) strategy
  xfsrestore: version 3.0.1 (dump format 3.0) - Running single-threaded
  xfsrestore: searching media for dump
  xfsrestore: examining media file 0
  xfsrestore: dump description:
  xfsrestore: hostname: rat
  xfsrestore: mount point: /home
  xfsrestore: volume: /dev/sdb3
  xfsrestore: session time: Thu Aug 18 12:57:36 2011
2>xfsrestore: level: 0
  xfsrestore: session label: "rat_18Aug2011"
  xfsrestore: media label: "rat18Aug2011"
  xfsrestore: file system id: f3b08587-cf98-4b7b-99b0-dc9d4e77b631
  xfsrestore: session id: d8069cd0-a092-4fb2-b378-0eda33474aae
  xfsrestore: media id: 96370000-6e2c-40eb-9c3c-93ca42de7524
  xfsrestore: searching media for directory dump
  xfsrestore: reading directories
  xfsrestore: 90820 directories and 539579 entries processed
  xfsrestore: directory post-processing
1>xfsrestore: restoring non-directory files
9>xfsrestore: attempt to read 1008286921 bytes failed: end of recorded data
  xfsrestore: user quota information written to '/tmp/mnt3/xfsdump_quotas'
7>xfsrestore: group quota information written to '/tmp/mnt3/xfsdump_quotas_group'
4>xfsrestore: use 'xfs_quota' to restore quotas
  xfsrestore: restore complete: 2522 seconds elapsed
  xfsrestore: Restore Status: SUCCESS
  optimus:~ #

I downloaded xfsdump-3.0.5.tar.gz, did a build, and tried to do a restore using the newly built xfsrestore:

chingl@optimus:~/testdump> df -h
  Filesystem            Size  Used Avail Use% Mounted on
  rootfs                101G   41G   60G  41% /
  devtmpfs              998M  480K  997M   1% /dev
  tmpfs                1004M  1.1M 1003M   1% /dev/shm
  /dev/sda2             101G   41G   60G  41% /
  /dev/sda3             824G  697G  127G  85% /home
  /dev/sdb2              70G  5.8G   65G   9% /tmp/mnt2
  /dev/sdb3             830G   49G  781G   6% /tmp/mnt3
  chingl@optimus:~/testdump> df
  Filesystem           1K-blocks      Used Available Use% Mounted on
  rootfs               104878048  42063828  62814220  41% /
  devtmpfs               1021032       480   1020552   1% /dev
  tmpfs                  1027960      1064   1026896   1% /dev/shm
  /dev/sda2            104878048  42063828  62814220  41% /
  /dev/sda3            863017248 730313900 132703348  85% /home
  /dev/sdb2             73363456   6071484  67291972   9% /tmp/mnt2
  /dev/sdb3            869382652  50612640 818770012   6% /tmp/mnt3
  chingl@optimus:~/testdump>
  
{>
  optimus:/home/chingl/archive/rat # /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore -f ./rat18Aug2011 /tmp/mnt3
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: using file dump (drive_simple) strategy
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: version 3.0.5 (dump format 3.0) - Running single-threaded
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: searching media for dump
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: examining media file 0
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: dump description:
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: hostname: rat
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: mount point: /home
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: volume: /dev/sdb3
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: session time: Thu Aug 18 12:57:36 2011
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: level: 0
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: session label: "rat_18Aug2011"
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: media label: "rat18Aug2011"
3>/home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: file system id: f3b08587-cf98-4b7b-99b0-dc9d4e77b631
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: session id: d8069cd0-a092-4fb2-b378-0eda33474aae
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: media id: 96370000-6e2c-40eb-9c3c-93ca42de7524
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: searching media for directory dump
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: reading directories
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: 90820 directories and 539579 entries processed
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: directory post-processing
  /home/chingl/XFS/xfsdump-3.0.5/restore/xfsrestore: restoring non-directory files
  xfsrestore: content.c:7510: restore_extent_group: Assertion `ehdr.eh_type == 4' failed.
(>Aborted
2>optimus:/home/chingl/archive/rat #


Could some one please assist to enlighten me what is going on, why does the restoration fail?  The xfsdump session looked OK.

Is there any way I can extract back my /home back up?  This is my only back up copy.  i have two other xfsdump dump files taken earlier, I have not tried those.

Is xfsdump and xfsrestore really robust for dump to regular file, or should I have done a tar instead?

Thank you.

GL

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

^ permalink raw reply	[flat|nested] 10+ messages in thread
end of thread, other threads:[~2011-08-30  4:07 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2011-08-29 16:36 xfsrestore Does Only Only Partial Restore Gim Leong Chin
2011-08-29 16:44 ` Bill Kendall
  -- strict thread matches above, loose matches on Subject: below --
2011-08-30  3:06 Gim Leong Chin
2011-08-30  4:07 ` Bill Kendall
2011-08-28 12:31 Gim Leong Chin
2011-08-28 15:15 ` Gim Leong Chin
2011-08-29  3:53   ` Gim Leong Chin
2011-08-29  5:00 ` Dave Chinner
2011-08-29  5:47   ` Gim Leong Chin
2011-08-29 14:11 ` Bill Kendall

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.