From: Ross Zwisler <ross.zwisler@linux.intel.com>
To: Xiao Guangrong <guangrong.xiao@linux.intel.com>
Cc: Ross Zwisler <ross.zwisler@linux.intel.com>,
Dan Williams <dan.j.williams@intel.com>,
Yumei Huang <yuhuang@redhat.com>, KVM <kvm@vger.kernel.org>,
"linux-nvdimm@lists.01.org" <linux-nvdimm@ml01.01.org>,
"qemu-devel@nongnu.org" <qemu-devel@nongnu.org>,
LKML <linux-kernel@vger.kernel.org>,
Linux ACPI <linux-acpi@vger.kernel.org>,
Stefan Hajnoczi <stefanha@redhat.com>
Subject: Re: DAX can not work on virtual nvdimm device
Date: Mon, 29 Aug 2016 13:30:14 -0600 [thread overview]
Message-ID: <20160829193014.GB16738@linux.intel.com> (raw)
In-Reply-To: <600ac51c-0f61-6e53-9bfa-669c85494d1f@linux.intel.com>
On Mon, Aug 29, 2016 at 03:54:10PM +0800, Xiao Guangrong wrote:
>
> Hi Ross,
>
> Sorry for the delay, i just returned back from KVM Forum.
>
> On 08/20/2016 02:30 AM, Ross Zwisler wrote:
> > On Fri, Aug 19, 2016 at 07:59:29AM -0700, Dan Williams wrote:
> > > On Fri, Aug 19, 2016 at 4:19 AM, Xiao Guangrong
> > > <guangrong.xiao@linux.intel.com> wrote:
> > > >
> > > > Hi Dan,
> > > >
> > > > Recently, Redhat reported that nvml test suite failed on QEMU/KVM,
> > > > more detailed info please refer to:
> > > > https://bugzilla.redhat.com/show_bug.cgi?id=1365721
> > > >
> > > > The reason for this bug is that the memory region created by mmap()
> > > > on the dax-based file was gone so that the region can not be found
> > > > in /proc/self/smaps during the runtime.
> > > >
> > > > This is a simple way to trigger this issue:
> > > > mount -o dax /dev/pmem0 /mnt/pmem/
> > > > vim /mnt/pmem/xxx
> > > > then 'vim' is crashed due to segment fault.
> > > >
> > > > This bug can be reproduced on your tree, the top commit is
> > > > 10d7902fa0e82b (dax: unmap/truncate on device shutdown), the kernel
> > > > configure file is attached.
> > > >
> > > > Your thought or comment is highly appreciated.
> > >
> > > I'm going to be offline until Tuesday, but I will investigate when I'm
> > > back. In the meantime if Ross or Vishal had an opportunity to take a
> > > look I wouldn't say "no" :).
> >
> > I haven't been able to reproduce this vim segfault. I'm using QEMU v2.6.0,
> > and the kernel commit you mentioned, and your kernel config.
> >
> > Here's my QEMU command line:
> >
> > sudo ~/qemu/bin/qemu-system-x86_64 /var/lib/libvirt/images/alara.qcow2 \
> > -machine pc,nvdimm -m 8G,maxmem=100G,slots=100 -object \
> > memory-backend-file,id=mem1,share,mem-path=/dev/pmem0,size=8G -device \
> > nvdimm,memdev=mem1,id=nv1 -smp 6 -machine pc,accel=kvm
> >
> > With this I'm able to mkfs the guest's /dev/pmem0, mount it with -o dax, and
> > write a file with vim.
>
> Thanks for your test. That's strange...
>
> >
> > Can you reproduce your results with a pmem device created via a memmap kernel
> > command line parameter in the guest? You'll need to update your kernel
> > config to enable CONFIG_X86_PMEM_LEGACY and CONFIG_X86_PMEM_LEGACY_DEVICE.
> >
>
> Okay, i tested it with mmap=6G!10G, it failed too. So it looks like it's a
> filesystem or DAX issue.
>
> More precisely, i figured out the root case that read() returns a wrong value
> when it reaches the end of the file, following test case can trigger it:
>
> #include <stdlib.h>
> #include <stdio.h>
> #include <unistd.h>
> #include <fcntl.h>
> #include <sys/types.h>
> #include <sys/stat.h>
>
> int main(int argc, char *argv[])
> {
> char *filename;
>
> if (argc < 2) {
> printf("arg: filename.\n");
> return -1;
> }
>
> filename = argv[1];
> printf("test on %s.\n", filename);
>
> int fd = open(filename, O_RDWR);
>
> if (fd < 0) {
> perror("open");
> return -1;
> }
>
> int count = 0;
>
> while (1) {
> ssize_t ret;
> char buf;
>
> ret = read(fd, &buf, sizeof(buf));
> if (ret < 0) {
> perror("READ");
> return -1;
> }
>
> if (ret == 0)
> break;
> if (ret != sizeof(buf)) {
> printf("Count %x Ret %lx sizeof(buf) %lx.\n",
> count, ret, sizeof(buf));
> return -1;
> }
>
> count++;
> printf("%c", buf);
> }
>
> printf("\n Good Read.\n");
> return 0;
> }
>
>
>
> It will fail at "ret != sizeof(buf)", for example, the error output on my
> test env is:
> Count 1000 Ret 22f84200 sizeof(buf) 1.
Can you please verify that you are using "usable" memory for your memmap? All
the details are here:
https://nvdimm.wiki.kernel.org/how_to_choose_the_correct_memmap_kernel_parameter_for_pmem_on_your_system
My guess is that Boaz was correct, and that your memmap is off using addresses
that don't actually map to memory.
- Ross
next prev parent reply other threads:[~2016-08-29 19:30 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-08-19 11:19 DAX can not work on virtual nvdimm device Xiao Guangrong
2016-08-19 14:59 ` Dan Williams
2016-08-19 18:30 ` Ross Zwisler
2016-08-21 9:55 ` Boaz Harrosh
2016-08-29 7:54 ` Xiao Guangrong
2016-08-29 19:30 ` Ross Zwisler [this message]
2016-08-30 6:53 ` Xiao Guangrong
2016-08-30 17:09 ` Dan Williams
2016-08-31 8:44 ` Xiao Guangrong
2016-08-31 16:46 ` Ross Zwisler
2016-09-02 2:57 ` Ross Zwisler
2016-09-06 15:06 ` Jan Kara
2016-09-08 20:47 ` Ross Zwisler
2016-09-09 9:19 ` Jan Kara
2016-09-09 14:03 ` Theodore Ts'o
2016-09-09 16:34 ` Ross Zwisler
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20160829193014.GB16738@linux.intel.com \
--to=ross.zwisler@linux.intel.com \
--cc=dan.j.williams@intel.com \
--cc=guangrong.xiao@linux.intel.com \
--cc=kvm@vger.kernel.org \
--cc=linux-acpi@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-nvdimm@ml01.01.org \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@redhat.com \
--cc=yuhuang@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).