From: Roman Bolshakov <r.bolshakov@yadro.com>
To: Paolo Bonzini <pbonzini@redhat.com>
Cc: Thomas Huth <thuth@redhat.com>, <kvm@vger.kernel.org>
Subject: Re: [kvm-unit-tests PATCH v2 10/10] travis.yml: Add x86 build with clang 10
Date: Wed, 23 Sep 2020 00:25:07 +0300 [thread overview]
Message-ID: <20200922212507.GA11460@SPB-NB-133.local> (raw)
In-Reply-To: <788b7191-6987-9399-f352-2e661255157e@redhat.com>
On Tue, Sep 22, 2020 at 04:51:18PM +0200, Paolo Bonzini wrote:
> On 15/09/20 17:59, Roman Bolshakov wrote:
> > So, a workaround for that could be adding '-Wl,--build-id=none' to the
> > makefile rule for realmode.elf. Then multiboot magic is placed properly
> > at 0x4000 instead of 0x4030. Unfortunately it doesn't help with the
> > test :-)
>
> Heh, weird. I also tried adding
>
> /DISCARD/ : { *(.note.gnu.build-id) }
>
> to the linker script and I got a very helpful (not) linker warning:
>
> /usr/bin/ld: warning: .note.gnu.build-id section discarded, --build-id ignored.
>
> ... except that the --build-id was placed not by me but rather by gcc.
> So we should probably simplify things doing this:
>
> diff --git a/x86/Makefile.common b/x86/Makefile.common
> index 090ce22..10c8a42 100644
> --- a/x86/Makefile.common
> +++ b/x86/Makefile.common
> @@ -69,8 +69,8 @@ test_cases: $(tests-common) $(tests)
> $(TEST_DIR)/%.o: CFLAGS += -std=gnu99 -ffreestanding -I $(SRCDIR)/lib -I $(SRCDIR)/lib/x86 -I lib
>
> $(TEST_DIR)/realmode.elf: $(TEST_DIR)/realmode.o
> - $(CC) -m32 -nostdlib -o $@ -Wl,-m,elf_i386 \
> - -Wl,-T,$(SRCDIR)/$(TEST_DIR)/realmode.lds $^
> + $(LD) -o $@ -m elf_i386 \
> + -T $(SRCDIR)/$(TEST_DIR)/realmode.lds $^
>
Agreed, in the case it's better to tell linker directly what is needed
rather than fighting with compiler's way of invoking the linker.
> $(TEST_DIR)/realmode.o: bits = 32
>
> diff --git a/x86/realmode.lds b/x86/realmode.lds
> index 0ed3063..3220c19 100644
> --- a/x86/realmode.lds
> +++ b/x86/realmode.lds
> @@ -1,5 +1,6 @@
> SECTIONS
> {
> + /DISCARD/ : { *(.note.gnu.build-id) }
> . = 16K;
> stext = .;
> .text : { *(.init) *(.text) }
>
> which I will squash in your patch 3.
>
Thanks!
There's another difference right after multiboot header.
Here's how GCC binary looks:
00004000 <stext>:
4000: 02 b0 ad 1b 00 00 add 0x1bad(%eax),%dh
4006: 00 00 add %al,(%eax)
4008: fe 4f 52 decb 0x52(%edi)
400b: e4 .byte 0xe4
0000400c <test_function>:
400c: 66 b8 34 12 mov $0x1234,%ax
4010: 00 00 add %al,(%eax)
4012: 66 c3 retw
Here's clang:
00004000 <stext>:
4000: 02 b0 ad 1b 00 00 add 0x1bad(%eax),%dh
4006: 00 00 add %al,(%eax)
4008: fe 4f 52 decb 0x52(%edi)
400b: e4 66 in $0x66,%al
400d: 90 nop
400e: 66 90 xchg %ax,%ax
00004010 <test_function>:
4010: 66 b8 34 12 mov $0x1234,%ax
4014: 00 00 add %al,(%eax)
4016: 66 c3 retw
So, clang pads stext with two NOPs after 400b until it's quad-aligned.
I'm not sure how we can ask it to stop doing that.
The assembly (clang-10 -S) doesn't show an alignment requirement:
.set mb_magic, 464367618
.set mb_flags, 0
# multiboot header
.long 464367618
.long 0
.long -464367618
.p2align 0, 0x90
.globl start
".p2align 0, 0x90" behaves like ".p2align 4, 0x90", sounds like a bug?
But it doesn't introduce an issue as it turned out later
> But the main issue is that clang does not support .code16gcc so it
> writes 32-bit code that is run in 16-bit mode.
I had impression that it does support .code16gcc from the PR (and
included since LLVM 4.0):
https://reviews.llvm.org/D20109
https://github.com/llvm/llvm-project/commit/6477ce2697bf1d9afd2bcc0cf0c16c7cf08713be
Then another changes register allocation since LLVM 5.0 but I don't
know if it breaks anything (I'm not familiar with LLVM TBH).
https://github.com/llvm/llvm-project/commit/f5f593b674ed031f3f5aa2c44ac705547532d5cb
> It'd be a start to use -m16 instead of -m32, but then I think it still
> miscompiles the (32-bit) code between "start" and the .code16gcc
> label.
>
Bingo! Changing target variable "bits = 32" to "bits = 16" helps, it
proceeds properly until "iret 1" (insn_code_iret32) test and then it
hangs.
Inline assembly:
MK_INSN(iret32, "pushf\n\t"
"pushl %cs\n\t"
"call 1f\n\t" /* a near call will push eip onto the stack */
"jmp 2f\n\t"
"1: iretl\n\t"
"2:\n\t"
);
GCC:
00006c25 <insn_code_iret32>:
6c25: 66 9c pushfw
6c27: 66 0e pushw %cs
6c29: 66 e8 02 00 callw 6c2f <insn_code_iret32+0xa>
6c2d: 00 00 add %al,(%eax)
6c2f: eb 02 jmp 6c33 <insn_code_iret16>
6c31: 66 cf iretw
Clang saves 16-bit registers but restores 32-bit in `iret` and `call`
doesn't have an operand-size prefix:
00007547 <insn_code_iret32>:
7547: 9c pushf
7548: 66 0e pushw %cs
754a: e8 02 00 eb 02 call 2eb7551 <edata+0x2eacb6d>
754f: 66 cf iretw
So, this fixes the test and makes "iret 3" pass (otherwise it hangs):
diff --git a/x86/realmode.c b/x86/realmode.c
index 7c2d776..0ae5186 100644
--- a/x86/realmode.c
+++ b/x86/realmode.c
@@ -761,9 +761,9 @@ static void test_pusha_popa(void)
static void test_iret(void)
{
- MK_INSN(iret32, "pushf\n\t"
+ MK_INSN(iret32, "pushfl\n\t"
"pushl %cs\n\t"
- "call 1f\n\t" /* a near call will push eip onto the stack */
+ "calll 1f\n\t" /* a near call will push eip onto the stack */
"jmp 2f\n\t"
"1: iretl\n\t"
"2:\n\t"
@@ -782,7 +782,7 @@ static void test_iret(void)
"orl $0xffc18028, %eax\n\t"
"pushl %eax\n\t"
"pushl %cs\n\t"
- "call 1f\n\t"
+ "calll 1f\n\t"
"jmp 2f\n\t"
"1: iretl\n\t"
"2:\n\t");
With the above change I get the following machine code for iret32 which
is equivalent to GCC:
00007547 <insn_code_iret32>:
7547: 66 9c pushfw
7549: 66 0e pushw %cs
754b: 66 e8 02 00 callw 7551 <insn_code_iret32+0xa>
754f: 00 00 add %al,(%eax)
7551: eb 02 jmp 7555 <insn_code_iret16>
7553: 66 cf iretw
Still, there're a few more failed tests but realmode doesn't hang anymore:
FAIL: pusha/popa 1
FAIL: pusha/popa 1
FAIL: jmp far 1
And explicit instruction suffixes fix them too:
@@ -639,7 +639,7 @@ static void test_jcc_near(void)
static void test_long_jmp(void)
{
- MK_INSN(long_jmp, "call 1f\n\t"
+ MK_INSN(long_jmp, "calll 1f\n\t"
"jmp 2f\n\t"
"1: jmp $0, $test_function\n\t"
"2:\n\t");
@@ -728,26 +728,26 @@ static void test_null(void)
static void test_pusha_popa(void)
{
- MK_INSN(pusha, "pusha\n\t"
- "pop %edi\n\t"
- "pop %esi\n\t"
- "pop %ebp\n\t"
- "add $4, %esp\n\t"
- "pop %ebx\n\t"
- "pop %edx\n\t"
- "pop %ecx\n\t"
- "pop %eax\n\t"
+ MK_INSN(pusha, "pushal\n\t"
+ "popl %edi\n\t"
+ "popl %esi\n\t"
+ "popl %ebp\n\t"
+ "addl $4, %esp\n\t"
+ "popl %ebx\n\t"
+ "popl %edx\n\t"
+ "popl %ecx\n\t"
+ "popl %eax\n\t"
);
- MK_INSN(popa, "push %eax\n\t"
- "push %ecx\n\t"
- "push %edx\n\t"
- "push %ebx\n\t"
- "push %esp\n\t"
- "push %ebp\n\t"
- "push %esi\n\t"
- "push %edi\n\t"
- "popa\n\t"
+ MK_INSN(popa, "pushl %eax\n\t"
+ "pushl %ecx\n\t"
+ "pushl %edx\n\t"
+ "pushl %ebx\n\t"
+ "pushl %esp\n\t"
+ "pushl %ebp\n\t"
+ "pushl %esi\n\t"
+ "pushl %edi\n\t"
+ "popal\n\t"
);
init_inregs(&(struct regs){ .eax = 0, .ebx = 1, .ecx = 2, .edx = 3, .esi = 4, .edi = 5, .ebp = 6 });
Then everything passes in realmode test:
$ ./x86-run x86/realmode.flat | grep FAIL
qemu-system-x86_64: warning: host doesn't support requested feature:
CPUID.80000001H:ECX.svm [bit 2]
$
Perhaps it's worth to respin the series.
Thanks,
Roman
next prev parent reply other threads:[~2020-09-22 21:34 UTC|newest]
Thread overview: 27+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-09-01 8:50 [kvm-unit-tests PATCH v2 00/10] Add support for generic ELF cross-compiler Roman Bolshakov
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 01/10] x86: Makefile: Allow division on x86_64-elf binutils Roman Bolshakov
2020-09-03 15:19 ` Thomas Huth
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 02/10] x86: Replace instruction prefixes with spaces Roman Bolshakov
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 03/10] x86: Makefile: Fix linkage of realmode on x86_64-elf binutils Roman Bolshakov
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 04/10] lib: Bundle debugreg.h from the kernel Roman Bolshakov
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 05/10] lib: x86: Use portable format macros for uint32_t Roman Bolshakov
2020-09-04 13:47 ` Thomas Huth
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 06/10] configure: Add an option to specify getopt Roman Bolshakov
2020-09-04 13:50 ` Thomas Huth
2020-09-22 13:53 ` Paolo Bonzini
2020-09-22 21:51 ` Roman Bolshakov
2020-09-23 2:41 ` Paolo Bonzini
2020-09-23 5:14 ` Thomas Huth
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 07/10] README: Update build instructions for macOS Roman Bolshakov
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 08/10] travis.yml: Add CI " Roman Bolshakov
2020-09-04 13:53 ` Thomas Huth
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 09/10] travis.yml: Change matrix keyword to jobs Roman Bolshakov
2020-09-04 14:20 ` Thomas Huth
2020-09-01 8:50 ` [kvm-unit-tests PATCH v2 10/10] travis.yml: Add x86 build with clang 10 Roman Bolshakov
2020-09-04 14:31 ` Thomas Huth
2020-09-14 14:45 ` Roman Bolshakov
2020-09-14 16:37 ` Thomas Huth
2020-09-15 15:59 ` Roman Bolshakov
2020-09-22 14:51 ` Paolo Bonzini
2020-09-22 21:25 ` Roman Bolshakov [this message]
2020-09-23 2:37 ` Paolo Bonzini
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200922212507.GA11460@SPB-NB-133.local \
--to=r.bolshakov@yadro.com \
--cc=kvm@vger.kernel.org \
--cc=pbonzini@redhat.com \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).