4.9rc4: linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory

4.9rc4: linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory

[Steven Haigh]

[-- Attachment #1.1.1: Type: text/plain, Size: 1379 bytes --]

I'm trying to use the same build procedure I had for working correctly
for Xen 4.7 & 4.8.1 - but am coming across this error:

gcc  -DPIC -m64 -DBUILD_ID -fno-strict-aliasing -std=gnu99 -Wall
-Wstrict-prototypes -Wdeclaration-after-statement
-Wno-unused-but-set-variable -Wno-unused-local-typedefs   -g3 -O0
-fno-omit-frame-pointer -D__XEN_INTERFACE_VERSION__=__XE
N_LATEST_INTERFACE_VERSION__ -MMD -MF .linux.opic.d -D_LARGEFILE_SOURCE
-D_LARGEFILE64_SOURCE   -Werror -Wmissing-prototypes -I./include
-I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
-I/builddir/build/BUI
LD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/libs/toollog/include
-I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
 -fPIC -c -o linux.opic linux.c
mv headers.chk.new headers.chk
linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
 #include <xen/sys/evtchn.h>
                            ^
compilation terminated.
linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
 #include <xen/sys/evtchn.h>
                            ^
compilation terminated.

Any clues as to what to start pulling apart that changed between 4.8.1
and 4.9.0-rc4 that could cause this?

-- 
Steven Haigh

Email: netwiz@crc.id.au
Web: https://www.crc.id.au
Phone: (03) 9001 6090 - 0412 935 897



[-- Attachment #1.2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 819 bytes --]

[-- Attachment #2: Type: text/plain, Size: 127 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

Re: 4.9rc4: linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory

[M A Young]

On Tue, 9 May 2017, Steven Haigh wrote:

> I'm trying to use the same build procedure I had for working correctly
> for Xen 4.7 & 4.8.1 - but am coming across this error:
> 
> gcc  -DPIC -m64 -DBUILD_ID -fno-strict-aliasing -std=gnu99 -Wall
> -Wstrict-prototypes -Wdeclaration-after-statement
> -Wno-unused-but-set-variable -Wno-unused-local-typedefs   -g3 -O0
> -fno-omit-frame-pointer -D__XEN_INTERFACE_VERSION__=__XE
> N_LATEST_INTERFACE_VERSION__ -MMD -MF .linux.opic.d -D_LARGEFILE_SOURCE
> -D_LARGEFILE64_SOURCE   -Werror -Wmissing-prototypes -I./include
> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
> -I/builddir/build/BUI
> LD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/libs/toollog/include
> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>  -fPIC -c -o linux.opic linux.c
> mv headers.chk.new headers.chk
> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>  #include <xen/sys/evtchn.h>
>                             ^
> compilation terminated.
> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>  #include <xen/sys/evtchn.h>
>                             ^
> compilation terminated.
> 
> Any clues as to what to start pulling apart that changed between 4.8.1
> and 4.9.0-rc4 that could cause this?

It worked for me in a test build, eg. see one of the builds at
https://copr.fedorainfracloud.org/coprs/myoung/xentest/build/549124/

	Michael Young

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

Re: 4.9rc4: linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory

[Steven Haigh]

[-- Attachment #1.1.1: Type: text/plain, Size: 2689 bytes --]

On 10/05/17 01:20, M A Young wrote:
> On Tue, 9 May 2017, Steven Haigh wrote:
> 
>> I'm trying to use the same build procedure I had for working correctly
>> for Xen 4.7 & 4.8.1 - but am coming across this error:
>>
>> gcc  -DPIC -m64 -DBUILD_ID -fno-strict-aliasing -std=gnu99 -Wall
>> -Wstrict-prototypes -Wdeclaration-after-statement
>> -Wno-unused-but-set-variable -Wno-unused-local-typedefs   -g3 -O0
>> -fno-omit-frame-pointer -D__XEN_INTERFACE_VERSION__=__XE
>> N_LATEST_INTERFACE_VERSION__ -MMD -MF .linux.opic.d -D_LARGEFILE_SOURCE
>> -D_LARGEFILE64_SOURCE   -Werror -Wmissing-prototypes -I./include
>> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>> -I/builddir/build/BUI
>> LD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/libs/toollog/include
>> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>>  -fPIC -c -o linux.opic linux.c
>> mv headers.chk.new headers.chk
>> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>>  #include <xen/sys/evtchn.h>
>>                             ^
>> compilation terminated.
>> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>>  #include <xen/sys/evtchn.h>
>>                             ^
>> compilation terminated.
>>
>> Any clues as to what to start pulling apart that changed between 4.8.1
>> and 4.9.0-rc4 that could cause this?
> 
> It worked for me in a test build, eg. see one of the builds at
> https://copr.fedorainfracloud.org/coprs/myoung/xentest/build/549124/

Ok, after lots of debugging, when I run 'make dist', I usually use the
macro for smp building, so I end up with:
	make %{?_smp_mflags} dist

It seems this is hit and miss as to it actually working.

I have had a 100% success rate (but slow builds) with:
	make dist

Trying with 'make -j4 dist' seems to work the couple of times I've tried it.

This seems to be a new problem that I haven't come across before in 4.4,
4.5, 4.6, 4.7 or my initial 4.8.1 builds - so its new to 4.9.0 rc's.

The consensus on #xen seems to be that there is a race between libs &
include - and that these are supposed to be built in sequence and not
parallel.

I'm a little over my depth now - as I assume this heads into Makefile land.

If it helps, there is a full build log available at:
	https://cloud.crc.id.au/index.php/s/iTWJE3A1TQBhgDq

I've committed my current progress in my git tree:
	https://xen.crc.id.au/git/?p=xen49;a=tree

Right now, we're looking at lines 304 / 305 of SPECS/xen49.spec

-- 
Steven Haigh

Email: netwiz@crc.id.au
Web: https://www.crc.id.au
Phone: (03) 9001 6090 - 0412 935 897


[-- Attachment #1.2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 819 bytes --]

[-- Attachment #2: Type: text/plain, Size: 127 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

Re: 4.9rc4: Cannot build with higher than -j4 - was: linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory

[Steven Haigh]

[-- Attachment #1.1.1: Type: text/plain, Size: 3015 bytes --]

On 10/05/17 23:02, Steven Haigh wrote:
> On 10/05/17 01:20, M A Young wrote:
>> On Tue, 9 May 2017, Steven Haigh wrote:
>>
>>> I'm trying to use the same build procedure I had for working correctly
>>> for Xen 4.7 & 4.8.1 - but am coming across this error:
>>>
>>> gcc  -DPIC -m64 -DBUILD_ID -fno-strict-aliasing -std=gnu99 -Wall
>>> -Wstrict-prototypes -Wdeclaration-after-statement
>>> -Wno-unused-but-set-variable -Wno-unused-local-typedefs   -g3 -O0
>>> -fno-omit-frame-pointer -D__XEN_INTERFACE_VERSION__=__XE
>>> N_LATEST_INTERFACE_VERSION__ -MMD -MF .linux.opic.d -D_LARGEFILE_SOURCE
>>> -D_LARGEFILE64_SOURCE   -Werror -Wmissing-prototypes -I./include
>>> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>>> -I/builddir/build/BUI
>>> LD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/libs/toollog/include
>>> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>>>  -fPIC -c -o linux.opic linux.c
>>> mv headers.chk.new headers.chk
>>> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>>>  #include <xen/sys/evtchn.h>
>>>                             ^
>>> compilation terminated.
>>> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>>>  #include <xen/sys/evtchn.h>
>>>                             ^
>>> compilation terminated.
>>>
>>> Any clues as to what to start pulling apart that changed between 4.8.1
>>> and 4.9.0-rc4 that could cause this?
>>
>> It worked for me in a test build, eg. see one of the builds at
>> https://copr.fedorainfracloud.org/coprs/myoung/xentest/build/549124/
> 
> Ok, after lots of debugging, when I run 'make dist', I usually use the
> macro for smp building, so I end up with:
> 	make %{?_smp_mflags} dist
> 
> It seems this is hit and miss as to it actually working.
> 
> I have had a 100% success rate (but slow builds) with:
> 	make dist
> 
> Trying with 'make -j4 dist' seems to work the couple of times I've tried it.
> 
> This seems to be a new problem that I haven't come across before in 4.4,
> 4.5, 4.6, 4.7 or my initial 4.8.1 builds - so its new to 4.9.0 rc's.
> 
> The consensus on #xen seems to be that there is a race between libs &
> include - and that these are supposed to be built in sequence and not
> parallel.
> 
> I'm a little over my depth now - as I assume this heads into Makefile land.
> 
> If it helps, there is a full build log available at:
> 	https://cloud.crc.id.au/index.php/s/iTWJE3A1TQBhgDq
> 
> I've committed my current progress in my git tree:
> 	https://xen.crc.id.au/git/?p=xen49;a=tree
> 
> Right now, we're looking at lines 304 / 305 of SPECS/xen49.spec

Just wanted to give this a nudge. It seems if you build with above -j4
(on a machine with suitable number of cores), the build will fail. This
is a degradation from any version previous to 4.9.

-- 
Steven Haigh

Email: netwiz@crc.id.au
Web: https://www.crc.id.au
Phone: (03) 9001 6090 - 0412 935 897


[-- Attachment #1.2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 819 bytes --]

[-- Attachment #2: Type: text/plain, Size: 127 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

Re: 4.9rc4: Cannot build with higher than -j4 - was: linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory

[George Dunlap]

On Sun, May 14, 2017 at 10:50 AM, Steven Haigh <netwiz@crc.id.au> wrote:
> On 10/05/17 23:02, Steven Haigh wrote:
>> On 10/05/17 01:20, M A Young wrote:
>>> On Tue, 9 May 2017, Steven Haigh wrote:
>>>
>>>> I'm trying to use the same build procedure I had for working correctly
>>>> for Xen 4.7 & 4.8.1 - but am coming across this error:
>>>>
>>>> gcc  -DPIC -m64 -DBUILD_ID -fno-strict-aliasing -std=gnu99 -Wall
>>>> -Wstrict-prototypes -Wdeclaration-after-statement
>>>> -Wno-unused-but-set-variable -Wno-unused-local-typedefs   -g3 -O0
>>>> -fno-omit-frame-pointer -D__XEN_INTERFACE_VERSION__=__XE
>>>> N_LATEST_INTERFACE_VERSION__ -MMD -MF .linux.opic.d -D_LARGEFILE_SOURCE
>>>> -D_LARGEFILE64_SOURCE   -Werror -Wmissing-prototypes -I./include
>>>> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>>>> -I/builddir/build/BUI
>>>> LD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/libs/toollog/include
>>>> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>>>>  -fPIC -c -o linux.opic linux.c
>>>> mv headers.chk.new headers.chk
>>>> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>>>>  #include <xen/sys/evtchn.h>
>>>>                             ^
>>>> compilation terminated.
>>>> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>>>>  #include <xen/sys/evtchn.h>
>>>>                             ^
>>>> compilation terminated.
>>>>
>>>> Any clues as to what to start pulling apart that changed between 4.8.1
>>>> and 4.9.0-rc4 that could cause this?
>>>
>>> It worked for me in a test build, eg. see one of the builds at
>>> https://copr.fedorainfracloud.org/coprs/myoung/xentest/build/549124/
>>
>> Ok, after lots of debugging, when I run 'make dist', I usually use the
>> macro for smp building, so I end up with:
>>       make %{?_smp_mflags} dist
>>
>> It seems this is hit and miss as to it actually working.
>>
>> I have had a 100% success rate (but slow builds) with:
>>       make dist
>>
>> Trying with 'make -j4 dist' seems to work the couple of times I've tried it.
>>
>> This seems to be a new problem that I haven't come across before in 4.4,
>> 4.5, 4.6, 4.7 or my initial 4.8.1 builds - so its new to 4.9.0 rc's.
>>
>> The consensus on #xen seems to be that there is a race between libs &
>> include - and that these are supposed to be built in sequence and not
>> parallel.
>>
>> I'm a little over my depth now - as I assume this heads into Makefile land.
>>
>> If it helps, there is a full build log available at:
>>       https://cloud.crc.id.au/index.php/s/iTWJE3A1TQBhgDq
>>
>> I've committed my current progress in my git tree:
>>       https://xen.crc.id.au/git/?p=xen49;a=tree
>>
>> Right now, we're looking at lines 304 / 305 of SPECS/xen49.spec
>
> Just wanted to give this a nudge. It seems if you build with above -j4
> (on a machine with suitable number of cores), the build will fail. This
> is a degradation from any version previous to 4.9.

Julien,

Probably something we should put on your list as a release blocker.

 -George

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

Re: 4.9rc4: Cannot build with higher than -j4 - was: linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory

[Julien Grall]

Hi George,

CC Ian and Wei for feedback on the error.

On 15/05/17 14:04, George Dunlap wrote:
> On Sun, May 14, 2017 at 10:50 AM, Steven Haigh <netwiz@crc.id.au> wrote:
>> On 10/05/17 23:02, Steven Haigh wrote:
>>> On 10/05/17 01:20, M A Young wrote:
>>>> On Tue, 9 May 2017, Steven Haigh wrote:
>>>>
>>>>> I'm trying to use the same build procedure I had for working correctly
>>>>> for Xen 4.7 & 4.8.1 - but am coming across this error:
>>>>>
>>>>> gcc  -DPIC -m64 -DBUILD_ID -fno-strict-aliasing -std=gnu99 -Wall
>>>>> -Wstrict-prototypes -Wdeclaration-after-statement
>>>>> -Wno-unused-but-set-variable -Wno-unused-local-typedefs   -g3 -O0
>>>>> -fno-omit-frame-pointer -D__XEN_INTERFACE_VERSION__=__XE
>>>>> N_LATEST_INTERFACE_VERSION__ -MMD -MF .linux.opic.d -D_LARGEFILE_SOURCE
>>>>> -D_LARGEFILE64_SOURCE   -Werror -Wmissing-prototypes -I./include
>>>>> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>>>>> -I/builddir/build/BUI
>>>>> LD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/libs/toollog/include
>>>>> -I/builddir/build/BUILD/xen-4.9.0-rc4/tools/libs/evtchn/../../../tools/include
>>>>>  -fPIC -c -o linux.opic linux.c
>>>>> mv headers.chk.new headers.chk
>>>>> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>>>>>  #include <xen/sys/evtchn.h>
>>>>>                             ^
>>>>> compilation terminated.
>>>>> linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory
>>>>>  #include <xen/sys/evtchn.h>
>>>>>                             ^
>>>>> compilation terminated.
>>>>>
>>>>> Any clues as to what to start pulling apart that changed between 4.8.1
>>>>> and 4.9.0-rc4 that could cause this?
>>>>
>>>> It worked for me in a test build, eg. see one of the builds at
>>>> https://copr.fedorainfracloud.org/coprs/myoung/xentest/build/549124/
>>>
>>> Ok, after lots of debugging, when I run 'make dist', I usually use the
>>> macro for smp building, so I end up with:
>>>       make %{?_smp_mflags} dist
>>>
>>> It seems this is hit and miss as to it actually working.
>>>
>>> I have had a 100% success rate (but slow builds) with:
>>>       make dist
>>>
>>> Trying with 'make -j4 dist' seems to work the couple of times I've tried it.
>>>
>>> This seems to be a new problem that I haven't come across before in 4.4,
>>> 4.5, 4.6, 4.7 or my initial 4.8.1 builds - so its new to 4.9.0 rc's.
>>>
>>> The consensus on #xen seems to be that there is a race between libs &
>>> include - and that these are supposed to be built in sequence and not
>>> parallel.
>>>
>>> I'm a little over my depth now - as I assume this heads into Makefile land.
>>>
>>> If it helps, there is a full build log available at:
>>>       https://cloud.crc.id.au/index.php/s/iTWJE3A1TQBhgDq
>>>
>>> I've committed my current progress in my git tree:
>>>       https://xen.crc.id.au/git/?p=xen49;a=tree
>>>
>>> Right now, we're looking at lines 304 / 305 of SPECS/xen49.spec
>>
>> Just wanted to give this a nudge. It seems if you build with above -j4
>> (on a machine with suitable number of cores), the build will fail. This
>> is a degradation from any version previous to 4.9.
>
> Julien,
>
> Probably something we should put on your list as a release blocker.

I think you are right. Added in the list.

Cheers,

-- 
Julien Grall

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

Re: 4.9rc4: Cannot build with higher than -j4 - was: linux.c:27:28: fatal error: xen/sys/evtchn.h: No such file or directory

[Wei Liu]

On Mon, May 15, 2017 at 04:29:31PM +0100, Julien Grall wrote:
> Hi George,
> 
> CC Ian and Wei for feedback on the error.
> 

No you didn't. ;p

I've tracked down the issue. Trying to work out a fix at the moment.

The culprit is: stubdom build runs before tools build. The link farm
rune in tools/include depends on setting XEN_OS.

I'm rather baffled why this issue didn't surface until now.

Wei.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel