Took me a while to find the xl config option to set this flag (pci = [
'sbdf, rdm_policy=strict/relaxed' ]) but now it works as expected!

I remember 'relaxed' is a default value so 'rdm_policy' can't be dropped here if you like this.