From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751286AbeECOlw (ORCPT ); Thu, 3 May 2018 10:41:52 -0400 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:40136 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751076AbeECOlu (ORCPT ); Thu, 3 May 2018 10:41:50 -0400 Subject: Re: [PATCH v4 08/15] KVM: s390: interfaces to (de)configure guest's AP matrix To: Pierre Morel , linux-s390@vger.kernel.org, linux-kernel@vger.kernel.org, kvm@vger.kernel.org Cc: freude@de.ibm.com, schwidefsky@de.ibm.com, heiko.carstens@de.ibm.com, borntraeger@de.ibm.com, cohuck@redhat.com, kwankhede@nvidia.com, bjsdjshi@linux.vnet.ibm.com, pbonzini@redhat.com, alex.williamson@redhat.com, alifm@linux.vnet.ibm.com, mjrosato@linux.vnet.ibm.com, jjherne@linux.vnet.ibm.com, thuth@redhat.com, pasic@linux.vnet.ibm.com, berrange@redhat.com, fiuczy@linux.vnet.ibm.com, buendgen@de.ibm.com References: <1523827345-11600-1-git-send-email-akrowiak@linux.vnet.ibm.com> <1523827345-11600-9-git-send-email-akrowiak@linux.vnet.ibm.com> <99f4752a-1358-61e4-bf9e-5672b2d4036f@linux.vnet.ibm.com> <0f47c442-47b8-ee57-d014-5200c59125d7@linux.vnet.ibm.com> <54e4c3ef-0750-981b-7b0e-6b18d1a77c3c@linux.vnet.ibm.com> From: Tony Krowiak Date: Thu, 3 May 2018 10:41:39 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.0 MIME-Version: 1.0 In-Reply-To: <54e4c3ef-0750-981b-7b0e-6b18d1a77c3c@linux.vnet.ibm.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-TM-AS-GCONF: 00 x-cbid: 18050314-0008-0000-0000-000009B4719A X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00008962; HX=3.00000241; KW=3.00000007; PH=3.00000004; SC=3.00000258; SDB=6.01026928; UDB=6.00524525; IPR=6.00806061; MB=3.00020905; MTD=3.00000008; XFM=3.00000015; UTC=2018-05-03 14:41:47 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 18050314-0009-0000-0000-000047156222 Message-Id: <7a733e41-3956-6828-9efa-899c9a954c20@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-05-03_07:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1011 lowpriorityscore=0 impostorscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1709140000 definitions=main-1805030129 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 05/02/2018 10:57 AM, Pierre Morel wrote: > On 25/04/2018 18:21, Tony Krowiak wrote: >> On 04/23/2018 09:46 AM, Pierre Morel wrote: >>> On 15/04/2018 23:22, Tony Krowiak wrote: >>>> Provides interfaces to assign AP adapters, usage domains >>>> and control domains to a KVM guest. >>>> > ... >>>> +/** >>>> + * kvm_ap_matrix_create >>>> + * >>>> + * Create an AP matrix to hold a configuration of AP adapters, >>>> domains and >>>> + * control domains. >>>> + * >>>> + * @ap_matrix: holds the matrix that is created >>>> + * >>>> + * Returns 0 if the matrix is successfully created. Returns an >>>> error if an APQN >>>> + * derived from the cross product of the AP adapter IDs and AP >>>> queue indexes >>>> + * comprising the AP matrix is configured for another guest. >>>> + */ >>>> +int kvm_ap_matrix_create(struct kvm_ap_matrix **ap_matrix); >>> >>> why not simply return the pointer? >> >> The function returns a value indicating the reason a matrix could not >> be created. >> Returning a NULL pointer provides no clue as to why the call failed. > > That is why the ERR_PTR exist :) The point it moot, I'm getting rid of this function call and including the struct kvm_ap_matrix as a static member of the parent struct ap_matrix_mdev and not a pointer. > > > > ... >>>> + * Returns 0 if the APQNs are valid, otherwise; returns -EBUSY. >>>> + */ >>>> +static int kvm_ap_validate_queue_sharing(struct kvm *kvm, >>>> + struct kvm_ap_matrix *matrix) >>>> +{ >>>> + struct kvm *vm; >>>> + unsigned long *apm, *aqm; >>>> + unsigned long apid, apqi; >>>> + >>>> + >>>> + /* No other VM may share an AP Queue with the input VM */ >>> >>> I wonder if these functions and structures should really belong to KVM. >>> The only have sense with the VFIO driver. >>> My opinion is that they belong there, in the VFIO driver code. >> >> I disagree for two reasons: >> >> 1. The vfio_ap driver should not have to know how to configure the KVM >> guest's matrix nor anything else about KVM for that matter. >> >> 2. The interfaces and structures defined in kvm-ap.h and implemented >> in kvm-ap.c don't have anything to do with VFIO and can stand alone >> to be used by any client code to configure a guest's matrix. > > Doing this you will have to change KVM if the AP VFIO matrix protocol > to access the queues change. > i.e. suppose some day the queues may be shared between guests. > ... The kvm_ap_configure_matrix(kvm, matrix) interface configures the APM, AQM and ADM in the guest's CRYCB which implies AP instructions are being interpreted. There is nothing in SIE precluding the sharing of AP queues between guests using SIE to interpret AP instructions, it is my opinion - along with several others - that this is not advisable given the results are not predictable, not to mention the security concerns. If the protocol to access queues changes, then we create a different interface. The other option is to include a flag on the kvm_ap_configure_matrix(kvm, matrix) interface to indicate whether sharing is allowed. I don't like this, because we have no way of knowing if the caller has taken the proper care to ensure the VM sharing the queue should be allowed access. Besides, when queue sharing is implemented, it is my opinion that we will intercept the AP instructions and the matrix will not be configured in the CRYCB. I stick by my response above. > >>>> +static int kvm_ap_matrix_apm_create(struct kvm_ap_matrix *ap_matrix, >>>> + struct ap_config_info *config) >>>> +{ >>>> + int apm_max = (config && config->apxa) ? config->Na + 1 : 16; >>> >>> At this moment you already know the format of the crycb. >> >> How? > > you calculated this in kvm_ap_build_crycbd() which is called from > kvm_s390_crypto_init() > itself called from kvm_arch_init_vm(). > It is when starting the VM. This structure is used by the vfio_ap driver to store the mediated matrix device's matrix configuration as well as to configure the CRYCB. The mediated device's matrix is configured before the guest is started ... it is the means for configuring the guest's matrix after all. The bottom line is, this function will be called long before the kvm_ap_build_crycbd() function is called. Having said that, I am including the struct kvm_ap_matrix as a static field in struct ap_matrix_mdev - i.e., not a pointer. Consequently, the apm_max, aqm_max and adm_max fields will be set by the driver when the mediated matrix device is created. > > > kvm_ap_matrix_apm_create() is called much later when realizing the device The kvm_ap_matrix_apm_create() is called by the kvm_ap_matrix_create() which is called when the mediated matrix device is created - i.e., the vfio_ap_mdev_create() function is vfio_ap_ops.c. The mediated device is created when the UUID is written to the sysfs create file. The mediated device is used when the guest is started to configure it's CRYCB, so the kvm_ap_matrix_apm_create() is called long before the device is realized. Again the point is moot because I am getting rid of the dynamic allocation of struct kvm_ap_matrix. > > > ... > > >