From patchwork Sat Dec 1 00:13:23 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Alex Williamson X-Patchwork-Id: 1006258 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (mailfrom) smtp.mailfrom=nongnu.org (client-ip=2001:4830:134:3::11; helo=lists.gnu.org; envelope-from=qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org; receiver=) Authentication-Results: ozlabs.org; dmarc=fail (p=none dis=none) header.from=redhat.com Received: from lists.gnu.org (lists.gnu.org [IPv6:2001:4830:134:3::11]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 436BZN4XrFz9s8r for ; Sat, 1 Dec 2018 11:14:02 +1100 (AEDT) Received: from localhost ([::1]:35197 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gSsv1-0001cT-Qe for incoming@patchwork.ozlabs.org; Fri, 30 Nov 2018 19:13:59 -0500 Received: from eggs.gnu.org ([2001:4830:134:3::10]:60294) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gSsug-0001cD-FV for qemu-devel@nongnu.org; Fri, 30 Nov 2018 19:13:39 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gSsuc-0005TK-Ek for qemu-devel@nongnu.org; Fri, 30 Nov 2018 19:13:38 -0500 Received: from mx1.redhat.com ([209.132.183.28]:53628) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1gSsuc-0005SV-5h for qemu-devel@nongnu.org; Fri, 30 Nov 2018 19:13:34 -0500 Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id DBFD0307D84D; Sat, 1 Dec 2018 00:13:30 +0000 (UTC) Received: from gimli.home (ovpn-116-92.phx2.redhat.com [10.3.116.92]) by smtp.corp.redhat.com (Postfix) with ESMTP id 8D7B960CD1; Sat, 1 Dec 2018 00:13:23 +0000 (UTC) From: Alex Williamson To: qemu-devel@nongnu.org Date: Fri, 30 Nov 2018 17:13:23 -0700 Message-ID: <154362272919.7153.15101701755308287523.stgit@gimli.home> User-Agent: StGit/0.19-dirty MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.12 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.48]); Sat, 01 Dec 2018 00:13:31 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-Received-From: 209.132.183.28 Subject: [Qemu-devel] [for-3.2 PATCH 0/9] pcie: Enhanced link speed and width support X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Geoffrey McRae , Peter Maydell , Eduardo Habkost , "Michael S. Tsirkin" , Markus Armbruster , Paolo Bonzini , David Gibson , Richard Henderson Errors-To: qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org Sender: "Qemu-devel" RFC->v1: - Add Cc reported by get_maintainer - Fixup some commit logs (no code changes in patches 1-7) - Add Geoffrey's Tested-by - Add patches 8 & 9 which define a QEMU 3.2 machine type and cranking up the link speed and width for that machine type while maintaining compatibile speeds for older machine types (testing requested for non-x86 machine types) - Various other users have also reported success with this series (/r/VFIO) Original cover letter: QEMU exposes gen1 PCI-express interconnect devices supporting only 2.5GT/s and x1 width. It might not seem obvious that a virtual bandwidth limitation can result in a real performance degradation, but it's been reported that in some configurations assigned GPUs might not scale their link speed up to the maximum supported value if the downstream port above it only advertises limited link support. As proposed[1] this series effectively implements virtual link negotiation on downstream ports and enhances the generic PCIe root port to allow user configurable speeds and widths. The "negotiation" simply mirrors the link status of the connected downstream device providing the appearance of dynamic link speed scaling to match the endpoint device. Not yet implemented from the proposal is support for globally updating defaults based on machine type, though the foundation is provided here by allowing supporting PCIESlots to implement an instance_init callback which can call into a common helper for this. I have not specifically tested migration with this, but we already consider LNKSTA to be dynamic and the other changes implemented here are static config space changes with no changes being implemented for devices using default values, ie. they should be compatible by virtue of existing config space migration support. I think I've covered the required link related registers to support PCIe 4.0, but please let me know if I've missed any. Testing and feedback appreciated, patch 6/7 provides example qemu:arg options and requirements to use with existing libvirt. Native libvirt support TBD. Thanks, Alex [1] https://lists.gnu.org/archive/html/qemu-devel/2018-10/msg03086.html --- Alex Williamson (9): pcie: Create enums for link speed and width pci: Sync PCIe downstream port LNKSTA on read qapi: Define PCIe link speed and width properties pcie: Add link speed and width fields to PCIESlot pcie: Fill PCIESlot link fields to support higher speeds and widths pcie: Allow generic PCIe root port to specify link speed and width vfio/pci: Remove PCIe Link Status emulation q35/440fx/arm/spapr: Add QEMU 3.2 machine type pcie: Fast PCIe root ports for new machines hw/arm/virt.c | 19 +++- hw/core/qdev-properties.c | 178 ++++++++++++++++++++++++++++++++++++ hw/i386/pc_piix.c | 15 ++- hw/i386/pc_q35.c | 13 ++- hw/pci-bridge/gen_pcie_root_port.c | 2 hw/pci-bridge/pcie_root_port.c | 14 +++ hw/pci/pci.c | 4 + hw/pci/pcie.c | 118 +++++++++++++++++++++++- hw/ppc/spapr.c | 25 ++++- hw/vfio/pci.c | 9 -- include/hw/compat.h | 11 ++ include/hw/i386/pc.h | 3 + include/hw/pci/pci.h | 13 +++ include/hw/pci/pcie.h | 1 include/hw/pci/pcie_port.h | 4 + include/hw/pci/pcie_regs.h | 23 ++++- include/hw/qdev-properties.h | 8 ++ qapi/common.json | 42 ++++++++ 18 files changed, 480 insertions(+), 22 deletions(-)