From patchwork Mon Jun 12 10:40:26 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "liguang.zhang" <18622748025@163.com> X-Patchwork-Id: 1793924 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@legolas.ozlabs.org Authentication-Results: legolas.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=nongnu.org (client-ip=209.51.188.17; helo=lists.gnu.org; envelope-from=qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org; receiver=) Authentication-Results: legolas.ozlabs.org; dkim=pass (1024-bit key; unprotected) header.d=163.com header.i=@163.com header.a=rsa-sha256 header.s=s110527 header.b=kp3fKFvA; dkim-atps=neutral Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by legolas.ozlabs.org (Postfix) with ESMTPS id 4QfsRG2Jhtz20Vx for ; Mon, 12 Jun 2023 23:07:22 +1000 (AEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1q8hFO-0004L1-BO; Mon, 12 Jun 2023 09:06:14 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <18622748025@163.com>) id 1q8eyd-0001Hi-6q for qemu-devel@nongnu.org; Mon, 12 Jun 2023 06:40:48 -0400 Received: from m12.mail.163.com ([220.181.12.197]) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from <18622748025@163.com>) id 1q8eyZ-0004bq-N9 for qemu-devel@nongnu.org; Mon, 12 Jun 2023 06:40:46 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=From:Subject:Date:Message-Id; bh=1EghS0/DCmpW2schBS rcg/MX3b8q8Jj+V8D4M7ReZ7k=; b=kp3fKFvA/VMeD5ILzWE/GbI6g4saCaJtua 3bQswgvQSnNAQJUFUfh59LlwcajQNuMK4CFNC4Uz62LsEWmMFYKDsR1O1u1xEdXr 8Jlx5T6cZiMlNCXLDMxr6t6y2b9tPQk4sj/yLcDE4mJ15Hlu6BQCz+ZrDCDmrScB Z/l8qNu3k= Received: from localhost.localdomain (unknown [211.94.241.37]) by zwqz-smtp-mta-g0-1 (Coremail) with SMTP id _____wCnJpcd9oZkSvteAQ--.32949S2; Mon, 12 Jun 2023 18:40:30 +0800 (CST) From: "liguang.zhang" <18622748025@163.com> To: qemu-devel@nongnu.org Cc: pbonzini@redhat.com, "liguang.zhang" Subject: [PATCH] target/riscv: fix the issue of guest reboot then no response or crash in kvm-mode Date: Mon, 12 Jun 2023 18:40:26 +0800 Message-Id: <20230612104026.5110-1-18622748025@163.com> X-Mailer: git-send-email 2.17.1 X-CM-TRANSID: _____wCnJpcd9oZkSvteAQ--.32949S2 X-Coremail-Antispam: 1Uf129KBjvJXoWxXw17WF4fWF43Gr13WF17KFg_yoWrGF4fpF 4DC3y3Cr18t34xJw1ftrZrXr1ru3929F4DArWxCw4fAF45JrZ8G3Z7K3y3tr98GFyUurWa kF45CF13u3yUtaDanT9S1TB71UUUUUUqnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDUYxBIdaVFxhVjvjDU0xZFpf9x07bw-erUUUUU= X-Originating-IP: [211.94.241.37] X-CM-SenderInfo: bpryljasxumiisv6il2tof0z/1tbiyB+MWVp7Kqdd8QAAsC Received-SPF: pass client-ip=220.181.12.197; envelope-from=18622748025@163.com; helo=m12.mail.163.com X-Spam_score_int: 0 X-Spam_score: -0.1 X-Spam_bar: / X-Spam_report: (-0.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, FROM_LOCAL_DIGITS=0.001, FROM_LOCAL_HEX=0.006, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_BL=0.01, RCVD_IN_MSPIKE_L4=1.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-Mailman-Approved-At: Mon, 12 Jun 2023 09:06:04 -0400 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org Sender: qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org From: "liguang.zhang" kernel log ```shell The system is going down NOW! Sent SIGTERM to all processes logout Sent SIGKILL to all processes Requesting system reboot ``` then no response for qemu command: system_reset: kernel log: ```shell [ 53.739556] kvm [150]: VCPU exit error -95 [ 53.739563] kvm [148]: VCPU exit error -95 [ 53.739557] kvm [149]: VCPU exit error -95 [ 53.740957] kvm [149]: SEPC=0x0 SSTATUS=0x200004120 HSTATUS=0x2002001c0 [ 53.740957] kvm [148]: SEPC=0x0 SSTATUS=0x200004120 HSTATUS=0x2002001c0 [ 53.741054] kvm [148]: SCAUSE=0x14 STVAL=0x0 HTVAL=0x0 HTINST=0x0 [ 53.741058] kvm [149]: SCAUSE=0x14 STVAL=0x0 HTVAL=0x0 HTINST=0x0 [ 53.756187] kvm [150]: SEPC=0x0 SSTATUS=0x200004120 HSTATUS=0x2002001c0 [ 53.757797] kvm [150]: SCAUSE=0x14 STVAL=0x0 HTVAL=0x0 HTINST=0x0 ``` solution: add reset csr and context for riscv vcpu qemu ioctl reset vcpu->arch.power_off state of kvm tests: qemu-system-riscv64 -M virt -bios none -kernel Image \ -smp 4 -enable-kvm \ -append "rootwait root=/dev/vda ro" \ -drive file=rootfs.ext2,format=raw,id=hd0 \ -device virtio-blk-device,drive=hd0 in guest shell: qemu command: system_reset Signed-off-by: liguang.zhang --- target/riscv/kvm.c | 43 ++++++++++++++++++++++++++++++++++++++++ target/riscv/kvm_riscv.h | 1 + 2 files changed, 44 insertions(+) diff --git a/target/riscv/kvm.c b/target/riscv/kvm.c index 0f932a5b96..c6a7824c9e 100644 --- a/target/riscv/kvm.c +++ b/target/riscv/kvm.c @@ -42,6 +42,8 @@ #include "migration/migration.h" #include "sysemu/runstate.h" +static bool cap_has_mp_state; + static uint64_t kvm_riscv_reg_id(CPURISCVState *env, uint64_t type, uint64_t idx) { @@ -335,6 +337,25 @@ int kvm_arch_get_registers(CPUState *cs) return ret; } +int kvm_riscv_set_mpstate_to_kvm(RISCVCPU *cpu, int state) +{ + if (cap_has_mp_state) { + + struct kvm_mp_state mp_state = { + .mp_state = state + }; + + int ret = kvm_vcpu_ioctl(CPU(cpu), KVM_SET_MP_STATE, &mp_state); + if (ret) { + fprintf(stderr, "%s: failed to set MP_STATE %d/%s\n", + __func__, ret, strerror(-ret)); + return -1; + } + } + + return 0; +} + int kvm_arch_put_registers(CPUState *cs, int level) { int ret = 0; @@ -354,6 +375,18 @@ int kvm_arch_put_registers(CPUState *cs, int level) return ret; } + if (KVM_PUT_RESET_STATE == level) { + RISCVCPU *cpu = RISCV_CPU(cs); + if (cs->cpu_index == 0) { + ret = kvm_riscv_set_mpstate_to_kvm(cpu, KVM_MP_STATE_RUNNABLE); + } else { + ret = kvm_riscv_set_mpstate_to_kvm(cpu, KVM_MP_STATE_STOPPED); + } + if (ret) { + return ret; + } + } + return ret; } @@ -428,6 +461,7 @@ int kvm_arch_add_msi_route_post(struct kvm_irq_routing_entry *route, int kvm_arch_init(MachineState *ms, KVMState *s) { + cap_has_mp_state = kvm_check_extension(s, KVM_CAP_MP_STATE); return 0; } @@ -506,10 +540,19 @@ void kvm_riscv_reset_vcpu(RISCVCPU *cpu) if (!kvm_enabled()) { return; } + for (int i=0; i<32; i++) + env->gpr[i] = 0; env->pc = cpu->env.kernel_addr; env->gpr[10] = kvm_arch_vcpu_id(CPU(cpu)); /* a0 */ env->gpr[11] = cpu->env.fdt_addr; /* a1 */ env->satp = 0; + env->mie = 0; + env->stvec = 0; + env->sscratch = 0; + env->sepc = 0; + env->scause = 0; + env->stval = 0; + env->mip = 0; } void kvm_riscv_set_irq(RISCVCPU *cpu, int irq, int level) diff --git a/target/riscv/kvm_riscv.h b/target/riscv/kvm_riscv.h index ed281bdce0..4a4c262820 100644 --- a/target/riscv/kvm_riscv.h +++ b/target/riscv/kvm_riscv.h @@ -21,5 +21,6 @@ void kvm_riscv_reset_vcpu(RISCVCPU *cpu); void kvm_riscv_set_irq(RISCVCPU *cpu, int irq, int level); +int kvm_riscv_set_mpstate_to_kvm(RISCVCPU *cpu, int state); #endif