From patchwork Thu Nov 18 10:54:06 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mohammad Heib X-Patchwork-Id: 1556570 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: bilbo.ozlabs.org; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=redhat.com header.i=@redhat.com header.a=rsa-sha256 header.s=mimecast20190719 header.b=Ah6pIt10; dkim-atps=neutral Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=openvswitch.org (client-ip=2605:bc80:3010::136; helo=smtp3.osuosl.org; envelope-from=ovs-dev-bounces@openvswitch.org; receiver=) Received: from smtp3.osuosl.org (smtp3.osuosl.org [IPv6:2605:bc80:3010::136]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by bilbo.ozlabs.org (Postfix) with ESMTPS id 4HvxX24QDSz9s1l for ; Thu, 18 Nov 2021 21:54:56 +1100 (AEDT) Received: from localhost (localhost [127.0.0.1]) by smtp3.osuosl.org (Postfix) with ESMTP id 7087B60776; Thu, 18 Nov 2021 10:54:50 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp3.osuosl.org ([127.0.0.1]) by localhost (smtp3.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id QLbOEevMGWOj; Thu, 18 Nov 2021 10:54:49 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [140.211.9.56]) by smtp3.osuosl.org (Postfix) with ESMTPS id 573FE60611; Thu, 18 Nov 2021 10:54:48 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id 235DFC002E; Thu, 18 Nov 2021 10:54:48 +0000 (UTC) X-Original-To: dev@openvswitch.org Delivered-To: ovs-dev@lists.linuxfoundation.org Received: from smtp3.osuosl.org (smtp3.osuosl.org [IPv6:2605:bc80:3010::136]) by lists.linuxfoundation.org (Postfix) with ESMTP id C380DC0012 for ; Thu, 18 Nov 2021 10:54:46 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp3.osuosl.org (Postfix) with ESMTP id B8BF4606C4 for ; Thu, 18 Nov 2021 10:54:46 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp3.osuosl.org ([127.0.0.1]) by localhost (smtp3.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id kJf6jIk4kPWw for ; Thu, 18 Nov 2021 10:54:45 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124]) by smtp3.osuosl.org (Postfix) with ESMTPS id 04BFD60611 for ; Thu, 18 Nov 2021 10:54:44 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1637232883; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=f06gGVFx6S6mHclNhvadqmN3CaAsazixBTr6/cBwJks=; b=Ah6pIt10g0hqzgxXxztwHtGR6Y+V+brLaqnzV05IEyocXu4Fwy21zUr7vpdEY3tAIw0684 DxE2sS+6Fh+ZpKFn06mQNA51/Nn4xMx0rTwo1vP1UI2PAzuJEaB4jU0vePBpmJ7+GXIr5L apkJ5v2AKBtpZWbPL3hPe5owK0OZl9w= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-541-KDHtHFdANTK9H5Vn2EckdA-1; Thu, 18 Nov 2021 05:54:41 -0500 X-MC-Unique: KDHtHFdANTK9H5Vn2EckdA-1 Received: from smtp.corp.redhat.com (int-mx08.intmail.prod.int.phx2.redhat.com [10.5.11.23]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id C70491922961 for ; Thu, 18 Nov 2021 10:54:40 +0000 (UTC) Received: from mheiblap.localdomain.com (unknown [10.35.206.237]) by smtp.corp.redhat.com (Postfix) with ESMTP id B64E819D9B; Thu, 18 Nov 2021 10:54:39 +0000 (UTC) From: Mohammad Heib To: dev@openvswitch.org Date: Thu, 18 Nov 2021 12:54:06 +0200 Message-Id: <20211118105406.508257-1-mheib@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.84 on 10.5.11.23 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=mheib@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Subject: [ovs-dev] [PATCH ovn] controller/pinctrl: improve packet-in debuggability X-BeenThere: ovs-dev@openvswitch.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ovs-dev-bounces@openvswitch.org Sender: "dev" Improve packet-in debuggability within pinctrl module by printing basic details about each received packet-in message, those messages will be printed to the logs only when DBG log level is enabled. Also, add two coverage counters that will indicate the total packet-in messages that were received and the number of times that the pinctrl main thread was notified to handle a change in the local DBs, those counters can be used by the user as an indicator to enable the DBG logs level and see more details about the received packet-in in the logs. Reported-at: https://bugzilla.redhat.com/show_bug.cgi?id=1821965 Signed-off-by: Mohammad Heib --- controller/pinctrl.c | 66 ++++++++++++++++++++++++++++++++++++++++++++ tests/ovn.at | 8 ++++++ 2 files changed, 74 insertions(+) diff --git a/controller/pinctrl.c b/controller/pinctrl.c index ae5320e09..38bda2a89 100644 --- a/controller/pinctrl.c +++ b/controller/pinctrl.c @@ -364,6 +364,8 @@ COVERAGE_DEFINE(pinctrl_drop_put_mac_binding); COVERAGE_DEFINE(pinctrl_drop_buffered_packets_map); COVERAGE_DEFINE(pinctrl_drop_controller_event); COVERAGE_DEFINE(pinctrl_drop_put_vport_binding); +COVERAGE_DEFINE(pinctrl_notify_main_thread); +COVERAGE_DEFINE(pinctrl_total_pin_pkts); struct empty_lb_backends_event { struct hmap_node hmap_node; @@ -3073,6 +3075,7 @@ process_packet_in(struct rconn *swconn, const struct ofp_header *msg) { static struct vlog_rate_limit rl = VLOG_RATE_LIMIT_INIT(1, 5); + struct ds pin_str = DS_EMPTY_INITIALIZER; struct ofputil_packet_in pin; struct ofpbuf continuation; enum ofperr error = ofputil_decode_packet_in(msg, true, NULL, NULL, &pin, @@ -3099,18 +3102,22 @@ process_packet_in(struct rconn *swconn, const struct ofp_header *msg) dp_packet_use_const(&packet, pin.packet, pin.packet_len); struct flow headers; flow_extract(&packet, &headers); + ds_put_cstr(&pin_str, "pinctrl received packet-in | opcode="); switch (ntohl(ah->opcode)) { case ACTION_OPCODE_ARP: + ds_put_cstr(&pin_str, "ARP"); pinctrl_handle_arp(swconn, &headers, &packet, &pin.flow_metadata, &userdata); break; case ACTION_OPCODE_IGMP: + ds_put_cstr(&pin_str, "IGMP"); pinctrl_ip_mcast_handle(swconn, &headers, &packet, &pin.flow_metadata, &userdata); break; case ACTION_OPCODE_PUT_ARP: + ds_put_cstr(&pin_str, "PUT_ARP"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_put_mac_binding(&pin.flow_metadata.flow, &headers, true); @@ -3118,21 +3125,25 @@ process_packet_in(struct rconn *swconn, const struct ofp_header *msg) break; case ACTION_OPCODE_PUT_DHCP_OPTS: + ds_put_cstr(&pin_str, "PUT_DHCP_OPTS"); pinctrl_handle_put_dhcp_opts(swconn, &packet, &pin, &headers, &userdata, &continuation); break; case ACTION_OPCODE_ND_NA: + ds_put_cstr(&pin_str, "ND_NA"); pinctrl_handle_nd_na(swconn, &headers, &pin.flow_metadata, &userdata, false); break; case ACTION_OPCODE_ND_NA_ROUTER: + ds_put_cstr(&pin_str, "ND_NA_ROUTER"); pinctrl_handle_nd_na(swconn, &headers, &pin.flow_metadata, &userdata, true); break; case ACTION_OPCODE_PUT_ND: + ds_put_cstr(&pin_str, "PUT_ND"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_put_mac_binding(&pin.flow_metadata.flow, &headers, false); @@ -3140,17 +3151,20 @@ process_packet_in(struct rconn *swconn, const struct ofp_header *msg) break; case ACTION_OPCODE_PUT_FDB: + ds_put_cstr(&pin_str, "PUT_FDB"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_put_fdb(&pin.flow_metadata.flow, &headers); ovs_mutex_unlock(&pinctrl_mutex); break; case ACTION_OPCODE_PUT_DHCPV6_OPTS: + ds_put_cstr(&pin_str, "PUT_DHCPV6_OPTS"); pinctrl_handle_put_dhcpv6_opts(swconn, &packet, &pin, &userdata, &continuation); break; case ACTION_OPCODE_DNS_LOOKUP: + ds_put_cstr(&pin_str, "DNS_LOOKUP"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_dns_lookup(swconn, &packet, &pin, &userdata, &continuation); @@ -3158,63 +3172,83 @@ process_packet_in(struct rconn *swconn, const struct ofp_header *msg) break; case ACTION_OPCODE_LOG: + ds_put_cstr(&pin_str, "LOG"); handle_acl_log(&headers, &userdata); break; case ACTION_OPCODE_PUT_ND_RA_OPTS: + ds_put_cstr(&pin_str, "PUT_ND_RA_OPTS"); pinctrl_handle_put_nd_ra_opts(swconn, &headers, &packet, &pin, &userdata, &continuation); break; case ACTION_OPCODE_ND_NS: + ds_put_cstr(&pin_str, "ND_NS"); pinctrl_handle_nd_ns(swconn, &headers, &packet, &pin.flow_metadata, &userdata); break; case ACTION_OPCODE_ICMP: + ds_put_cstr(&pin_str, "ICMP"); pinctrl_handle_icmp(swconn, &headers, &packet, &pin.flow_metadata, &userdata, true, false); break; case ACTION_OPCODE_ICMP4_ERROR: case ACTION_OPCODE_ICMP6_ERROR: + if (ntohl(ah->opcode) == ACTION_OPCODE_ICMP4_ERROR) { + ds_put_cstr(&pin_str, "ICMP4_ERROR"); + } else { + ds_put_cstr(&pin_str, "ICMP6_ERROR"); + } pinctrl_handle_icmp(swconn, &headers, &packet, &pin.flow_metadata, &userdata, false, false); break; case ACTION_OPCODE_TCP_RESET: + ds_put_cstr(&pin_str, "TCP_RESET"); pinctrl_handle_tcp_reset(swconn, &headers, &packet, &pin.flow_metadata, &userdata, false); break; case ACTION_OPCODE_SCTP_ABORT: + ds_put_cstr(&pin_str, "SCTP_ABORT"); pinctrl_handle_sctp_abort(swconn, &headers, &packet, &pin.flow_metadata, &userdata, false); break; case ACTION_OPCODE_REJECT: + ds_put_cstr(&pin_str, "REJECT"); pinctrl_handle_reject(swconn, &headers, &packet, &pin.flow_metadata, &userdata); break; case ACTION_OPCODE_PUT_ICMP4_FRAG_MTU: case ACTION_OPCODE_PUT_ICMP6_FRAG_MTU: + if (ntohl(ah->opcode) == ACTION_OPCODE_PUT_ICMP4_FRAG_MTU) { + ds_put_cstr(&pin_str, "PUT_ICMP4_FRAG_MTU"); + } else { + ds_put_cstr(&pin_str, "PUT_ICMP6_FRAG_MTU"); + } pinctrl_handle_put_icmp_frag_mtu(swconn, &headers, &packet, &pin, &userdata, &continuation); break; case ACTION_OPCODE_EVENT: + ds_put_cstr(&pin_str, "EVENT"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_event(&userdata); ovs_mutex_unlock(&pinctrl_mutex); break; case ACTION_OPCODE_BIND_VPORT: + ds_put_cstr(&pin_str, "BIND_VPORT"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_bind_vport(&pin.flow_metadata.flow, &userdata); ovs_mutex_unlock(&pinctrl_mutex); break; case ACTION_OPCODE_DHCP6_SERVER: + ds_put_cstr(&pin_str, "DHCP6_SERVER"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_dhcp6_server(swconn, &headers, &packet, &pin.flow_metadata); @@ -3222,6 +3256,7 @@ process_packet_in(struct rconn *swconn, const struct ofp_header *msg) break; case ACTION_OPCODE_HANDLE_SVC_CHECK: + ds_put_cstr(&pin_str, "HANDLE_SVC_CHECK"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_svc_check(swconn, &headers, &packet, &pin.flow_metadata); @@ -3229,16 +3264,45 @@ process_packet_in(struct rconn *swconn, const struct ofp_header *msg) break; case ACTION_OPCODE_BFD_MSG: + ds_put_cstr(&pin_str, "BFD_MSG"); ovs_mutex_lock(&pinctrl_mutex); pinctrl_handle_bfd_msg(swconn, &headers, &packet); ovs_mutex_unlock(&pinctrl_mutex); break; default: + ds_put_format(&pin_str, "unrecognized(%"PRIu32")", + ntohl(ah->opcode)); VLOG_WARN_RL(&rl, "unrecognized packet-in opcode %"PRIu32, ntohl(ah->opcode)); break; } + + + if (VLOG_IS_DBG_ENABLED()) { + ds_put_format(&pin_str, "| OF_Table_ID=%u", pin.table_id); + ds_put_format(&pin_str, "| OF_Cookie_ID=0x%"PRIx64, + ntohll(pin.cookie)); + + if (pin.flow_metadata.flow.in_port.ofp_port) { + ds_put_format(&pin_str, "| in-port=%u", + pin.flow_metadata.flow.in_port.ofp_port); + } + + ds_put_format(&pin_str, "| src-mac="ETH_ADDR_FMT",", + ETH_ADDR_ARGS(headers.dl_src)); + ds_put_format(&pin_str, " dst-mac="ETH_ADDR_FMT, + ETH_ADDR_ARGS(headers.dl_dst)); + if (headers.dl_type != htons(ETH_TYPE_IPV6)) { + ds_put_format(&pin_str, "| src-ip="IP_FMT",", + IP_ARGS(headers.nw_src)); + ds_put_format(&pin_str, " dst-ip="IP_FMT, + IP_ARGS(headers.nw_dst)); + } + VLOG_DBG("%s \n", ds_cstr(&pin_str)); + } + + ds_destroy(&pin_str); } /* Called with in the pinctrl_handler thread context. */ @@ -3256,6 +3320,7 @@ pinctrl_recv(struct rconn *swconn, const struct ofp_header *oh, config.miss_send_len = UINT16_MAX; set_switch_config(swconn, &config); } else if (type == OFPTYPE_PACKET_IN) { + COVERAGE_INC(pinctrl_total_pin_pkts); process_packet_in(swconn, oh); } else { if (VLOG_IS_DBG_ENABLED()) { @@ -3280,6 +3345,7 @@ notify_pinctrl_handler(void) static void notify_pinctrl_main(void) { + COVERAGE_INC(pinctrl_notify_main_thread); seq_change(pinctrl_main_seq); } diff --git a/tests/ovn.at b/tests/ovn.at index ae832918c..02e64b7b4 100644 --- a/tests/ovn.at +++ b/tests/ovn.at @@ -18019,6 +18019,8 @@ ovs-vsctl -- add-port br-int hv1-vif3 -- \ options:rxq_pcap=hv1/vif3-rx.pcap \ ofport-request=3 +ovs-appctl -t ovn-controller vlog/set dbg + sim_add hv2 as hv2 ovs-vsctl add-br br-phys @@ -18209,6 +18211,8 @@ wait_row_count Port_Binding 1 logical_port=sw0-vir chassis=$hv1_ch_uuid check_row_count Port_Binding 1 logical_port=sw0-vir virtual_parent=sw0-p1 wait_for_ports_up sw0-vir check ovn-nbctl --wait=hv sync +AT_CHECK([test 2 = `cat hv1/ovn-controller.log | grep "pinctrl received packet-in" | \ +grep opcode=BIND_VPORT | grep OF_Table_ID=24 | wc -l`]) wait_row_count Port_Binding 1 logical_port=sw0-vir6 chassis=$hv1_ch_uuid check_row_count Port_Binding 1 logical_port=sw0-vir6 virtual_parent=sw0-p1 @@ -21075,6 +21079,10 @@ list mac_binding], [0], [lr0-sw0 AT_CHECK([test 1 = `cat hv1/ovn-controller.log | grep NXT_PACKET_IN2 | \ grep table_id=10 | wc -l`]) + +AT_CHECK([test 1 = `cat hv1/ovn-controller.log | grep "pinctrl received packet-in" | \ +grep opcode=PUT_ARP | grep OF_Table_ID=10 | wc -l`]) + AT_CHECK([test 1 = `as hv1 ovs-ofctl dump-flows br-int table=10 | grep arp | \ grep controller | grep -v n_packets=0 | wc -l`])