From patchwork Sun Apr 18 07:34:26 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Siddhesh Poyarekar X-Patchwork-Id: 1467576 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=sourceware.org (client-ip=8.43.85.97; helo=sourceware.org; envelope-from=libc-alpha-bounces@sourceware.org; receiver=) Authentication-Results: ozlabs.org; dkim=pass (1024-bit key; secure) header.d=sourceware.org header.i=@sourceware.org header.a=rsa-sha256 header.s=default header.b=vu/+2F5o; dkim-atps=neutral Received: from sourceware.org (ip-8-43-85-97.sourceware.org [8.43.85.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 4FNMD82s57z9vFg for ; Sun, 18 Apr 2021 17:35:04 +1000 (AEST) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 0EB27394340B; Sun, 18 Apr 2021 07:34:53 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 0EB27394340B DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1618731293; bh=eYOi0N8kaW8mK9tcVnn4+MfOfLjESVaW2Rs/4V3Ipbc=; h=To:Subject:Date:List-Id:List-Unsubscribe:List-Archive:List-Post: List-Help:List-Subscribe:From:Reply-To:From; b=vu/+2F5oo1oSXBRoCegal0ajf0VsOzddtyh6VvALnxG8tLCN80M48RmlZemLjVR/x mOIJJsM4b700hKe1QQAdbn9hexQdYM0EA9FktTQjey8HoX4/hzJ4wMRaLU5em9ERxn 6KFA8tMPY0+DaqKMI5iVtF3ZrtIdFejL/xDAK92w= X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from cyan.elm.relay.mailchannels.net (cyan.elm.relay.mailchannels.net [23.83.212.47]) by sourceware.org (Postfix) with ESMTPS id 675C9393A426 for ; Sun, 18 Apr 2021 07:34:40 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 675C9393A426 X-Sender-Id: dreamhost|x-authsender|siddhesh@gotplt.org Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id CCE4712219E for ; Sun, 18 Apr 2021 07:34:38 +0000 (UTC) Received: from pdx1-sub0-mail-a18.g.dreamhost.com (100-96-18-71.trex.outbound.svc.cluster.local [100.96.18.71]) (Authenticated sender: dreamhost) by relay.mailchannels.net (Postfix) with ESMTPA id 5002C122205 for ; Sun, 18 Apr 2021 07:34:36 +0000 (UTC) X-Sender-Id: dreamhost|x-authsender|siddhesh@gotplt.org Received: from pdx1-sub0-mail-a18.g.dreamhost.com (pop.dreamhost.com [64.90.62.162]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384) by 100.96.18.71 (trex/6.1.1); Sun, 18 Apr 2021 07:34:38 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: dreamhost|x-authsender|siddhesh@gotplt.org X-MailChannels-Auth-Id: dreamhost X-Descriptive-Reaction: 63912a3024a699b7_1618731278385_1109226025 X-MC-Loop-Signature: 1618731278384:41513819 X-MC-Ingress-Time: 1618731278384 Received: from pdx1-sub0-mail-a18.g.dreamhost.com (localhost [127.0.0.1]) by pdx1-sub0-mail-a18.g.dreamhost.com (Postfix) with ESMTP id 0F76986EF6 for ; Sun, 18 Apr 2021 00:34:36 -0700 (PDT) Received: from rhbox.intra.reserved-bit.com (unknown [1.186.101.110]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: siddhesh@gotplt.org) by pdx1-sub0-mail-a18.g.dreamhost.com (Postfix) with ESMTPSA id A95FF86EF5 for ; Sun, 18 Apr 2021 00:34:34 -0700 (PDT) X-DH-BACKEND: pdx1-sub0-mail-a18 To: libc-alpha@sourceware.org Subject: [committed 1/2] benchtests: Fix pthread-locks test to produce valid json Date: Sun, 18 Apr 2021 13:04:26 +0530 Message-Id: <20210418073427.1229743-1-siddhesh@sourceware.org> X-Mailer: git-send-email 2.29.2 MIME-Version: 1.0 X-Spam-Status: No, score=-3494.9 required=5.0 tests=BAYES_00, GIT_PATCH_0, JMQ_SPF_NEUTRAL, KAM_DMARC_NONE, KAM_DMARC_STATUS, RCVD_IN_BARRACUDACENTRAL, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H3, RCVD_IN_MSPIKE_WL, SPF_HELO_NONE, SPF_NEUTRAL, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Siddhesh Poyarekar via Libc-alpha From: Siddhesh Poyarekar Reply-To: Siddhesh Poyarekar Errors-To: libc-alpha-bounces@sourceware.org Sender: "Libc-alpha" The benchtests json allows {function {variant}} categorization of results whereas the pthread-locks tests had {function {variant {subvariant}}}, which broke validation. Fix that by serializing the subvariants as variant-subvariant. Also update the schema to recognize the new benchmark attributes after fixing the naming conventions. --- benchtests/bench-pthread-locks.c | 15 +++++++-------- benchtests/scripts/benchout.schema.json | 4 ++++ 2 files changed, 11 insertions(+), 8 deletions(-) diff --git a/benchtests/bench-pthread-locks.c b/benchtests/bench-pthread-locks.c index 318c92bd8e..5274246a4b 100644 --- a/benchtests/bench-pthread-locks.c +++ b/benchtests/bench-pthread-locks.c @@ -487,17 +487,20 @@ do_bench_2 (const char *name, test_t func, int filler, json_ctx_t *js) } stdev = sqrt (stdev / (RUN_COUNT - 1)); - json_attr_object_begin (js, filler ? "filler" : "empty"); + char buf[128]; + snprintf (buf, sizeof buf, "%s-%s", name, filler ? "filler" : "empty"); + + json_attr_object_begin (js, buf); json_attr_double (js, "duration", (double) cur); json_attr_double (js, "iterations", (double) iters); - json_attr_double (js, "wall_sec", (double) td); + json_attr_double (js, "wall-sec", (double) td); json_attr_double (js, "mean", mean); json_attr_double (js, "stdev", stdev); - json_attr_double (js, "min_outlier", (double) curs[0] / (double) iters); + json_attr_double (js, "min-outlier", (double) curs[0] / (double) iters); json_attr_double (js, "min", (double) curs[1] / (double) iters); json_attr_double (js, "max", (double) curs[RUN_COUNT] / (double) iters); - json_attr_double (js, "max_outlier", (double) curs[RUN_COUNT + 1] / (double) iters); + json_attr_double (js, "max-outlier", (double) curs[RUN_COUNT + 1] / (double) iters); json_attr_object_end (js); @@ -509,13 +512,9 @@ do_bench_1 (const char *name, test_t func, json_ctx_t *js) { int rv = 0; - json_attr_object_begin (js, name); - rv += do_bench_2 (name, func, 0, js); rv += do_bench_2 (name, func, 1, js); - json_attr_object_end (js); - return rv; } diff --git a/benchtests/scripts/benchout.schema.json b/benchtests/scripts/benchout.schema.json index 8cfd606497..5f098e91c9 100644 --- a/benchtests/scripts/benchout.schema.json +++ b/benchtests/scripts/benchout.schema.json @@ -27,6 +27,10 @@ "min-throughput": {"type": "number"}, "max-throughput": {"type": "number"}, "reciprocal-throughput": {"type": "number"}, + "min-outlier": {"type": "number"}, + "max-outlier": {"type": "number"}, + "wall-sec": {"type": "number"}, + "stdev": {"type": "number"}, "timings": { "type": "array", "items": {"type": "number"} From patchwork Sun Apr 18 07:34:27 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Siddhesh Poyarekar X-Patchwork-Id: 1467575 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=sourceware.org (client-ip=2620:52:3:1:0:246e:9693:128c; helo=sourceware.org; envelope-from=libc-alpha-bounces@sourceware.org; receiver=) Authentication-Results: ozlabs.org; dkim=pass (1024-bit key; secure) header.d=sourceware.org header.i=@sourceware.org header.a=rsa-sha256 header.s=default header.b=aLHjm0Rw; dkim-atps=neutral Received: from sourceware.org (server2.sourceware.org [IPv6:2620:52:3:1:0:246e:9693:128c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 4FNMD55x18z9vFm for ; Sun, 18 Apr 2021 17:35:01 +1000 (AEST) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 7B609393BC1B; Sun, 18 Apr 2021 07:34:52 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 7B609393BC1B DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1618731292; bh=rNFtdbPOXj36Oxb1DtPXShfQJW0uzLFEujFms2Z90Ks=; h=To:Subject:Date:In-Reply-To:References:List-Id:List-Unsubscribe: List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To: From; b=aLHjm0RwestJ6AzWNhJyKu5cjFVAFbSDxMdy2ZqSuLx4dRbqSOa44Sn1cZn7EqKPh nxz4xciY0ItoT9B2ZR3vPrDRT48AvUFunxJq5nZO1cyLlBkK1acMhhc4sfD223V0/H 9HcbRh+seoGCop9woVM82nZ93zX/fSo0sMebu9sQ= X-Original-To: libc-alpha@sourceware.org Delivered-To: libc-alpha@sourceware.org Received: from donkey.elm.relay.mailchannels.net (donkey.elm.relay.mailchannels.net [23.83.212.49]) by sourceware.org (Postfix) with ESMTPS id 65DA13896832 for ; Sun, 18 Apr 2021 07:34:40 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 65DA13896832 X-Sender-Id: dreamhost|x-authsender|siddhesh@gotplt.org Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id C411B680A22 for ; Sun, 18 Apr 2021 07:34:38 +0000 (UTC) Received: from pdx1-sub0-mail-a18.g.dreamhost.com (100-96-133-89.trex.outbound.svc.cluster.local [100.96.133.89]) (Authenticated sender: dreamhost) by relay.mailchannels.net (Postfix) with ESMTPA id 4CE76680C22 for ; Sun, 18 Apr 2021 07:34:38 +0000 (UTC) X-Sender-Id: dreamhost|x-authsender|siddhesh@gotplt.org Received: from pdx1-sub0-mail-a18.g.dreamhost.com (pop.dreamhost.com [64.90.62.162]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384) by 100.96.133.89 (trex/6.1.1); Sun, 18 Apr 2021 07:34:38 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: dreamhost|x-authsender|siddhesh@gotplt.org X-MailChannels-Auth-Id: dreamhost X-Shelf-Unite: 061127411ffbab0a_1618731278524_175377413 X-MC-Loop-Signature: 1618731278524:3141930712 X-MC-Ingress-Time: 1618731278523 Received: from pdx1-sub0-mail-a18.g.dreamhost.com (localhost [127.0.0.1]) by pdx1-sub0-mail-a18.g.dreamhost.com (Postfix) with ESMTP id 0D56186EF5 for ; Sun, 18 Apr 2021 00:34:38 -0700 (PDT) Received: from rhbox.intra.reserved-bit.com (unknown [1.186.101.110]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: siddhesh@gotplt.org) by pdx1-sub0-mail-a18.g.dreamhost.com (Postfix) with ESMTPSA id E7E2A7F6D9 for ; Sun, 18 Apr 2021 00:34:36 -0700 (PDT) X-DH-BACKEND: pdx1-sub0-mail-a18 To: libc-alpha@sourceware.org Subject: [committed 2/2] benchtests: Fix name of exp10f benchmark variant Date: Sun, 18 Apr 2021 13:04:27 +0530 Message-Id: <20210418073427.1229743-2-siddhesh@sourceware.org> X-Mailer: git-send-email 2.29.2 In-Reply-To: <20210418073427.1229743-1-siddhesh@sourceware.org> References: <20210418073427.1229743-1-siddhesh@sourceware.org> MIME-Version: 1.0 X-Spam-Status: No, score=-3494.8 required=5.0 tests=BAYES_00, GIT_PATCH_0, JMQ_SPF_NEUTRAL, KAM_DMARC_NONE, KAM_DMARC_STATUS, RCVD_IN_BARRACUDACENTRAL, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_NONE, SPF_NEUTRAL, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Siddhesh Poyarekar via Libc-alpha From: Siddhesh Poyarekar Reply-To: Siddhesh Poyarekar Errors-To: libc-alpha-bounces@sourceware.org Sender: "Libc-alpha" Variant names don't accept brackets. --- benchtests/exp10f-inputs | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/benchtests/exp10f-inputs b/benchtests/exp10f-inputs index 302af485eb..49c62e6089 100644 --- a/benchtests/exp10f-inputs +++ b/benchtests/exp10f-inputs @@ -1,7 +1,7 @@ ## args: float ## ret: float ## includes: math.h -## name: workload-spec2017.wrf (adapted) +## name: workload-spec2017.wrf-adapted 0x0p+0 -0x1.cca64ap+0 -0x1.570ef6p-2