From patchwork Mon Mar 2 14:50:02 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Heiko Thiery X-Patchwork-Id: 1247692 Return-Path: X-Original-To: incoming-buildroot@patchwork.ozlabs.org Delivered-To: patchwork-incoming-buildroot@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=busybox.net (client-ip=140.211.166.133; helo=hemlock.osuosl.org; envelope-from=buildroot-bounces@busybox.net; receiver=) Authentication-Results: ozlabs.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: ozlabs.org; dkim=fail reason="signature verification failed" (2048-bit key; unprotected) header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20161025 header.b=I2bc7l05; dkim-atps=neutral Received: from hemlock.osuosl.org (smtp2.osuosl.org [140.211.166.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 48WNPk3r4Gz9sRN for ; Tue, 3 Mar 2020 01:51:22 +1100 (AEDT) Received: from localhost (localhost [127.0.0.1]) by hemlock.osuosl.org (Postfix) with ESMTP id 146288766C; Mon, 2 Mar 2020 14:51:20 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from hemlock.osuosl.org ([127.0.0.1]) by localhost (.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id y0QW7kAMRdbx; Mon, 2 Mar 2020 14:51:18 +0000 (UTC) Received: from ash.osuosl.org (ash.osuosl.org [140.211.166.34]) by hemlock.osuosl.org (Postfix) with ESMTP id 3AD1E875BE; Mon, 2 Mar 2020 14:51:18 +0000 (UTC) X-Original-To: buildroot@lists.busybox.net Delivered-To: buildroot@osuosl.org Received: from fraxinus.osuosl.org (smtp4.osuosl.org [140.211.166.137]) by ash.osuosl.org (Postfix) with ESMTP id 7E13F1BF97E for ; Mon, 2 Mar 2020 14:51:08 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by fraxinus.osuosl.org (Postfix) with ESMTP id 7B69D84E49 for ; Mon, 2 Mar 2020 14:51:08 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from fraxinus.osuosl.org ([127.0.0.1]) by localhost (.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id yOfHRpFYxvDn for ; Mon, 2 Mar 2020 14:51:06 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mail-wm1-f44.google.com (mail-wm1-f44.google.com [209.85.128.44]) by fraxinus.osuosl.org (Postfix) with ESMTPS id 0A77385593 for ; Mon, 2 Mar 2020 14:50:37 +0000 (UTC) Received: by mail-wm1-f44.google.com with SMTP id z12so11506239wmi.4 for ; Mon, 02 Mar 2020 06:50:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=kFqoPzwZmVMZ4SKPJsxo3BWKLpnEyxxwJrbli/wP214=; b=I2bc7l05xcZGp596Nz2xuRdwn4wovdmF6fFytuXGozDe+ZhTMcXgNj77a3Ysgg92EJ GsUU/V09zXKRkriybMH8MKS0ky0ObuzCSkzvyCv49sJpBAdile8BRp94wZ+8vWOZzpzX SJ2k0Uqks0t+zHGiSP5VpHr1h3HkBrtZqg3Dw1bMJ4+ylxLUouYDDrtimpBB9ffiqZkV 70L+5aYGCQwmPXtNmYYVMAhNpZxOAZDSJFWkTlJ5crFns8mrkUeBnRp2CvKE2/1efA3Y ZKvDGy0x5N9kqhIdqAOXNhemnFSK5AKWzWz2slPegnCiBNwTjavf86GeM1BoIx84WdFY tleA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=kFqoPzwZmVMZ4SKPJsxo3BWKLpnEyxxwJrbli/wP214=; b=inij3WrAnDetf+15nXDpcgS4Nm5ezYBP8K4wl4pB8yn7l4do1OMe4kjDc/kkyxOvwz IK2a5AaHLMatr9lo9761/H3SeRESwpa5Ih01w/mz7xnW8V8mbr5bW8Wq6FPpBuI3+eV5 RlDUAsIfTJh09XKEHHfr5xV6caoLJIIR38xHo1S070ZMMfcpdvO/uPT1xXqPJ8AFlGvd dvLgpRUmn4KGVA6ytFk6E2BNBp1BBYXSMIdDNv6xPOAS6ZCRaxJtoZY1DsuVxgLH2hzt xIt6RDNRlxZKdLdbolG5rfxnWjJhQWCY+DBQf9qXh1fKkXNUEMUc50/u5NdTF4tRn7KG 9Qrw== X-Gm-Message-State: ANhLgQ16xkSezQn3fZ4SGQxPt2na9qiUJTt4VHebIqnAUH7m0o5sejp0 xaOj/FpTZ3tdkrTFzsnF/lP8W4go X-Google-Smtp-Source: ADFU+vtQhzkJYX8zSJ/8R7w1auBg51JHq3hHaM/LtHnzMDdTsSWMttqDuuTWNyuEByZES6UsALrLFQ== X-Received: by 2002:a1c:e104:: with SMTP id y4mr3578872wmg.176.1583160634016; Mon, 02 Mar 2020 06:50:34 -0800 (PST) Received: from hthiery01.sab.local ([213.135.10.150]) by smtp.gmail.com with ESMTPSA id h17sm29648355wro.52.2020.03.02.06.50.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 02 Mar 2020 06:50:33 -0800 (PST) From: Heiko Thiery To: buildroot@buildroot.org Date: Mon, 2 Mar 2020 15:50:02 +0100 Message-Id: <20200302145013.9574-1-heiko.thiery@gmail.com> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Subject: [Buildroot] [PATCH v4 00/12] pkg-stats json output improvements X-BeenThere: buildroot@busybox.net X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion and development of buildroot List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Heiko Thiery , Thomas Petazzoni , Titouan Christophe Errors-To: buildroot-bounces@busybox.net Sender: "buildroot" - add developers information to the packages - add supported defconfigs to json - add license information to json - add license file information to json - add patch files to json - add a more generic check status field to the packages for easier post processing. The following check status are availble: checks: cve, license, license-files, hash, hash-license,patches, version, url, developers, pkg-check --- v3 -> v4: Included the review comments from Titouan - use only one signed-off mail address - do some things in a more pythonic way - remove the patch_count attribute and use a class property instead (Note that the patch_count value will not go into the json output anymore,but then coutn can be computed by "len(patch_files)".) - remove the status initializer in the package class that was introduced in v3 - update the cve status at the end of the cve check loop - change the is_valid_infra -> has_valid_infra and use it as property v2 -> v3: - keep variable latest_release but change format - add check for license file hashes - introduce a na status for the checks - add a list of all possible checks to the json output - add the cve check status v1 -> v2: - cleanup and recreation of patches - remove pkg name from dumping to json - use patch_files instead of combine count and files in dict - include getdevelopers.py to reuse Developers class --- Heiko Thiery (12): support/scripts/pkg-stats: store latest version in a dict support/scripts/pkg-stats: store patch files for the package support/scripts/pkg-stats: set developers info support/scripts/pkg-stats: store licences of package support/scripts/pkg-stats: add package status support/scripts/pkg-stats: add package count to stats support/scripts/pkg-stats: store pkg dir path support/scripts/pkg-stats: add defconfig support support/scripts/pkg-stats: add support for license hash check support/scripts/pkg-stats: set status to 'na' for virtual packages support/scripts/pkg-stats: initialize all package status checks support/scripts/pkg-stats: add status for cve check support/scripts/pkg-stats | 271 +++++++++++++++++++++++++++++--------- 1 file changed, 211 insertions(+), 60 deletions(-)