From patchwork Tue Mar 2 13:44:21 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Richard Purdie X-Patchwork-Id: 1446053 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=lists.linux.it (client-ip=2001:1418:10:5::2; helo=picard.linux.it; envelope-from=ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it; receiver=) Authentication-Results: ozlabs.org; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=linuxfoundation.org header.i=@linuxfoundation.org header.a=rsa-sha256 header.s=google header.b=Hj6bklq9; dkim-atps=neutral Received: from picard.linux.it (picard.linux.it [IPv6:2001:1418:10:5::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 4DqdfD25Pdz9sVt for ; Wed, 3 Mar 2021 00:44:35 +1100 (AEDT) Received: from picard.linux.it (localhost [IPv6:::1]) by picard.linux.it (Postfix) with ESMTP id 079E03C56EF for ; Tue, 2 Mar 2021 14:44:33 +0100 (CET) X-Original-To: ltp@lists.linux.it Delivered-To: ltp@picard.linux.it Received: from in-7.smtp.seeweb.it (in-7.smtp.seeweb.it [217.194.8.7]) by picard.linux.it (Postfix) with ESMTP id 2D7493C4EDE for ; Tue, 2 Mar 2021 14:44:23 +0100 (CET) Received: from mail-wr1-x431.google.com (mail-wr1-x431.google.com [IPv6:2a00:1450:4864:20::431]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by in-7.smtp.seeweb.it (Postfix) with ESMTPS id C0AB12348B7 for ; Tue, 2 Mar 2021 14:44:22 +0100 (CET) Received: by mail-wr1-x431.google.com with SMTP id h98so19903151wrh.11 for ; Tue, 02 Mar 2021 05:44:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linuxfoundation.org; s=google; h=message-id:subject:from:to:date:user-agent:mime-version :content-transfer-encoding; bh=SOyvtmlYC2JiWK8OccYE8jhkSUFTKfbs5jbxPeo2v4I=; b=Hj6bklq9IKR9LuJLVueBGDL0db68jy07AP+3dzmSqgTawGwMUdq6BOFzTE2iCbh6Lp uxQWQ6Hs2hBlQ8xfcSumF58oieQ9N6P9D8Fcf/HuF6fA8euogNfONycAWrYyaKbg/cQi vV2VuTkb96roEM1uL+jUsXH23/YDp2g2TnjOY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:date:user-agent :mime-version:content-transfer-encoding; bh=SOyvtmlYC2JiWK8OccYE8jhkSUFTKfbs5jbxPeo2v4I=; b=hLF7+3itVcnhp4VOf2jqmCmdaUaWOfGZkgC99Z8PmsG2Xp5ClTKSmwzMuBwZqvrt44 L/qLVm0UIqGNSHur46nQXEGorY/7WiGA9VhTl3xB0wmx1que4nvyy8SVWm7EJDWAPjlu JWYZcEBvKhfcz/KsdfkG6bO1vQMriGyJ+naib8sAamqok2AycKMJeBaKDAekhl3lz66t jvSPvnBkgRSZOHYGXMjITLvJX/ad4doY4nxf6ldEO5bRsMpsEyVmSSW0fZP7JYnMrajC sgQbLJ+wk/i/Dal8pDc4Fc+ZnPmbF/LPhfBbx8xpXmHBUGerXrY8Nw4vKPr1ejH0L1Gs VVXg== X-Gm-Message-State: AOAM531+MlXqgOV3e5c8tLQrmARzAR/yhX4Oeq6UJUEcxJQQeRbS5Xbg k2T6dipC5k8X4DHnYLvQi5d3uJd2k/CxDw== X-Google-Smtp-Source: ABdhPJwXQvz2j4SD0X45KKuQEdzwXrfOA30Yh4BePztsXGbwQD6ZimR6AmPAckJCboFElb2Jse3Kug== X-Received: by 2002:a5d:4485:: with SMTP id j5mr12991358wrq.339.1614692662271; Tue, 02 Mar 2021 05:44:22 -0800 (PST) Received: from ?IPv6:2001:8b0:aba:5f3c:fd4c:95a0:62b1:7d53? ([2001:8b0:aba:5f3c:fd4c:95a0:62b1:7d53]) by smtp.gmail.com with ESMTPSA id e1sm1547307wrw.85.2021.03.02.05.44.22 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 02 Mar 2021 05:44:22 -0800 (PST) Message-ID: <6c83b5fc8c891046131dbe049e37357e055f706e.camel@linuxfoundation.org> From: Richard Purdie To: LTP List Date: Tue, 02 Mar 2021 13:44:21 +0000 User-Agent: Evolution 3.38.1-1 MIME-Version: 1.0 X-Virus-Scanned: clamav-milter 0.102.4 at in-7.smtp.seeweb.it X-Virus-Status: Clean X-Spam-Status: No, score=0.1 required=7.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_PASS autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on in-7.smtp.seeweb.it Subject: [LTP] [PATCH] open_posix_testsuite/generate-makefiles.sh: Fix determinism issue X-BeenThere: ltp@lists.linux.it X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux Test Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it Sender: "ltp" Currently the list of tests is generated by the order of the files found within the directories. This results in differences in the run.sh and  Makefiles. Within Yocto Project this results in differing target test packages. The fix is simple, just sort the output from locate-test. Signed-off-by: Richard Purdie Index: git/testcases/open_posix_testsuite/scripts/generate-makefiles.sh =================================================================== --- git.orig/testcases/open_posix_testsuite/scripts/generate-makefiles.sh +++ git/testcases/open_posix_testsuite/scripts/generate-makefiles.sh @@ -24,7 +24,7 @@ generate_locate_test_makefile() { echo "Generating $maketype Makefiles" - locate-test --$maketype | sed -e 's,^./,,g' > make-gen.$maketype + locate-test --$maketype | sed -e 's,^./,,g' | sort > make-gen.$maketype generate_makefiles make-gen.$maketype $*