diff mbox series

Azure: Do not run "udelay" test on sandbox

Message ID 20241117162606.3212279-1-trini@konsulko.com
State Superseded
Delegated to: Tom Rini
Headers show
Series Azure: Do not run "udelay" test on sandbox | expand

Commit Message

Tom Rini Nov. 17, 2024, 4:26 p.m. UTC
With the changes in commit 88db4fc5fec2 ("test: Update time tests to use
unit-test asserts") we now frequently exceed the limit on the udelay
test, leading to false failures in CI. Skip this test.

Signed-off-by: Tom Rini <trini@konsulko.com>
---
Cc: Simon Glass <sjg@chromium.org>
---
 .azure-pipelines.yml | 5 +++++
 1 file changed, 5 insertions(+)

Comments

Simon Glass Nov. 17, 2024, 7:49 p.m. UTC | #1
On Sun, 17 Nov 2024 at 09:26, Tom Rini <trini@konsulko.com> wrote:
>
> With the changes in commit 88db4fc5fec2 ("test: Update time tests to use
> unit-test asserts") we now frequently exceed the limit on the udelay
> test, leading to false failures in CI. Skip this test.
>
> Signed-off-by: Tom Rini <trini@konsulko.com>
> ---
> Cc: Simon Glass <sjg@chromium.org>
> ---
>  .azure-pipelines.yml | 5 +++++
>  1 file changed, 5 insertions(+)

Reviewed-by: Simon Glass <sjg@chromium.org>
Andrew Goodbody Nov. 19, 2024, 2:10 p.m. UTC | #2
On 17/11/2024 16:26, Tom Rini wrote:
> With the changes in commit 88db4fc5fec2 ("test: Update time tests to use
> unit-test asserts") we now frequently exceed the limit on the udelay
> test, leading to false failures in CI. Skip this test.
> 
> Signed-off-by: Tom Rini <trini@konsulko.com>
> ---
> Cc: Simon Glass <sjg@chromium.org>
> ---
>   .azure-pipelines.yml | 5 +++++
>   1 file changed, 5 insertions(+)
> 
> diff --git a/.azure-pipelines.yml b/.azure-pipelines.yml
> index 4ecf76eaa0b5..a51db936d83a 100644
> --- a/.azure-pipelines.yml
> +++ b/.azure-pipelines.yml
> @@ -320,12 +320,14 @@ stages:
>         matrix:
>           sandbox:
>             TEST_PY_BD: "sandbox"
> +          TEST_PY_TEST_SPEC: "not udelay"
>           sandbox_asan:
>             TEST_PY_BD: "sandbox"
>             OVERRIDE: "-a ASAN"
>             TEST_PY_TEST_SPEC: "version"
>           sandbox_clang:
>             TEST_PY_BD: "sandbox"
> +          TEST_PY_TEST_SPEC: "not udelay"
>             OVERRIDE: "-O clang-17"
>           sandbox_clang_asan:
>             TEST_PY_BD: "sandbox"
> @@ -333,8 +335,10 @@ stages:
>             TEST_PY_TEST_SPEC: "version"
>           sandbox64:
>             TEST_PY_BD: "sandbox64"
> +          TEST_PY_TEST_SPEC: "not udelay"
>           sandbox64_clang:
>             TEST_PY_BD: "sandbox64"
> +          TEST_PY_TEST_SPEC: "not udelay"
>             OVERRIDE: "-O clang-17"
>           sandbox_spl:
>             TEST_PY_BD: "sandbox_spl"
> @@ -351,6 +355,7 @@ stages:
>             OVERRIDE: "-a CONFIG_SPL_LOAD_FIT_FULL=y"
>           sandbox_flattree:
>             TEST_PY_BD: "sandbox_flattree"
> +          TEST_PY_TEST_SPEC: "not udelay"
>           sandbox_trace:
>             TEST_PY_BD: "sandbox"
>             BUILD_ENV: "FTRACE=1 NO_LTO=1"

Tested-by: Andrew Goodbody <andrew.goodbody@linaro.org>
Reviewed-by: Andrew Goodbody <andrew.goodbody@linaro.org>
diff mbox series

Patch

diff --git a/.azure-pipelines.yml b/.azure-pipelines.yml
index 4ecf76eaa0b5..a51db936d83a 100644
--- a/.azure-pipelines.yml
+++ b/.azure-pipelines.yml
@@ -320,12 +320,14 @@  stages:
       matrix:
         sandbox:
           TEST_PY_BD: "sandbox"
+          TEST_PY_TEST_SPEC: "not udelay"
         sandbox_asan:
           TEST_PY_BD: "sandbox"
           OVERRIDE: "-a ASAN"
           TEST_PY_TEST_SPEC: "version"
         sandbox_clang:
           TEST_PY_BD: "sandbox"
+          TEST_PY_TEST_SPEC: "not udelay"
           OVERRIDE: "-O clang-17"
         sandbox_clang_asan:
           TEST_PY_BD: "sandbox"
@@ -333,8 +335,10 @@  stages:
           TEST_PY_TEST_SPEC: "version"
         sandbox64:
           TEST_PY_BD: "sandbox64"
+          TEST_PY_TEST_SPEC: "not udelay"
         sandbox64_clang:
           TEST_PY_BD: "sandbox64"
+          TEST_PY_TEST_SPEC: "not udelay"
           OVERRIDE: "-O clang-17"
         sandbox_spl:
           TEST_PY_BD: "sandbox_spl"
@@ -351,6 +355,7 @@  stages:
           OVERRIDE: "-a CONFIG_SPL_LOAD_FIT_FULL=y"
         sandbox_flattree:
           TEST_PY_BD: "sandbox_flattree"
+          TEST_PY_TEST_SPEC: "not udelay"
         sandbox_trace:
           TEST_PY_BD: "sandbox"
           BUILD_ENV: "FTRACE=1 NO_LTO=1"