Sitelet https://github.com/nodejs/node/issues/46517
Skip to content

Investigate flaky test/addons/new-isolate-addon #46517

Description

@RaisinTen

Test

test/addons/new-isolate-addon

Platform

Windows

Console output

Output of a test failure from test/addons/new-isolate-addon/test.js:

not ok 26 addons/new-isolate-addon/test
  ---
  duration_ms: 0.316
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected
    
      Uint8Array(1) [
    +   0
    -   66
      ]
        at Object.<anonymous> (c:\workspace\node-test-binary-windows-native-suites\node\test\addons\new-isolate-addon\test.js:8:8)
        at Module._compile (node:internal/modules/cjs/loader:1246:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1300:10)
        at Module.load (node:internal/modules/cjs/loader:1103:32)
        at Module._load (node:internal/modules/cjs/loader:942:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:83:12)
        at node:internal/main/run_main_module:23:47 {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: Uint8Array(1) [ 0 ],
      expected: Uint8Array(1) [ 6...

Output of a test failure from test/addons/new-isolate-addon/test-nonodesnapshot.js:

not ok 57 addons/new-isolate-addon/test-nonodesnapshot
  ---
  duration_ms: 0.333
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected
    
      Uint8Array(1) [
    +   0
    -   66
      ]
        at Object.<anonymous> (c:\workspace\node-test-binary-windows-native-suites\node\test\addons\new-isolate-addon\test.js:8:8)
        at Module._compile (node:internal/modules/cjs/loader:1246:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1300:10)
        at Module.load (node:internal/modules/cjs/loader:1103:32)
        at Module._load (node:internal/modules/cjs/loader:942:12)
        at Module.require (node:internal/modules/cjs/loader:1127:19)
        at require (node:internal/modules/helpers:112:18)
        at Object.<anonymous> (c:\workspace\node-test-binary-windows-native-suites\node\test\addons\new-isolate-addon\test-nonodesnap...

Build links

Additional information

These tests were added in #45885, so cc @addaleax.

Activity

  1. added
    flaky-testIssues and PRs involving tests that fail intermittently in CI.
    on Feb 6, 2023
  2. addaleax commented on Feb 6, 2023

    @addaleax
    Member

    I couldn’t reproduce this locally in repeated runs – it seems this is happening only on Windows? That’s surprising, given that there is no OS-specific code involved here.

  3. RaisinTen commented on Feb 6, 2023

    @RaisinTen
    MemberAuthor

    Yea, this only affects Windows ARM and I have no idea why it happens. Does it make sense to skip this test only on the Windows ARM platform as a mitigation step?

  4. richardlau commented on Feb 6, 2023

    @richardlau
    Member

    According to nodejs/reliability#497 (comment) this is only failing on Windows arm64? That's not a platform we test on by default -- it's being worked on in nodejs/build#3046 (see also nodejs/build#3046 (comment) that work is currently being done on the machines).

    I'm a little surprised this is being flagged for all of those PRs. I checked a few of the failing CI's from #46495, for example, and none of them failed with this test. Most of the current Windows CI failures are nodejs/build#3174, which is a left over Node.js process preventing the git checkout from being cleaned. Maybe there's a bug in the ncu-ci walk pr logic?

    I suspect the tests being discussed in this issue either doesn't work on Windows on ARM64 (would not have been tested in the original PR) or it's somehow related to the current work in nodejs/build#3046. cc @nodejs/platform-windows-arm

  5. shnooshnoo commented on Dec 12, 2023

    @shnooshnoo

    according to reliability reports this test has only been failing for a brief period of time back in feb this year. All the failures were on nearform arm64 machines, which are now deprecated. I believe flakiness of this test has been related to the ongoing work around windows arm64 platform and is no longer the case. If there are no recent signs of this test being flaky I believe this issue can be closed for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    flaky-testIssues and PRs involving tests that fail intermittently in CI.windowsIssues and PRs related to the Windows platform.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions