[taskcluster 2025-10-13T15:47:31.635Z] Worker Type (code-analysis-1/linux-gw-gcp) settings:
[taskcluster 2025-10-13T15:47:31.635Z]   {
[taskcluster 2025-10-13T15:47:31.635Z]     "config": {
[taskcluster 2025-10-13T15:47:31.635Z]       "deploymentId": ""
[taskcluster 2025-10-13T15:47:31.635Z]     },
[taskcluster 2025-10-13T15:47:31.635Z]     "generic-worker": {
[taskcluster 2025-10-13T15:47:31.635Z]       "engine": "multiuser",
[taskcluster 2025-10-13T15:47:31.635Z]       "go-arch": "amd64",
[taskcluster 2025-10-13T15:47:31.635Z]       "go-os": "linux",
[taskcluster 2025-10-13T15:47:31.635Z]       "go-version": "go1.22.2",
[taskcluster 2025-10-13T15:47:31.635Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v64.3.0",
[taskcluster 2025-10-13T15:47:31.635Z]       "revision": "b66b6614b9b79077f1bfc78f97afb8c25c0c4b30",
[taskcluster 2025-10-13T15:47:31.635Z]       "source": "https://github.com/taskcluster/taskcluster/commits/b66b6614b9b79077f1bfc78f97afb8c25c0c4b30",
[taskcluster 2025-10-13T15:47:31.635Z]       "version": "64.3.0"
[taskcluster 2025-10-13T15:47:31.635Z]     },
[taskcluster 2025-10-13T15:47:31.635Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-gui-googlecompute-2024-08-22t22-48-09z",
[taskcluster 2025-10-13T15:47:31.635Z]     "instance-id": "3062956561560281650",
[taskcluster 2025-10-13T15:47:31.635Z]     "instance-type": "projects/887720501152/machineTypes/c2-standard-4",
[taskcluster 2025-10-13T15:47:31.635Z]     "local-ipv4": "10.138.0.36",
[taskcluster 2025-10-13T15:47:31.635Z]     "project-id": "fxci-production-level1-workers",

...(481 lines hidden)...

Preparing to unpack .../56-linux-libc-dev_6.12.48-1_all.deb ...

Unpacking linux-libc-dev (6.12.48-1) ...

Selecting previously unselected package libcrypt-dev:amd64.

Preparing to unpack .../57-libcrypt-dev_1%3a4.4.38-1_amd64.deb ...

Unpacking libcrypt-dev:amd64 (1:4.4.38-1) ...

Selecting previously unselected package rpcsvc-proto.

Preparing to unpack .../58-rpcsvc-proto_1.4.3-1_amd64.deb ...

Unpacking rpcsvc-proto (1.4.3-1) ...

Selecting previously unselected package libc6-dev:amd64.

Preparing to unpack .../59-libc6-dev_2.41-12_amd64.deb ...

Unpacking libc6-dev:amd64 (2.41-12) ...

Selecting previously unselected package libexpat1-dev:amd64.

Preparing to unpack .../60-libexpat1-dev_2.7.1-2_amd64.deb ...

Unpacking libexpat1-dev:amd64 (2.7.1-2) ...

Selecting previously unselected package libtcmalloc-minimal4t64:amd64.

Preparing to unpack .../61-libtcmalloc-minimal4t64_2.16-1_amd64.deb ...

Unpacking libtcmalloc-minimal4t64:amd64 (2.16-1) ...

Selecting previously unselected package libunwind8:amd64.

Preparing to unpack .../62-libunwind8_1.8.1-0.1_amd64.deb ...

Unpacking libunwind8:amd64 (1.8.1-0.1) ...

Selecting previously unselected package libgoogle-perftools4t64:amd64.

Preparing to unpack .../63-libgoogle-perftools4t64_2.16-1_amd64.deb ...

Unpacking libgoogle-perftools4t64:amd64 (2.16-1) ...

Selecting previously unselected package libjs-jquery.

Preparing to unpack .../64-libjs-jquery_3.6.1+dfsg+~3.5.14-1_all.deb ...

Unpacking libjs-jquery (3.6.1+dfsg+~3.5.14-1) ...

Selecting previously unselected package libjs-underscore.

Preparing to unpack .../65-libjs-underscore_1.13.4~dfsg+~1.11.4-3_all.deb ...

Unpacking libjs-underscore (1.13.4~dfsg+~1.11.4-3) ...

Selecting previously unselected package libjs-sphinxdoc.

Preparing to unpack .../66-libjs-sphinxdoc_8.1.3-5_all.deb ...

Unpacking libjs-sphinxdoc (8.1.3-5) ...

Selecting previously unselected package libpython3.13:amd64.

Preparing to unpack .../67-libpython3.13_3.13.5-2_amd64.deb ...

Unpacking libpython3.13:amd64 (3.13.5-2) ...

Selecting previously unselected package zlib1g-dev:amd64.

Preparing to unpack .../68-zlib1g-dev_1%3a1.3.dfsg+really1.3.1-1+b1_amd64.deb ...

Unpacking zlib1g-dev:amd64 (1:1.3.dfsg+really1.3.1-1+b1) ...

Selecting previously unselected package libpython3.13-dev:amd64.

Preparing to unpack .../69-libpython3.13-dev_3.13.5-2_amd64.deb ...

Unpacking libpython3.13-dev:amd64 (3.13.5-2) ...

Selecting previously unselected package libpython3-dev:amd64.

Preparing to unpack .../70-libpython3-dev_3.13.5-1_amd64.deb ...

Unpacking libpython3-dev:amd64 (3.13.5-1) ...

Selecting previously unselected package python-is-python3.

Preparing to unpack .../71-python-is-python3_3.13.3-1_all.deb ...

Unpacking python-is-python3 (3.13.3-1) ...

Selecting previously unselected package python3.13-dev.

Preparing to unpack .../72-python3.13-dev_3.13.5-2_amd64.deb ...

Unpacking python3.13-dev (3.13.5-2) ...

Selecting previously unselected package python3-dev.

Preparing to unpack .../73-python3-dev_3.13.5-1_amd64.deb ...

Unpacking python3-dev (3.13.5-1) ...

Selecting previously unselected package python-dev-is-python3.

Preparing to unpack .../74-python-dev-is-python3_3.13.3-1_all.deb ...

Unpacking python-dev-is-python3 (3.13.3-1) ...

Setting up media-types (13.0.0) ...

Setting up libkeyutils1:amd64 (1.6.3-6) ...

Setting up libbrotli1:amd64 (1.1.0-2+b7) ...

Setting up binutils-common:amd64 (2.44-3) ...

Setting up libnghttp2-14:amd64 (1.64.0-1.1) ...

Setting up linux-libc-dev (6.12.48-1) ...

Setting up libctf-nobfd0:amd64 (2.44-3) ...

Setting up libcom-err2:amd64 (1.47.2-3+b3) ...

Setting up libgomp1:amd64 (14.2.0-19) ...

Setting up bzip2 (1.0.8-6) ...

Setting up libunwind8:amd64 (1.8.1-0.1) ...

Setting up libsframe1:amd64 (2.44-3) ...

Setting up libjansson4:amd64 (2.14-2+b3) ...

Setting up libkrb5support0:amd64 (1.21.3-5) ...

Setting up libsasl2-modules-db:amd64 (2.1.28+dfsg1-9) ...

Setting up rpcsvc-proto (1.4.3-1) ...

Setting up libmpfr6:amd64 (4.2.2-1) ...

Setting up libquadmath0:amd64 (14.2.0-19) ...

Setting up libp11-kit0:amd64 (0.25.5-3) ...

Setting up libunistring5:amd64 (1.3-2) ...

Setting up libmpc3:amd64 (1.3.1-1+b3) ...

Setting up libatomic1:amd64 (14.2.0-19) ...

Setting up libtcmalloc-minimal4t64:amd64 (2.16-1) ...

Setting up libk5crypto3:amd64 (1.21.3-5) ...

Setting up libsasl2-2:amd64 (2.1.28+dfsg1-9) ...

Setting up libnghttp3-9:amd64 (1.8.0-1) ...

Setting up libubsan1:amd64 (14.2.0-19) ...

Setting up libhwasan0:amd64 (14.2.0-19) ...

Setting up libcrypt-dev:amd64 (1:4.4.38-1) ...

Setting up libasan8:amd64 (14.2.0-19) ...

Setting up libtasn1-6:amd64 (4.20.0-2) ...

Setting up libkrb5-3:amd64 (1.21.3-5) ...

Setting up libssh2-1t64:amd64 (1.11.1-1) ...

Setting up libtsan2:amd64 (14.2.0-19) ...

Setting up libjs-jquery (3.6.1+dfsg+~3.5.14-1) ...

Setting up libbinutils:amd64 (2.44-3) ...

Setting up libisl23:amd64 (0.27-1) ...

Setting up libc-dev-bin (2.41-12) ...

Setting up libpython3.13-stdlib:amd64 (3.13.5-2) ...

Setting up libcc1-0:amd64 (14.2.0-19) ...

Setting up libldap2:amd64 (2.6.10+dfsg-1) ...

Setting up liblsan0:amd64 (14.2.0-19) ...

Setting up libitm1:amd64 (14.2.0-19) ...

Setting up libpython3-stdlib:amd64 (3.13.5-1) ...

Setting up libjs-underscore (1.13.4~dfsg+~1.11.4-3) ...

Setting up libctf0:amd64 (2.44-3) ...

Setting up libpython3.13:amd64 (3.13.5-2) ...

Setting up libgoogle-perftools4t64:amd64 (2.16-1) ...

Setting up python3.13 (3.13.5-2) ...

Setting up python3 (3.13.5-1) ...

running python rtupdate hooks for python3.13...

running python post-rtupdate hooks for python3.13...

Setting up libidn2-0:amd64 (2.3.8-2) ...

Setting up libgprofng0:amd64 (2.44-3) ...

Setting up libgssapi-krb5-2:amd64 (1.21.3-5) ...

Setting up cpp-14-x86-64-linux-gnu (14.2.0-19) ...

Setting up libjs-sphinxdoc (8.1.3-5) ...

Setting up cpp-14 (14.2.0-19) ...

Setting up libc6-dev:amd64 (2.41-12) ...

Setting up libgcc-14-dev:amd64 (14.2.0-19) ...

Setting up python-is-python3 (3.13.3-1) ...

Setting up binutils-x86-64-linux-gnu (2.44-3) ...

Setting up cpp-x86-64-linux-gnu (4:14.2.0-1) ...

Setting up libgnutls30t64:amd64 (3.8.9-3) ...

Setting up libpsl5t64:amd64 (0.21.2-1.1+b1) ...

Setting up binutils (2.44-3) ...

Setting up libexpat1-dev:amd64 (2.7.1-2) ...

Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2+b5) ...

Setting up zlib1g-dev:amd64 (1:1.3.dfsg+really1.3.1-1+b1) ...

Setting up cpp (4:14.2.0-1) ...

Setting up gcc-14-x86-64-linux-gnu (14.2.0-19) ...

Setting up gcc-x86-64-linux-gnu (4:14.2.0-1) ...

Setting up libcurl4t64:amd64 (8.14.1-2) ...

Setting up gcc-14 (14.2.0-19) ...

Setting up libpython3.13-dev:amd64 (3.13.5-2) ...

Setting up curl (8.14.1-2) ...

Setting up libpython3-dev:amd64 (3.13.5-1) ...

Setting up python3.13-dev (3.13.5-2) ...

Setting up gcc (4:14.2.0-1) ...

Setting up python3-dev (3.13.5-1) ...

Setting up python-dev-is-python3 (3.13.3-1) ...

Processing triggers for libc-bin (2.41-12) ...

+ pip install --disable-pip-version-check --quiet --no-cache-dir mercurial==6.8.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
+ curl -L https://github.com/mozilla/grcov/releases/download/v0.10.3/grcov-x86_64-unknown-linux-gnu-tc.tar.bz2
+ tar -C /usr/bin -xjv
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
grcov

 69 3031k   69 2094k    0     0  4917k      0 --:--:-- --:--:-- --:--:-- 4917k
100 3031k  100 3031k    0     0  5793k      0 --:--:-- --:--:-- --:--:-- 9663k
+ chmod +x /usr/bin/grcov
+ hg clone -r b93e1a67ef8e https://hg.mozilla.org/hgcustom/version-control-tools /src/version-control-tools/
Traceback (most recent call last):
  File "/usr/local/bin/hg", line 57, in <module>
  File "<frozen importlib._bootstrap>", line 1371, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1342, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 938, in _load_unlocked
  File "/usr/local/lib/python3.14/site-packages/hgdemandimport/demandimportpy3.py", line 52, in exec_module
  File "<frozen importlib.util>", line 260, in exec_module
  File "<frozen importlib._bootstrap>", line 1371, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1342, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 938, in _load_unlocked
  File "/usr/local/lib/python3.14/site-packages/hgdemandimport/demandimportpy3.py", line 50, in exec_module
  File "/usr/local/lib/python3.14/threading.py", line 6, in <module>
  File "<frozen importlib._bootstrap>", line 1371, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1342, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 938, in _load_unlocked
  File "/usr/local/lib/python3.14/site-packages/hgdemandimport/demandimportpy3.py", line 52, in exec_module
  File "<frozen importlib.util>", line 270, in exec_module
AttributeError: partially initialized module 'threading' from '/usr/local/lib/python3.14/threading.py' has no attribute 'RLock' (most likely due to a circular import)
Error: building at STEP "RUN /src/bot/ci/bootstrap.sh": while running runtime: exit status 1
Traceback (most recent call last):
  File "/usr/local/bin/taskboot", line 8, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.10/site-packages/taskboot/cli.py", line 359, in main
    args.func(target, args)
  File "/usr/local/lib/python3.10/site-packages/taskboot/build.py", line 94, in build_image
    build_tool.build(target.dir, dockerfile, tags, args.build_arg)
  File "/usr/local/lib/python3.10/site-packages/taskboot/docker.py", line 141, in build
    self.run(command)
  File "/usr/local/lib/python3.10/site-packages/taskboot/docker.py", line 64, in run
    return subprocess.run(command, check=True, **params)
  File "/usr/local/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/usr/bin/podman', 'build', '--file', '/tmp/taskboot.kudzv0m_/bot/Dockerfile', '--tag', 'registry.hub.docker.com/mozilla/code-coverage:bot-dev', '--tag', 'registry.hub.docker.com/mozilla/code-coverage:bot-e11ce22597b87582252c30a71eeb773004b47484', '/tmp/taskboot.kudzv0m_']' returned non-zero exit status 1.
+ exit_code=1
+ podman cp taskcontainer:/bot.tar.zst artifact0.zst
Error: "/bot.tar.zst" could not be found on container taskcontainer: No such file or directory
+ podman rm taskcontainer
d230d21e3bafa29cdb35943edefdbe05ba16e7e8fb3d650c5ce247cefb8444c6
+ exit 1
[taskcluster 2025-10-13T15:49:23.435Z]    Exit Code: 1
[taskcluster 2025-10-13T15:49:23.435Z]    User Time: 28.24663s
[taskcluster 2025-10-13T15:49:23.435Z]  Kernel Time: 5.035639s
[taskcluster 2025-10-13T15:49:23.435Z]    Wall Time: 1m51.236041605s
[taskcluster 2025-10-13T15:49:23.435Z]       Result: FAILED
[taskcluster 2025-10-13T15:49:23.435Z] === Task Finished ===
[taskcluster 2025-10-13T15:49:23.435Z] Task Duration: 1m51.23670845s
[taskcluster:error] Uploading error artifact public/code-coverage-bot.tar.zst from file artifact0.zst with message "Could not read file '/task_176036999690135/artifact0.zst'", reason "file-missing-on-worker" and expiry 2026-04-11T15:40:55.307Z
[taskcluster:error] TASK FAILURE during artifact upload: file-missing-on-worker: Could not read file '/task_176036999690135/artifact0.zst'
[taskcluster 2025-10-13T15:49:23.621Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2026-10-13T16:40:55.307Z
[taskcluster:error] exit status 1