[taskcluster 2025-10-20T15:36:08.912Z] Worker Type (proj-relman/generic-worker-ubuntu-24-04) settings:
[taskcluster 2025-10-20T15:36:08.912Z]   {
[taskcluster 2025-10-20T15:36:08.912Z]     "config": {
[taskcluster 2025-10-20T15:36:08.912Z]       "deploymentId": "49be08aef17b976e"
[taskcluster 2025-10-20T15:36:08.912Z]     },
[taskcluster 2025-10-20T15:36:08.912Z]     "generic-worker": {
[taskcluster 2025-10-20T15:36:08.912Z]       "config": {
[taskcluster 2025-10-20T15:36:08.912Z]         "headlessTasks": false
[taskcluster 2025-10-20T15:36:08.912Z]       },
[taskcluster 2025-10-20T15:36:08.912Z]       "engine": "multiuser",
[taskcluster 2025-10-20T15:36:08.912Z]       "go-arch": "amd64",
[taskcluster 2025-10-20T15:36:08.912Z]       "go-os": "linux",
[taskcluster 2025-10-20T15:36:08.912Z]       "go-version": "go1.25.1",
[taskcluster 2025-10-20T15:36:08.912Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v90.0.4",
[taskcluster 2025-10-20T15:36:08.912Z]       "revision": "88ee584b82f34693d2016e6d19e7cf9b68c6d7e1",
[taskcluster 2025-10-20T15:36:08.912Z]       "source": "https://github.com/taskcluster/taskcluster/commits/88ee584b82f34693d2016e6d19e7cf9b68c6d7e1",
[taskcluster 2025-10-20T15:36:08.912Z]       "version": "90.0.4"
[taskcluster 2025-10-20T15:36:08.912Z]     },
[taskcluster 2025-10-20T15:36:08.912Z]     "image": "projects/community-tc-workers/global/images/generic-worker-ubuntu-24-04-py5mogkuss886io7m8b3",
[taskcluster 2025-10-20T15:36:08.912Z]     "instance-id": "3821146532734561031",
[taskcluster 2025-10-20T15:36:08.912Z]     "instance-type": "projects/757942385826/machineTypes/n2-standard-4",
[taskcluster 2025-10-20T15:36:08.912Z]     "local-ipv4": "10.128.0.142",
[taskcluster 2025-10-20T15:36:08.912Z]     "machine-setup": {
[taskcluster 2025-10-20T15:36:08.912Z]       "maintainer": "taskcluster-notifications+workers@mozilla.com",
[taskcluster 2025-10-20T15:36:08.912Z]       "script": "https://raw.githubusercontent.com/taskcluster/community-tc-config/48c9c5f16c24f4fd60227afd9ed8e0f30b423243/imagesets/generic-worker-ubuntu-24-04/bootstrap.sh"
[taskcluster 2025-10-20T15:36:08.912Z]     },
[taskcluster 2025-10-20T15:36:08.912Z]     "project-id": "community-tc-workers",
[taskcluster 2025-10-20T15:36:08.912Z]     "public-hostname": "proj-relman-generic-worker-ubuntu-24-0-kzi8nhqssy6wpkb8dbk7rw.c.community-tc-workers.internal",
[taskcluster 2025-10-20T15:36:08.912Z]     "public-ipv4": "34.28.55.147",
[taskcluster 2025-10-20T15:36:08.912Z]     "region": "us-central1",
[taskcluster 2025-10-20T15:36:08.912Z]     "zone": "us-central1-f"
[taskcluster 2025-10-20T15:36:08.912Z]   }
[taskcluster 2025-10-20T15:36:08.912Z] Task ID: WFDisArGR4KM_nvseLMM0Q
[taskcluster 2025-10-20T15:36:08.912Z] === Task Starting ===
[taskcluster 2025-10-20T15:36:09.416Z] Uploading redirect artifact public/logs/live.log to URL https://community-websocktunnel.services.mozilla.com/us-central1-f.3821146532734561031.60099/log/IegapmFXSka_QYDOUrYXYg with mime type "text/plain; charset=utf-8" and expiry 2025-10-20T16:51:09.244Z
[taskcluster 2025-10-20T15:36:11.221Z] [d2g] Using cached docker image "docker.io/library/python:3.12"
[taskcluster 2025-10-20T15:36:11.221Z] Executing command 0: docker run -t --name taskcontainer_TmSPdF-7SpeDuAhCfWwtGQ --memory-swap -1 --pids-limit -1 '--add-host=localhost.localdomain:127.0.0.1' --add-host=taskcluster:host-gateway --env-file 'env.list' 'python:3.12' sh -lxce 'git clone --quiet https://github.com/mozilla/code-coverage /src && cd /src && git checkout 6d4b31d10cbe2992a935c657790f7c168069c670 -b checks && cd /src/report && ./ci-test.sh'
+ id -u
+ [ 0 -eq 0 ]
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ export PATH
+ [ #  ]
+ [  ]
+ id -u
+ [ 0 -eq 0 ]
+ PS1=# 
+ [ -d /etc/profile.d ]
+ run-parts --list --regex ^[a-zA-Z0-9_][a-zA-Z0-9._-]*\.sh$ /etc/profile.d
+ unset i
+ [  ]
+ git clone --quiet https://github.com/mozilla/code-coverage /src
+ cd /src
+ git checkout 6d4b31d10cbe2992a935c657790f7c168069c670 -b checks
Switched to a new branch 'checks'
+ cd /src/report
+ ./ci-test.sh
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
EE./usr/local/lib/python3.12/http/client.py:1309: ResourceWarning: unclosed <ssl.SSLSocket fd=3, family=2, type=1, proto=6, laddr=('172.17.0.2', 48578), raddr=('151.101.1.91', 443)>
  for i, one_value in enumerate(values):
ResourceWarning: Enable tracemalloc to get the object allocation traceback
.
======================================================================
ERROR: test (test.Test.test)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/urllib3/connection.py", line 198, in _new_conn
    sock = connection.create_connection(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/urllib3/util/connection.py", line 85, in create_connection
    raise err
  File "/usr/local/lib/python3.12/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 787, in urlopen
    response = self._make_request(
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 488, in _make_request
    raise new_e
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 464, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 1093, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.12/site-packages/urllib3/connection.py", line 753, in connect
    self.sock = sock = self._new_conn()
                       ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/urllib3/connection.py", line 207, in _new_conn
    raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x756413e56810>, 'Connection to api.coverage.moz.tools timed out. (connect timeout=None)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/requests/adapters.py", line 644, in send
    resp = conn.urlopen(
           ^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py", line 841, in urlopen
    retries = retries.increment(
              ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/urllib3/util/retry.py", line 519, in increment
    raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.coverage.moz.tools', port=443): Max retries exceeded with url: /v2/latest?repository=mozilla-central (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x756413e56810>, 'Connection to api.coverage.moz.tools timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/src/report/tests/test.py", line 31, in test
    task_id = codecoverage.get_last_task()
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/src/report/firefox_code_coverage/codecoverage.py", line 46, in get_last_task
    resp = requests.get(
           ^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/requests/adapters.py", line 665, in send
    raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='api.coverage.moz.tools', port=443): Max retries exceeded with url: /v2/latest?repository=mozilla-central (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x756413e56810>, 'Connection to api.coverage.moz.tools timed out. (connect timeout=None)'))

======================================================================
ERROR: test_download_grcov (test.Test.test_download_grcov)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/src/report/tests/test.py", line 119, in test_download_grcov
    codecoverage.download_grcov()
  File "/src/report/firefox_code_coverage/codecoverage.py", line 295, in download_grcov
    download_binary(url, archive)
  File "/usr/local/lib/python3.12/site-packages/tenacity/__init__.py", line 338, in wrapped_f
    return copy(f, *args, **kw)
           ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/tenacity/__init__.py", line 477, in __call__
    do = self.iter(retry_state=retry_state)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/tenacity/__init__.py", line 378, in iter
    result = action(retry_state)
             ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/tenacity/__init__.py", line 420, in exc_check
    raise retry_exc.reraise()
          ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/tenacity/__init__.py", line 187, in reraise
    raise self.last_attempt.result()
          ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/local/lib/python3.12/site-packages/tenacity/__init__.py", line 480, in __call__
    result = fn(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^
  File "/src/report/firefox_code_coverage/codecoverage.py", line 88, in download_binary
    artifact.raise_for_status()
  File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1026, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://firefox-ci-tc.services.mozilla.com/api/index/v1/task/gecko.cache.level-1.toolchains.v3.linux64-grcov.latest/artifacts/public%2Fbuild%2Fgrcov.tar.zst

----------------------------------------------------------------------
Ran 4 tests in 606.251s

FAILED (errors=2)
[taskcluster 2025-10-20T15:46:45.973Z]                        Exit Code: 1
[taskcluster 2025-10-20T15:46:45.973Z]                        User Time: 25.41ms
[taskcluster 2025-10-20T15:46:45.973Z]                      Kernel Time: 13.86ms
[taskcluster 2025-10-20T15:46:45.973Z]                        Wall Time: 10m34.752275805s
[taskcluster 2025-10-20T15:46:45.973Z]  Average Available System Memory: 14.36 GiB
[taskcluster 2025-10-20T15:46:45.973Z]       Average System Memory Used: 943.74 MiB
[taskcluster 2025-10-20T15:46:45.973Z]          Peak System Memory Used: 1.10 GiB
[taskcluster 2025-10-20T15:46:45.973Z]              Total System Memory: 15.62 GiB
[taskcluster 2025-10-20T15:46:45.973Z]                           Result: FAILED
[taskcluster 2025-10-20T15:46:45.974Z] === Task Finished ===
[taskcluster 2025-10-20T15:46:45.974Z] Task Duration: 10m34.752764496s
[taskcluster 2025-10-20T15:46:46.207Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2026-10-20T16:34:13.492Z
[taskcluster:error] exit status 1