Log records lost after moving from Promtail to Alloy

[DavidePrincipi]

After update to Core 3.6.4 log streams from rootfull containers are no longer recorded in Loki.

Steps to reproduce

• Install Core 3.6.3 and Netadata
• Update to Core 3.6.4

Expected behavior

New log messages from Netdata are recorded.

Actual behavior

Messages from Netdata are not stored in Loki.

Furthermore, if Alloy is restarted many 429 errors from Loki are returned because it is missing a "position" file.

 ts=2025-04-28T14:34:17.509337702Z level=warn msg="error sending batch, will retry" component_path=/ component_id=loki.write.default component=client host=10.5.4.1:20020 status=429

Components

• Core 3.6.4

See also

• Discussion https://mattermost.nethesis.it/nethesis/pl/mb4kd8iu3inmbcdy989ucx1j6w

---

Thanks to @mrmarkuz

[DavidePrincipi]

In Testing Core 3.7.0-dev.7

Test case

Check the bug isn't reproducible.

• Update existing installation: netdata logs start to be recorded again
• New installation: netdata logs are recorded

[mrmarkuz]

Test cases verified

• After update netdata logs are recorded again
• On a fresh install netdata logs are recorded
• No 429 errors anymore after restart of promtail