Skip to content

feat: add csv logging for job queue#348

Open
matheus1lva wants to merge 1 commit intomainfrom
feat/log-jobs
Open

feat: add csv logging for job queue#348
matheus1lva wants to merge 1 commit intomainfrom
feat/log-jobs

Conversation

@matheus1lva
Copy link
Collaborator

@matheus1lva matheus1lva commented Feb 24, 2026

Why this exists
Clear, minimal context makes reviews fast.
Tell the reviewer exactly how to validate your work so they can approve it quickly without guesswork.

Summary

Add job queue logging through csv controlled by env var so analysis on possible duplicate jobs can be done.

How to review

  • setup env var MQ_INVENTORY=true
  • start indexer/packages/ingest by doing bun run dev inside packages/ingest or through make dev on the root
  • Start terminal (packages/terminal bun dev`) if you have not run through make dev
  • run fanout abis
  • check if file is created over packages/ingest/output/extract-1-inventory.csv and has content such
jobName,abiPath,address,chainId,fromBlock,toBlock,outputLabel
evmlog,yearn/staking/pool,0x05a6344E69B66cb9d3E4eDaf6f9aA32223942457,1,21727522,21737521,
block,,,1,,,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19279061,19289060,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19289061,19299060,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19299061,19309060,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19309061,19319060,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19319061,19329060,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19329061,19339060,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19339061,19349060,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19349061,19359060,
evmlog,yearn/staking/pool,0xC8b003a10A2e527be57491B7961930AE6f25b0Ad,1,19359061,19369060,

Optional

  • check if csv is valid by opening using any visualization tool such as excel or google spreadsheet
    -- Or use any csv parsing library such papaparse

@vercel
Copy link

vercel bot commented Feb 24, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
kong Ready Ready Preview, Comment Feb 24, 2026 11:32pm

Request Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant