fix: replace truncated git tree API with apis.json + Contents API for catalog#160
Merged
fix: replace truncated git tree API with apis.json + Contents API for catalog#160
Conversation
There was a problem hiding this comment.
Pull request overview
This PR fixes catalog truncation caused by GitHub’s recursive git tree API limit by switching manifest generation to a curated apis.json index plus a single GitHub Contents API call for workflows/, restoring missing umbrella vendor sub-APIs and workflow sources.
Changes:
- Build the API manifest from
apis/openapi/apis.json(raw GitHub URL) instead of the recursive tree API. - Build the workflow manifest by listing
workflows/via the GitHub Contents API. - Remove tree-based manifest builders and related fallback logic.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
char0n
force-pushed
the
fix/catalog-use-apis-json
branch
from
7baea88 to
7121e48
Compare
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 1 out of 1 changed files in this pull request and generated 3 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
… catalog The GitHub recursive tree API truncates at ~100k entries, causing the catalog to drop from 5000+ to ~999 APIs and lose all umbrella vendor sub-APIs (googleapis.com/calendar, etc.) and all 380 workflows. Now uses two targeted API calls instead: - APIs: fetch curated apis.json index file (1 request → 1079 APIs) - Workflows: fetch workflows/ directory via Contents API (1 request → 380 workflows) Removes dead code: _fetch_full_tree, _build_api_manifest_from_tree, _build_manifest_shallow, _build_workflow_manifest_from_tree. Fixes #157 Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
char0n
force-pushed
the
fix/catalog-use-apis-json
branch
from
7121e48 to
4d6cfb9
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The GitHub recursive tree API truncates at ~100k entries, causing the catalog to drop from 5000+ to ~999 APIs and lose all umbrella vendor sub-APIs (googleapis.com/calendar, etc.) and all 380 workflows.
Fixes #157, closes #55.
Changes
Two targeted API calls replace the single truncated tree call:
apis.jsonindex from jentic-public-apis — 1 HTTP request → 1079 deduplicated APIs including all Google, Atlassian, etc. sub-APIsworkflows/directory via GitHub Contents API — 1 HTTP request → 380 workflowsRemoved dead code:
_fetch_full_tree,_build_api_manifest_from_tree,_build_manifest_shallow,_build_workflow_manifest_from_tree,_VERSION_BRANCH_RE.Net: -70 lines (71 added, 141 removed).
Limitations
apis.jsonis a curated index with 1079 APIs. The full repo has 5000+ API directories. APIs not yet added to the index won't appear in the catalog. This covers all major APIs and is maintained upstream.Test results
🤖 Generated with Claude Code