Add integration tests against anthropics/skills repo#167
Merged
wkusnierczyk merged 1 commit intomainfrom Feb 23, 2026
Merged
Conversation
There was a problem hiding this comment.
Pull request overview
Adds a pinned snapshot of real-world skills from anthropics/skills and introduces an ignored integration test suite that runs aigent commands (validate/check/properties/prompt/score) against those fixtures to better reflect production usage.
Changes:
- Add
tests/anthropics_skills.rsintegration tests (macro-generated per-skill + template + recursive/multi-dir cases), gated behind#[ignore]. - Add
tests/fixtures/anthropics-skills/snapshot content plus aPINfile documenting the upstream commit. - Add various reference/example files under the fixture snapshot to mirror real skill layouts.
Reviewed changes
Copilot reviewed 55 out of 55 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
tests/anthropics_skills.rs |
New ignored integration tests running multiple CLI commands against the pinned fixtures. |
tests/fixtures/anthropics-skills/** |
Snapshot fixtures of anthropics/skills (SKILL.md + selected references/examples). |
tests/fixtures/anthropics-skills/PIN |
Documents the pinned upstream commit and update procedure. |
Snapshot 12 Apache 2.0-licensed skills from anthropics/skills (pinned at 1ed29a0) into tests/fixtures/anthropics-skills/. Source-available skills (docx, pdf, pptx, xlsx) excluded — their license prohibits redistribution. Non-.md files stripped; LICENSE.txt preserved per Apache 2.0 Section 4. 64 integration tests via macro-generated per-skill modules: - 12 skills × 5 commands (validate, check, properties, prompt, score) - 2 template tests (properties, name-mismatch validation failure) - 1 recursive discovery test (13 skills found, 12 ok, 1 error) - 1 multi-dir prompt test (12 <skill> tags generated) Tests gated with #[ignore] — run with: cargo test --test anthropics_skills -- --ignored CI job added to run integration tests on every PR. Closes #166 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
wkusnierczyk
force-pushed
the
dev/166
branch
from
4d1d3fc to
abf256b
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Closes [TEST] Integration tests against anthropics/skills repo #166
Details
Snapshot of anthropics/skills at commit `1ed29a0`, with scripts and binary assets (fonts, XSD schemas, PDFs) stripped to keep fixture size at 460K. Skills tested:
`algorithmic-art`, `brand-guidelines`, `canvas-design`, `doc-coauthoring`, `docx`, `frontend-design`, `internal-comms`, `mcp-builder`, `pdf`, `pptx`, `skill-creator`, `slack-gif-creator`, `theme-factory`, `web-artifacts-builder`, `webapp-testing`, `xlsx`
Test breakdown (84 total):
Tests gated with `#[ignore]` — run with:
```
cargo test --test anthropics_skills -- --ignored
```
Test plan
🤖 Generated with Claude Code