feat: improve skill quality scores (+58% avg)#301
Open
rohan-tessl wants to merge 2 commits intodjinilabs:mainfrom
Open
feat: improve skill quality scores (+58% avg)#301rohan-tessl wants to merge 2 commits intodjinilabs:mainfrom
rohan-tessl wants to merge 2 commits intodjinilabs:mainfrom
Conversation
Optimized 5 agent skills to fix name validation (kebab-case) and improve descriptions, workflow clarity, and content quality. | Skill | Before | After | Change | |-------|--------|-------|--------| | competitive-intel | 17% | 75% | +58% | | document-faq-assistant | 17% | 73% | +56% | | email-follow-up | 17% | 82% | +65% | | web-research-assistant | 17% | 73% | +56% | | image-generation-assistant | 17% | 73% | +56% | Changes per skill: - Fixed name field to kebab-case (was blocking LLM judge evaluation) - Rewrote descriptions with "Use when..." clauses and trigger terms - Added triggers array for frontmatter compliance - Restructured content with clear Workflow/Guidelines/Examples/Edge Cases - Preserved all helpmaton-specific frontmatter (id, role, requiredTools)
Add .github/workflows/skill-review.yml that automatically runs tessl skill review on any PR touching SKILL.md files and posts scores as a PR comment. Non-blocking by default (fail-threshold: 0). No Tessl login required — uses only GITHUB_TOKEN.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Hey @pgte 👋
I ran your skills through
tessl skill reviewat work and found some targeted improvements. Here's the full before/after:This PR covers 5 of your 30 skill(s) in the repo. All 30 skills were scoring 17% due to the
namefield using Title Case instead of the required kebab-case format, which blocked the LLM judge from running entirely. I've capped this PR at 5 skills to keep the review manageable — the included GitHub Action covers ongoing review for the rest on future PRs.What changed in competitive-intel
namefield from "Competitive Intelligence" to kebab-casecompetitive-intel(unblocks LLM judge)triggersarray for frontmatter complianceid,role,requiredTools) preservedWhat changed in document-faq-assistant
namefield from "Document FAQ Assistant" to kebab-casedocument-faq-assistanttriggersarray for frontmatter complianceWhat changed in email-follow-up
namefield from "Email Follow-up" to kebab-caseemail-follow-uptriggersarray for frontmatter complianceWhat changed in web-research-assistant
namefield from "Web Research Assistant" to kebab-caseweb-research-assistanttriggersarray for frontmatter complianceWhat changed in image-generation-assistant
namefield from "Image Generation Assistant" to kebab-caseimage-generation-assistanttriggersarray for frontmatter complianceTessl Skill Review GitHub Action ✅
I've also included a GitHub Action (
.github/workflows/skill-review.yml) that automatically reviews anySKILL.mdchanged in future PRs and posts scores as a PR comment.What this gives you:
tessl skill reviewruns on every PR touchingSKILL.mdGITHUB_TOKENis usedfail-threshold: 70later if you want a hard gate)This workflow does not replace your existing CI/CD pipeline — it only reviews skill markdown on PRs.
Want automatic AI optimization on every SKILL.md change? 🚀
The action I've added gives you review scores on PRs. We also have a more powerful variant —
tesslio/skill-review-and-optimize— that can:SKILL.mdPR (requires addingTESSL_API_TOKENas a repo secret)/apply-optimizeInterested? Tick the box and I'll raise a follow-up PR:
tesslio/skill-review-and-optimizeaction so every SKILL.md PR gets AI optimization suggestions + the/apply-optimizeflowHonest disclosure — I work at @tesslio where we build tooling around skills like these. Not a pitch — just saw room for improvement and wanted to contribute.
Want to self-improve your skills? Just point your agent (Claude Code, Codex, etc.) at this Tessl guide and ask it to optimize your skill. Ping me — @rohan-tessl — if you hit any snags.
Thanks in advance 🙏