improve aws-detective skill structure + eval score#36
Open
fernandezbaptiste wants to merge 1 commit intomukul975:mainfrom
Open
improve aws-detective skill structure + eval score#36fernandezbaptiste wants to merge 1 commit intomukul975:mainfrom
fernandezbaptiste wants to merge 1 commit intomukul975:mainfrom
Conversation
Owner
|
Hi @fernandezbaptiste Thanks for this — genuinely useful feedback. Before we add the GitHub Action, two questions: does the reviewer understand domain-specific context (e.g., MITRE ATLAS technique IDs, D3FEND mappings)? And is the quality rubric publicly documented so contributors know what it's optimising for? |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
hey @mukul975, thanks for building this cybersecurity skills collection. really like the MITRE ATT&CK mapping approach across
750+structured skills. Kudos on passing4kstars! I've just starred it.ran your aws-detective skill through agent evals and spotted a few quick wins that took it from
~72%to~90%performance:expanded description with trigger terms like AWS Detective, security investigation, GuardDuty findings, VPC flow logs so agents reliably match user requests
restructured workflow with clear verification checkpoints + error recovery for common API failures
tightened verbose prose + consolidated tables to improve conciseness
these were easy changes to bring the skill in line with what performs well against Anthropic's best practices. honest disclosure, I work at tessl.io where we build tooling around this. not a pitch, just fixes that were straightforward to make!
you've got
754skills, if you want to do it yourself, spin up Claude Code and runtessl skill review. alternatively, let me know if you'd like an automatic review in your repo via GitHub Actions. it doesn't require signup, and this means you and your contributors get an instant quality signal before you have to review yourself.