skill auditor

DevOps Community

Skill notes

Audit Pipeline

Two hard rejection gates run at Steps 1 and 6. Both are mandatory and cannot be skipped. All other steps run sequentially. Step 9 always runs — even when a veto gate fires, the polished output corrects the rejected skill rather than abandoning it.

Language Policy

All audit output must be written in English, regardless of the language used in the user's request or in the submitted skill. This applies to every artifact produced by this skill: Veto reports (Step 1 and Step 6) Static evaluation scores and notes (Step 2) Generated test inputs (Step 4)

Step 1: Skill Veto — Structural Redlines ❌

HARD GATE. Any FAIL = immediate rejection. Do not proceed to Step 2. Read the target skill's SKILL.md and any bundled scripts. Check all four dimensions: → Full criteria: references/basic_veto.md Dimension · Immediate Rejection Triggers T1. Operational Stability · Failure rate > 20%; random crashes or infinite loops; unresolvable dependency conflicts requiring manual intervention

Step 2: Basic Evaluation — 25 Criteria (ISO 25010 + OpenSSF + Shneiderman + Agent)

Read the skill's full SKILL.md and all bundled files. Score each of the 25 criteria from 0–4. → Full rubric with per-level descriptions: references/basic_evaluation.md · Category (Framework) · Criteria · Max 1 · Functional Suitability (ISO 25010) · Completeness, Correctness, Appropriateness · 12 2 · Reliability (ISO 25010) · Fault Tolerance, Error Reporting, Recoverability · 12

3.1 Classify the Skill

Read the skill's description frontmatter and ## When to Use section. → Full category definitions: references/classification.md · Category · Typical Skills 1 · Evidence Insight · Search strategy builders, database scouts, critical appraisal tools, evidence synthesizers 2 · Protocol Design · Experimental design generators, study-type advisors, statistical power planners, validation strategists

Fluxly profile Runtime and permissions are inferred by Fluxly static checks, not author declarations or runtime test results.
Domain
DevOps
Author-declared agents
No explicit declaration found; this is not inferred or tested compatibility
Static check
94 / 100 · heuristic scan, not runtime safety proof
Runtime evidence
Not run; no isolated runtime test evidence is currently recorded
Author / version / license
@aipoch · MIT
Token usage
Heavy
Setup complexity
Manual integration
External API key
Not required
Operating systems
macOS
Runtime requirements
Node.js · Python
Detected file/system behavior
  • Read-only
  • Write / modify
  • Shell exec
Network behavior
External requests
Install commands
None (reference only)

Heads up: Tool permissions are not declared; actual access depends on the runtime.

Output preview skill-auditor.preview
# Step 6: Multi-Layer Output Evaluation

Evaluate all N outputs across three parallel layers.

Discussion

Powered by GitHub Discussions. Sign in with GitHub to comment, react, or subscribe.