skillsbench
- Repo stars 1,209
- Author updated Live
- Author repo skillsbench
- Domain
- AI
- Compatible agents
-
- Claude Code
- Cursor
- Cline
- Codex
- Windsurf
- Gemini CLI
- +20
- Trust score
- 88 / 100 · community maintained
- Author / version / license
- @benchflow-ai · no license declared
- Token usage
- Lean
- Setup complexity
- Plug-and-play
- External API key
- Not required
- Operating systems
- Unspecified (assume cross-platform)
- Runtime requirements
- No special requirements
- Permissions
-
- Read-only
- Write / modify
- Network behavior
- Local-only
- Install commands
- 26 variants
Profile is derived at build time from SKILL.md and install vectors. Subject to drift from author intent.
Heads up: 未限定 allowed-tools，默认拥有全部工具权限。
---
name: skillsbench
description: SkillsBench contribution workflow. Use when: (1) Creating benchmark tasks, (2) Understanding rep…
category: ai
runtime: no special runtime
---
# skillsbench output preview
## PART A: Task fit
- Use case: SkillsBench contribution workflow. Use when: (1) Creating benchmark tasks, (2) Understanding repo structure, (3) Preparing PRs for task submission. Benchmark evaluating how well AI agents use skills. runs entirely locally. Works with Claude Code, Cursor, Cline and 23 more..
- Inputs: target material, constraints, expected output, and acceptance criteria.
- Evidence boundary: follow “Official Resources / Quick Workflow / Task Requirements” and do not present inference as author intent.
## PART B: Execution result
- **01** The card summarizes the use case; runtime output centers on “SkillsBench contribution workflow. Use when: (1) Creating benchmark tasks, (2) Understanding repo structure, (3) Preparing PRs for task submission. Benchmark evaluating how well AI agents use skills. runs entirely locally. Works with Claude Code, Cursor, Cline and 23 more.”.
- **02** When the source has headings, the agent prioritizes “Official Resources / Quick Workflow / Task Requirements” so the result follows the author’s structure.
- **03** Typical output includes task judgment, concrete steps, required commands or file edits, validation, and follow-up options.
- **04** Risk context follows the fingerprint: read files, write/modify files; mostly runs locally; usually needs no extra API key.
## Running Rules
- read files, write/modify files; mostly runs locally; usually needs no extra API key.
- Validate with a small sample before expanding scope.
- Return the result, validation criteria, and next iteration options. Choose the trigger
The source does not require a stable slash command. After installation, invoke the skill by name and describe the task.
Provide inputs and boundaries
Name target files or source material, expected output, forbidden changes, and whether network or shell access is allowed. Permission fingerprint: read files, write/modify files.
Validate with a small run
Start with a small task and check whether the result follows “Official Resources / Quick Workflow / Task Requirements”. Inspect diffs, logs, previews, or tests before expanding scope.
Review before delivery
Confirm the final output includes a concrete result, evidence, and next action. If it stays generic, tighten inputs, boundaries, and acceptance criteria.
---
name: skillsbench
description: SkillsBench contribution workflow. Use when: (1) Creating benchmark tasks, (2) Understanding rep…
category: ai
source: benchflow-ai/skillsbench
---
# skillsbench
## When to use
- SkillsBench contribution workflow. Use when: (1) Creating benchmark tasks, (2) Understanding repo structure, (3) Prepa…
- Use it when the task has clear inputs, repeatable steps, and validation criteria.
## What to provide
- Target material, scope, expected result, and forbidden changes.
- Whether network, commands, file writes, or external services are allowed.
## Execution rules
- Organize steps around “Official Resources / Quick Workflow / Task Requirements” and keep inference separate from source facts.
- read files, write/modify files; mostly runs locally; usually needs no extra API key.
- Validate with a small sample before expanding the task.
## Output requirements
- Return the deliverable, key evidence, validation method, and next action.
- Mark missing information as unknown; do not invent commands, platforms, or dependencies. Evidence boundary and execution chain
The author source anchors workflow facts; repository files anchor sources and commands; Fluxly only adds fit, limitations, and quality judgment.
skill "skillsbench" {
input -> user goal + target files + boundaries + acceptance criteria
context -> Official Resources / Quick Workflow / Task Requirements
rules -> SKILL.md triggers / order / output contract
runtime -> no special runtime | read files, write/modify files | mostly runs locally
guardrails -> usually needs no extra API key + small-sample validation + diff/log review
output -> copyable result + checklist + next iteration
}SkillsBench
Benchmark evaluating how well AI agents use skills.
Official Resources
- GitHub: https://github.com/benchflow-ai/skillsbench
- BenchFlow SDK: https://github.com/benchflow-ai/benchflow
Quick Workflow
# 1. Install and initialize a task
pip install 'benchflow>=0.3.0a7'
bench tasks init <task-name>
# 2. Write files (see CONTRIBUTING.md for templates)
# 3. Validate
bench tasks check tasks/my-task
bench eval create -t tasks/my-task -a oracle # Must pass 100%
# 4. Test with agent (with skills)
bench eval create -t tasks/my-task -a claude-agent-acp -s tasks/my-task/environment/skills/
# 5. Test WITHOUT skills (omit -s)
bench eval create -t tasks/my-task -a claude-agent-acp
# 6. Submit PR (see PR template)Task Requirements
- Realistic workflows people actually do
- Measurably easier with skills than without
- instruction.md, solve.sh, and task.toml must be human-authored
- Deterministic, outcome-based verification
- Skills must be generalizable and reusable
References
- Full guide: CONTRIBUTING.md
- Task quality rubric: task-review skill (workflow + policy/implementation rubrics)
- Finding tasks: CONTRIBUTING.md#finding-good-task-ideas
Decide Fit First
Design Intent
How To Use It
Boundaries And Review