技能测试员
- 作者仓库星标 180
- 作者仓库 pskoett-ai-skills
- 领域
- 人工智能
- 作者声明的智能体
- 未找到明确声明;不据此推断已兼容或已测试
- 静态检查
- 88 / 100 · 启发式扫描,不代表运行安全
- 运行环境证据
- 未执行;当前没有隔离运行测试证据
- 作者 / 版本 / 许可证
- @pskoett · 未声明许可证
- 上下文用量评级
- 低消耗
- 接入复杂程度
- 需简单配置
- 是否需要外部接口密钥
- 不需要
- 兼容的系统
- 未声明(默认跨平台)
- 运行环境要求
- 未检出明确要求
- 检测到的文件与系统行为
-
- 只读
- 允许写入 / 修改
- 命令执行
- 网络行为
- 仅限本地
- 安装命令数
- 无(仅作为资料)
需要注意: 未声明工具权限范围;实际权限由运行环境决定。
# Extract markdown code blocks with frontmatter
# Copy to temp .github/workflows/
# Run: gh aw compile
# Skill Tester CI
Validates all CI skills (`*-ci`) in this repo. Runs spec validation, compiles gh-aw workflows, and checks CI-specific conventions.
## When to Use
- After adding or modifying a CI skill
- After upgrading `gh-aw` to a new version (API changes may break workflows)
- Before committing CI skill changes
- Before submitting the plugin for Anthropic review
## Prerequisites
- `gh-aw` CLI installed (`gh extension install github/gh-aw`)
- `python3` with `pyyaml` installed
- `quick_validate.py` available at `.claude/skills/skill-creator/scripts/`
## Checks
### 1. Anthropic Spec Validation
Run `quick_validate.py` on every CI skill:
```bash
for d in skills/*-ci/; do
python3 .claude/skills/skill-creator/scripts/quick_validate.py "$d"
done
```
### 2. Workflow Example Compilation
Extract workflow blocks from each CI skill's `references/workflow-example.md` and compile with `gh aw compile`:
```bash
# Extract markdown code blocks with frontmatter
# Copy to temp .github/workflows/
# Run: gh aw compile
```
**Pass criteria:** Zero compilation errors. Warnings are reported but don't fail.
### 3. Permission Checks
CI workflows in strict mode must NOT use write permissions directly. Verify:
- No `issues: write` (use `safe-outputs: add-comment` instead)
- No `pull-requests: write` (use `safe-outputs: create-pull-request-review-comment` instead)
- No `contents: write` unless the workflow creates files (eval-creator create mode)
- Required read permissions present for declared toolsets
### 4. Structural Checks
| Check | Rule | Severity |
|-------|------|----------|
| Has `references/workflow-example.md` | Required for all CI skills | Error |
| Workflow example has frontmatter block | At least one `` ```markdown `` block with `---` | Error |
| Name matches folder | Frontmatter `name` == directory name | Error |
| Description mentions gh-aw | CI skills should reference gh-aw | Warning |
| Has corresponding interactive skill | `foo-ci` should have a `foo` counterpart | Warning |
### 5. Cross-Workflow Validation
For workflows that use `call-workflow`:
- Verify the target workflow exists and has `workflow_call` in its `on:` section
- Verify the target's inputs match what the caller provides
## Output Format
```markdown
## CI Skill Test Results
**Date:** YYYY-MM-DD
**gh-aw version:** vX.Y.Z
**Skills tested:** N
**Passed:** N
**Compile errors:** N
**Spec failures:** N
### Compilation Results
- [skill-name]: ✓ compiled (N KB) | ✗ error: [message]
### Spec Results
- [skill-name]: ✓ valid | ✗ [error]
### Permission Issues
- [skill-name]: [issue]
```
## Running
Invoke manually:
```
/skill-tester-ci
```
Or run the script directly:
```bash
bash skills/skill-tester-ci/scripts/run-tests.sh
```
## What This Skill Does NOT Do
- Does not test interactive skills (use `skill-tester` for those)
- Does not execute workflows against real repos — only compiles them
- Does not modify skills — reports findings only
- Does not test workflow runtime behavior — compilation validates structure and permissions only
章节与文件索引
按说明文件中的顺序排列。
何时使用
先决条件
1. 人择规范验证
2. 工作流程示例编译
3. 权限检查
文件/命令 -> *-ci · gh-aw · gh extension install github/gh-aw · python3 · pyyaml · quick_validate.py · .claude/skills/skill-creator/scripts/ · references/workflow-example.md
内容校验值 -> 6bbde45e9d07
当前原文的自动摘译,尚未人工审校。
何时使用
添加或修改 CI 技能后 将
gh-aw升级到新版本后(API 更改可能会破坏工作流程) 在提交 CI 技能更改之前 在提交插件进行人工审核之前先决条件
gh-aw安装了 CLI (gh extension install github/gh-aw)python3安装了pyyamlquick_validate.py可在.claude/skills/skill-creator/scripts/获取1. 人择规范验证
对每个 CI 技能运行
quick_validate.py:2. 工作流程示例编译
从每个 CI 技能的
references/workflow-example.md中提取工作流程块并使用gh aw compile进行编译:通过标准:零编译错误。报告警告但不会失败。3. 权限检查
严格模式下的 CI 工作流程不得直接使用写入权限。验证:否
issues: write(改为使用safe-outputs: add-comment) 否pull-requests: write(改为使用safe-outputs: create-pull-request-review-comment) 否contents: write,除非工作流程创建文件(eval-creator 创建模式) 声明的工具集存在所需的读取权限