技能 Tester CI

AI 智能社区

作者仓库星标 180
作者仓库 pskoett-ai-skills

解读按原文结构重写，命令、链接、术语均保留；右侧可核对作者原始 SKILL.md

方法与流程

2. Workflow Example Compilation：Extract workflow blocks from each CI skill's references/workflow-example.md and compile with gh aw compile: Pass criteria: Zero compilation errors. Warnings are reported but don't fail.
5. Cross-Workflow Validation：For workflows that use call-workflow: Verify the target workflow exists and has workflowcall in its on: section Verify the target's inputs match what the caller provides

适用与边界

When to Use：After adding or modifying a CI skill After upgrading gh-aw to a new version (API changes may break workflows) Before committing CI skill changes
1. Anthropic Spec Validation：Run quickvalidate.py on every CI skill:
5. Cross-Workflow Validation：For workflows that use call-workflow: Verify the target workflow exists and has workflowcall in its on: section Verify the target's inputs match what the caller provides

原文中的明确线索

要点：「Pass criteria」、「Date」、「gh-aw version」、「Skills tested」、「Passed」、「Compile errors」、「Spec failures」
文件与命令：-ci、gh-aw、gh extension install github/gh-aw、python3、pyyaml、quickvalidate.py、.claude/skills/skill-creator/scripts/、references/workflow-example.md

流狐整理：以上内容来自当前 SKILL.md 的章节与原词；未补写作者没有声明的工具、兼容性或能力。

Skill Tester CI

Validates all CI skills (*-ci) in this repo. Runs spec validation, compiles gh-aw workflows, and checks CI-specific conventions.

When to Use

After adding or modifying a CI skill
After upgrading gh-aw to a new version (API changes may break workflows)
Before committing CI skill changes
Before submitting the plugin for Anthropic review

Prerequisites

gh-aw CLI installed (gh extension install github/gh-aw)
python3 with pyyaml installed
quick_validate.py available at .claude/skills/skill-creator/scripts/

Checks

1. Anthropic Spec Validation

Run quick_validate.py on every CI skill:

for d in skills/*-ci/; do
  python3 .claude/skills/skill-creator/scripts/quick_validate.py "$d"
done

2. Workflow Example Compilation

Extract workflow blocks from each CI skill's references/workflow-example.md and compile with gh aw compile:

# Extract markdown code blocks with frontmatter
# Copy to temp .github/workflows/
# Run: gh aw compile

Pass criteria: Zero compilation errors. Warnings are reported but don't fail.

3. Permission Checks

CI workflows in strict mode must NOT use write permissions directly. Verify:

No issues: write (use safe-outputs: add-comment instead)
No pull-requests: write (use safe-outputs: create-pull-request-review-comment instead)
No contents: write unless the workflow creates files (eval-creator create mode)
Required read permissions present for declared toolsets

4. Structural Checks

Check	Rule	Severity
Has `references/workflow-example.md`	Required for all CI skills	Error
Workflow example has frontmatter block	At least one ```markdown block with `---`	Error
Name matches folder	Frontmatter `name` == directory name	Error
Description mentions gh-aw	CI skills should reference gh-aw	Warning
Has corresponding interactive skill	`foo-ci` should have a `foo` counterpart	Warning

5. Cross-Workflow Validation

For workflows that use call-workflow:

Verify the target workflow exists and has workflow_call in its on: section
Verify the target's inputs match what the caller provides

Output Format

## CI Skill Test Results

**Date:** YYYY-MM-DD
**gh-aw version:** vX.Y.Z
**Skills tested:** N
**Passed:** N
**Compile errors:** N
**Spec failures:** N

### Compilation Results
- [skill-name]: ✓ compiled (N KB) | ✗ error: [message]

### Spec Results
- [skill-name]: ✓ valid | ✗ [error]

### Permission Issues
- [skill-name]: [issue]

Running

Invoke manually:

/skill-tester-ci

Or run the script directly:

bash skills/skill-tester-ci/scripts/run-tests.sh

What This Skill Does NOT Do

Does not test interactive skills (use skill-tester for those)
Does not execute workflows against real repos — only compiles them
Does not modify skills — reports findings only
Does not test workflow runtime behavior — compilation validates structure and permissions only

流狐档案作者与许可取自来源；运行、权限和网络为流狐检测或估算

流狐分类: AI 智能
作者声明 Agent: 未找到明确声明；不据此推断已兼容或已测试
静态检查: 88 / 100 · 启发式扫描，不代表运行安全
作者 / 版本 / 许可: @pskoett · 未声明 license
流狐 Token 估算: 低消耗
流狐接入估算: 需简单配置
是否需要外部 API Key: 未发现要求
检测到的系统要求: 未声明
底层运行要求: 未声明
检测到的文件与系统行为: 只读
允许写入 / 修改
Shell 执行
检测到的网络行为: 仅限本地
安装命令数: 无（仅作为资料）

档案由构建时根据 SKILL.md 与安装命令自动衍生，可能与作者实际意图存在差异。

需要注意： 未限定 allowed-tools，默认拥有全部工具权限。

输出预览 skill-tester-ci.preview

# 2. Workflow Example Compilation

# Extract markdown code blocks with frontmatter
# Copy to temp .github/workflows/
# Run: gh aw compile

SKILL.md SKILL.md

# Skill Tester CI

Validates all CI skills (`*-ci`) in this repo. Runs spec validation, compiles gh-aw workflows, and checks CI-specific conventions.

## When to Use

- After adding or modifying a CI skill
- After upgrading `gh-aw` to a new version (API changes may break workflows)
- Before committing CI skill changes
- Before submitting the plugin for Anthropic review

## Prerequisites

- `gh-aw` CLI installed (`gh extension install github/gh-aw`)
- `python3` with `pyyaml` installed
- `quick_validate.py` available at `.claude/skills/skill-creator/scripts/`

## Checks

### 1. Anthropic Spec Validation

Run `quick_validate.py` on every CI skill:

```bash
for d in skills/*-ci/; do
  python3 .claude/skills/skill-creator/scripts/quick_validate.py "$d"
done
```

### 2. Workflow Example Compilation

Extract workflow blocks from each CI skill's `references/workflow-example.md` and compile with `gh aw compile`:

```bash
# Extract markdown code blocks with frontmatter
# Copy to temp .github/workflows/
# Run: gh aw compile
```

**Pass criteria:** Zero compilation errors. Warnings are reported but don't fail.

### 3. Permission Checks

CI workflows in strict mode must NOT use write permissions directly. Verify:

- No `issues: write` (use `safe-outputs: add-comment` instead)
- No `pull-requests: write` (use `safe-outputs: create-pull-request-review-comment` instead)
- No `contents: write` unless the workflow creates files (eval-creator create mode)
- Required read permissions present for declared toolsets

### 4. Structural Checks

| Check | Rule | Severity |
|-------|------|----------|
| Has `references/workflow-example.md` | Required for all CI skills | Error |
| Workflow example has frontmatter block | At least one `` ```markdown `` block with `---` | Error |

…

证据边界与执行链路

作者原文负责流程事实；流狐只索引当前章节、要点、文件与命令。

章节    -> When to Use → Prerequisites → Checks → 1. Anthropic Spec Validation → 2. Workflow Example Compilation → 3. Permission Checks
要点    -> Pass criteria · Date · gh-aw version · Skills tested · Passed · Compile errors · Spec failures
文件/命令 -> -ci · gh-aw · gh extension install github/gh-aw · python3 · pyyaml · quickvalidate.py · .claude/skills/skill-creator/scripts/ · references/workflow-example.md
内容 SHA-256 -> 6bbde45e9d07