eval
- Repo stars 1,155
- License BSD-2-Clause
- Author repo LearningHumanoidWalking
/eval — Evaluate a Trained Checkpoint
Parse the user's request from $ARGUMENTS and run evaluation.
Command Template
uv run python run_experiment.py eval --path <PATH> [OPTIONS...]
Path Resolution
The user may provide:
- A .pt file: Use directly (
--path /tmp/.../actor_999.pt) - A run directory: Contains actor*.pt files (
--path /tmp/.../26-03-07-00-26-36_cartpole/) - A logdir: Contains timestamped run subdirectories (
--logdir /tmp/training_runs)
If no path is given, check /tmp/training_runs for the most recent run.
Use Glob to verify the path exists and resolve it before running.
Options
| Flag | Default | Description |
|---|---|---|
--ep-len |
10 | Episode length in seconds |
--seed |
None | Random seed for reproducible eval |
--out-dir |
None | Directory to save videos |
Instructions
- Resolve the model path from the user's input. If ambiguous, list available checkpoints and ask.
- Show the user which checkpoint will be evaluated (full path).
- Run the eval command. This opens an interactive MuJoCo viewer window — it is NOT a background job.
- Report the results when done.
- Fluxly category
- Other
- Author-declared agents
- No explicit declaration found; this is not inferred or tested compatibility
- Static check
- 94 / 100 · heuristic scan, not runtime safety proof
- Author / version / license
- @rohanpsingh · BSD-2-Clause
- Fluxly token estimate
- Lean
- Fluxly setup estimate
- Plug-and-play
- External API key
- No requirement detected
- Detected OS requirements
- Unspecified
- Runtime requirements
- Python
- Detected file/system behavior
-
- Read-only
- Detected network behavior
- Local-only
- Install commands
- None (reference only)
Profile is derived at build time from SKILL.md and install vectors. Subject to drift from author intent.
Heads up: 未限定 allowed-tools,默认拥有全部工具权限。
The current SKILL.md does not define a fixed output example. Command Template
The user may provide: A .pt file: Use directly (--path /tmp/.../actor999.pt) A run directory: Contains actor.pt files (--path /tmp/.../26-03-07-00-26-36cartpole/)
Flag · Default · Description --ep-len · 10 · Episode length in seconds --seed · None · Random seed for reproducible eval
Resolve the model path from the user's input. If ambiguous, list available checkpoints and ask. Show the user which checkpoint will be evaluated (full path). Run the eval command. This opens an interactive MuJoCo viewer window — it is NOT a background job.
# /eval — Evaluate a Trained Checkpoint
Parse the user's request from `$ARGUMENTS` and run evaluation.
## Command Template
```
uv run python run_experiment.py eval --path <PATH> [OPTIONS...]
```
## Path Resolution
The user may provide:
- **A .pt file**: Use directly (`--path /tmp/.../actor_999.pt`)
- **A run directory**: Contains actor*.pt files (`--path /tmp/.../26-03-07-00-26-36_cartpole/`)
- **A logdir**: Contains timestamped run subdirectories (`--logdir /tmp/training_runs`)
If no path is given, check `/tmp/training_runs` for the most recent run.
Use `Glob` to verify the path exists and resolve it before running.
## Options
| Flag | Default | Description |
|------|---------|-------------|
| `--ep-len` | 10 | Episode length in seconds |
| `--seed` | None | Random seed for reproducible eval |
| `--out-dir` | None | Directory to save videos |
## Instructions
1. Resolve the model path from the user's input. If ambiguous, list available checkpoints and ask.
2. Show the user which checkpoint will be evaluated (full path).
3. Run the eval command. This opens an interactive MuJoCo viewer window — it is NOT a background job.
4. Report the results when done. Author text anchors workflow facts; Fluxly only indexes current sections, terms, files, and commands.
sections -> Command Template → Path Resolution → Options → Instructions
terms -> A .pt file · A run directory · A logdir · Parse the user's request from $ARGUMENTS and run evaluation. · If no path is given, check /tmp/trainingruns for the most recent run. · Use Glob to verify the path exists and resolve it before running. · 1. Resolve the model path from the user's input.
files/cmd -> $ARGUMENTS · --path /tmp/.../actor999.pt · --path /tmp/.../26-03-07-00-26-36cartpole/ · --logdir /tmp/trainingruns · /tmp/trainingruns · Glob · --ep-len · --seed
body sha256 -> a33ca52ffbb1
Decide Fit First
Design Intent
How To Use It
Boundaries And Review