eval
- Repo stars 1,155
- License BSD-2-Clause
- Author repo LearningHumanoidWalking
- Domain
- Other
- Author-declared agents
- No explicit declaration found; this is not inferred or tested compatibility
- Static check
- 94 / 100 · heuristic scan, not runtime safety proof
- Runtime evidence
- Not run; no isolated runtime test evidence is currently recorded
- Author / version / license
- @rohanpsingh · BSD-2-Clause
- Token usage
- Lean
- Setup complexity
- Plug-and-play
- External API key
- Not required
- Operating systems
- Unspecified (assume cross-platform)
- Runtime requirements
- Python
- Detected file/system behavior
-
- Read-only
- Network behavior
- Local-only
- Install commands
- None (reference only)
Heads up: Tool permissions are not declared; actual access depends on the runtime.
# /eval — Evaluate a Trained Checkpoint
Parse the user's request from `$ARGUMENTS` and run evaluation.
## Command Template
```
uv run python run_experiment.py eval --path <PATH> [OPTIONS...]
```
## Path Resolution
The user may provide:
- **A .pt file**: Use directly (`--path /tmp/.../actor_999.pt`)
- **A run directory**: Contains actor*.pt files (`--path /tmp/.../26-03-07-00-26-36_cartpole/`)
- **A logdir**: Contains timestamped run subdirectories (`--logdir /tmp/training_runs`)
If no path is given, check `/tmp/training_runs` for the most recent run.
Use `Glob` to verify the path exists and resolve it before running.
## Options
| Flag | Default | Description |
|------|---------|-------------|
| `--ep-len` | 10 | Episode length in seconds |
| `--seed` | None | Random seed for reproducible eval |
| `--out-dir` | None | Directory to save videos |
## Instructions
1. Resolve the model path from the user's input. If ambiguous, list available checkpoints and ask.
2. Show the user which checkpoint will be evaluated (full path).
3. Run the eval command. This opens an interactive MuJoCo viewer window — it is NOT a background job.
4. Report the results when done.
Sections and files
Listed in source order.
sections -> Command Template → Path Resolution → Options → Instructions
terms -> A .pt file · A run directory · A logdir · Parse the user's request from $ARGUMENTS and run evaluation. · If no path is given, check /tmp/trainingruns for the most recent run. · Use Glob to verify the path exists and resolve it before running. · 1. Resolve the model path from the user's input.
files/cmd -> $ARGUMENTS · --path /tmp/.../actor_999.pt · --path /tmp/.../26-03-07-00-26-36_cartpole/ · --logdir /tmp/training_runs · /tmp/training_runs · Glob · --ep-len · --seed
body sha256 -> a33ca52ffbb1
Path Resolution
The user may provide: A .pt file: Use directly (
--path /tmp/.../actor_999.pt) A run directory: Contains actor*.pt files (--path /tmp/.../26-03-07-00-26-36_cartpole/) A logdir: Contains timestamped run subdirectories (--logdir /tmp/training_runs) If no path is given, check/tmp/training_runsfor the most recent run.Options
Flag · Default · Description
--ep-len· 10 · Episode length in seconds--seed· None · Random seed for reproducible eval--out-dir· None · Directory to save videosInstructions
Resolve the model path from the user's input. If ambiguous, list available checkpoints and ask. Show the user which checkpoint will be evaluated (full path). Run the eval command. This opens an interactive MuJoCo viewer window — it is NOT a background job. Report the results when done.