skill test

Data Community

Skill notes

Quick References

Scorers - Available scorers and quality gates YAML Schemas - Manifest and ground truth formats Python API - Programmatic usage examples Workflows - Detailed example workflows Trace Evaluation - Session trace analysis

/skill-test Command

The /skill-test command provides an interactive CLI for testing Databricks skills with real execution on Databricks.

Subcommands

Subcommand · Description run · Run evaluation against ground truth (default) regression · Compare current results against baseline init · Initialize test scaffolding for a new skill add · Interactive: prompt -> invoke skill -> test -> save

Quick Examples

See Workflows for detailed examples of each subcommand.

Environment Setup

Environment variables for Databricks MLflow: DATABRICKS_CONFIG_PROFILE - Databricks CLI profile (default: "DEFAULT") MLFLOW_TRACKING_URI - Set to "databricks" for Databricks MLflow MLFLOW_EXPERIMENT_NAME - Experiment path (e.g., "/Users/{user}/skill-test")

Fluxly profile Runtime and permissions are inferred by Fluxly static checks, not author declarations or runtime test results.
Domain
Data
Author-declared agents
No explicit declaration found; this is not inferred or tested compatibility
Static check
88 / 100 · heuristic scan, not runtime safety proof
Runtime evidence
Not run; no isolated runtime test evidence is currently recorded
Author / version / license
@databricks-solutions · no license declared
Token usage
Lean
Setup complexity
Guided setup
External API key
Not required
Operating systems
Unspecified (assume cross-platform)
Runtime requirements
Python
Detected file/system behavior
  • Read-only
  • Write / modify
  • Shell exec
  • Env read
Network behavior
Local-only
Install commands
None (reference only)

Heads up: Tool permissions are not declared; actual access depends on the runtime.

Output preview skill-test-databricks-solutions.preview
# Quick Examples

/skill-test databricks-spark-declarative-pipelines run
/skill-test databricks-spark-declarative-pipelines add --trace
/skill-test databricks-spark-declarative-pipelines review --batch --filter-success
/skill-test my-new-skill init

Discussion

Powered by GitHub Discussions. Sign in with GitHub to comment, react, or subscribe.