instrument
- Repo stars 0
- Author updated Live
- Author repo skills-registry
- Domain
- AI
- Compatible agents
-
- Claude Code
- Cursor
- Cline
- Codex
- Windsurf
- Gemini CLI
- +20
- Trust score
- 88 / 100 · community maintained
- Author / version / license
- @tomevault-io · no license declared
- Token usage
- Moderate
- Setup complexity
- Manual integration
- External API key
- Required · Vendor-specific
- Operating systems
- macOS · Linux · Windows
- Runtime requirements
- Python
- Permissions
-
- Read-only
- Write / modify
- Shell exec
- Env read
- Network behavior
- External requests
- Install commands
- 26 variants
Profile is derived at build time from SKILL.md and install vectors. Subject to drift from author intent.
Heads up: 未限定 allowed-tools,默认拥有全部工具权限。
---
name: instrument
description: Add Opik tracing to an existing codebase. Detects language (Python/TypeScript), identifies LLM f…
category: ai
runtime: Python
---
# instrument output preview
## PART A: Task fit
- Use case: Add Opik tracing to an existing codebase. Detects language (Python/TypeScript), identifies LLM frameworks, adds appropriate decorators and integrations, marks entrypoints, and wires up environment config. Use for "instrument my code", "add opik tracing", "add observability", or "trace my agent". Use when this capability is needed..
- Inputs: target material, constraints, expected output, and acceptance criteria.
- Evidence boundary: follow “Step 1 — Scope / Step 2 — Detect Language & Frameworks / Step 3 — Identify the Call Graph” and do not present inference as author intent.
## PART B: Execution result
- **01** The card summarizes the use case; runtime output centers on “Add Opik tracing to an existing codebase. Detects language (Python/TypeScript), identifies LLM frameworks, adds appropriate decorators and integrations, marks entrypoints, and wires up environment config. Use for "instrument my code", "add opik tracing", "add observability", or "trace my agent". Use when this capability is needed.”.
- **02** When the source has headings, the agent prioritizes “Step 1 — Scope / Step 2 — Detect Language & Frameworks / Step 3 — Identify the Call Graph” so the result follows the author’s structure.
- **03** Typical output includes task judgment, concrete steps, required commands or file edits, validation, and follow-up options.
- **04** Risk context follows the fingerprint: read files, write/modify files, run shell commands, read environment variables; may access external network resources; requires Vendor-specific API keys.
## Running Rules
- read files, write/modify files, run shell commands, read environment variables; may access external network resources; requires Vendor-specific API keys.
- Validate with a small sample before expanding scope.
- Return the result, validation criteria, and next iteration options. The source mentions slash commands such as `/opik`, `/api`; use them first when your agent supports command triggers.
Name target files or source material, expected output, forbidden changes, and whether network or shell access is allowed. Permission fingerprint: read files, write/modify files, run shell commands, read environment variables.
Start with a small task and check whether the result follows “Step 1 — Scope / Step 2 — Detect Language & Frameworks / Step 3 — Identify the Call Graph”. Inspect diffs, logs, previews, or tests before expanding scope.
Confirm the final output includes a concrete result, evidence, and next action. If it stays generic, tighten inputs, boundaries, and acceptance criteria.
---
name: instrument
description: Add Opik tracing to an existing codebase. Detects language (Python/TypeScript), identifies LLM f…
category: ai
source: tomevault-io/skills-registry
---
# instrument
## When to use
- Add Opik tracing to an existing codebase. Detects language (Python/TypeScript), identifies LLM frameworks, adds approp…
- Use it when the task has clear inputs, repeatable steps, and validation criteria.
## What to provide
- Target material, scope, expected result, and forbidden changes.
- Whether network, commands, file writes, or external services are allowed.
## Execution rules
- Organize steps around “Step 1 — Scope / Step 2 — Detect Language & Frameworks / Step 3 — Identify the Call Graph” and keep inference separate from source facts.
- read files, write/modify files, run shell commands, read environment variables; may access external network resources; requires Vendor-specific API keys.
- Validate with a small sample before expanding the task.
## Output requirements
- Return the deliverable, key evidence, validation method, and next action.
- Mark missing information as unknown; do not invent commands, platforms, or dependencies. The author source anchors workflow facts; repository files anchor sources and commands; Fluxly only adds fit, limitations, and quality judgment.
skill "instrument" {
input -> user goal + target files + boundaries + acceptance criteria
context -> Step 1 — Scope / Step 2 — Detect Language & Frameworks / Step 3 — Identify the Call Graph
rules -> SKILL.md triggers / order / output contract
runtime -> Python | read files, write/modify files, run shell commands, read environment variables | may access external network resources
guardrails -> requires Vendor-specific API keys + small-sample validation + diff/log review
output -> copyable result + checklist + next iteration
} Instrument — Add Opik Tracing to a Codebase
You are instrumenting an existing codebase with Opik observability. Follow these steps precisely.
Step 1 — Scope
If $ARGUMENTS is provided, scope your work to those files or directories. Otherwise, discover the project root and instrument the main application code.
Step 2 — Detect Language & Frameworks
Scan the codebase to determine:
- Language: Python (look for
*.py,pyproject.toml,requirements.txt) or TypeScript (look for*.ts,*.tsx,package.json) - LLM frameworks in use — search imports for these patterns:
| Import pattern | Framework | Integration |
|---|---|---|
from openai / import OpenAI |
OpenAI | track_openai |
import anthropic |
Anthropic | track_anthropic |
from langchain / @langchain |
LangChain | OpikTracer callback |
from langgraph |
LangGraph | OpikTracer with graph= |
from crewai |
CrewAI | track_crewai |
import dspy |
DSPy | OpikCallback |
from google … genai |
Google Gemini | track_genai |
import boto3 … bedrock |
AWS Bedrock | track_bedrock |
from llama_index |
LlamaIndex | LlamaIndexCallbackHandler |
import litellm |
LiteLLM | OpikLogger callback |
from pydantic_ai |
Pydantic AI | Logfire OTLP bridge |
from opik.integrations.adk / from google.adk |
Google ADK | track_adk_agent_recursive |
import ollama |
Ollama | track_openai with localhost base_url or manual @opik.track |
from agents import / from openai.agents |
OpenAI Agents SDK | OpikTracingProcessor |
from haystack |
Haystack | OpikConnector |
opik-openai / trackOpenAI (TS) |
OpenAI (TS) | trackOpenAI |
opik-vercel / OpikExporter (TS) |
Vercel AI SDK | OpikExporter |
opik-langchain / OpikCallbackHandler (TS) |
LangChain.js | OpikCallbackHandler |
opik-gemini / trackGemini (TS) |
Gemini (TS) | trackGemini |
- Existing Opik usage — check if
opikor@opik.trackis already imported. If so, audit rather than re-instrument.
Step 3 — Identify the Call Graph
Find:
- Entrypoint: the top-level function that kicks off the agent (e.g.,
main,run,agent,handle_message, a route handler, or whatever the user's main orchestration function is) - LLM call sites: functions that call an LLM provider directly
- Tool functions: retrieval, search, API calls, or other tool-like operations
- Existing config classes: dataclasses, Pydantic models, or plain classes holding model names, temperatures, prompts, or other tunable parameters
Entrypoint Parameter Rules
The function marked with entrypoint=True must only accept primitive-typed parameters: str, int, float, bool, and list/dict of primitives. This is because:
- Opik reads the function's type hints to build an input form in the UI
- Users will type these values manually in a text field via the Local Runner
- Complex types (Pydantic models, dataclasses, request objects, custom classes) cannot be entered in a UI input field
If the candidate entrypoint accepts complex types (e.g., a request model, a config object, a dataclass):
- Look higher in the call chain for a function that already accepts primitives
- If none exists, create a thin wrapper function that accepts only primitives, unpacks them, and calls the original function. Move the
entrypoint=Truedecorator to this wrapper.
Example — bad entrypoint (complex parameter):
# ❌ DO NOT mark this as entrypoint — RecommendRequest is a Pydantic model
@app.post("/recommend")
async def recommend(request: RecommendRequest):
summary, tool_results = await run_agent(user_message=build_user_message(request))
return RecommendResponse(city=request.city, recommendations=_extract_recommendations(tool_results), summary=summary)
Example — good entrypoint (primitives only):
@opik.track(name="recommend-agent", entrypoint=True)
async def _run_entrypoint(user_message: str) -> tuple[str, list[dict]]:
"""Opik entrypoint — receives only the user message for Local Runner schema."""
return await run_agent(user_message=user_message)
@app.post("/recommend")
async def recommend(request: RecommendRequest):
summary, tool_results = await _run_entrypoint(user_message=build_user_message(request))
return RecommendResponse(city=request.city, recommendations=_extract_recommendations(tool_results), summary=summary)
The wrapper extracts the primitive values from the complex object and delegates to the existing logic. The HTTP handler calls the wrapper instead of the inner function directly, so the trace captures the full execution.
Step 4 — Add Framework Integrations
For each detected framework, add the appropriate integration at the module level. See the integration table above and references/integrations.md for the exact patterns.
Python examples:
# OpenAI
from opik.integrations.openai import track_openai
client = track_openai(OpenAI()) # wrap existing client
# Anthropic
from opik.integrations.anthropic import track_anthropic
client = track_anthropic(anthropic.Anthropic())
# LangChain / LangGraph
from opik.integrations.langchain import OpikTracer
tracer = OpikTracer()
# pass config={"callbacks": [tracer]} to invoke()
# LiteLLM inside @opik.track — CRITICAL: pass span context
from opik.opik_context import get_current_span_data
# in every litellm.completion() call, add:
# metadata={"opik": {"current_span_data": get_current_span_data()}}
TypeScript examples:
// OpenAI
import { trackOpenAI } from "opik-openai";
const trackedClient = trackOpenAI(openai);
// Vercel AI SDK
import { OpikExporter } from "opik-vercel";
// set up NodeSDK with OpikExporter
Step 5 — Add @opik.track Decorators (Python) or Client Tracing (TypeScript)
Python
Add import opik at the top of each file you instrument.
| Function role | Decorator |
|---|---|
| Entrypoint (top-level agent) | @opik.track(entrypoint=True, name="<agent-name>") |
| LLM call | @opik.track(type="llm") |
| Tool / retrieval | @opik.track(type="tool") |
| Guardrail / validation | @opik.track(type="guardrail") |
| Other helper in the call chain | @opik.track |
- Entrypoint parameters must be primitives only (
str,int,float,bool,list,dict). If the natural entrypoint takes a complex type, create a wrapper — see Step 3 "Entrypoint Parameter Rules". - Config access must happen inside
@opik.track: Any call toclient.get_or_create_config()and subsequent access of config fields must occur inside a@opik.track-decorated function, or in a function called downstream from one. This is how Opik injects config metadata into the current trace. Calling it at module level or outside the traced call stack will raise an error. - Place the decorator above any existing decorators (e.g., above
@app.route) - For async functions,
@opik.trackworks the same way — no changes needed - If the function is a script entrypoint (not a long-running server), add
opik.flush_tracker()after the top-level call
TypeScript
Use the client-based approach:
import { Opik } from "opik";
const client = new Opik({ projectName: "<project-name>" });
// In the entrypoint function:
const trace = client.trace({ name: "<agent-name>", input: { ... } });
const span = trace.span({ name: "<operation>", type: "tool", input: { ... } });
// ... logic
span.end({ output: { ... } });
trace.end({ output: { ... } });
await client.flush();
For entrypoints that should be discoverable by opik connect — note that params must only use primitive types (string, number, boolean) since users enter these values in a UI text field:
import { track } from "opik";
const myAgent = track(
{ name: "<agent-name>", entrypoint: true, params: [{ name: "query", type: "string" }] },
async (query: string) => { /* ... */ }
);
Step 6 — Conversational Agents: Add thread_id
If the agent handles multi-turn conversations (chat bots, support agents, multi-step assistants), wire thread_id:
@opik.track(entrypoint=True)
def handle_message(session_id: str, message: str) -> str:
opik.update_current_trace(thread_id=session_id)
return generate_response(session_id, message)
Skip this for single-shot agents or batch processing.
Step 7 — Environment Config
Follow the setup decision tree from the main opik skill:
- If the project has
.env/.env.local→ appendOPIK_API_KEY,OPIK_WORKSPACE,OPIK_URL_OVERRIDE(if missing) - If no
.envexists → Python: create/update~/.opik.config; TypeScript: create.envor.env.local - Never introduce a second config mechanism
- Never overwrite existing values
- Update
.env.example/.env.sampleif one exists - Set
project_namein code, not in env files
OPIK_URL_OVERRIDE path rules
The URL suffix depends on where Opik is hosted:
| Deployment | URL format | Example |
|---|---|---|
| Opik Cloud / managed | <base>/opik/api |
https://www.comet.com/opik/api |
| Self-hosted (local) | <base>/api |
http://localhost:5173/api |
- Cloud/managed: always append
/opik/api - Self-hosted (typically
localhostor an internal hostname): append only/api— no/opikprefix - When writing or suggesting an
OPIK_URL_OVERRIDEvalue, apply this rule so users don't have to remember it
Step 8 — Install Dependencies
Print the install command but do NOT run it automatically. Let the user decide.
Python:
pip install opik
Plus any integration packages if needed (most are included in opik).
TypeScript:
npm install opik
Plus framework-specific packages: opik-openai, opik-vercel, opik-langchain, opik-gemini as needed.
Step 9 — Verify
After instrumentation, do a quick audit:
- Every LLM call site is traced (via integration wrapper or
@opik.track) - Exactly one function has
entrypoint=True - The entrypoint function accepts only primitive parameters (
str,int,float,bool,list,dict) — no Pydantic models, dataclasses, or custom classes - All
get_or_create_config()calls and config field access happen inside@opik.track-decorated functions (or downstream from one) - Script entrypoints call
opik.flush_tracker()(Python) orawait client.flush()(TypeScript) - LiteLLM calls inside
@opik.trackpasscurrent_span_datavia metadata - No hardcoded API keys were introduced
- Existing tests still import correctly (no circular imports introduced)
Anti-Patterns to Avoid
- Double-wrapping: Don't add
@opik.track(type="llm")to a function that already uses a framework integration (e.g.,track_openai). The integration handles tracing. - Orphaned LiteLLM traces: Always pass
current_span_datawhenOpikLoggeris used inside@opik.trackcode. - Complex entrypoint parameters: The entrypoint function must only accept primitives (
str,int,float,bool,list,dict). Pydantic models, dataclasses, or custom classes can't be typed into a UI input field. If the natural entrypoint takes a complex type, create a thin wrapper that accepts primitives. - Config access outside
@opik.track:get_or_create_config()and config field reads must happen inside a@opik.track-decorated function or downstream from one. Module-level or untraced calls will fail and won't attach config metadata to the trace. - Missing entrypoint: Without
entrypoint=True, Local Runner (opik connect) won't discover the agent. - Missing flush: Scripts that exit without flushing lose trace data.
- Overwriting config: Check before writing to
.envor~/.opik.config.
References
For detailed API signatures and advanced patterns, see:
../opik/references/tracing-python.md— Python SDK reference../opik/references/tracing-typescript.md— TypeScript SDK reference../opik/references/integrations.md— All framework integrations../opik/references/observability.md— Core concepts (traces, spans, threads)
Source: comet-ml/opik-skills — distributed by TomeVault.
Decide Fit First
Design Intent
How To Use It
Boundaries And Review