sn da excel workflow

Data Community

Skill notes

Step 1 — Count rows across all sheets (lightweight, no full load)

Count rows per sheet without loading data into memory. Use openpyxl read_only mode — this works for any file size. ⚠️ Do NOT use pd.read_excel() to count rows — it loads all data into memory, which will OOM on large files. → capability: excel-reading/multi-sheet-reading

Step 2 — Large file gate (CRITICAL — choose strategy by row count)

total_rows · Strategy · What to do < 10k · Direct read · df = pd.read_excel(file_path, sheet_name=target_sheet) 10k – 100k · Parquet cache · pd.read_excel() once → df.to_parquet() → all later reads from Parquet >= 100k · STOP. Load sn-da-large-file-analysis skill · Read its SKILL.md, then follow its streaming read + Parquet pattern. Do NOT use pd.read_excel() at all — it will OOM or timeout on 100k+ rows.

Step 3 — Inspect schema & data types

Preview target sheet structure. For large files (>= 10k rows), only read a small sample — never full load just to inspect. → capability: excel-reading/range-reading

Step 4 — Data cleaning

Handle missing values, normalize text, clean invalid characters. ⚠️ Large file rule: When total_rows >= 100k, do NOT use df.apply(lambda...). Use vectorized operations or np.where() instead. See sn-da-large-file-analysis skill for the vectorized cheat sheet. → capabilities:

Step 5 — Filter & extract

Apply condition or category filters, aggregate results. → capabilities: excel-data-filtering/condition-filtering excel-data-filtering/category-filtering excel-data-filtering/threshold-filtering

Fluxly profile Runtime and permissions are inferred by Fluxly static checks, not author declarations or runtime test results.
Domain
Data
Author-declared agents
No explicit declaration found; this is not inferred or tested compatibility
Static check
88 / 100 · heuristic scan, not runtime safety proof
Runtime evidence
Not run; no isolated runtime test evidence is currently recorded
Author / version / license
@OpenSenseNova · no license declared
Token usage
Lean
Setup complexity
Guided setup
External API key
Not required
Operating systems
Unspecified (assume cross-platform)
Runtime requirements
Python
Detected file/system behavior
  • Read-only
  • Shell exec
Network behavior
Local-only
Install commands
None (reference only)

Heads up: Tool permissions are not declared; actual access depends on the runtime.

Output preview sn-da-excel-workflow.preview
# Step 6 — Export results

output_path = "/mnt/data/result.xlsx"
result_df.to_excel(output_path, index=False)
print(f"[Download](sandbox:{output_path})")

Discussion

Powered by GitHub Discussions. Sign in with GitHub to comment, react, or subscribe.