agent academy report

Data Community

Skill notes

Folder Structure

The workspace folder should be organized as follows: If the user provides a workspace path, use it. Otherwise, ask for it.

Overview

The report generation has 6 phases: Extract feedback from Excel files and GitHub issues Analyze sentiment using keyword-based scoring Generate charts with matplotlib Build markdown files (management summary + detailed analysis)

Phase 1: Extract Feedback

Run scripts/extract_feedback.py: This script: Reads all .xlsx files from <workspace>/report/data/ Maps filenames to human-readable course names Extracts feedback text, completion dates, and respondent names/emails

GitHub Issues (Operative & Recruit)

After running the extract script, fetch feedback from GitHub issues. Do not use mcp_github_mcp_search_issues — the search API caps results at 1,000, which is insufficient for Recruit (1,390+ issues). Instead, use mcp_github_mcp_list_issues which supports full GraphQL cursor pagination: Recruit issues: Operative issues: Paginate through all pages using the endCursor from each response until hasNextPage is false. The API returns max 100 per page — Recruit requires ~14 pages, Operative ~4 pages. Do not stop early; collect every issue.

Non-Badge GitHub Issues

After collecting badge submission issues, also fetch all other open issues that are NOT badge submissions. These are bug reports, questions, and general feedback that should be classified into the correct course. Fetch issues without the completed labels: Filter out issues that already have recruit-completed or operative-completed labels. For each remaining issue, classify it to a course using this keyword map (match against issue title and labels, case-insensitive):

Fluxly profile Runtime and permissions are inferred by Fluxly static checks, not author declarations or runtime test results.
Domain
Data
Author-declared agents
No explicit declaration found; this is not inferred or tested compatibility
Static check
88 / 100 · heuristic scan, not runtime safety proof
Runtime evidence
Not run; no isolated runtime test evidence is currently recorded
Author / version / license
@microsoft · no license declared
Token usage
Heavy
Setup complexity
Guided setup
External API key
Not required
Operating systems
macOS · Linux
Runtime requirements
Python
Detected file/system behavior
  • Read-only
  • Write / modify
Network behavior
External requests
Install commands
None (reference only)

Heads up: Tool permissions are not declared; actual access depends on the runtime.

01
Phase 1: Extract Feedback

Run `scripts/extract_feedback.py`: This script: Reads all `.xlsx` files from `<workspace>/report/data/` Maps filenames to human-readable course names Extracts feedback text, completion dates, and respondent names/emails

02
Phase 2: Analyze Sentiment

Run `scripts/analyze_sentiment.py`: This script: Reads `<workspace>/report/data/_all_feedback.json` Scores each feedback item using regex-based sentiment analysis (word-boundary `\b` matching, case-insensitive) Detects common themes and adds a `themes` array to each record (list of matched theme names, e.g. `["Hands-on & Practical Learning", "MCP & Agent Development Skills"]`)

03
Phase 3: Generate Charts

Run `scripts/generate_charts.py`: Requires `matplotlib` and `numpy`. Install if needed: `pip3 install matplotlib numpy`. This generates overview charts plus individual per-course charts in `<workspace>/report/charts/` at 180 DPI. Note: Submission/completion charts only count actual submissions (`source: "excel"` and `source: "github_completed"`). Non-badge GitHub issues (`source: "github_issue"`) are excluded from these charts — they are only used for sentiment analysis.

04
Phase 4: Build Markdown

Run `scripts/build_markdown.py`: This generates three markdown files in `<workspace>/report/markdown/`:

05
Phase 5: Export PDF

Run `scripts/export_pdf.py`: Example: `python3 scripts/export_pdf.py "/path/to/workspace/report" "Agent Academy - Report April 2026"` This script: Downloads badge images from `https://raw.githubusercontent.com/microsoft/agent-academy/main/docs/public/images/` to `<workspace>/report/badges/` (if not already present) Builds a single HTML file with:

06
Phase 6: Verify PDF Formatting

After generating the PDF, always open and visually inspect it to check for formatting issues. Use the `view_image` tool or open the PDF to review each page.

Discussion

Powered by GitHub Discussions. Sign in with GitHub to comment, react, or subscribe.