axiom analyze test failures

AI Community

Skill notes

Your Mission

Analyze the codebase to find patterns that cause flaky tests, focusing on: Swift Testing async patterns (missing confirmation, wrong waits) Swift 6 concurrency issues (@MainActor missing) Parallel execution races (shared state, missing .serialized) Timing-dependent assertions

Files to Scan

Include: *Tests.swift, *Test.swift, /*Tests/*.swift Skip: */Pods/*, */Carthage/*, */.build/*, */DerivedData/*, */scratch/*, */docs/*, */.claude/*, */.claude-plugin/*

Pattern 1: Missing await confirmation (CRITICAL)

Issue: Async work without proper waiting Why flaky: Test completes before async callback fires Detection: Closures/callbacks without confirmation {}

Pattern 2: @MainActor Missing on UI Tests (CRITICAL)

Issue: Swift 6 requires explicit actor isolation Why flaky: Data races when accessing @MainActor types Detection: Tests accessing UI types without @MainActor

Pattern 3: Shared Mutable State in @Suite (HIGH)

Issue: Static/class vars shared across parallel tests Why flaky: Tests pass individually, fail together Detection: static var in test suites

Fluxly profile Runtime and permissions are inferred by Fluxly static checks, not author declarations or runtime test results.
Domain
AI
Author-declared agents
No explicit declaration found; this is not inferred or tested compatibility
Static check
94 / 100 · heuristic scan, not runtime safety proof
Runtime evidence
Not run; no isolated runtime test evidence is currently recorded
Author / version / license
@CharlesWiltgen · MIT
Token usage
Moderate
Setup complexity
Guided setup
External API key
Not required
Operating systems
Unspecified (assume cross-platform)
Runtime requirements
No explicit requirements detected
Detected file/system behavior
  • Read-only
  • Write / modify
  • Shell exec
Network behavior
External requests
Install commands
None (reference only)

Heads up: Tool permissions are not declared; actual access depends on the runtime.

01
Step 1: Find All Test Files

Use Glob: `/*Tests.swift`, `/*Test.swift`

02
Step 2: Search for Flaky Patterns

Pattern 1 - Missing confirmation: Pattern 2 - Missing @MainActor: Pattern 3 - Shared mutable state: Pattern 4 - Task.sleep in tests: Pattern 5 - Missing .serialized:

03
Step 3: Read Context and Verify

For each match: Read surrounding context (20 lines) Verify it's a real issue (not false positive) Check if fix is already present

Discussion

Powered by GitHub Discussions. Sign in with GitHub to comment, react, or subscribe.