Flaky Test Analyzer

Analyze flaky test behavior from GitHub Actions artifacts and prioritize tests by wasted CI time and instability signals.

Developed by Vineet Kumar
Demo disclaimer
This web UI currently supports public GitHub repository URLs for quick evaluation and demo flows.
For private repositories, use the workflow at ci-snippet/flaky-tests.yml (or copy equivalent steps) in your repo CI pipeline, then run this analyzer against generated reports in your controlled environment.
Why this matters: reliable flake detection needs test reruns/repeats; single run per commit usually cannot expose flaky behavior.
Tip: set GITHUB_TOKEN on the server for better API reliability and fewer rate-limit failures.
AI Explain setup (Anthropic)
The Explain button needs ANTHROPIC_API_KEY available to the Flask process.
macOS/Linux: export ANTHROPIC_API_KEY=sk-ant-...
VS Code debug: set ANTHROPIC_API_KEY in .vscode/launch.json under env.
No repo handy? Seed realistic flaky tests to try the dashboard + AI explain.

No flaky tests yet. Fetch a repo or load demo data above (real detection needs more than one run per commit, e.g. reruns).