Comparison

Nijam vs Allure Report

Allure Report is a great open-source way to turn a test run into a rich HTML report. Nijam is the hosted dashboard that adds cross-run history, flaky ranking, and team triage for Playwright, pytest, and Vitest, with no report to generate, publish, or retain yourself.

One run vs every run

A hosted dashboard, not a static file

Same test results. One is a report you generate and publish per run; the other is a living dashboard that remembers every run for you.

Why Nijam

Why teams pick Nijam over Allure Report

Everything Allure gives you per run, plus hosting, history, and flakiness, without owning the pipeline.

Hosted, not homework

Allure gives you a static report to generate and publish yourself. Nijam hosts every run automatically, a link per run, with nothing to deploy, publish, or babysit.

History without the glue

Allure trends need a history folder carried between CI runs, which is easy to get wrong. Nijam keeps every run and attempt automatically, no pipeline plumbing.

Flakiness, ranked

Allure flags a test as flaky only if you configure it. Nijam auto-detects flakiness and ranks it per test across every run, on every plan.

A dashboard, not a file

Allure is one report per run. Nijam is a living dashboard across runs, branches, and PRs, so you can watch quality over time instead of opening one report at a time.

AI-ready via MCP

Point your agents at Nijam’s MCP server to ask about failures, flakiness, and history in plain language. A static Allure report has nothing to query.

Zero maintenance

No generate step, no publishing job, no history or retention to manage. Send the results your CI already produces and Nijam takes it from there.

Feature by feature

How they compare for test reporting

Baseline is Allure Report, the open-source reporter, not the paid Allure TestOps product.

Capability
Allure Report
Nijam
Hosting & setup
What it is
An open-source report generator you run in CI
A hosted dashboard, reports upload automatically
Where reports live
A static HTML site you publish and host yourself
Hosted for you, a link per run
Onboarding
Adapter + generate step + publish/retain in CI
Add the reporter, push a run
Maintenance
You own the generate, publish, and history pipeline
Zero, nothing to deploy or retain
History & trends
Cross-run history
Needs a history folder persisted across CI runs
Every run and attempt kept automatically
Trends over time
Limited, only when history is wired up
Built in across runs, branches, and PRs
Flaky detection
Manual flaky marks or config
Auto-detected and ranked per test
Per-test history
The report covers a single run
Every run for a test on one page
Frameworks
Playwright
Adapter available
First-class: attempts, shards, timeline
pytest
Adapter available
First-class plugin
Vitest
Community / generic support
First-class reporter
Playwright trace viewer
Attaches files only
Opens the native Playwright trace
Framework breadth
Adapters for many frameworks
Focused on Playwright, pytest, Vitest
Collaboration
Accounts & orgs
A static report, no accounts
Orgs, members, and roles
Shareable links
Share the hosted static site
A link per run, access-controlled
Slack / GitHub
Not built in
PR checks and Slack alerts
AI / MCP access
None
MCP server for agents
Cost & ops
License
Open source and free
Free tier, then simple credits
Hosted product
Allure TestOps, a paid enterprise product
Hosting included, no separate SKU
Total effort
CI glue, hosting, and retention are on you
Managed end to end
Best for
Teams that want a free per-run report and will run the pipeline
Teams that want hosted history and triage without the ops
First-class
Partial or gated
Not really

Playwright · pytest · Vitest

First-class for the frameworks you report

Deep, hosted support for the three we focus on, with the history and flakiness that a per-run report can’t give you on its own.

Playwright

First-class

Attempts, shards, and a run timeline, plus one click into the native Playwright trace viewer with screenshots and video attached.

pytest

First-class

A lightweight pytest plugin streams results from every CI job. No traces required, and flaky tracking is included from the first run.

Vitest

First-class

A first-class Vitest reporter turns unit and component runs into the same hosted history, flakiness scoring, and failure views as the rest.

Pricing

Free to generate, or hosted for you

Allure Report is free to run yourself; Nijam hosts everything, history and all, for a simple per-report price.

Allure Report
Open source + TestOps
Allure Report is free and open source
You host, publish, and retain reports yourself
Hosted history means Allure TestOps (paid)
The real cost is CI and ops time
Nijam
Hosted, simple credits
Hosting, history, and flaky tracking included
1 credit = one Playwright report
Free forever tier, then $20/mo Pro
No pipeline to build or maintain

FAQ

Questions teams ask us

Give your Allure reports a home

Keep the reports you love and let Nijam host them with cross-run history, flaky ranking, and triage for Playwright, pytest, and Vitest, with no pipeline to build.

Free while you connect your first project · works with GitHub Actions, Jenkins, GitLab CI & CircleCI