Methodology Over Marketing

Why trust
Evidalux?

Most audit products say "we have dozens of checks." We say how each one decided, how sure it is, and what it cannot prove — on every finding, in every report. A compliance scan that hides its uncertainty is worse than no scan.

35
Compliance checks, each stating the rule it is based on
6
Confidence levels — including "cannot be verified by any tool"
6
Official sources the regulation radar reads: EUR-Lex, EDPB, GOV.UK, legislation.gov.uk, US Federal Register, Canada OPC
Never
A report that says "your site is compliant" — we don't issue certificates
How we measure

Where an outside reference exists, we use it

A regression corpus pins every check's behaviour, but we write those fixtures ourselves, so it is a build gate — not evidence. What can tell you something is a measurement we do not control.

The method

Accessibility runs on the industry's own engine

WCAG checks are executed by axe-core — the same open-source engine auditors and browser dev tools use — driven through a real browser, not a static parser. A rule that axe cannot decide is reported as undecided rather than guessed, and the EAA view is a mapping of those results onto the Act's requirements, not a second opinion about them.

  • ✓ Rendered in a real browser, so JavaScript-built pages are measured as users get them
  • ✓ Consent-management findings are checked against the published IAB TCF vendor list
  • ✓ A site that blocks the scanner is marked invalid — no score is produced from a page we never saw

What this does not prove. Most compliance questions have no industry reference tool to score against — there is no axe-core for "is this privacy notice adequate". For those checks "as accurate as the leader" is not a claim anyone can make, us included, which is why each finding carries its own confidence level instead. Automated accessibility testing also reaches roughly a third of WCAG: the rest needs a person, and the report says so rather than implying a clean scan means a compliant site.

On the roadmap

None of these run today — they are design notes, listed so the gap is visible rather than implied. The one thing below that is real is the confidence label, and it ships on every finding.

○Mutation Testing — controlled degradation, blind-spot detection (monthly)
○Adversarial Test Suite — pages designed to fool the plugin
○Determinism Check — 10× rerun on LLM plugins, Cohen's κ
○Inter-Rater (3 LLMs) — GPT-4o + Claude Opus + Gemini majority vote
○Public Benchmark — W3C ACT-rules, IAB CMP Validator, SchemaOrg test corpus
○Regulatory Expert Panel — biannual external counsel (GDPR + EAA) review
○Drift Detection — daily 3σ deviation alerts on finding rate
○Customer False-Positive Loop — "Is this wrong?" button → fixture feedback
✓Confidence Taxonomy — every finding gets a VERIFIED/DETECTED/SUSPECTED badge (this one is live)
Confidence Taxonomy

Every finding's epistemic status is disclosed

Saying "this is compliant, this isn't" isn't enough. How the finding was produced is always visible in the report. The user can answer "how much should I trust this?" from the report itself.

🟢
VERIFIED HTTP/DNS/TLS handshake parse, JSON-LD parse, header read. Deterministic, no judgment.
🟡
DETECTED DOM regex, heuristic substring, HEAD probe. Tolerance margin exists.
🟠
SUSPECTED LLM response interpretation, vision-LLM screenshot review, NLP semantic claim.
⚪
INCONCLUSIVE Plugin ran but data is insufficient. Tells the user "rerun this scan."
🔍
MANUAL_REQUIRED Plugin can't audit; human review needed. Saying "automated check not possible" is honesty.
⚫
OUT_OF_SCOPE Plugin not applicable. E.g. an EU-only plugin is skipped on a US-only site.

Every finding's JSON output also carries mandatory method (how it was measured), limitations (caveats), and evidence.guidelines (regulator reference) fields. When an auditor asks "how did you produce this finding?" the answer comes straight from the report.

Transparency principle

Nothing to hide

Everything below is in the report you get, not a promise about our internal process.

Every finding names its rule

A finding cites the article or guideline it rests on and whether that source is binding, quasi-binding or guidance. You can check our reading against the text instead of taking our word for it.

Every finding admits its method

How the check decided — parsed header, DOM pattern, rendered browser, language model — and the limitations of that method, printed next to the result rather than buried in documentation.

A blocked scan scores nothing

If a bot challenge or an error page stands between us and the site, the run is marked invalid. No score is produced from a page nobody saw — an empty finding list is not a clean bill of health.

No certificates

Every report opens with the same sentence: this is not a compliance certificate. It is what an automated scanner observed at one moment, and the decisions stay yours and your counsel's.

Methodology over marketing

What each check decided, how sure it is, and what it cannot prove — on the finding, not in a footnote.

What we check Regulation Radar