EvidaLux Tools Validation Report
Every run of our 64 audit tools — behaviour lock, agreement with external references, and real-site oracles. Methodology over marketing — bad numbers publish too.
Generated:
2026-05-07T13:51:51.198437+00:00This is an archived snapshot. For the latest, see here.
Section 1 — Cross-Tool Agreement
Diff against industry-reference tools on the same 10-site cohort.
cohort: 2026-05-cohort1median agreement 0.00
Day-1 baseline. Reference tool integrations are stubbed. Real PSI/axe/Observatory/SSL Labs wiring happens next sprint. Honest baseline numbers will appear once integrations land.
| Plugin | Reference tool | Band | Agreement | Agreed / Compared | Comparison metric |
|---|---|---|---|---|---|
axe_wcag | axe-core CLI (Deque) | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
broken_links | linkchecker (W3C) | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
exposed_files | nuclei exposed-panels templates | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
hreflang_validator | hreflang.org | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
iab_tcf | IAB CMP Validator | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
lighthouse_perf | Google PageSpeed Insights API | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
lighthouse_seo | Google PageSpeed Insights API | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
robots_txt_audit | Google robotstxt parser | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
security_headers | Mozilla Observatory API | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
structured_data | Google Rich Results Test API | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
tls_deep | SSL Labs API | RED | 0.00 | 0 / 0 10 of 10 sites unmeasured | — |
Section 2 — Real-World Correctness
Plugin findings on random real sites (US/Europe/Turkey/Arab/South America) scored against a real-browser + HTTP ground truth. Unreachable sites are INCONCLUSIVE (never gate); a gate failure is a false positive/negative on a reachable site.
| Region | When | Verdict | Reachable | Inconclusive | FP | FN |
|---|---|---|---|---|---|---|
| arab, europe, south_america, turkey, us | 2026-07-20 02:41 UTC | FAIL | 86 | 14 | 1 | 0 |
| arab, europe, south_america, turkey, us | 2026-07-19 02:37 UTC | FAIL | 88 | 12 | 1 | 0 |
| arab, europe, south_america, turkey, us | 2026-07-18 20:31 UTC | PASS | 85 | 15 | 0 | 0 |
| arab, europe, south_america, turkey, us | 2026-07-18 19:22 UTC | FAIL | 84 | 16 | 5 | 0 |
| arab, europe, south_america, turkey, us | 2026-07-18 18:18 UTC | PASS | 18 | 7 | 0 | 0 |
| arab, europe, south_america, turkey, us | 2026-07-18 18:00 UTC | FAIL | 20 | 5 | 3 | 0 |
| arab, europe, south_america, turkey, us | 2026-07-18 16:09 UTC | FAIL | 20 | 5 | 44 | 1 |
| arab, europe, south_america, turkey, us | 2026-07-04 06:08 UTC | FAIL | 20 | 5 | 1 | 1 |
| arab, europe, south_america, turkey, us | 2026-07-03 06:20 UTC | FAIL | 19 | 6 | 1 | 1 |
Latest run — 2026-07-20 02:41 UTC
| Plugin | Confirmed | FP | FN | Inconclusive |
|---|---|---|---|---|
accessibility.eaa_mapping | 0 | 0 | 0 | 155 |
compliance.accessibility_statement | 74 | 0 | 0 | 98 |
compliance.age_verification | 0 | 0 | 0 | 86 |
compliance.ai_disclosure | 0 | 0 | 0 | 86 |
compliance.child_consent | 0 | 0 | 0 | 86 |
compliance.cookie_consent | 0 | 0 | 0 | 210 |
compliance.cross_border_transfer | 0 | 0 | 0 | 172 |
compliance.dark_pattern | 86 | 0 | 0 | 172 |
compliance.data_subject_request | 8 | 0 | 0 | 78 |
compliance.dpo_contact | 0 | 0 | 0 | 86 |
compliance.eu_representative | 0 | 0 | 0 | 86 |
compliance.geo_consistency | 0 | 0 | 0 | 172 |
compliance.iab_tcf | 0 | 0 | 0 | 86 |
compliance.iab_tcf_verified | 6 | 0 | 0 | 80 |
compliance.legal_disclosure | 82 | 0 | 0 | 176 |
compliance.odr_link | 86 | 0 | 0 | 0 |
compliance.pay_or_consent_wall | 0 | 0 | 0 | 86 |
compliance.pricing_indication | 0 | 0 | 0 | 172 |
compliance.privacy_policy_content | 36 | 0 | 0 | 116 |
compliance.purchase_disclosure | 0 | 0 | 0 | 172 |
compliance.required_pages | 274 | 0 | 0 | 70 |
quality.api_test | 0 | 0 | 0 | 222 |
security.exposed_files | 157 | 0 | 0 | 13 |
security.headers | 608 | 0 | 0 | 303 |
security.tls_deep | 246 | 1 | 0 | 93 |
seo.broken_links | 38 | 0 | 0 | 28 |
seo.canonical_audit | 51 | 0 | 0 | 4 |
seo.duplicate_content | 0 | 0 | 0 | 85 |
seo.freshness | 34 | 0 | 0 | 28 |
seo.hreflang_validator | 74 | 0 | 0 | 5 |
seo.meta_tags | 158 | 0 | 0 | 0 |
seo.robots_txt_audit | 17 | 0 | 0 | 1 |
seo.sitemap | 84 | 0 | 0 | 3 |
seo.structured_data | 80 | 0 | 0 | 9 |
tech.dns_health | 344 | 0 | 0 | 172 |
tech.stack_detection | 0 | 0 | 0 | 86 |
Wrong findings — latest run (gate)
false_positivesecurity.tls_deep/tls.no_https — https://www.isbank.com.tr/ — TLS handshake succeeded independently