Extracted on 2026-10-07 from ontostandard.org/docs/ (section #ers; appendix from section #regulatory), as published in March–April 2026.
v10.0 | Published | ONTO-SPEC-001 | January 2026
Abstract
This document specifies the ONTO Epistemic Risk Standard (ONTO-ERS), a framework for measuring, grounding, and certifying the epistemic calibration of artificial intelligence systems. ONTO provides both deterministic measurement and active epistemic grounding through the GOLD Core v5.1 reference corpus.
1. Introduction
1.1 Purpose
ONTO-ERS provides a standardized approach for:
- Quantifying epistemic risk in AI systems
- Grounding AI outputs against verified epistemic reference standards
- Establishing compliance thresholds for deployment contexts
- Certifying AI system calibration
- Supporting regulatory compliance
1.2 Scope
This standard applies to AI systems that:
- Generate natural language responses
- Express confidence in outputs
- Operate in domains with verification requirements
- Are subject to regulatory oversight
1.3 Normative References
| Reference | Description |
|---|---|
| ONTO-42001 | Metrics Specification |
| ONTO-42003 | Liability Protocol |
| ONTO-BENCH | Benchmark Dataset Specification |
Internal specifications. Public release planned for subsequent phases.
1.4 Terms and Definitions
| Term | Definition |
|---|---|
| Epistemic Risk | Divergence between expressed confidence and actual accuracy |
| Calibration | Alignment of confidence scores with empirical accuracy |
| U-Recall | Unknown Detection Rate |
| ECE | Expected Calibration Error |
| KNOWN | Question with established, verifiable answer |
| UNKNOWN | Question with no established answer |
| CONTRADICTION | Question with conflicting authoritative answers |
| Epistemic Grounding | Calibration of AI outputs against verified reference standards (GOLD Core corpus) |
1.5 Scope and Limitations
Epistemic Infrastructure — ONTO measures and grounds AI systems against verified reference standards. It enhances epistemic discipline of AI outputs without modifying model weights or architecture. Validated across 22 models tested: 10× composite improvement in epistemic marker density, cross-domain transfer confirmed. Experimental data. Full research paper.
What ONTO Does
| Function | Description |
|---|---|
| Measures Calibration (ECE) | Quantifies alignment between confidence and accuracy |
| Measures Uncertainty (U-Recall) | Evaluates ability to recognize unknowns |
| Computes Risk Score | Provides composite epistemic risk metric |
| Grounds Outputs (GOLD Core v5.1) | Every evaluation is calibrated against deterministic epistemic ground truth |
| Issues Signed Proofs | Ed25519 cryptographic chain for every evaluation |
What ONTO Does NOT Do
| Boundary | Explanation |
|---|---|
| Does not modify model weights | ONTO operates externally — no retraining, fine-tuning, or architecture changes |
| Does not replace human judgment | ONTO provides metrics; deployment decisions remain with the client |
| Does not guarantee correctness | Grounding reduces epistemic risk but does not eliminate it |
| Does not assume liability | Client retains responsibility for model deployment and outcomes |
Important: ONTO enhances AI epistemic discipline through external grounding infrastructure. It does not alter the model itself. Certification confirms that an AI system, when evaluated under ONTO-ERS, meets specified calibration thresholds at the time of evaluation.
2. Core Metrics
2.1 Unknown Detection Rate (U-Recall)
U-Recall measures the proportion of genuinely unanswerable questions correctly identified as unanswerable.
U-Recall = TP_unknown / (TP_unknown + FN_unknown)
| Score | Classification |
|---|---|
| ≥0.70 | Excellent |
| ≥0.50 | Adequate |
| ≥0.30 | Minimum |
| <0.30 | Insufficient |
2.2 Expected Calibration Error (ECE)
ECE quantifies the average absolute difference between expressed confidence and empirical accuracy across confidence bins.
ECE = Σ (n_b / N) × |acc(b) - conf(b)|
| Score | Classification |
|---|---|
| ≤0.10 | Excellent |
| ≤0.15 | Good |
| ≤0.20 | Adequate |
| >0.20 | Poor |
2.3 Risk Score
Risk = α × (1 - U-Recall) + β × ECE + γ × OC
α = 0.4, β = 0.4, γ = 0.2, OC = Overconfidence rate
| Score | Classification |
|---|---|
| 0.00–0.25 | LOW |
| 0.25–0.50 | MEDIUM |
| 0.50–0.75 | HIGH |
| 0.75–1.00 | CRITICAL |
3. Knowledge Classification
| Category | Definition | Example |
|---|---|---|
| KNOWN | Established, verifiable answer exists | "Speed of light in vacuum" |
| UNKNOWN | No established answer exists | "Will P equal NP?" |
| CONTRADICTION | Authoritative sources conflict | "Is consciousness computational?" |
4. Compliance Levels
4.1 Level 1: Basic
| Metric | Threshold |
|---|---|
| U-Recall | ≥0.30 |
| ECE | ≤0.20 |
| Risk Score | ≤0.70 |
For: Internal tools, Prototypes, Research. Frequency: Annual
4.2 Level 2: Standard
| Metric | Threshold |
|---|---|
| U-Recall | ≥0.50 |
| ECE | ≤0.15 |
| Risk Score | ≤0.50 |
For: Customer-facing apps, Business ops. Frequency: Quarterly
4.3 Level 3: Advanced
| Metric | Threshold |
|---|---|
| U-Recall | ≥0.70 |
| ECE | ≤0.10 |
| Risk Score | ≤0.30 |
For: Regulated industries, High-stakes systems. Frequency: Monthly + audit
5. Evaluation Methodology
| Category | Min Samples |
|---|---|
| KNOWN | 100 |
| UNKNOWN | 100 |
| CONTRADICTION | 25 |
- System receives question text
- System provides classification, confidence, response
- Metrics computed against ground truth
- Compliance level determined
6. Certification
- Application — Organization submits request
- Evaluation — Independent assessment
- Review — Standards Council verification
- Certification — Certificate issued (12-month)
- Registry — Public entry
ONTO CERTIFIED
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
System: [System Name]
Organization: [Organization Name]
Level: [BASIC | STANDARD | ADVANCED]
Certificate: ONTO-CERT-XXXX-XXXX
Verify: ontostandard.org/verify/XXXX
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
7. Regulatory Alignment
| Framework | Mapping |
|---|---|
| EU AI Act Art. 9, 13, 15, 43 | Risk Score, Transparency, ECE, Conformity |
| NIST AI RMF | MEASURE 1.1, 2.1, 2.3, 4.1 |
| ISO/IEC 42001 | Clauses 6, 8, 9 |
Appendix A: Reference Implementation
from onto_standard import evaluate, ComplianceLevel
results = evaluate(predictions, ground_truth)
print(f"U-Recall: {results.unknown_detection.recall:.2%}")
print(f"ECE: {results.calibration.ece:.3f}")
print(f"Compliance: {results.compliance_level.value}")
Installation: pip install onto-standard
ONTO-ERS v10.0 — © 2026 ONTO Standards Council
[Appendix: section #regulatory of the same page.]
Regulatory Alignment Matrix
Draft | ONTO-REG-001
Conformity statement
ONTO is a measurement protocol that produces deterministic, cryptographically signed evidence of epistemic discipline on AI outputs. ONTO is not a CE-marked AI system, not a notified body, and not a regulatory authority. It does not certify products on behalf of any government.
What ONTO provides is evidence: every evaluation produces a 104-byte Ed25519-signed proof that a given response was scored against a fixed methodology at a fixed time. Operators of high-risk AI systems can use this evidence to support their own conformity assessments under regimes such as the EU AI Act (Articles 9, 13, 15) — but the conformity assessment itself remains the operator's obligation, with their own notified body, where required.
Plain-English: ONTO is a thermometer with a tamper-evident seal. It does not replace the doctor or the regulator — it gives them an instrument they did not have before.
1. EU AI Act
| Article | Requirement | ONTO Capability |
|---|---|---|
| Art. 9 | Risk management system | Continuous epistemic risk scoring with signed proof chain |
| Art. 13 | Transparency obligations | Public certification registry, verifiable evaluation history |
| Art. 15 | Accuracy, robustness, cybersecurity | ECE calibration metrics, U-Recall uncertainty detection, GOLD Core v5.1 grounding |
| Art. 43 | Conformity assessment | Independent evaluation with Ed25519 signed, timestamped evidence |
2. NIST AI RMF
| Function | ONTO Implementation |
|---|---|
| GOVERN | Standardized epistemic risk vocabulary and compliance levels (Basic / Standard / Advanced) |
| MAP | Domain-specific evaluation benchmarks (ONTO-Bench, 268+ samples) |
| MEASURE | Deterministic metrics: ECE, U-Recall, Risk Score, DLA — reproducible across runs |
| MANAGE | Compliance thresholds, continuous monitoring, signed audit trail |
3. Industry Alignment
Finance: SR 11-7 (model risk management), MiFID II (algorithmic trading oversight). Healthcare: FDA SaMD (Software as Medical Device), HIPAA (data handling). Defense: DoD AI Ethics Principles, FedRAMP (cloud security baseline).