ONTO
Updated 2026-10-10Contact
ONTO:2603.0009Standard · 2026-04✓ Open

ONTO Epistemic Risk Standard v10.0 with regulatory alignment

Metrics (unknown recall, calibration error, risk score), knowledge classes and compliance levels of the prompt-layer period, with a mapping to EU AI Act, NIST and ISO.

Extracted on 2026-10-07 from ontostandard.org/docs/ (section #ers; appendix from section #regulatory), as published in March–April 2026.

v10.0 | Published | ONTO-SPEC-001 | January 2026

Abstract

This document specifies the ONTO Epistemic Risk Standard (ONTO-ERS), a framework for measuring, grounding, and certifying the epistemic calibration of artificial intelligence systems. ONTO provides both deterministic measurement and active epistemic grounding through the GOLD Core v5.1 reference corpus.


1. Introduction

1.1 Purpose

ONTO-ERS provides a standardized approach for:

  1. Quantifying epistemic risk in AI systems
  2. Grounding AI outputs against verified epistemic reference standards
  3. Establishing compliance thresholds for deployment contexts
  4. Certifying AI system calibration
  5. Supporting regulatory compliance

1.2 Scope

This standard applies to AI systems that:

  • Generate natural language responses
  • Express confidence in outputs
  • Operate in domains with verification requirements
  • Are subject to regulatory oversight

1.3 Normative References

Reference Description
ONTO-42001 Metrics Specification
ONTO-42003 Liability Protocol
ONTO-BENCH Benchmark Dataset Specification

Internal specifications. Public release planned for subsequent phases.

1.4 Terms and Definitions

Term Definition
Epistemic Risk Divergence between expressed confidence and actual accuracy
Calibration Alignment of confidence scores with empirical accuracy
U-Recall Unknown Detection Rate
ECE Expected Calibration Error
KNOWN Question with established, verifiable answer
UNKNOWN Question with no established answer
CONTRADICTION Question with conflicting authoritative answers
Epistemic Grounding Calibration of AI outputs against verified reference standards (GOLD Core corpus)

1.5 Scope and Limitations

Epistemic Infrastructure — ONTO measures and grounds AI systems against verified reference standards. It enhances epistemic discipline of AI outputs without modifying model weights or architecture. Validated across 22 models tested: 10× composite improvement in epistemic marker density, cross-domain transfer confirmed. Experimental data. Full research paper.

What ONTO Does

Function Description
Measures Calibration (ECE) Quantifies alignment between confidence and accuracy
Measures Uncertainty (U-Recall) Evaluates ability to recognize unknowns
Computes Risk Score Provides composite epistemic risk metric
Grounds Outputs (GOLD Core v5.1) Every evaluation is calibrated against deterministic epistemic ground truth
Issues Signed Proofs Ed25519 cryptographic chain for every evaluation

What ONTO Does NOT Do

Boundary Explanation
Does not modify model weights ONTO operates externally — no retraining, fine-tuning, or architecture changes
Does not replace human judgment ONTO provides metrics; deployment decisions remain with the client
Does not guarantee correctness Grounding reduces epistemic risk but does not eliminate it
Does not assume liability Client retains responsibility for model deployment and outcomes

Important: ONTO enhances AI epistemic discipline through external grounding infrastructure. It does not alter the model itself. Certification confirms that an AI system, when evaluated under ONTO-ERS, meets specified calibration thresholds at the time of evaluation.


2. Core Metrics

2.1 Unknown Detection Rate (U-Recall)

U-Recall measures the proportion of genuinely unanswerable questions correctly identified as unanswerable.

U-Recall = TP_unknown / (TP_unknown + FN_unknown)
Score Classification
≥0.70 Excellent
≥0.50 Adequate
≥0.30 Minimum
<0.30 Insufficient

2.2 Expected Calibration Error (ECE)

ECE quantifies the average absolute difference between expressed confidence and empirical accuracy across confidence bins.

ECE = Σ (n_b / N) × |acc(b) - conf(b)|
Score Classification
≤0.10 Excellent
≤0.15 Good
≤0.20 Adequate
>0.20 Poor

2.3 Risk Score

Risk = α × (1 - U-Recall) + β × ECE + γ × OC
α = 0.4, β = 0.4, γ = 0.2, OC = Overconfidence rate
Score Classification
0.00–0.25 LOW
0.25–0.50 MEDIUM
0.50–0.75 HIGH
0.75–1.00 CRITICAL

3. Knowledge Classification

Category Definition Example
KNOWN Established, verifiable answer exists "Speed of light in vacuum"
UNKNOWN No established answer exists "Will P equal NP?"
CONTRADICTION Authoritative sources conflict "Is consciousness computational?"

4. Compliance Levels

4.1 Level 1: Basic

Metric Threshold
U-Recall ≥0.30
ECE ≤0.20
Risk Score ≤0.70

For: Internal tools, Prototypes, Research. Frequency: Annual

4.2 Level 2: Standard

Metric Threshold
U-Recall ≥0.50
ECE ≤0.15
Risk Score ≤0.50

For: Customer-facing apps, Business ops. Frequency: Quarterly

4.3 Level 3: Advanced

Metric Threshold
U-Recall ≥0.70
ECE ≤0.10
Risk Score ≤0.30

For: Regulated industries, High-stakes systems. Frequency: Monthly + audit


5. Evaluation Methodology

Category Min Samples
KNOWN 100
UNKNOWN 100
CONTRADICTION 25
  1. System receives question text
  2. System provides classification, confidence, response
  3. Metrics computed against ground truth
  4. Compliance level determined

6. Certification

  1. Application — Organization submits request
  2. Evaluation — Independent assessment
  3. Review — Standards Council verification
  4. Certification — Certificate issued (12-month)
  5. Registry — Public entry
ONTO CERTIFIED
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
System:       [System Name]
Organization: [Organization Name]
Level:        [BASIC | STANDARD | ADVANCED]
Certificate:  ONTO-CERT-XXXX-XXXX
Verify:       ontostandard.org/verify/XXXX
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

7. Regulatory Alignment

Framework Mapping
EU AI Act Art. 9, 13, 15, 43 Risk Score, Transparency, ECE, Conformity
NIST AI RMF MEASURE 1.1, 2.1, 2.3, 4.1
ISO/IEC 42001 Clauses 6, 8, 9

Appendix A: Reference Implementation

from onto_standard import evaluate, ComplianceLevel
results = evaluate(predictions, ground_truth)
print(f"U-Recall: {results.unknown_detection.recall:.2%}")
print(f"ECE: {results.calibration.ece:.3f}")
print(f"Compliance: {results.compliance_level.value}")

Installation: pip install onto-standard


ONTO-ERS v10.0 — © 2026 ONTO Standards Council

[Appendix: section #regulatory of the same page.]

Regulatory Alignment Matrix

Draft | ONTO-REG-001

Conformity statement

ONTO is a measurement protocol that produces deterministic, cryptographically signed evidence of epistemic discipline on AI outputs. ONTO is not a CE-marked AI system, not a notified body, and not a regulatory authority. It does not certify products on behalf of any government.

What ONTO provides is evidence: every evaluation produces a 104-byte Ed25519-signed proof that a given response was scored against a fixed methodology at a fixed time. Operators of high-risk AI systems can use this evidence to support their own conformity assessments under regimes such as the EU AI Act (Articles 9, 13, 15) — but the conformity assessment itself remains the operator's obligation, with their own notified body, where required.

Plain-English: ONTO is a thermometer with a tamper-evident seal. It does not replace the doctor or the regulator — it gives them an instrument they did not have before.

1. EU AI Act

Article Requirement ONTO Capability
Art. 9 Risk management system Continuous epistemic risk scoring with signed proof chain
Art. 13 Transparency obligations Public certification registry, verifiable evaluation history
Art. 15 Accuracy, robustness, cybersecurity ECE calibration metrics, U-Recall uncertainty detection, GOLD Core v5.1 grounding
Art. 43 Conformity assessment Independent evaluation with Ed25519 signed, timestamped evidence

2. NIST AI RMF

Function ONTO Implementation
GOVERN Standardized epistemic risk vocabulary and compliance levels (Basic / Standard / Advanced)
MAP Domain-specific evaluation benchmarks (ONTO-Bench, 268+ samples)
MEASURE Deterministic metrics: ECE, U-Recall, Risk Score, DLA — reproducible across runs
MANAGE Compliance thresholds, continuous monitoring, signed audit trail

3. Industry Alignment

Finance: SR 11-7 (model risk management), MiFID II (algorithmic trading oversight). Healthcare: FDA SaMD (Software as Medical Device), HIPAA (data handling). Defense: DoD AI Ethics Principles, FedRAMP (cloud security baseline).