Audit Policy

Holding government accountable means being accountable ourselves. This policy explains how our scoring can be reviewed.

When audits may be initiated

• Proactively by Integrity Matters or Civix IQ
• In response to credible, well-documented concerns raised by elected officials, journalists, or institutional partners
• As part of a broader third-party review initiative (e.g., academic or civic research partnerships)

Frivolous or duplicative requests may be declined.

What we do — and don't — review

We are committed to accuracy and fairness. We review and correct substantive scoring errors, such as when the system misattributes a vote or quote, misclassifies a topic or motion, or lacks key context that would have altered the outcome.

However, we do not review differences of opinion about how the AI interprets governance principles or evaluates the likelihood of a violation. These judgments are made by the system consistently, using a principled, structured rubric developed by Civix IQ. That consistency is essential to the system's purpose and fairness.

Audit structure

Audits are conducted by a neutral third-party analyst or governance expert approved by Civix IQ and bound by NDA, and focus on fair application of the scoring methodology — not political alignment. Scope may include:

• Review of classification consistency (e.g., how "Clear" vs. "Likely" is assigned)
• Targeted review of 3–5 votes or quotes to assess scoring consistency
• Confirmation that the score was calculated based on stated criteria

Confidentiality & IP protection

Auditors must sign an NDA to protect the neutrality of the review process and the integrity of the underlying system. Proprietary formulas, AI prompts, and internal tools are shared only under strict confidentiality. Public statements by auditors must be authorized and limited to procedural outcomes, not technical details.

Costs

Civix IQ may sponsor audits as part of scheduled internal QA or grant-funded research. Challenge-based audits requested by members or third parties may require a formal written challenge, be subject to cost-sharing or fixed audit fees, and be limited in scope to maintain feasibility.

Transparency reporting

We may publish a summary of audit outcomes on the site. Public summaries describe findings (e.g., "Process upheld," "Classification adjustment made") without revealing formulas.

Submit a review request

To request a review, email [email protected] with your name, the evaluation in question, and your reason for the request. Not all requests are eligible for third-party review.